00:00:00.000 Started by upstream project "autotest-per-patch" build number 130871 00:00:00.000 originally caused by: 00:00:00.000 Started by user sys_sgci 00:00:00.065 Checking out git https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool into /var/jenkins_home/workspace/nvmf-tcp-vg-autotest_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4 to read jbp/jenkins/jjb-config/jobs/autotest-downstream/autotest-vg.groovy 00:00:00.065 The recommended git tool is: git 00:00:00.066 using credential 00000000-0000-0000-0000-000000000002 00:00:00.067 > git rev-parse --resolve-git-dir /var/jenkins_home/workspace/nvmf-tcp-vg-autotest_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4/jbp/.git # timeout=10 00:00:00.106 Fetching changes from the remote Git repository 00:00:00.108 > git config remote.origin.url https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool # timeout=10 00:00:00.169 Using shallow fetch with depth 1 00:00:00.169 Fetching upstream changes from https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool 00:00:00.169 > git --version # timeout=10 00:00:00.223 > git --version # 'git version 2.39.2' 00:00:00.223 using GIT_ASKPASS to set credentials SPDKCI HTTPS Credentials 00:00:00.263 Setting http proxy: proxy-dmz.intel.com:911 00:00:00.263 > git fetch --tags --force --progress --depth=1 -- https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool refs/heads/master # timeout=5 00:00:04.606 > git rev-parse origin/FETCH_HEAD^{commit} # timeout=10 00:00:04.618 > git rev-parse FETCH_HEAD^{commit} # timeout=10 00:00:04.631 Checking out Revision f95f9907808933a1db7196e15e13478e0f322ee7 (FETCH_HEAD) 00:00:04.631 > git config core.sparsecheckout # timeout=10 00:00:04.642 > git read-tree -mu HEAD # timeout=10 00:00:04.657 > git checkout -f f95f9907808933a1db7196e15e13478e0f322ee7 # timeout=5 00:00:04.676 Commit message: "Revert "autotest-phy: replace deprecated label for nvmf-cvl"" 00:00:04.677 > git rev-list --no-walk 67cd2f1639a8077ee9fc0f9259e068d0e5b67761 # timeout=10 00:00:04.813 [Pipeline] Start of Pipeline 00:00:04.822 [Pipeline] library 00:00:04.824 Loading library shm_lib@master 00:00:04.824 Library shm_lib@master is cached. Copying from home. 00:00:04.839 [Pipeline] node 00:00:04.850 Running on VM-host-SM0 in /var/jenkins/workspace/nvmf-tcp-vg-autotest_3 00:00:04.852 [Pipeline] { 00:00:04.860 [Pipeline] catchError 00:00:04.861 [Pipeline] { 00:00:04.871 [Pipeline] wrap 00:00:04.879 [Pipeline] { 00:00:04.886 [Pipeline] stage 00:00:04.888 [Pipeline] { (Prologue) 00:00:04.904 [Pipeline] echo 00:00:04.906 Node: VM-host-SM0 00:00:04.912 [Pipeline] cleanWs 00:00:04.921 [WS-CLEANUP] Deleting project workspace... 00:00:04.921 [WS-CLEANUP] Deferred wipeout is used... 00:00:04.927 [WS-CLEANUP] done 00:00:05.195 [Pipeline] setCustomBuildProperty 00:00:05.311 [Pipeline] httpRequest 00:00:05.723 [Pipeline] echo 00:00:05.725 Sorcerer 10.211.164.101 is alive 00:00:05.732 [Pipeline] retry 00:00:05.734 [Pipeline] { 00:00:05.744 [Pipeline] httpRequest 00:00:05.747 HttpMethod: GET 00:00:05.747 URL: http://10.211.164.101/packages/jbp_f95f9907808933a1db7196e15e13478e0f322ee7.tar.gz 00:00:05.747 Sending request to url: http://10.211.164.101/packages/jbp_f95f9907808933a1db7196e15e13478e0f322ee7.tar.gz 00:00:05.757 Response Code: HTTP/1.1 200 OK 00:00:05.758 Success: Status code 200 is in the accepted range: 200,404 00:00:05.758 Saving response body to /var/jenkins/workspace/nvmf-tcp-vg-autotest_3/jbp_f95f9907808933a1db7196e15e13478e0f322ee7.tar.gz 00:00:07.307 [Pipeline] } 00:00:07.315 [Pipeline] // retry 00:00:07.319 [Pipeline] sh 00:00:07.592 + tar --no-same-owner -xf jbp_f95f9907808933a1db7196e15e13478e0f322ee7.tar.gz 00:00:07.605 [Pipeline] httpRequest 00:00:08.000 [Pipeline] echo 00:00:08.002 Sorcerer 10.211.164.101 is alive 00:00:08.009 [Pipeline] retry 00:00:08.011 [Pipeline] { 00:00:08.022 [Pipeline] httpRequest 00:00:08.025 HttpMethod: GET 00:00:08.026 URL: http://10.211.164.101/packages/spdk_d16db39ee342e0479057d263a9944f38a2a1af94.tar.gz 00:00:08.026 Sending request to url: http://10.211.164.101/packages/spdk_d16db39ee342e0479057d263a9944f38a2a1af94.tar.gz 00:00:08.028 Response Code: HTTP/1.1 200 OK 00:00:08.029 Success: Status code 200 is in the accepted range: 200,404 00:00:08.029 Saving response body to /var/jenkins/workspace/nvmf-tcp-vg-autotest_3/spdk_d16db39ee342e0479057d263a9944f38a2a1af94.tar.gz 00:00:31.075 [Pipeline] } 00:00:31.093 [Pipeline] // retry 00:00:31.100 [Pipeline] sh 00:00:31.382 + tar --no-same-owner -xf spdk_d16db39ee342e0479057d263a9944f38a2a1af94.tar.gz 00:00:34.679 [Pipeline] sh 00:00:34.959 + git -C spdk log --oneline -n5 00:00:34.959 d16db39ee bdev/nvme: removed 'multipath' param from spdk_bdev_nvme_create() 00:00:34.959 32fb30b70 bdev/nvme: changed default config to multipath 00:00:34.959 397c5fc31 bdev/nvme: ctrl config consistency check 00:00:34.959 3950cd1bb bdev/nvme: Change spdk_bdev_reset() to succeed if at least one nvme_ctrlr is reconnected 00:00:34.959 f9141d271 test/blob: Add BLOCKLEN macro in blob_ut 00:00:34.977 [Pipeline] writeFile 00:00:34.992 [Pipeline] sh 00:00:35.271 + jbp/jenkins/jjb-config/jobs/scripts/autorun_quirks.sh 00:00:35.281 [Pipeline] sh 00:00:35.560 + cat autorun-spdk.conf 00:00:35.560 SPDK_RUN_FUNCTIONAL_TEST=1 00:00:35.560 SPDK_TEST_NVMF=1 00:00:35.560 SPDK_TEST_NVMF_TRANSPORT=tcp 00:00:35.560 SPDK_TEST_USDT=1 00:00:35.560 SPDK_TEST_NVMF_MDNS=1 00:00:35.560 SPDK_RUN_UBSAN=1 00:00:35.560 NET_TYPE=virt 00:00:35.560 SPDK_JSONRPC_GO_CLIENT=1 00:00:35.560 SPDK_ABI_DIR=/home/vagrant/spdk_repo/spdk-abi 00:00:35.567 RUN_NIGHTLY=0 00:00:35.569 [Pipeline] } 00:00:35.582 [Pipeline] // stage 00:00:35.596 [Pipeline] stage 00:00:35.598 [Pipeline] { (Run VM) 00:00:35.610 [Pipeline] sh 00:00:35.889 + jbp/jenkins/jjb-config/jobs/scripts/prepare_nvme.sh 00:00:35.889 + echo 'Start stage prepare_nvme.sh' 00:00:35.889 Start stage prepare_nvme.sh 00:00:35.889 + [[ -n 2 ]] 00:00:35.889 + disk_prefix=ex2 00:00:35.889 + [[ -n /var/jenkins/workspace/nvmf-tcp-vg-autotest_3 ]] 00:00:35.889 + [[ -e /var/jenkins/workspace/nvmf-tcp-vg-autotest_3/autorun-spdk.conf ]] 00:00:35.889 + source /var/jenkins/workspace/nvmf-tcp-vg-autotest_3/autorun-spdk.conf 00:00:35.889 ++ SPDK_RUN_FUNCTIONAL_TEST=1 00:00:35.889 ++ SPDK_TEST_NVMF=1 00:00:35.889 ++ SPDK_TEST_NVMF_TRANSPORT=tcp 00:00:35.889 ++ SPDK_TEST_USDT=1 00:00:35.889 ++ SPDK_TEST_NVMF_MDNS=1 00:00:35.889 ++ SPDK_RUN_UBSAN=1 00:00:35.889 ++ NET_TYPE=virt 00:00:35.889 ++ SPDK_JSONRPC_GO_CLIENT=1 00:00:35.889 ++ SPDK_ABI_DIR=/home/vagrant/spdk_repo/spdk-abi 00:00:35.889 ++ RUN_NIGHTLY=0 00:00:35.889 + cd /var/jenkins/workspace/nvmf-tcp-vg-autotest_3 00:00:35.889 + nvme_files=() 00:00:35.889 + declare -A nvme_files 00:00:35.889 + backend_dir=/var/lib/libvirt/images/backends 00:00:35.889 + nvme_files['nvme.img']=5G 00:00:35.889 + nvme_files['nvme-cmb.img']=5G 00:00:35.889 + nvme_files['nvme-multi0.img']=4G 00:00:35.889 + nvme_files['nvme-multi1.img']=4G 00:00:35.889 + nvme_files['nvme-multi2.img']=4G 00:00:35.889 + nvme_files['nvme-openstack.img']=8G 00:00:35.889 + nvme_files['nvme-zns.img']=5G 00:00:35.889 + (( SPDK_TEST_NVME_PMR == 1 )) 00:00:35.889 + (( SPDK_TEST_FTL == 1 )) 00:00:35.889 + (( SPDK_TEST_NVME_FDP == 1 )) 00:00:35.889 + [[ ! -d /var/lib/libvirt/images/backends ]] 00:00:35.889 + for nvme in "${!nvme_files[@]}" 00:00:35.889 + sudo -E spdk/scripts/vagrant/create_nvme_img.sh -n /var/lib/libvirt/images/backends/ex2-nvme-multi2.img -s 4G 00:00:35.889 Formatting '/var/lib/libvirt/images/backends/ex2-nvme-multi2.img', fmt=raw size=4294967296 preallocation=falloc 00:00:35.889 + for nvme in "${!nvme_files[@]}" 00:00:35.889 + sudo -E spdk/scripts/vagrant/create_nvme_img.sh -n /var/lib/libvirt/images/backends/ex2-nvme-cmb.img -s 5G 00:00:35.889 Formatting '/var/lib/libvirt/images/backends/ex2-nvme-cmb.img', fmt=raw size=5368709120 preallocation=falloc 00:00:35.889 + for nvme in "${!nvme_files[@]}" 00:00:35.889 + sudo -E spdk/scripts/vagrant/create_nvme_img.sh -n /var/lib/libvirt/images/backends/ex2-nvme-openstack.img -s 8G 00:00:35.889 Formatting '/var/lib/libvirt/images/backends/ex2-nvme-openstack.img', fmt=raw size=8589934592 preallocation=falloc 00:00:35.889 + for nvme in "${!nvme_files[@]}" 00:00:35.889 + sudo -E spdk/scripts/vagrant/create_nvme_img.sh -n /var/lib/libvirt/images/backends/ex2-nvme-zns.img -s 5G 00:00:35.889 Formatting '/var/lib/libvirt/images/backends/ex2-nvme-zns.img', fmt=raw size=5368709120 preallocation=falloc 00:00:35.889 + for nvme in "${!nvme_files[@]}" 00:00:35.889 + sudo -E spdk/scripts/vagrant/create_nvme_img.sh -n /var/lib/libvirt/images/backends/ex2-nvme-multi1.img -s 4G 00:00:35.889 Formatting '/var/lib/libvirt/images/backends/ex2-nvme-multi1.img', fmt=raw size=4294967296 preallocation=falloc 00:00:35.889 + for nvme in "${!nvme_files[@]}" 00:00:35.889 + sudo -E spdk/scripts/vagrant/create_nvme_img.sh -n /var/lib/libvirt/images/backends/ex2-nvme-multi0.img -s 4G 00:00:35.889 Formatting '/var/lib/libvirt/images/backends/ex2-nvme-multi0.img', fmt=raw size=4294967296 preallocation=falloc 00:00:35.889 + for nvme in "${!nvme_files[@]}" 00:00:35.889 + sudo -E spdk/scripts/vagrant/create_nvme_img.sh -n /var/lib/libvirt/images/backends/ex2-nvme.img -s 5G 00:00:36.823 Formatting '/var/lib/libvirt/images/backends/ex2-nvme.img', fmt=raw size=5368709120 preallocation=falloc 00:00:36.823 ++ sudo grep -rl ex2-nvme.img /etc/libvirt/qemu 00:00:36.823 + echo 'End stage prepare_nvme.sh' 00:00:36.823 End stage prepare_nvme.sh 00:00:36.830 [Pipeline] sh 00:00:37.102 + DISTRO=fedora39 CPUS=10 RAM=12288 jbp/jenkins/jjb-config/jobs/scripts/vagrant_create_vm.sh 00:00:37.102 Setup: -n 10 -s 12288 -x http://proxy-dmz.intel.com:911 -p libvirt --qemu-emulator=/usr/local/qemu/vanilla-v8.0.0/bin/qemu-system-x86_64 --nic-model=e1000 -b /var/lib/libvirt/images/backends/ex2-nvme.img -b /var/lib/libvirt/images/backends/ex2-nvme-multi0.img,nvme,/var/lib/libvirt/images/backends/ex2-nvme-multi1.img:/var/lib/libvirt/images/backends/ex2-nvme-multi2.img -H -a -v -f fedora39 00:00:37.102 00:00:37.102 DIR=/var/jenkins/workspace/nvmf-tcp-vg-autotest_3/spdk/scripts/vagrant 00:00:37.102 SPDK_DIR=/var/jenkins/workspace/nvmf-tcp-vg-autotest_3/spdk 00:00:37.102 VAGRANT_TARGET=/var/jenkins/workspace/nvmf-tcp-vg-autotest_3 00:00:37.102 HELP=0 00:00:37.102 DRY_RUN=0 00:00:37.102 NVME_FILE=/var/lib/libvirt/images/backends/ex2-nvme.img,/var/lib/libvirt/images/backends/ex2-nvme-multi0.img, 00:00:37.102 NVME_DISKS_TYPE=nvme,nvme, 00:00:37.102 NVME_AUTO_CREATE=0 00:00:37.102 NVME_DISKS_NAMESPACES=,/var/lib/libvirt/images/backends/ex2-nvme-multi1.img:/var/lib/libvirt/images/backends/ex2-nvme-multi2.img, 00:00:37.102 NVME_CMB=,, 00:00:37.102 NVME_PMR=,, 00:00:37.102 NVME_ZNS=,, 00:00:37.102 NVME_MS=,, 00:00:37.102 NVME_FDP=,, 00:00:37.102 SPDK_VAGRANT_DISTRO=fedora39 00:00:37.102 SPDK_VAGRANT_VMCPU=10 00:00:37.102 SPDK_VAGRANT_VMRAM=12288 00:00:37.102 SPDK_VAGRANT_PROVIDER=libvirt 00:00:37.102 SPDK_VAGRANT_HTTP_PROXY=http://proxy-dmz.intel.com:911 00:00:37.102 SPDK_QEMU_EMULATOR=/usr/local/qemu/vanilla-v8.0.0/bin/qemu-system-x86_64 00:00:37.102 SPDK_OPENSTACK_NETWORK=0 00:00:37.102 VAGRANT_PACKAGE_BOX=0 00:00:37.102 VAGRANTFILE=/var/jenkins/workspace/nvmf-tcp-vg-autotest_3/spdk/scripts/vagrant/Vagrantfile 00:00:37.102 FORCE_DISTRO=true 00:00:37.102 VAGRANT_BOX_VERSION= 00:00:37.102 EXTRA_VAGRANTFILES= 00:00:37.102 NIC_MODEL=e1000 00:00:37.102 00:00:37.102 mkdir: created directory '/var/jenkins/workspace/nvmf-tcp-vg-autotest_3/fedora39-libvirt' 00:00:37.102 /var/jenkins/workspace/nvmf-tcp-vg-autotest_3/fedora39-libvirt /var/jenkins/workspace/nvmf-tcp-vg-autotest_3 00:00:40.387 Bringing machine 'default' up with 'libvirt' provider... 00:00:40.955 ==> default: Creating image (snapshot of base box volume). 00:00:40.955 ==> default: Creating domain with the following settings... 00:00:40.955 ==> default: -- Name: fedora39-39-1.5-1721788873-2326_default_1728299482_d8ed3ae5990fa9c296a5 00:00:40.955 ==> default: -- Domain type: kvm 00:00:40.955 ==> default: -- Cpus: 10 00:00:40.955 ==> default: -- Feature: acpi 00:00:40.955 ==> default: -- Feature: apic 00:00:40.955 ==> default: -- Feature: pae 00:00:40.955 ==> default: -- Memory: 12288M 00:00:40.955 ==> default: -- Memory Backing: hugepages: 00:00:40.955 ==> default: -- Management MAC: 00:00:40.955 ==> default: -- Loader: 00:00:40.955 ==> default: -- Nvram: 00:00:40.955 ==> default: -- Base box: spdk/fedora39 00:00:40.955 ==> default: -- Storage pool: default 00:00:40.955 ==> default: -- Image: /var/lib/libvirt/images/fedora39-39-1.5-1721788873-2326_default_1728299482_d8ed3ae5990fa9c296a5.img (20G) 00:00:40.955 ==> default: -- Volume Cache: default 00:00:40.955 ==> default: -- Kernel: 00:00:40.955 ==> default: -- Initrd: 00:00:40.955 ==> default: -- Graphics Type: vnc 00:00:40.955 ==> default: -- Graphics Port: -1 00:00:40.955 ==> default: -- Graphics IP: 127.0.0.1 00:00:40.955 ==> default: -- Graphics Password: Not defined 00:00:40.955 ==> default: -- Video Type: cirrus 00:00:40.955 ==> default: -- Video VRAM: 9216 00:00:40.955 ==> default: -- Sound Type: 00:00:40.955 ==> default: -- Keymap: en-us 00:00:40.955 ==> default: -- TPM Path: 00:00:40.955 ==> default: -- INPUT: type=mouse, bus=ps2 00:00:40.955 ==> default: -- Command line args: 00:00:40.955 ==> default: -> value=-device, 00:00:40.955 ==> default: -> value=nvme,id=nvme-0,serial=12340,addr=0x10, 00:00:40.955 ==> default: -> value=-drive, 00:00:40.955 ==> default: -> value=format=raw,file=/var/lib/libvirt/images/backends/ex2-nvme.img,if=none,id=nvme-0-drive0, 00:00:40.955 ==> default: -> value=-device, 00:00:40.955 ==> default: -> value=nvme-ns,drive=nvme-0-drive0,bus=nvme-0,nsid=1,zoned=false,logical_block_size=4096,physical_block_size=4096, 00:00:40.955 ==> default: -> value=-device, 00:00:40.955 ==> default: -> value=nvme,id=nvme-1,serial=12341,addr=0x11, 00:00:40.955 ==> default: -> value=-drive, 00:00:40.955 ==> default: -> value=format=raw,file=/var/lib/libvirt/images/backends/ex2-nvme-multi0.img,if=none,id=nvme-1-drive0, 00:00:40.955 ==> default: -> value=-device, 00:00:40.955 ==> default: -> value=nvme-ns,drive=nvme-1-drive0,bus=nvme-1,nsid=1,zoned=false,logical_block_size=4096,physical_block_size=4096, 00:00:40.955 ==> default: -> value=-drive, 00:00:40.955 ==> default: -> value=format=raw,file=/var/lib/libvirt/images/backends/ex2-nvme-multi1.img,if=none,id=nvme-1-drive1, 00:00:40.955 ==> default: -> value=-device, 00:00:40.955 ==> default: -> value=nvme-ns,drive=nvme-1-drive1,bus=nvme-1,nsid=2,zoned=false,logical_block_size=4096,physical_block_size=4096, 00:00:40.955 ==> default: -> value=-drive, 00:00:40.955 ==> default: -> value=format=raw,file=/var/lib/libvirt/images/backends/ex2-nvme-multi2.img,if=none,id=nvme-1-drive2, 00:00:40.955 ==> default: -> value=-device, 00:00:40.955 ==> default: -> value=nvme-ns,drive=nvme-1-drive2,bus=nvme-1,nsid=3,zoned=false,logical_block_size=4096,physical_block_size=4096, 00:00:41.214 ==> default: Creating shared folders metadata... 00:00:41.214 ==> default: Starting domain. 00:00:43.116 ==> default: Waiting for domain to get an IP address... 00:01:01.217 ==> default: Waiting for SSH to become available... 00:01:02.153 ==> default: Configuring and enabling network interfaces... 00:01:06.341 default: SSH address: 192.168.121.50:22 00:01:06.341 default: SSH username: vagrant 00:01:06.341 default: SSH auth method: private key 00:01:08.906 ==> default: Rsyncing folder: /mnt/jenkins_nvme/jenkins/workspace/nvmf-tcp-vg-autotest_3/spdk/ => /home/vagrant/spdk_repo/spdk 00:01:17.018 ==> default: Mounting SSHFS shared folder... 00:01:17.953 ==> default: Mounting folder via SSHFS: /mnt/jenkins_nvme/jenkins/workspace/nvmf-tcp-vg-autotest_3/fedora39-libvirt/output => /home/vagrant/spdk_repo/output 00:01:17.953 ==> default: Checking Mount.. 00:01:19.328 ==> default: Folder Successfully Mounted! 00:01:19.328 ==> default: Running provisioner: file... 00:01:20.264 default: ~/.gitconfig => .gitconfig 00:01:20.523 00:01:20.523 SUCCESS! 00:01:20.523 00:01:20.523 cd to /var/jenkins/workspace/nvmf-tcp-vg-autotest_3/fedora39-libvirt and type "vagrant ssh" to use. 00:01:20.523 Use vagrant "suspend" and vagrant "resume" to stop and start. 00:01:20.523 Use vagrant "destroy" followed by "rm -rf /var/jenkins/workspace/nvmf-tcp-vg-autotest_3/fedora39-libvirt" to destroy all trace of vm. 00:01:20.523 00:01:20.532 [Pipeline] } 00:01:20.546 [Pipeline] // stage 00:01:20.555 [Pipeline] dir 00:01:20.556 Running in /var/jenkins/workspace/nvmf-tcp-vg-autotest_3/fedora39-libvirt 00:01:20.558 [Pipeline] { 00:01:20.569 [Pipeline] catchError 00:01:20.570 [Pipeline] { 00:01:20.581 [Pipeline] sh 00:01:20.857 + vagrant ssh-config --host vagrant 00:01:20.857 + sed -ne /^Host/,$p 00:01:20.857 + tee ssh_conf 00:01:24.165 Host vagrant 00:01:24.165 HostName 192.168.121.50 00:01:24.165 User vagrant 00:01:24.165 Port 22 00:01:24.165 UserKnownHostsFile /dev/null 00:01:24.165 StrictHostKeyChecking no 00:01:24.165 PasswordAuthentication no 00:01:24.165 IdentityFile /var/lib/libvirt/images/.vagrant.d/boxes/spdk-VAGRANTSLASH-fedora39/39-1.5-1721788873-2326/libvirt/fedora39 00:01:24.165 IdentitiesOnly yes 00:01:24.165 LogLevel FATAL 00:01:24.165 ForwardAgent yes 00:01:24.165 ForwardX11 yes 00:01:24.165 00:01:24.179 [Pipeline] withEnv 00:01:24.182 [Pipeline] { 00:01:24.194 [Pipeline] sh 00:01:24.474 + /usr/local/bin/ssh -t -F ssh_conf vagrant@vagrant #!/bin/bash 00:01:24.474 source /etc/os-release 00:01:24.474 [[ -e /image.version ]] && img=$(< /image.version) 00:01:24.474 # Minimal, systemd-like check. 00:01:24.474 if [[ -e /.dockerenv ]]; then 00:01:24.474 # Clear garbage from the node's name: 00:01:24.474 # agt-er_autotest_547-896 -> autotest_547-896 00:01:24.474 # $HOSTNAME is the actual container id 00:01:24.474 agent=$HOSTNAME@${DOCKER_SWARM_PLUGIN_JENKINS_AGENT_NAME#*_} 00:01:24.474 if grep -q "/etc/hostname" /proc/self/mountinfo; then 00:01:24.474 # We can assume this is a mount from a host where container is running, 00:01:24.474 # so fetch its hostname to easily identify the target swarm worker. 00:01:24.474 container="$(< /etc/hostname) ($agent)" 00:01:24.474 else 00:01:24.474 # Fallback 00:01:24.474 container=$agent 00:01:24.474 fi 00:01:24.474 fi 00:01:24.474 echo "${NAME} ${VERSION_ID}|$(uname -r)|${img:-N/A}|${container:-N/A}" 00:01:24.474 00:01:24.744 [Pipeline] } 00:01:24.759 [Pipeline] // withEnv 00:01:24.768 [Pipeline] setCustomBuildProperty 00:01:24.782 [Pipeline] stage 00:01:24.785 [Pipeline] { (Tests) 00:01:24.801 [Pipeline] sh 00:01:25.080 + scp -F ssh_conf -r /var/jenkins/workspace/nvmf-tcp-vg-autotest_3/jbp/jenkins/jjb-config/jobs/scripts/autoruner.sh vagrant@vagrant:./ 00:01:25.353 [Pipeline] sh 00:01:25.633 + scp -F ssh_conf -r /var/jenkins/workspace/nvmf-tcp-vg-autotest_3/jbp/jenkins/jjb-config/jobs/scripts/pkgdep-autoruner.sh vagrant@vagrant:./ 00:01:25.904 [Pipeline] timeout 00:01:25.904 Timeout set to expire in 1 hr 0 min 00:01:25.906 [Pipeline] { 00:01:25.918 [Pipeline] sh 00:01:26.196 + /usr/local/bin/ssh -t -F ssh_conf vagrant@vagrant git -C spdk_repo/spdk reset --hard 00:01:26.766 HEAD is now at d16db39ee bdev/nvme: removed 'multipath' param from spdk_bdev_nvme_create() 00:01:26.792 [Pipeline] sh 00:01:27.080 + /usr/local/bin/ssh -t -F ssh_conf vagrant@vagrant sudo chown vagrant:vagrant spdk_repo 00:01:27.351 [Pipeline] sh 00:01:27.630 + scp -F ssh_conf -r /var/jenkins/workspace/nvmf-tcp-vg-autotest_3/autorun-spdk.conf vagrant@vagrant:spdk_repo 00:01:27.902 [Pipeline] sh 00:01:28.181 + /usr/local/bin/ssh -t -F ssh_conf vagrant@vagrant JOB_BASE_NAME=nvmf-tcp-vg-autotest ./autoruner.sh spdk_repo 00:01:28.440 ++ readlink -f spdk_repo 00:01:28.440 + DIR_ROOT=/home/vagrant/spdk_repo 00:01:28.440 + [[ -n /home/vagrant/spdk_repo ]] 00:01:28.440 + DIR_SPDK=/home/vagrant/spdk_repo/spdk 00:01:28.440 + DIR_OUTPUT=/home/vagrant/spdk_repo/output 00:01:28.440 + [[ -d /home/vagrant/spdk_repo/spdk ]] 00:01:28.440 + [[ ! -d /home/vagrant/spdk_repo/output ]] 00:01:28.440 + [[ -d /home/vagrant/spdk_repo/output ]] 00:01:28.440 + [[ nvmf-tcp-vg-autotest == pkgdep-* ]] 00:01:28.440 + cd /home/vagrant/spdk_repo 00:01:28.440 + source /etc/os-release 00:01:28.440 ++ NAME='Fedora Linux' 00:01:28.440 ++ VERSION='39 (Cloud Edition)' 00:01:28.440 ++ ID=fedora 00:01:28.440 ++ VERSION_ID=39 00:01:28.440 ++ VERSION_CODENAME= 00:01:28.440 ++ PLATFORM_ID=platform:f39 00:01:28.440 ++ PRETTY_NAME='Fedora Linux 39 (Cloud Edition)' 00:01:28.440 ++ ANSI_COLOR='0;38;2;60;110;180' 00:01:28.440 ++ LOGO=fedora-logo-icon 00:01:28.440 ++ CPE_NAME=cpe:/o:fedoraproject:fedora:39 00:01:28.440 ++ HOME_URL=https://fedoraproject.org/ 00:01:28.440 ++ DOCUMENTATION_URL=https://docs.fedoraproject.org/en-US/fedora/f39/system-administrators-guide/ 00:01:28.440 ++ SUPPORT_URL=https://ask.fedoraproject.org/ 00:01:28.440 ++ BUG_REPORT_URL=https://bugzilla.redhat.com/ 00:01:28.440 ++ REDHAT_BUGZILLA_PRODUCT=Fedora 00:01:28.440 ++ REDHAT_BUGZILLA_PRODUCT_VERSION=39 00:01:28.440 ++ REDHAT_SUPPORT_PRODUCT=Fedora 00:01:28.440 ++ REDHAT_SUPPORT_PRODUCT_VERSION=39 00:01:28.440 ++ SUPPORT_END=2024-11-12 00:01:28.440 ++ VARIANT='Cloud Edition' 00:01:28.440 ++ VARIANT_ID=cloud 00:01:28.440 + uname -a 00:01:28.440 Linux fedora39-cloud-1721788873-2326 6.8.9-200.fc39.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Jul 24 03:04:40 UTC 2024 x86_64 GNU/Linux 00:01:28.440 + sudo /home/vagrant/spdk_repo/spdk/scripts/setup.sh status 00:01:29.007 0000:00:03.0 (1af4 1001): Active devices: mount@vda:vda2,mount@vda:vda3,mount@vda:vda5, so not binding PCI dev 00:01:29.007 Hugepages 00:01:29.007 node hugesize free / total 00:01:29.007 node0 1048576kB 0 / 0 00:01:29.007 node0 2048kB 0 / 0 00:01:29.007 00:01:29.007 Type BDF Vendor Device NUMA Driver Device Block devices 00:01:29.007 virtio 0000:00:03.0 1af4 1001 unknown virtio-pci - vda 00:01:29.007 NVMe 0000:00:10.0 1b36 0010 unknown nvme nvme0 nvme0n1 00:01:29.007 NVMe 0000:00:11.0 1b36 0010 unknown nvme nvme1 nvme1n1 nvme1n2 nvme1n3 00:01:29.007 + rm -f /tmp/spdk-ld-path 00:01:29.007 + source autorun-spdk.conf 00:01:29.007 ++ SPDK_RUN_FUNCTIONAL_TEST=1 00:01:29.007 ++ SPDK_TEST_NVMF=1 00:01:29.007 ++ SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:29.007 ++ SPDK_TEST_USDT=1 00:01:29.007 ++ SPDK_TEST_NVMF_MDNS=1 00:01:29.007 ++ SPDK_RUN_UBSAN=1 00:01:29.007 ++ NET_TYPE=virt 00:01:29.007 ++ SPDK_JSONRPC_GO_CLIENT=1 00:01:29.007 ++ SPDK_ABI_DIR=/home/vagrant/spdk_repo/spdk-abi 00:01:29.007 ++ RUN_NIGHTLY=0 00:01:29.007 + (( SPDK_TEST_NVME_CMB == 1 || SPDK_TEST_NVME_PMR == 1 )) 00:01:29.007 + [[ -n '' ]] 00:01:29.007 + sudo git config --global --add safe.directory /home/vagrant/spdk_repo/spdk 00:01:29.007 + for M in /var/spdk/build-*-manifest.txt 00:01:29.007 + [[ -f /var/spdk/build-kernel-manifest.txt ]] 00:01:29.007 + cp /var/spdk/build-kernel-manifest.txt /home/vagrant/spdk_repo/output/ 00:01:29.007 + for M in /var/spdk/build-*-manifest.txt 00:01:29.007 + [[ -f /var/spdk/build-pkg-manifest.txt ]] 00:01:29.007 + cp /var/spdk/build-pkg-manifest.txt /home/vagrant/spdk_repo/output/ 00:01:29.007 + for M in /var/spdk/build-*-manifest.txt 00:01:29.007 + [[ -f /var/spdk/build-repo-manifest.txt ]] 00:01:29.007 + cp /var/spdk/build-repo-manifest.txt /home/vagrant/spdk_repo/output/ 00:01:29.007 ++ uname 00:01:29.007 + [[ Linux == \L\i\n\u\x ]] 00:01:29.007 + sudo dmesg -T 00:01:29.007 + sudo dmesg --clear 00:01:29.007 + dmesg_pid=5258 00:01:29.007 + [[ Fedora Linux == FreeBSD ]] 00:01:29.007 + export UNBIND_ENTIRE_IOMMU_GROUP=yes 00:01:29.007 + UNBIND_ENTIRE_IOMMU_GROUP=yes 00:01:29.007 + sudo dmesg -Tw 00:01:29.007 + [[ -e /var/spdk/dependencies/vhost/spdk_test_image.qcow2 ]] 00:01:29.007 + [[ -x /usr/src/fio-static/fio ]] 00:01:29.007 + export FIO_BIN=/usr/src/fio-static/fio 00:01:29.007 + FIO_BIN=/usr/src/fio-static/fio 00:01:29.007 + [[ '' == \/\q\e\m\u\_\v\f\i\o\/* ]] 00:01:29.007 + [[ ! -v VFIO_QEMU_BIN ]] 00:01:29.007 + [[ -e /usr/local/qemu/vfio-user-latest ]] 00:01:29.007 + export VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:01:29.007 + VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:01:29.007 + [[ -e /usr/local/qemu/vanilla-latest ]] 00:01:29.007 + export QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:01:29.007 + QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:01:29.007 + spdk/autorun.sh /home/vagrant/spdk_repo/autorun-spdk.conf 00:01:29.007 Test configuration: 00:01:29.007 SPDK_RUN_FUNCTIONAL_TEST=1 00:01:29.007 SPDK_TEST_NVMF=1 00:01:29.007 SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:29.007 SPDK_TEST_USDT=1 00:01:29.007 SPDK_TEST_NVMF_MDNS=1 00:01:29.007 SPDK_RUN_UBSAN=1 00:01:29.007 NET_TYPE=virt 00:01:29.007 SPDK_JSONRPC_GO_CLIENT=1 00:01:29.007 SPDK_ABI_DIR=/home/vagrant/spdk_repo/spdk-abi 00:01:29.266 RUN_NIGHTLY=0 11:12:10 -- common/autotest_common.sh@1680 -- $ [[ n == y ]] 00:01:29.266 11:12:10 -- common/autobuild_common.sh@15 -- $ source /home/vagrant/spdk_repo/spdk/scripts/common.sh 00:01:29.266 11:12:10 -- scripts/common.sh@15 -- $ shopt -s extglob 00:01:29.266 11:12:10 -- scripts/common.sh@544 -- $ [[ -e /bin/wpdk_common.sh ]] 00:01:29.266 11:12:10 -- scripts/common.sh@552 -- $ [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:01:29.266 11:12:10 -- scripts/common.sh@553 -- $ source /etc/opt/spdk-pkgdep/paths/export.sh 00:01:29.266 11:12:10 -- paths/export.sh@2 -- $ PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/vagrant/.local/bin:/home/vagrant/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:29.266 11:12:10 -- paths/export.sh@3 -- $ PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/vagrant/.local/bin:/home/vagrant/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:29.266 11:12:10 -- paths/export.sh@4 -- $ PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/vagrant/.local/bin:/home/vagrant/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:29.266 11:12:10 -- paths/export.sh@5 -- $ export PATH 00:01:29.266 11:12:10 -- paths/export.sh@6 -- $ echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/vagrant/.local/bin:/home/vagrant/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:29.266 11:12:10 -- common/autobuild_common.sh@485 -- $ out=/home/vagrant/spdk_repo/spdk/../output 00:01:29.266 11:12:10 -- common/autobuild_common.sh@486 -- $ date +%s 00:01:29.266 11:12:10 -- common/autobuild_common.sh@486 -- $ mktemp -dt spdk_1728299530.XXXXXX 00:01:29.266 11:12:10 -- common/autobuild_common.sh@486 -- $ SPDK_WORKSPACE=/tmp/spdk_1728299530.tIPvaw 00:01:29.266 11:12:10 -- common/autobuild_common.sh@488 -- $ [[ -n '' ]] 00:01:29.266 11:12:10 -- common/autobuild_common.sh@492 -- $ '[' -n '' ']' 00:01:29.266 11:12:10 -- common/autobuild_common.sh@495 -- $ scanbuild_exclude='--exclude /home/vagrant/spdk_repo/spdk/dpdk/' 00:01:29.267 11:12:10 -- common/autobuild_common.sh@499 -- $ scanbuild_exclude+=' --exclude /home/vagrant/spdk_repo/spdk/xnvme --exclude /tmp' 00:01:29.267 11:12:10 -- common/autobuild_common.sh@501 -- $ scanbuild='scan-build -o /home/vagrant/spdk_repo/spdk/../output/scan-build-tmp --exclude /home/vagrant/spdk_repo/spdk/dpdk/ --exclude /home/vagrant/spdk_repo/spdk/xnvme --exclude /tmp --status-bugs' 00:01:29.267 11:12:10 -- common/autobuild_common.sh@502 -- $ get_config_params 00:01:29.267 11:12:10 -- common/autotest_common.sh@407 -- $ xtrace_disable 00:01:29.267 11:12:10 -- common/autotest_common.sh@10 -- $ set +x 00:01:29.267 11:12:10 -- common/autobuild_common.sh@502 -- $ config_params='--enable-debug --enable-werror --with-rdma --with-usdt --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk --with-avahi --with-golang' 00:01:29.267 11:12:10 -- common/autobuild_common.sh@504 -- $ start_monitor_resources 00:01:29.267 11:12:10 -- pm/common@17 -- $ local monitor 00:01:29.267 11:12:10 -- pm/common@19 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:01:29.267 11:12:10 -- pm/common@19 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:01:29.267 11:12:10 -- pm/common@25 -- $ sleep 1 00:01:29.267 11:12:10 -- pm/common@21 -- $ date +%s 00:01:29.267 11:12:10 -- pm/common@21 -- $ date +%s 00:01:29.267 11:12:10 -- pm/common@21 -- $ /home/vagrant/spdk_repo/spdk/scripts/perf/pm/collect-cpu-load -d /home/vagrant/spdk_repo/spdk/../output/power -l -p monitor.autobuild.sh.1728299530 00:01:29.267 11:12:10 -- pm/common@21 -- $ /home/vagrant/spdk_repo/spdk/scripts/perf/pm/collect-vmstat -d /home/vagrant/spdk_repo/spdk/../output/power -l -p monitor.autobuild.sh.1728299530 00:01:29.267 Redirecting to /home/vagrant/spdk_repo/spdk/../output/power/monitor.autobuild.sh.1728299530_collect-cpu-load.pm.log 00:01:29.267 Redirecting to /home/vagrant/spdk_repo/spdk/../output/power/monitor.autobuild.sh.1728299530_collect-vmstat.pm.log 00:01:30.202 11:12:11 -- common/autobuild_common.sh@505 -- $ trap stop_monitor_resources EXIT 00:01:30.202 11:12:11 -- spdk/autobuild.sh@11 -- $ SPDK_TEST_AUTOBUILD= 00:01:30.202 11:12:11 -- spdk/autobuild.sh@12 -- $ umask 022 00:01:30.202 11:12:11 -- spdk/autobuild.sh@13 -- $ cd /home/vagrant/spdk_repo/spdk 00:01:30.202 11:12:11 -- spdk/autobuild.sh@16 -- $ date -u 00:01:30.202 Mon Oct 7 11:12:11 AM UTC 2024 00:01:30.202 11:12:11 -- spdk/autobuild.sh@17 -- $ git describe --tags 00:01:30.202 v25.01-pre-38-gd16db39ee 00:01:30.202 11:12:11 -- spdk/autobuild.sh@19 -- $ '[' 0 -eq 1 ']' 00:01:30.202 11:12:11 -- spdk/autobuild.sh@23 -- $ '[' 1 -eq 1 ']' 00:01:30.202 11:12:11 -- spdk/autobuild.sh@24 -- $ run_test ubsan echo 'using ubsan' 00:01:30.202 11:12:11 -- common/autotest_common.sh@1101 -- $ '[' 3 -le 1 ']' 00:01:30.202 11:12:11 -- common/autotest_common.sh@1107 -- $ xtrace_disable 00:01:30.202 11:12:11 -- common/autotest_common.sh@10 -- $ set +x 00:01:30.202 ************************************ 00:01:30.202 START TEST ubsan 00:01:30.202 ************************************ 00:01:30.202 using ubsan 00:01:30.202 11:12:11 ubsan -- common/autotest_common.sh@1125 -- $ echo 'using ubsan' 00:01:30.202 00:01:30.202 real 0m0.000s 00:01:30.202 user 0m0.000s 00:01:30.202 sys 0m0.000s 00:01:30.202 11:12:11 ubsan -- common/autotest_common.sh@1126 -- $ xtrace_disable 00:01:30.202 11:12:11 ubsan -- common/autotest_common.sh@10 -- $ set +x 00:01:30.202 ************************************ 00:01:30.202 END TEST ubsan 00:01:30.202 ************************************ 00:01:30.202 11:12:11 -- spdk/autobuild.sh@27 -- $ '[' -n '' ']' 00:01:30.202 11:12:11 -- spdk/autobuild.sh@31 -- $ case "$SPDK_TEST_AUTOBUILD" in 00:01:30.202 11:12:11 -- spdk/autobuild.sh@47 -- $ [[ 0 -eq 1 ]] 00:01:30.202 11:12:11 -- spdk/autobuild.sh@51 -- $ [[ 0 -eq 1 ]] 00:01:30.202 11:12:11 -- spdk/autobuild.sh@55 -- $ [[ -n '' ]] 00:01:30.202 11:12:11 -- spdk/autobuild.sh@57 -- $ [[ 0 -eq 1 ]] 00:01:30.202 11:12:11 -- spdk/autobuild.sh@59 -- $ [[ 0 -eq 1 ]] 00:01:30.202 11:12:11 -- spdk/autobuild.sh@62 -- $ [[ 0 -eq 1 ]] 00:01:30.202 11:12:11 -- spdk/autobuild.sh@67 -- $ /home/vagrant/spdk_repo/spdk/configure --enable-debug --enable-werror --with-rdma --with-usdt --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk --with-avahi --with-golang --with-shared 00:01:30.461 Using default SPDK env in /home/vagrant/spdk_repo/spdk/lib/env_dpdk 00:01:30.461 Using default DPDK in /home/vagrant/spdk_repo/spdk/dpdk/build 00:01:31.029 Using 'verbs' RDMA provider 00:01:46.506 Configuring ISA-L (logfile: /home/vagrant/spdk_repo/spdk/.spdk-isal.log)...done. 00:01:58.719 Configuring ISA-L-crypto (logfile: /home/vagrant/spdk_repo/spdk/.spdk-isal-crypto.log)...done. 00:01:58.719 go version go1.21.1 linux/amd64 00:01:58.719 Creating mk/config.mk...done. 00:01:58.719 Creating mk/cc.flags.mk...done. 00:01:58.719 Type 'make' to build. 00:01:58.719 11:12:40 -- spdk/autobuild.sh@70 -- $ run_test make make -j10 00:01:58.719 11:12:40 -- common/autotest_common.sh@1101 -- $ '[' 3 -le 1 ']' 00:01:58.719 11:12:40 -- common/autotest_common.sh@1107 -- $ xtrace_disable 00:01:58.719 11:12:40 -- common/autotest_common.sh@10 -- $ set +x 00:01:58.719 ************************************ 00:01:58.719 START TEST make 00:01:58.719 ************************************ 00:01:58.719 11:12:40 make -- common/autotest_common.sh@1125 -- $ make -j10 00:01:58.719 make[1]: Nothing to be done for 'all'. 00:02:13.609 The Meson build system 00:02:13.609 Version: 1.5.0 00:02:13.609 Source dir: /home/vagrant/spdk_repo/spdk/dpdk 00:02:13.609 Build dir: /home/vagrant/spdk_repo/spdk/dpdk/build-tmp 00:02:13.609 Build type: native build 00:02:13.609 Program cat found: YES (/usr/bin/cat) 00:02:13.609 Project name: DPDK 00:02:13.609 Project version: 24.03.0 00:02:13.609 C compiler for the host machine: cc (gcc 13.3.1 "cc (GCC) 13.3.1 20240522 (Red Hat 13.3.1-1)") 00:02:13.609 C linker for the host machine: cc ld.bfd 2.40-14 00:02:13.609 Host machine cpu family: x86_64 00:02:13.609 Host machine cpu: x86_64 00:02:13.609 Message: ## Building in Developer Mode ## 00:02:13.609 Program pkg-config found: YES (/usr/bin/pkg-config) 00:02:13.609 Program check-symbols.sh found: YES (/home/vagrant/spdk_repo/spdk/dpdk/buildtools/check-symbols.sh) 00:02:13.609 Program options-ibverbs-static.sh found: YES (/home/vagrant/spdk_repo/spdk/dpdk/buildtools/options-ibverbs-static.sh) 00:02:13.609 Program python3 found: YES (/usr/bin/python3) 00:02:13.609 Program cat found: YES (/usr/bin/cat) 00:02:13.609 Compiler for C supports arguments -march=native: YES 00:02:13.609 Checking for size of "void *" : 8 00:02:13.609 Checking for size of "void *" : 8 (cached) 00:02:13.609 Compiler for C supports link arguments -Wl,--undefined-version: YES 00:02:13.609 Library m found: YES 00:02:13.609 Library numa found: YES 00:02:13.609 Has header "numaif.h" : YES 00:02:13.609 Library fdt found: NO 00:02:13.609 Library execinfo found: NO 00:02:13.609 Has header "execinfo.h" : YES 00:02:13.609 Found pkg-config: YES (/usr/bin/pkg-config) 1.9.5 00:02:13.609 Run-time dependency libarchive found: NO (tried pkgconfig) 00:02:13.609 Run-time dependency libbsd found: NO (tried pkgconfig) 00:02:13.609 Run-time dependency jansson found: NO (tried pkgconfig) 00:02:13.609 Run-time dependency openssl found: YES 3.1.1 00:02:13.609 Run-time dependency libpcap found: YES 1.10.4 00:02:13.609 Has header "pcap.h" with dependency libpcap: YES 00:02:13.609 Compiler for C supports arguments -Wcast-qual: YES 00:02:13.609 Compiler for C supports arguments -Wdeprecated: YES 00:02:13.609 Compiler for C supports arguments -Wformat: YES 00:02:13.609 Compiler for C supports arguments -Wformat-nonliteral: NO 00:02:13.609 Compiler for C supports arguments -Wformat-security: NO 00:02:13.609 Compiler for C supports arguments -Wmissing-declarations: YES 00:02:13.609 Compiler for C supports arguments -Wmissing-prototypes: YES 00:02:13.609 Compiler for C supports arguments -Wnested-externs: YES 00:02:13.609 Compiler for C supports arguments -Wold-style-definition: YES 00:02:13.609 Compiler for C supports arguments -Wpointer-arith: YES 00:02:13.609 Compiler for C supports arguments -Wsign-compare: YES 00:02:13.609 Compiler for C supports arguments -Wstrict-prototypes: YES 00:02:13.609 Compiler for C supports arguments -Wundef: YES 00:02:13.609 Compiler for C supports arguments -Wwrite-strings: YES 00:02:13.609 Compiler for C supports arguments -Wno-address-of-packed-member: YES 00:02:13.609 Compiler for C supports arguments -Wno-packed-not-aligned: YES 00:02:13.609 Compiler for C supports arguments -Wno-missing-field-initializers: YES 00:02:13.609 Compiler for C supports arguments -Wno-zero-length-bounds: YES 00:02:13.609 Program objdump found: YES (/usr/bin/objdump) 00:02:13.609 Compiler for C supports arguments -mavx512f: YES 00:02:13.609 Checking if "AVX512 checking" compiles: YES 00:02:13.609 Fetching value of define "__SSE4_2__" : 1 00:02:13.609 Fetching value of define "__AES__" : 1 00:02:13.609 Fetching value of define "__AVX__" : 1 00:02:13.609 Fetching value of define "__AVX2__" : 1 00:02:13.609 Fetching value of define "__AVX512BW__" : (undefined) 00:02:13.609 Fetching value of define "__AVX512CD__" : (undefined) 00:02:13.609 Fetching value of define "__AVX512DQ__" : (undefined) 00:02:13.609 Fetching value of define "__AVX512F__" : (undefined) 00:02:13.609 Fetching value of define "__AVX512VL__" : (undefined) 00:02:13.609 Fetching value of define "__PCLMUL__" : 1 00:02:13.609 Fetching value of define "__RDRND__" : 1 00:02:13.609 Fetching value of define "__RDSEED__" : 1 00:02:13.609 Fetching value of define "__VPCLMULQDQ__" : (undefined) 00:02:13.609 Fetching value of define "__znver1__" : (undefined) 00:02:13.609 Fetching value of define "__znver2__" : (undefined) 00:02:13.609 Fetching value of define "__znver3__" : (undefined) 00:02:13.609 Fetching value of define "__znver4__" : (undefined) 00:02:13.609 Compiler for C supports arguments -Wno-format-truncation: YES 00:02:13.609 Message: lib/log: Defining dependency "log" 00:02:13.609 Message: lib/kvargs: Defining dependency "kvargs" 00:02:13.609 Message: lib/telemetry: Defining dependency "telemetry" 00:02:13.609 Checking for function "getentropy" : NO 00:02:13.609 Message: lib/eal: Defining dependency "eal" 00:02:13.609 Message: lib/ring: Defining dependency "ring" 00:02:13.609 Message: lib/rcu: Defining dependency "rcu" 00:02:13.609 Message: lib/mempool: Defining dependency "mempool" 00:02:13.609 Message: lib/mbuf: Defining dependency "mbuf" 00:02:13.609 Fetching value of define "__PCLMUL__" : 1 (cached) 00:02:13.609 Fetching value of define "__AVX512F__" : (undefined) (cached) 00:02:13.609 Compiler for C supports arguments -mpclmul: YES 00:02:13.609 Compiler for C supports arguments -maes: YES 00:02:13.609 Compiler for C supports arguments -mavx512f: YES (cached) 00:02:13.609 Compiler for C supports arguments -mavx512bw: YES 00:02:13.609 Compiler for C supports arguments -mavx512dq: YES 00:02:13.609 Compiler for C supports arguments -mavx512vl: YES 00:02:13.609 Compiler for C supports arguments -mvpclmulqdq: YES 00:02:13.609 Compiler for C supports arguments -mavx2: YES 00:02:13.609 Compiler for C supports arguments -mavx: YES 00:02:13.609 Message: lib/net: Defining dependency "net" 00:02:13.609 Message: lib/meter: Defining dependency "meter" 00:02:13.609 Message: lib/ethdev: Defining dependency "ethdev" 00:02:13.609 Message: lib/pci: Defining dependency "pci" 00:02:13.609 Message: lib/cmdline: Defining dependency "cmdline" 00:02:13.609 Message: lib/hash: Defining dependency "hash" 00:02:13.609 Message: lib/timer: Defining dependency "timer" 00:02:13.609 Message: lib/compressdev: Defining dependency "compressdev" 00:02:13.609 Message: lib/cryptodev: Defining dependency "cryptodev" 00:02:13.609 Message: lib/dmadev: Defining dependency "dmadev" 00:02:13.609 Compiler for C supports arguments -Wno-cast-qual: YES 00:02:13.609 Message: lib/power: Defining dependency "power" 00:02:13.609 Message: lib/reorder: Defining dependency "reorder" 00:02:13.609 Message: lib/security: Defining dependency "security" 00:02:13.609 Has header "linux/userfaultfd.h" : YES 00:02:13.609 Has header "linux/vduse.h" : YES 00:02:13.609 Message: lib/vhost: Defining dependency "vhost" 00:02:13.609 Compiler for C supports arguments -Wno-format-truncation: YES (cached) 00:02:13.609 Message: drivers/bus/pci: Defining dependency "bus_pci" 00:02:13.609 Message: drivers/bus/vdev: Defining dependency "bus_vdev" 00:02:13.609 Message: drivers/mempool/ring: Defining dependency "mempool_ring" 00:02:13.609 Message: Disabling raw/* drivers: missing internal dependency "rawdev" 00:02:13.609 Message: Disabling regex/* drivers: missing internal dependency "regexdev" 00:02:13.609 Message: Disabling ml/* drivers: missing internal dependency "mldev" 00:02:13.609 Message: Disabling event/* drivers: missing internal dependency "eventdev" 00:02:13.609 Message: Disabling baseband/* drivers: missing internal dependency "bbdev" 00:02:13.609 Message: Disabling gpu/* drivers: missing internal dependency "gpudev" 00:02:13.609 Program doxygen found: YES (/usr/local/bin/doxygen) 00:02:13.609 Configuring doxy-api-html.conf using configuration 00:02:13.609 Configuring doxy-api-man.conf using configuration 00:02:13.609 Program mandb found: YES (/usr/bin/mandb) 00:02:13.609 Program sphinx-build found: NO 00:02:13.609 Configuring rte_build_config.h using configuration 00:02:13.609 Message: 00:02:13.609 ================= 00:02:13.609 Applications Enabled 00:02:13.609 ================= 00:02:13.609 00:02:13.609 apps: 00:02:13.609 00:02:13.609 00:02:13.609 Message: 00:02:13.609 ================= 00:02:13.609 Libraries Enabled 00:02:13.609 ================= 00:02:13.609 00:02:13.609 libs: 00:02:13.609 log, kvargs, telemetry, eal, ring, rcu, mempool, mbuf, 00:02:13.609 net, meter, ethdev, pci, cmdline, hash, timer, compressdev, 00:02:13.609 cryptodev, dmadev, power, reorder, security, vhost, 00:02:13.610 00:02:13.610 Message: 00:02:13.610 =============== 00:02:13.610 Drivers Enabled 00:02:13.610 =============== 00:02:13.610 00:02:13.610 common: 00:02:13.610 00:02:13.610 bus: 00:02:13.610 pci, vdev, 00:02:13.610 mempool: 00:02:13.610 ring, 00:02:13.610 dma: 00:02:13.610 00:02:13.610 net: 00:02:13.610 00:02:13.610 crypto: 00:02:13.610 00:02:13.610 compress: 00:02:13.610 00:02:13.610 vdpa: 00:02:13.610 00:02:13.610 00:02:13.610 Message: 00:02:13.610 ================= 00:02:13.610 Content Skipped 00:02:13.610 ================= 00:02:13.610 00:02:13.610 apps: 00:02:13.610 dumpcap: explicitly disabled via build config 00:02:13.610 graph: explicitly disabled via build config 00:02:13.610 pdump: explicitly disabled via build config 00:02:13.610 proc-info: explicitly disabled via build config 00:02:13.610 test-acl: explicitly disabled via build config 00:02:13.610 test-bbdev: explicitly disabled via build config 00:02:13.610 test-cmdline: explicitly disabled via build config 00:02:13.610 test-compress-perf: explicitly disabled via build config 00:02:13.610 test-crypto-perf: explicitly disabled via build config 00:02:13.610 test-dma-perf: explicitly disabled via build config 00:02:13.610 test-eventdev: explicitly disabled via build config 00:02:13.610 test-fib: explicitly disabled via build config 00:02:13.610 test-flow-perf: explicitly disabled via build config 00:02:13.610 test-gpudev: explicitly disabled via build config 00:02:13.610 test-mldev: explicitly disabled via build config 00:02:13.610 test-pipeline: explicitly disabled via build config 00:02:13.610 test-pmd: explicitly disabled via build config 00:02:13.610 test-regex: explicitly disabled via build config 00:02:13.610 test-sad: explicitly disabled via build config 00:02:13.610 test-security-perf: explicitly disabled via build config 00:02:13.610 00:02:13.610 libs: 00:02:13.610 argparse: explicitly disabled via build config 00:02:13.610 metrics: explicitly disabled via build config 00:02:13.610 acl: explicitly disabled via build config 00:02:13.610 bbdev: explicitly disabled via build config 00:02:13.610 bitratestats: explicitly disabled via build config 00:02:13.610 bpf: explicitly disabled via build config 00:02:13.610 cfgfile: explicitly disabled via build config 00:02:13.610 distributor: explicitly disabled via build config 00:02:13.610 efd: explicitly disabled via build config 00:02:13.610 eventdev: explicitly disabled via build config 00:02:13.610 dispatcher: explicitly disabled via build config 00:02:13.610 gpudev: explicitly disabled via build config 00:02:13.610 gro: explicitly disabled via build config 00:02:13.610 gso: explicitly disabled via build config 00:02:13.610 ip_frag: explicitly disabled via build config 00:02:13.610 jobstats: explicitly disabled via build config 00:02:13.610 latencystats: explicitly disabled via build config 00:02:13.610 lpm: explicitly disabled via build config 00:02:13.610 member: explicitly disabled via build config 00:02:13.610 pcapng: explicitly disabled via build config 00:02:13.610 rawdev: explicitly disabled via build config 00:02:13.610 regexdev: explicitly disabled via build config 00:02:13.610 mldev: explicitly disabled via build config 00:02:13.610 rib: explicitly disabled via build config 00:02:13.610 sched: explicitly disabled via build config 00:02:13.610 stack: explicitly disabled via build config 00:02:13.610 ipsec: explicitly disabled via build config 00:02:13.610 pdcp: explicitly disabled via build config 00:02:13.610 fib: explicitly disabled via build config 00:02:13.610 port: explicitly disabled via build config 00:02:13.610 pdump: explicitly disabled via build config 00:02:13.610 table: explicitly disabled via build config 00:02:13.610 pipeline: explicitly disabled via build config 00:02:13.610 graph: explicitly disabled via build config 00:02:13.610 node: explicitly disabled via build config 00:02:13.610 00:02:13.610 drivers: 00:02:13.610 common/cpt: not in enabled drivers build config 00:02:13.610 common/dpaax: not in enabled drivers build config 00:02:13.610 common/iavf: not in enabled drivers build config 00:02:13.610 common/idpf: not in enabled drivers build config 00:02:13.610 common/ionic: not in enabled drivers build config 00:02:13.610 common/mvep: not in enabled drivers build config 00:02:13.610 common/octeontx: not in enabled drivers build config 00:02:13.610 bus/auxiliary: not in enabled drivers build config 00:02:13.610 bus/cdx: not in enabled drivers build config 00:02:13.610 bus/dpaa: not in enabled drivers build config 00:02:13.610 bus/fslmc: not in enabled drivers build config 00:02:13.610 bus/ifpga: not in enabled drivers build config 00:02:13.610 bus/platform: not in enabled drivers build config 00:02:13.610 bus/uacce: not in enabled drivers build config 00:02:13.610 bus/vmbus: not in enabled drivers build config 00:02:13.610 common/cnxk: not in enabled drivers build config 00:02:13.610 common/mlx5: not in enabled drivers build config 00:02:13.610 common/nfp: not in enabled drivers build config 00:02:13.610 common/nitrox: not in enabled drivers build config 00:02:13.610 common/qat: not in enabled drivers build config 00:02:13.610 common/sfc_efx: not in enabled drivers build config 00:02:13.610 mempool/bucket: not in enabled drivers build config 00:02:13.610 mempool/cnxk: not in enabled drivers build config 00:02:13.610 mempool/dpaa: not in enabled drivers build config 00:02:13.610 mempool/dpaa2: not in enabled drivers build config 00:02:13.610 mempool/octeontx: not in enabled drivers build config 00:02:13.610 mempool/stack: not in enabled drivers build config 00:02:13.610 dma/cnxk: not in enabled drivers build config 00:02:13.610 dma/dpaa: not in enabled drivers build config 00:02:13.610 dma/dpaa2: not in enabled drivers build config 00:02:13.610 dma/hisilicon: not in enabled drivers build config 00:02:13.610 dma/idxd: not in enabled drivers build config 00:02:13.610 dma/ioat: not in enabled drivers build config 00:02:13.610 dma/skeleton: not in enabled drivers build config 00:02:13.610 net/af_packet: not in enabled drivers build config 00:02:13.610 net/af_xdp: not in enabled drivers build config 00:02:13.610 net/ark: not in enabled drivers build config 00:02:13.610 net/atlantic: not in enabled drivers build config 00:02:13.610 net/avp: not in enabled drivers build config 00:02:13.610 net/axgbe: not in enabled drivers build config 00:02:13.610 net/bnx2x: not in enabled drivers build config 00:02:13.610 net/bnxt: not in enabled drivers build config 00:02:13.610 net/bonding: not in enabled drivers build config 00:02:13.610 net/cnxk: not in enabled drivers build config 00:02:13.610 net/cpfl: not in enabled drivers build config 00:02:13.610 net/cxgbe: not in enabled drivers build config 00:02:13.610 net/dpaa: not in enabled drivers build config 00:02:13.610 net/dpaa2: not in enabled drivers build config 00:02:13.610 net/e1000: not in enabled drivers build config 00:02:13.610 net/ena: not in enabled drivers build config 00:02:13.610 net/enetc: not in enabled drivers build config 00:02:13.610 net/enetfec: not in enabled drivers build config 00:02:13.610 net/enic: not in enabled drivers build config 00:02:13.610 net/failsafe: not in enabled drivers build config 00:02:13.610 net/fm10k: not in enabled drivers build config 00:02:13.610 net/gve: not in enabled drivers build config 00:02:13.610 net/hinic: not in enabled drivers build config 00:02:13.610 net/hns3: not in enabled drivers build config 00:02:13.610 net/i40e: not in enabled drivers build config 00:02:13.610 net/iavf: not in enabled drivers build config 00:02:13.610 net/ice: not in enabled drivers build config 00:02:13.610 net/idpf: not in enabled drivers build config 00:02:13.610 net/igc: not in enabled drivers build config 00:02:13.610 net/ionic: not in enabled drivers build config 00:02:13.610 net/ipn3ke: not in enabled drivers build config 00:02:13.610 net/ixgbe: not in enabled drivers build config 00:02:13.610 net/mana: not in enabled drivers build config 00:02:13.610 net/memif: not in enabled drivers build config 00:02:13.610 net/mlx4: not in enabled drivers build config 00:02:13.610 net/mlx5: not in enabled drivers build config 00:02:13.610 net/mvneta: not in enabled drivers build config 00:02:13.610 net/mvpp2: not in enabled drivers build config 00:02:13.610 net/netvsc: not in enabled drivers build config 00:02:13.610 net/nfb: not in enabled drivers build config 00:02:13.610 net/nfp: not in enabled drivers build config 00:02:13.610 net/ngbe: not in enabled drivers build config 00:02:13.610 net/null: not in enabled drivers build config 00:02:13.610 net/octeontx: not in enabled drivers build config 00:02:13.610 net/octeon_ep: not in enabled drivers build config 00:02:13.610 net/pcap: not in enabled drivers build config 00:02:13.610 net/pfe: not in enabled drivers build config 00:02:13.610 net/qede: not in enabled drivers build config 00:02:13.610 net/ring: not in enabled drivers build config 00:02:13.610 net/sfc: not in enabled drivers build config 00:02:13.610 net/softnic: not in enabled drivers build config 00:02:13.610 net/tap: not in enabled drivers build config 00:02:13.610 net/thunderx: not in enabled drivers build config 00:02:13.610 net/txgbe: not in enabled drivers build config 00:02:13.610 net/vdev_netvsc: not in enabled drivers build config 00:02:13.610 net/vhost: not in enabled drivers build config 00:02:13.610 net/virtio: not in enabled drivers build config 00:02:13.610 net/vmxnet3: not in enabled drivers build config 00:02:13.610 raw/*: missing internal dependency, "rawdev" 00:02:13.610 crypto/armv8: not in enabled drivers build config 00:02:13.610 crypto/bcmfs: not in enabled drivers build config 00:02:13.610 crypto/caam_jr: not in enabled drivers build config 00:02:13.610 crypto/ccp: not in enabled drivers build config 00:02:13.610 crypto/cnxk: not in enabled drivers build config 00:02:13.610 crypto/dpaa_sec: not in enabled drivers build config 00:02:13.610 crypto/dpaa2_sec: not in enabled drivers build config 00:02:13.610 crypto/ipsec_mb: not in enabled drivers build config 00:02:13.610 crypto/mlx5: not in enabled drivers build config 00:02:13.610 crypto/mvsam: not in enabled drivers build config 00:02:13.610 crypto/nitrox: not in enabled drivers build config 00:02:13.610 crypto/null: not in enabled drivers build config 00:02:13.610 crypto/octeontx: not in enabled drivers build config 00:02:13.610 crypto/openssl: not in enabled drivers build config 00:02:13.610 crypto/scheduler: not in enabled drivers build config 00:02:13.610 crypto/uadk: not in enabled drivers build config 00:02:13.610 crypto/virtio: not in enabled drivers build config 00:02:13.610 compress/isal: not in enabled drivers build config 00:02:13.610 compress/mlx5: not in enabled drivers build config 00:02:13.610 compress/nitrox: not in enabled drivers build config 00:02:13.610 compress/octeontx: not in enabled drivers build config 00:02:13.610 compress/zlib: not in enabled drivers build config 00:02:13.610 regex/*: missing internal dependency, "regexdev" 00:02:13.610 ml/*: missing internal dependency, "mldev" 00:02:13.610 vdpa/ifc: not in enabled drivers build config 00:02:13.610 vdpa/mlx5: not in enabled drivers build config 00:02:13.610 vdpa/nfp: not in enabled drivers build config 00:02:13.611 vdpa/sfc: not in enabled drivers build config 00:02:13.611 event/*: missing internal dependency, "eventdev" 00:02:13.611 baseband/*: missing internal dependency, "bbdev" 00:02:13.611 gpu/*: missing internal dependency, "gpudev" 00:02:13.611 00:02:13.611 00:02:13.611 Build targets in project: 85 00:02:13.611 00:02:13.611 DPDK 24.03.0 00:02:13.611 00:02:13.611 User defined options 00:02:13.611 buildtype : debug 00:02:13.611 default_library : shared 00:02:13.611 libdir : lib 00:02:13.611 prefix : /home/vagrant/spdk_repo/spdk/dpdk/build 00:02:13.611 c_args : -Wno-stringop-overflow -fcommon -Wno-stringop-overread -Wno-array-bounds -fPIC -Werror 00:02:13.611 c_link_args : 00:02:13.611 cpu_instruction_set: native 00:02:13.611 disable_apps : dumpcap,graph,pdump,proc-info,test-acl,test-bbdev,test-cmdline,test-compress-perf,test-crypto-perf,test-dma-perf,test-eventdev,test-fib,test-flow-perf,test-gpudev,test-mldev,test-pipeline,test-pmd,test-regex,test-sad,test-security-perf,test 00:02:13.611 disable_libs : acl,argparse,bbdev,bitratestats,bpf,cfgfile,dispatcher,distributor,efd,eventdev,fib,gpudev,graph,gro,gso,ip_frag,ipsec,jobstats,latencystats,lpm,member,metrics,mldev,node,pcapng,pdcp,pdump,pipeline,port,rawdev,regexdev,rib,sched,stack,table 00:02:13.611 enable_docs : false 00:02:13.611 enable_drivers : bus,bus/pci,bus/vdev,mempool/ring 00:02:13.611 enable_kmods : false 00:02:13.611 max_lcores : 128 00:02:13.611 tests : false 00:02:13.611 00:02:13.611 Found ninja-1.11.1.git.kitware.jobserver-1 at /usr/local/bin/ninja 00:02:13.611 ninja: Entering directory `/home/vagrant/spdk_repo/spdk/dpdk/build-tmp' 00:02:13.611 [1/268] Compiling C object lib/librte_log.a.p/log_log_linux.c.o 00:02:13.611 [2/268] Compiling C object lib/librte_kvargs.a.p/kvargs_rte_kvargs.c.o 00:02:13.611 [3/268] Compiling C object lib/librte_log.a.p/log_log.c.o 00:02:13.611 [4/268] Linking static target lib/librte_kvargs.a 00:02:13.611 [5/268] Linking static target lib/librte_log.a 00:02:13.611 [6/268] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry_data.c.o 00:02:13.611 [7/268] Generating lib/kvargs.sym_chk with a custom command (wrapped by meson to capture output) 00:02:13.611 [8/268] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_errno.c.o 00:02:13.611 [9/268] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry_legacy.c.o 00:02:13.611 [10/268] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_hexdump.c.o 00:02:13.611 [11/268] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_config.c.o 00:02:13.869 [12/268] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_debug.c.o 00:02:13.869 [13/268] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_bus.c.o 00:02:13.869 [14/268] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_class.c.o 00:02:13.869 [15/268] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry.c.o 00:02:13.869 [16/268] Linking static target lib/librte_telemetry.a 00:02:13.869 [17/268] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_dev.c.o 00:02:13.869 [18/268] Generating lib/log.sym_chk with a custom command (wrapped by meson to capture output) 00:02:14.127 [19/268] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_devargs.c.o 00:02:14.127 [20/268] Linking target lib/librte_log.so.24.1 00:02:14.385 [21/268] Generating symbol file lib/librte_log.so.24.1.p/librte_log.so.24.1.symbols 00:02:14.385 [22/268] Linking target lib/librte_kvargs.so.24.1 00:02:14.385 [23/268] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_interrupts.c.o 00:02:14.643 [24/268] Generating symbol file lib/librte_kvargs.so.24.1.p/librte_kvargs.so.24.1.symbols 00:02:14.643 [25/268] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_fbarray.c.o 00:02:14.643 [26/268] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_string_fns.c.o 00:02:14.643 [27/268] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_launch.c.o 00:02:14.643 [28/268] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_mcfg.c.o 00:02:14.901 [29/268] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_lcore.c.o 00:02:14.901 [30/268] Generating lib/telemetry.sym_chk with a custom command (wrapped by meson to capture output) 00:02:14.901 [31/268] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memory.c.o 00:02:14.901 [32/268] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memalloc.c.o 00:02:14.901 [33/268] Linking target lib/librte_telemetry.so.24.1 00:02:14.901 [34/268] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_uuid.c.o 00:02:14.901 [35/268] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memzone.c.o 00:02:15.158 [36/268] Generating symbol file lib/librte_telemetry.so.24.1.p/librte_telemetry.so.24.1.symbols 00:02:15.158 [37/268] Compiling C object lib/librte_eal.a.p/eal_common_rte_reciprocal.c.o 00:02:15.416 [38/268] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_options.c.o 00:02:15.416 [39/268] Compiling C object lib/librte_eal.a.p/eal_common_rte_version.c.o 00:02:15.674 [40/268] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_tailqs.c.o 00:02:15.674 [41/268] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_thread.c.o 00:02:15.674 [42/268] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_timer.c.o 00:02:15.674 [43/268] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_hypervisor.c.o 00:02:15.674 [44/268] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_cpuflags.c.o 00:02:15.674 [45/268] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_points.c.o 00:02:15.674 [46/268] Compiling C object lib/librte_eal.a.p/eal_common_rte_random.c.o 00:02:15.933 [47/268] Compiling C object lib/librte_eal.a.p/eal_common_malloc_elem.c.o 00:02:15.933 [48/268] Compiling C object lib/librte_eal.a.p/eal_common_malloc_heap.c.o 00:02:16.191 [49/268] Compiling C object lib/librte_eal.a.p/eal_common_rte_malloc.c.o 00:02:16.191 [50/268] Compiling C object lib/librte_eal.a.p/eal_unix_eal_debug.c.o 00:02:16.191 [51/268] Compiling C object lib/librte_eal.a.p/eal_common_rte_service.c.o 00:02:16.449 [52/268] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_dynmem.c.o 00:02:16.449 [53/268] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace.c.o 00:02:16.707 [54/268] Compiling C object lib/librte_eal.a.p/eal_common_hotplug_mp.c.o 00:02:16.707 [55/268] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_proc.c.o 00:02:16.707 [56/268] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_utils.c.o 00:02:16.707 [57/268] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_ctf.c.o 00:02:16.964 [58/268] Compiling C object lib/librte_eal.a.p/eal_common_rte_keepalive.c.o 00:02:16.964 [59/268] Compiling C object lib/librte_eal.a.p/eal_common_malloc_mp.c.o 00:02:16.965 [60/268] Compiling C object lib/librte_eal.a.p/eal_linux_eal_cpuflags.c.o 00:02:17.223 [61/268] Compiling C object lib/librte_eal.a.p/eal_unix_eal_file.c.o 00:02:17.223 [62/268] Compiling C object lib/librte_eal.a.p/eal_unix_eal_filesystem.c.o 00:02:17.481 [63/268] Compiling C object lib/librte_eal.a.p/eal_unix_eal_firmware.c.o 00:02:17.481 [64/268] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_thread.c.o 00:02:17.481 [65/268] Compiling C object lib/librte_eal.a.p/eal_unix_rte_thread.c.o 00:02:17.481 [66/268] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_memory.c.o 00:02:17.481 [67/268] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_timer.c.o 00:02:17.740 [68/268] Compiling C object lib/librte_eal.a.p/eal_linux_eal.c.o 00:02:17.740 [69/268] Compiling C object lib/librte_eal.a.p/eal_linux_eal_alarm.c.o 00:02:17.999 [70/268] Compiling C object lib/librte_eal.a.p/eal_linux_eal_hugepage_info.c.o 00:02:17.999 [71/268] Compiling C object lib/librte_eal.a.p/eal_x86_rte_cpuflags.c.o 00:02:17.999 [72/268] Compiling C object lib/librte_eal.a.p/eal_linux_eal_dev.c.o 00:02:18.257 [73/268] Compiling C object lib/librte_eal.a.p/eal_linux_eal_interrupts.c.o 00:02:18.257 [74/268] Compiling C object lib/librte_eal.a.p/eal_x86_rte_hypervisor.c.o 00:02:18.257 [75/268] Compiling C object lib/librte_eal.a.p/eal_x86_rte_spinlock.c.o 00:02:18.515 [76/268] Compiling C object lib/librte_eal.a.p/eal_linux_eal_lcore.c.o 00:02:18.515 [77/268] Compiling C object lib/librte_eal.a.p/eal_linux_eal_thread.c.o 00:02:18.515 [78/268] Compiling C object lib/librte_eal.a.p/eal_linux_eal_timer.c.o 00:02:18.515 [79/268] Compiling C object lib/librte_eal.a.p/eal_linux_eal_memalloc.c.o 00:02:18.515 [80/268] Compiling C object lib/librte_eal.a.p/eal_linux_eal_vfio.c.o 00:02:18.773 [81/268] Compiling C object lib/librte_eal.a.p/eal_linux_eal_vfio_mp_sync.c.o 00:02:18.773 [82/268] Compiling C object lib/librte_eal.a.p/eal_x86_rte_power_intrinsics.c.o 00:02:18.773 [83/268] Compiling C object lib/librte_eal.a.p/eal_linux_eal_memory.c.o 00:02:18.773 [84/268] Compiling C object lib/librte_ring.a.p/ring_rte_ring.c.o 00:02:18.773 [85/268] Linking static target lib/librte_ring.a 00:02:19.031 [86/268] Compiling C object lib/librte_eal.a.p/eal_x86_rte_cycles.c.o 00:02:19.031 [87/268] Linking static target lib/librte_eal.a 00:02:19.031 [88/268] Compiling C object lib/librte_rcu.a.p/rcu_rte_rcu_qsbr.c.o 00:02:19.031 [89/268] Linking static target lib/librte_rcu.a 00:02:19.031 [90/268] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool_ops.c.o 00:02:19.290 [91/268] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_pool_ops.c.o 00:02:19.290 [92/268] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_ptype.c.o 00:02:19.290 [93/268] Generating lib/ring.sym_chk with a custom command (wrapped by meson to capture output) 00:02:19.548 [94/268] Compiling C object lib/librte_mempool.a.p/mempool_mempool_trace_points.c.o 00:02:19.548 [95/268] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool_ops_default.c.o 00:02:19.548 [96/268] Generating lib/rcu.sym_chk with a custom command (wrapped by meson to capture output) 00:02:19.548 [97/268] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool.c.o 00:02:19.548 [98/268] Linking static target lib/librte_mempool.a 00:02:19.806 [99/268] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_dyn.c.o 00:02:19.806 [100/268] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf.c.o 00:02:19.806 [101/268] Linking static target lib/librte_mbuf.a 00:02:20.064 [102/268] Compiling C object lib/librte_net.a.p/net_rte_ether.c.o 00:02:20.064 [103/268] Compiling C object lib/net/libnet_crc_avx512_lib.a.p/net_crc_avx512.c.o 00:02:20.064 [104/268] Linking static target lib/net/libnet_crc_avx512_lib.a 00:02:20.064 [105/268] Compiling C object lib/librte_net.a.p/net_rte_net.c.o 00:02:20.064 [106/268] Compiling C object lib/librte_net.a.p/net_rte_arp.c.o 00:02:20.064 [107/268] Compiling C object lib/librte_net.a.p/net_rte_net_crc.c.o 00:02:20.322 [108/268] Compiling C object lib/librte_net.a.p/net_net_crc_sse.c.o 00:02:20.322 [109/268] Linking static target lib/librte_net.a 00:02:20.322 [110/268] Compiling C object lib/librte_meter.a.p/meter_rte_meter.c.o 00:02:20.322 [111/268] Linking static target lib/librte_meter.a 00:02:20.580 [112/268] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_private.c.o 00:02:20.838 [113/268] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_driver.c.o 00:02:20.838 [114/268] Generating lib/mempool.sym_chk with a custom command (wrapped by meson to capture output) 00:02:20.838 [115/268] Generating lib/net.sym_chk with a custom command (wrapped by meson to capture output) 00:02:20.838 [116/268] Generating lib/meter.sym_chk with a custom command (wrapped by meson to capture output) 00:02:20.838 [117/268] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_profile.c.o 00:02:20.838 [118/268] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_class_eth.c.o 00:02:21.096 [119/268] Generating lib/mbuf.sym_chk with a custom command (wrapped by meson to capture output) 00:02:21.354 [120/268] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_trace_points.c.o 00:02:21.612 [121/268] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev_cman.c.o 00:02:21.612 [122/268] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_tm.c.o 00:02:21.869 [123/268] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_common.c.o 00:02:21.869 [124/268] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev_telemetry.c.o 00:02:21.870 [125/268] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_telemetry.c.o 00:02:21.870 [126/268] Compiling C object lib/librte_pci.a.p/pci_rte_pci.c.o 00:02:21.870 [127/268] Linking static target lib/librte_pci.a 00:02:21.870 [128/268] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline.c.o 00:02:22.127 [129/268] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_mtr.c.o 00:02:22.128 [130/268] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_cirbuf.c.o 00:02:22.128 [131/268] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse.c.o 00:02:22.128 [132/268] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8079.c.o 00:02:22.128 [133/268] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8472.c.o 00:02:22.385 [134/268] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_num.c.o 00:02:22.385 [135/268] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_portlist.c.o 00:02:22.385 [136/268] Generating lib/pci.sym_chk with a custom command (wrapped by meson to capture output) 00:02:22.385 [137/268] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_string.c.o 00:02:22.385 [138/268] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_linux_ethtool.c.o 00:02:22.385 [139/268] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_socket.c.o 00:02:22.386 [140/268] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_vt100.c.o 00:02:22.386 [141/268] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8636.c.o 00:02:22.386 [142/268] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_os_unix.c.o 00:02:22.386 [143/268] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev.c.o 00:02:22.386 [144/268] Compiling C object lib/librte_hash.a.p/hash_rte_hash_crc.c.o 00:02:22.386 [145/268] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_rdline.c.o 00:02:22.951 [146/268] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_flow.c.o 00:02:22.951 [147/268] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_ipaddr.c.o 00:02:22.951 [148/268] Linking static target lib/librte_ethdev.a 00:02:22.951 [149/268] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_etheraddr.c.o 00:02:22.951 [150/268] Compiling C object lib/librte_hash.a.p/hash_rte_thash_gfni.c.o 00:02:22.951 [151/268] Linking static target lib/librte_cmdline.a 00:02:22.951 [152/268] Compiling C object lib/librte_hash.a.p/hash_rte_fbk_hash.c.o 00:02:23.210 [153/268] Compiling C object lib/librte_timer.a.p/timer_rte_timer.c.o 00:02:23.210 [154/268] Linking static target lib/librte_timer.a 00:02:23.210 [155/268] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_compressdev.c.o 00:02:23.494 [156/268] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_compressdev_pmd.c.o 00:02:23.494 [157/268] Compiling C object lib/librte_hash.a.p/hash_rte_thash.c.o 00:02:23.494 [158/268] Compiling C object lib/librte_hash.a.p/hash_rte_cuckoo_hash.c.o 00:02:23.494 [159/268] Linking static target lib/librte_hash.a 00:02:23.770 [160/268] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_comp.c.o 00:02:23.770 [161/268] Linking static target lib/librte_compressdev.a 00:02:23.770 [162/268] Compiling C object lib/librte_cryptodev.a.p/cryptodev_cryptodev_pmd.c.o 00:02:23.770 [163/268] Generating lib/timer.sym_chk with a custom command (wrapped by meson to capture output) 00:02:24.029 [164/268] Compiling C object lib/librte_cryptodev.a.p/cryptodev_cryptodev_trace_points.c.o 00:02:24.029 [165/268] Compiling C object lib/librte_power.a.p/power_guest_channel.c.o 00:02:24.287 [166/268] Compiling C object lib/librte_dmadev.a.p/dmadev_rte_dmadev.c.o 00:02:24.287 [167/268] Compiling C object lib/librte_power.a.p/power_power_common.c.o 00:02:24.287 [168/268] Compiling C object lib/librte_dmadev.a.p/dmadev_rte_dmadev_trace_points.c.o 00:02:24.287 [169/268] Linking static target lib/librte_dmadev.a 00:02:24.545 [170/268] Compiling C object lib/librte_power.a.p/power_power_amd_pstate_cpufreq.c.o 00:02:24.545 [171/268] Generating lib/cmdline.sym_chk with a custom command (wrapped by meson to capture output) 00:02:24.545 [172/268] Compiling C object lib/librte_power.a.p/power_power_acpi_cpufreq.c.o 00:02:24.545 [173/268] Compiling C object lib/librte_power.a.p/power_power_kvm_vm.c.o 00:02:24.545 [174/268] Generating lib/compressdev.sym_chk with a custom command (wrapped by meson to capture output) 00:02:24.803 [175/268] Generating lib/hash.sym_chk with a custom command (wrapped by meson to capture output) 00:02:24.803 [176/268] Compiling C object lib/librte_cryptodev.a.p/cryptodev_rte_cryptodev.c.o 00:02:24.803 [177/268] Linking static target lib/librte_cryptodev.a 00:02:24.803 [178/268] Compiling C object lib/librte_power.a.p/power_power_cppc_cpufreq.c.o 00:02:25.062 [179/268] Compiling C object lib/librte_power.a.p/power_power_intel_uncore.c.o 00:02:25.320 [180/268] Compiling C object lib/librte_power.a.p/power_rte_power_uncore.c.o 00:02:25.320 [181/268] Compiling C object lib/librte_power.a.p/power_power_pstate_cpufreq.c.o 00:02:25.320 [182/268] Compiling C object lib/librte_power.a.p/power_rte_power.c.o 00:02:25.320 [183/268] Generating lib/dmadev.sym_chk with a custom command (wrapped by meson to capture output) 00:02:25.320 [184/268] Compiling C object lib/librte_vhost.a.p/vhost_fd_man.c.o 00:02:25.579 [185/268] Compiling C object lib/librte_power.a.p/power_rte_power_pmd_mgmt.c.o 00:02:25.579 [186/268] Linking static target lib/librte_power.a 00:02:25.837 [187/268] Compiling C object lib/librte_reorder.a.p/reorder_rte_reorder.c.o 00:02:25.837 [188/268] Linking static target lib/librte_reorder.a 00:02:25.837 [189/268] Compiling C object lib/librte_vhost.a.p/vhost_iotlb.c.o 00:02:26.095 [190/268] Compiling C object lib/librte_security.a.p/security_rte_security.c.o 00:02:26.095 [191/268] Linking static target lib/librte_security.a 00:02:26.095 [192/268] Compiling C object lib/librte_vhost.a.p/vhost_vdpa.c.o 00:02:26.095 [193/268] Compiling C object lib/librte_vhost.a.p/vhost_socket.c.o 00:02:26.353 [194/268] Generating lib/reorder.sym_chk with a custom command (wrapped by meson to capture output) 00:02:26.353 [195/268] Compiling C object lib/librte_vhost.a.p/vhost_vhost.c.o 00:02:26.918 [196/268] Generating lib/power.sym_chk with a custom command (wrapped by meson to capture output) 00:02:26.918 [197/268] Generating lib/security.sym_chk with a custom command (wrapped by meson to capture output) 00:02:26.918 [198/268] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_params.c.o 00:02:27.175 [199/268] Compiling C object lib/librte_vhost.a.p/vhost_vhost_user.c.o 00:02:27.176 [200/268] Compiling C object lib/librte_vhost.a.p/vhost_virtio_net_ctrl.c.o 00:02:27.176 [201/268] Compiling C object lib/librte_vhost.a.p/vhost_vduse.c.o 00:02:27.434 [202/268] Generating lib/cryptodev.sym_chk with a custom command (wrapped by meson to capture output) 00:02:27.434 [203/268] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_common.c.o 00:02:27.692 [204/268] Compiling C object drivers/libtmp_rte_bus_vdev.a.p/bus_vdev_vdev_params.c.o 00:02:27.692 [205/268] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci.c.o 00:02:27.692 [206/268] Compiling C object lib/librte_vhost.a.p/vhost_vhost_crypto.c.o 00:02:27.949 [207/268] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_common_uio.c.o 00:02:27.949 [208/268] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci_uio.c.o 00:02:27.949 [209/268] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci_vfio.c.o 00:02:27.949 [210/268] Linking static target drivers/libtmp_rte_bus_pci.a 00:02:28.207 [211/268] Compiling C object drivers/libtmp_rte_bus_vdev.a.p/bus_vdev_vdev.c.o 00:02:28.207 [212/268] Linking static target drivers/libtmp_rte_bus_vdev.a 00:02:28.207 [213/268] Generating drivers/rte_bus_pci.pmd.c with a custom command 00:02:28.207 [214/268] Compiling C object drivers/librte_bus_pci.a.p/meson-generated_.._rte_bus_pci.pmd.c.o 00:02:28.207 [215/268] Compiling C object drivers/librte_bus_pci.so.24.1.p/meson-generated_.._rte_bus_pci.pmd.c.o 00:02:28.207 [216/268] Linking static target drivers/librte_bus_pci.a 00:02:28.466 [217/268] Compiling C object drivers/libtmp_rte_mempool_ring.a.p/mempool_ring_rte_mempool_ring.c.o 00:02:28.466 [218/268] Linking static target drivers/libtmp_rte_mempool_ring.a 00:02:28.466 [219/268] Generating drivers/rte_bus_vdev.pmd.c with a custom command 00:02:28.466 [220/268] Compiling C object drivers/librte_bus_vdev.a.p/meson-generated_.._rte_bus_vdev.pmd.c.o 00:02:28.466 [221/268] Compiling C object drivers/librte_bus_vdev.so.24.1.p/meson-generated_.._rte_bus_vdev.pmd.c.o 00:02:28.466 [222/268] Linking static target drivers/librte_bus_vdev.a 00:02:28.466 [223/268] Generating drivers/rte_mempool_ring.pmd.c with a custom command 00:02:28.466 [224/268] Compiling C object drivers/librte_mempool_ring.a.p/meson-generated_.._rte_mempool_ring.pmd.c.o 00:02:28.466 [225/268] Linking static target drivers/librte_mempool_ring.a 00:02:28.466 [226/268] Compiling C object drivers/librte_mempool_ring.so.24.1.p/meson-generated_.._rte_mempool_ring.pmd.c.o 00:02:28.724 [227/268] Generating drivers/rte_bus_vdev.sym_chk with a custom command (wrapped by meson to capture output) 00:02:28.724 [228/268] Generating drivers/rte_bus_pci.sym_chk with a custom command (wrapped by meson to capture output) 00:02:29.291 [229/268] Compiling C object lib/librte_vhost.a.p/vhost_virtio_net.c.o 00:02:29.291 [230/268] Linking static target lib/librte_vhost.a 00:02:30.225 [231/268] Generating lib/eal.sym_chk with a custom command (wrapped by meson to capture output) 00:02:30.225 [232/268] Linking target lib/librte_eal.so.24.1 00:02:30.483 [233/268] Generating symbol file lib/librte_eal.so.24.1.p/librte_eal.so.24.1.symbols 00:02:30.483 [234/268] Linking target lib/librte_meter.so.24.1 00:02:30.483 [235/268] Linking target drivers/librte_bus_vdev.so.24.1 00:02:30.483 [236/268] Linking target lib/librte_pci.so.24.1 00:02:30.483 [237/268] Linking target lib/librte_dmadev.so.24.1 00:02:30.483 [238/268] Linking target lib/librte_timer.so.24.1 00:02:30.483 [239/268] Linking target lib/librte_ring.so.24.1 00:02:30.483 [240/268] Generating symbol file lib/librte_pci.so.24.1.p/librte_pci.so.24.1.symbols 00:02:30.483 [241/268] Generating symbol file lib/librte_timer.so.24.1.p/librte_timer.so.24.1.symbols 00:02:30.742 [242/268] Generating symbol file lib/librte_dmadev.so.24.1.p/librte_dmadev.so.24.1.symbols 00:02:30.742 [243/268] Generating symbol file lib/librte_meter.so.24.1.p/librte_meter.so.24.1.symbols 00:02:30.742 [244/268] Generating symbol file lib/librte_ring.so.24.1.p/librte_ring.so.24.1.symbols 00:02:30.742 [245/268] Linking target drivers/librte_bus_pci.so.24.1 00:02:30.742 [246/268] Linking target lib/librte_mempool.so.24.1 00:02:30.742 [247/268] Linking target lib/librte_rcu.so.24.1 00:02:30.742 [248/268] Generating lib/vhost.sym_chk with a custom command (wrapped by meson to capture output) 00:02:30.742 [249/268] Generating lib/ethdev.sym_chk with a custom command (wrapped by meson to capture output) 00:02:30.742 [250/268] Generating symbol file lib/librte_mempool.so.24.1.p/librte_mempool.so.24.1.symbols 00:02:30.742 [251/268] Generating symbol file lib/librte_rcu.so.24.1.p/librte_rcu.so.24.1.symbols 00:02:30.742 [252/268] Linking target drivers/librte_mempool_ring.so.24.1 00:02:30.742 [253/268] Linking target lib/librte_mbuf.so.24.1 00:02:31.000 [254/268] Generating symbol file lib/librte_mbuf.so.24.1.p/librte_mbuf.so.24.1.symbols 00:02:31.000 [255/268] Linking target lib/librte_compressdev.so.24.1 00:02:31.000 [256/268] Linking target lib/librte_cryptodev.so.24.1 00:02:31.000 [257/268] Linking target lib/librte_net.so.24.1 00:02:31.000 [258/268] Linking target lib/librte_reorder.so.24.1 00:02:31.259 [259/268] Generating symbol file lib/librte_net.so.24.1.p/librte_net.so.24.1.symbols 00:02:31.259 [260/268] Generating symbol file lib/librte_cryptodev.so.24.1.p/librte_cryptodev.so.24.1.symbols 00:02:31.259 [261/268] Linking target lib/librte_security.so.24.1 00:02:31.259 [262/268] Linking target lib/librte_hash.so.24.1 00:02:31.259 [263/268] Linking target lib/librte_cmdline.so.24.1 00:02:31.259 [264/268] Linking target lib/librte_ethdev.so.24.1 00:02:31.259 [265/268] Generating symbol file lib/librte_hash.so.24.1.p/librte_hash.so.24.1.symbols 00:02:31.518 [266/268] Generating symbol file lib/librte_ethdev.so.24.1.p/librte_ethdev.so.24.1.symbols 00:02:31.518 [267/268] Linking target lib/librte_power.so.24.1 00:02:31.518 [268/268] Linking target lib/librte_vhost.so.24.1 00:02:31.518 INFO: autodetecting backend as ninja 00:02:31.518 INFO: calculating backend command to run: /usr/local/bin/ninja -C /home/vagrant/spdk_repo/spdk/dpdk/build-tmp -j 10 00:02:58.060 CC lib/ut_mock/mock.o 00:02:58.060 CC lib/ut/ut.o 00:02:58.060 CC lib/log/log_deprecated.o 00:02:58.060 CC lib/log/log.o 00:02:58.060 CC lib/log/log_flags.o 00:02:58.060 LIB libspdk_ut.a 00:02:58.060 LIB libspdk_ut_mock.a 00:02:58.060 LIB libspdk_log.a 00:02:58.060 SO libspdk_ut.so.2.0 00:02:58.060 SO libspdk_ut_mock.so.6.0 00:02:58.060 SO libspdk_log.so.7.0 00:02:58.060 SYMLINK libspdk_ut.so 00:02:58.060 SYMLINK libspdk_ut_mock.so 00:02:58.060 SYMLINK libspdk_log.so 00:02:58.060 CXX lib/trace_parser/trace.o 00:02:58.060 CC lib/util/base64.o 00:02:58.060 CC lib/util/bit_array.o 00:02:58.060 CC lib/util/cpuset.o 00:02:58.060 CC lib/util/crc16.o 00:02:58.060 CC lib/util/crc32.o 00:02:58.060 CC lib/util/crc32c.o 00:02:58.060 CC lib/dma/dma.o 00:02:58.060 CC lib/ioat/ioat.o 00:02:58.060 CC lib/vfio_user/host/vfio_user_pci.o 00:02:58.060 CC lib/util/crc32_ieee.o 00:02:58.060 CC lib/util/crc64.o 00:02:58.060 CC lib/util/dif.o 00:02:58.060 CC lib/util/fd.o 00:02:58.060 CC lib/util/fd_group.o 00:02:58.060 LIB libspdk_dma.a 00:02:58.060 CC lib/vfio_user/host/vfio_user.o 00:02:58.060 LIB libspdk_ioat.a 00:02:58.060 SO libspdk_dma.so.5.0 00:02:58.060 CC lib/util/file.o 00:02:58.060 SO libspdk_ioat.so.7.0 00:02:58.060 CC lib/util/hexlify.o 00:02:58.060 SYMLINK libspdk_dma.so 00:02:58.060 CC lib/util/iov.o 00:02:58.060 CC lib/util/math.o 00:02:58.060 SYMLINK libspdk_ioat.so 00:02:58.060 CC lib/util/net.o 00:02:58.060 CC lib/util/pipe.o 00:02:58.060 LIB libspdk_vfio_user.a 00:02:58.060 CC lib/util/strerror_tls.o 00:02:58.060 SO libspdk_vfio_user.so.5.0 00:02:58.060 CC lib/util/string.o 00:02:58.060 CC lib/util/uuid.o 00:02:58.060 CC lib/util/xor.o 00:02:58.060 SYMLINK libspdk_vfio_user.so 00:02:58.060 CC lib/util/zipf.o 00:02:58.060 CC lib/util/md5.o 00:02:58.319 LIB libspdk_util.a 00:02:58.577 SO libspdk_util.so.10.0 00:02:58.577 SYMLINK libspdk_util.so 00:02:58.577 LIB libspdk_trace_parser.a 00:02:58.835 SO libspdk_trace_parser.so.6.0 00:02:58.835 SYMLINK libspdk_trace_parser.so 00:02:58.835 CC lib/vmd/vmd.o 00:02:58.835 CC lib/rdma_utils/rdma_utils.o 00:02:58.835 CC lib/vmd/led.o 00:02:58.835 CC lib/idxd/idxd.o 00:02:58.835 CC lib/idxd/idxd_user.o 00:02:58.835 CC lib/rdma_provider/common.o 00:02:58.835 CC lib/json/json_parse.o 00:02:58.835 CC lib/idxd/idxd_kernel.o 00:02:58.835 CC lib/env_dpdk/env.o 00:02:58.835 CC lib/conf/conf.o 00:02:59.094 CC lib/env_dpdk/memory.o 00:02:59.094 CC lib/rdma_provider/rdma_provider_verbs.o 00:02:59.094 CC lib/env_dpdk/pci.o 00:02:59.094 CC lib/json/json_util.o 00:02:59.094 LIB libspdk_conf.a 00:02:59.094 CC lib/json/json_write.o 00:02:59.094 SO libspdk_conf.so.6.0 00:02:59.094 LIB libspdk_rdma_utils.a 00:02:59.094 SO libspdk_rdma_utils.so.1.0 00:02:59.094 SYMLINK libspdk_conf.so 00:02:59.094 CC lib/env_dpdk/init.o 00:02:59.094 SYMLINK libspdk_rdma_utils.so 00:02:59.094 CC lib/env_dpdk/threads.o 00:02:59.094 LIB libspdk_rdma_provider.a 00:02:59.094 SO libspdk_rdma_provider.so.6.0 00:02:59.353 SYMLINK libspdk_rdma_provider.so 00:02:59.353 CC lib/env_dpdk/pci_ioat.o 00:02:59.353 CC lib/env_dpdk/pci_virtio.o 00:02:59.353 CC lib/env_dpdk/pci_vmd.o 00:02:59.353 CC lib/env_dpdk/pci_idxd.o 00:02:59.353 LIB libspdk_json.a 00:02:59.353 SO libspdk_json.so.6.0 00:02:59.353 CC lib/env_dpdk/pci_event.o 00:02:59.353 LIB libspdk_idxd.a 00:02:59.353 LIB libspdk_vmd.a 00:02:59.353 CC lib/env_dpdk/sigbus_handler.o 00:02:59.353 CC lib/env_dpdk/pci_dpdk.o 00:02:59.612 SO libspdk_vmd.so.6.0 00:02:59.612 SO libspdk_idxd.so.12.1 00:02:59.612 SYMLINK libspdk_json.so 00:02:59.612 CC lib/env_dpdk/pci_dpdk_2207.o 00:02:59.612 SYMLINK libspdk_idxd.so 00:02:59.612 CC lib/env_dpdk/pci_dpdk_2211.o 00:02:59.612 SYMLINK libspdk_vmd.so 00:02:59.612 CC lib/jsonrpc/jsonrpc_server_tcp.o 00:02:59.612 CC lib/jsonrpc/jsonrpc_server.o 00:02:59.612 CC lib/jsonrpc/jsonrpc_client.o 00:02:59.612 CC lib/jsonrpc/jsonrpc_client_tcp.o 00:02:59.871 LIB libspdk_jsonrpc.a 00:03:00.130 SO libspdk_jsonrpc.so.6.0 00:03:00.130 SYMLINK libspdk_jsonrpc.so 00:03:00.389 LIB libspdk_env_dpdk.a 00:03:00.389 CC lib/rpc/rpc.o 00:03:00.389 SO libspdk_env_dpdk.so.15.0 00:03:00.647 SYMLINK libspdk_env_dpdk.so 00:03:00.647 LIB libspdk_rpc.a 00:03:00.647 SO libspdk_rpc.so.6.0 00:03:00.647 SYMLINK libspdk_rpc.so 00:03:00.906 CC lib/trace/trace.o 00:03:00.906 CC lib/trace/trace_flags.o 00:03:00.906 CC lib/trace/trace_rpc.o 00:03:00.906 CC lib/keyring/keyring.o 00:03:00.906 CC lib/keyring/keyring_rpc.o 00:03:00.906 CC lib/notify/notify.o 00:03:00.906 CC lib/notify/notify_rpc.o 00:03:01.164 LIB libspdk_notify.a 00:03:01.164 SO libspdk_notify.so.6.0 00:03:01.164 LIB libspdk_trace.a 00:03:01.164 LIB libspdk_keyring.a 00:03:01.164 SYMLINK libspdk_notify.so 00:03:01.164 SO libspdk_trace.so.11.0 00:03:01.164 SO libspdk_keyring.so.2.0 00:03:01.164 SYMLINK libspdk_trace.so 00:03:01.164 SYMLINK libspdk_keyring.so 00:03:01.423 CC lib/thread/thread.o 00:03:01.423 CC lib/sock/sock.o 00:03:01.423 CC lib/thread/iobuf.o 00:03:01.423 CC lib/sock/sock_rpc.o 00:03:01.990 LIB libspdk_sock.a 00:03:01.990 SO libspdk_sock.so.10.0 00:03:02.248 SYMLINK libspdk_sock.so 00:03:02.507 CC lib/nvme/nvme_ctrlr_cmd.o 00:03:02.507 CC lib/nvme/nvme_ctrlr.o 00:03:02.507 CC lib/nvme/nvme_fabric.o 00:03:02.507 CC lib/nvme/nvme_ns_cmd.o 00:03:02.507 CC lib/nvme/nvme_ns.o 00:03:02.507 CC lib/nvme/nvme_pcie.o 00:03:02.507 CC lib/nvme/nvme_pcie_common.o 00:03:02.507 CC lib/nvme/nvme_qpair.o 00:03:02.507 CC lib/nvme/nvme.o 00:03:03.074 LIB libspdk_thread.a 00:03:03.074 SO libspdk_thread.so.10.2 00:03:03.074 SYMLINK libspdk_thread.so 00:03:03.332 CC lib/nvme/nvme_quirks.o 00:03:03.332 CC lib/accel/accel.o 00:03:03.332 CC lib/accel/accel_rpc.o 00:03:03.332 CC lib/accel/accel_sw.o 00:03:03.590 CC lib/nvme/nvme_transport.o 00:03:03.590 CC lib/init/json_config.o 00:03:03.590 CC lib/blob/blobstore.o 00:03:03.590 CC lib/virtio/virtio.o 00:03:03.590 CC lib/virtio/virtio_vhost_user.o 00:03:03.590 CC lib/virtio/virtio_vfio_user.o 00:03:03.848 CC lib/init/subsystem.o 00:03:03.848 CC lib/init/subsystem_rpc.o 00:03:03.848 CC lib/virtio/virtio_pci.o 00:03:03.848 CC lib/blob/request.o 00:03:03.848 CC lib/nvme/nvme_discovery.o 00:03:03.848 CC lib/blob/zeroes.o 00:03:03.848 CC lib/init/rpc.o 00:03:04.107 CC lib/fsdev/fsdev.o 00:03:04.107 CC lib/blob/blob_bs_dev.o 00:03:04.107 LIB libspdk_init.a 00:03:04.107 SO libspdk_init.so.6.0 00:03:04.107 LIB libspdk_virtio.a 00:03:04.107 SO libspdk_virtio.so.7.0 00:03:04.107 SYMLINK libspdk_init.so 00:03:04.107 CC lib/fsdev/fsdev_io.o 00:03:04.107 CC lib/fsdev/fsdev_rpc.o 00:03:04.365 SYMLINK libspdk_virtio.so 00:03:04.365 CC lib/nvme/nvme_ctrlr_ocssd_cmd.o 00:03:04.365 CC lib/nvme/nvme_ns_ocssd_cmd.o 00:03:04.365 CC lib/nvme/nvme_tcp.o 00:03:04.365 LIB libspdk_accel.a 00:03:04.365 CC lib/event/app.o 00:03:04.365 SO libspdk_accel.so.16.0 00:03:04.624 SYMLINK libspdk_accel.so 00:03:04.624 CC lib/event/reactor.o 00:03:04.624 CC lib/event/log_rpc.o 00:03:04.624 CC lib/event/app_rpc.o 00:03:04.624 LIB libspdk_fsdev.a 00:03:04.624 SO libspdk_fsdev.so.1.0 00:03:04.624 CC lib/event/scheduler_static.o 00:03:04.624 CC lib/nvme/nvme_opal.o 00:03:04.882 SYMLINK libspdk_fsdev.so 00:03:04.882 CC lib/nvme/nvme_io_msg.o 00:03:04.882 CC lib/nvme/nvme_poll_group.o 00:03:04.882 CC lib/nvme/nvme_zns.o 00:03:04.882 CC lib/bdev/bdev.o 00:03:04.882 LIB libspdk_event.a 00:03:04.882 CC lib/nvme/nvme_stubs.o 00:03:05.140 CC lib/fuse_dispatcher/fuse_dispatcher.o 00:03:05.140 SO libspdk_event.so.15.0 00:03:05.140 SYMLINK libspdk_event.so 00:03:05.140 CC lib/bdev/bdev_rpc.o 00:03:05.140 CC lib/bdev/bdev_zone.o 00:03:05.398 CC lib/bdev/part.o 00:03:05.398 CC lib/bdev/scsi_nvme.o 00:03:05.398 CC lib/nvme/nvme_auth.o 00:03:05.656 CC lib/nvme/nvme_cuse.o 00:03:05.656 CC lib/nvme/nvme_rdma.o 00:03:05.656 LIB libspdk_fuse_dispatcher.a 00:03:05.656 SO libspdk_fuse_dispatcher.so.1.0 00:03:05.656 SYMLINK libspdk_fuse_dispatcher.so 00:03:06.593 LIB libspdk_blob.a 00:03:06.593 SO libspdk_blob.so.11.0 00:03:06.593 SYMLINK libspdk_blob.so 00:03:06.851 CC lib/blobfs/blobfs.o 00:03:06.851 CC lib/blobfs/tree.o 00:03:06.851 CC lib/lvol/lvol.o 00:03:06.851 LIB libspdk_nvme.a 00:03:07.109 SO libspdk_nvme.so.14.0 00:03:07.367 SYMLINK libspdk_nvme.so 00:03:07.625 LIB libspdk_bdev.a 00:03:07.625 SO libspdk_bdev.so.17.0 00:03:07.625 LIB libspdk_blobfs.a 00:03:07.625 SYMLINK libspdk_bdev.so 00:03:07.625 SO libspdk_blobfs.so.10.0 00:03:07.884 SYMLINK libspdk_blobfs.so 00:03:07.884 LIB libspdk_lvol.a 00:03:07.884 SO libspdk_lvol.so.10.0 00:03:07.884 CC lib/ublk/ublk.o 00:03:07.884 CC lib/ublk/ublk_rpc.o 00:03:07.884 CC lib/ftl/ftl_core.o 00:03:07.884 CC lib/ftl/ftl_init.o 00:03:07.884 CC lib/ftl/ftl_layout.o 00:03:07.884 CC lib/ftl/ftl_debug.o 00:03:07.884 CC lib/scsi/dev.o 00:03:07.884 CC lib/nbd/nbd.o 00:03:07.884 CC lib/nvmf/ctrlr.o 00:03:07.884 SYMLINK libspdk_lvol.so 00:03:07.884 CC lib/nvmf/ctrlr_discovery.o 00:03:08.143 CC lib/nbd/nbd_rpc.o 00:03:08.143 CC lib/scsi/lun.o 00:03:08.143 CC lib/scsi/port.o 00:03:08.143 CC lib/scsi/scsi.o 00:03:08.143 CC lib/nvmf/ctrlr_bdev.o 00:03:08.401 CC lib/ftl/ftl_io.o 00:03:08.401 CC lib/ftl/ftl_sb.o 00:03:08.401 CC lib/nvmf/subsystem.o 00:03:08.401 CC lib/scsi/scsi_bdev.o 00:03:08.401 LIB libspdk_nbd.a 00:03:08.401 SO libspdk_nbd.so.7.0 00:03:08.401 CC lib/scsi/scsi_pr.o 00:03:08.401 CC lib/nvmf/nvmf.o 00:03:08.401 SYMLINK libspdk_nbd.so 00:03:08.401 CC lib/ftl/ftl_l2p.o 00:03:08.659 LIB libspdk_ublk.a 00:03:08.659 CC lib/scsi/scsi_rpc.o 00:03:08.659 CC lib/nvmf/nvmf_rpc.o 00:03:08.659 SO libspdk_ublk.so.3.0 00:03:08.659 CC lib/nvmf/transport.o 00:03:08.659 SYMLINK libspdk_ublk.so 00:03:08.659 CC lib/nvmf/tcp.o 00:03:08.917 CC lib/ftl/ftl_l2p_flat.o 00:03:08.917 CC lib/ftl/ftl_nv_cache.o 00:03:08.917 CC lib/scsi/task.o 00:03:08.917 CC lib/nvmf/stubs.o 00:03:08.917 CC lib/nvmf/mdns_server.o 00:03:09.176 LIB libspdk_scsi.a 00:03:09.176 SO libspdk_scsi.so.9.0 00:03:09.176 SYMLINK libspdk_scsi.so 00:03:09.176 CC lib/ftl/ftl_band.o 00:03:09.434 CC lib/nvmf/rdma.o 00:03:09.434 CC lib/nvmf/auth.o 00:03:09.434 CC lib/ftl/ftl_band_ops.o 00:03:09.705 CC lib/iscsi/conn.o 00:03:09.705 CC lib/iscsi/init_grp.o 00:03:09.705 CC lib/iscsi/iscsi.o 00:03:09.705 CC lib/vhost/vhost.o 00:03:09.705 CC lib/ftl/ftl_writer.o 00:03:09.705 CC lib/vhost/vhost_rpc.o 00:03:09.705 CC lib/vhost/vhost_scsi.o 00:03:09.976 CC lib/iscsi/param.o 00:03:09.976 CC lib/ftl/ftl_rq.o 00:03:10.234 CC lib/ftl/ftl_reloc.o 00:03:10.234 CC lib/iscsi/portal_grp.o 00:03:10.234 CC lib/iscsi/tgt_node.o 00:03:10.234 CC lib/iscsi/iscsi_subsystem.o 00:03:10.234 CC lib/iscsi/iscsi_rpc.o 00:03:10.492 CC lib/vhost/vhost_blk.o 00:03:10.492 CC lib/ftl/ftl_l2p_cache.o 00:03:10.492 CC lib/ftl/ftl_p2l.o 00:03:10.492 CC lib/iscsi/task.o 00:03:10.750 CC lib/vhost/rte_vhost_user.o 00:03:10.750 CC lib/ftl/ftl_p2l_log.o 00:03:10.750 CC lib/ftl/mngt/ftl_mngt.o 00:03:10.750 CC lib/ftl/mngt/ftl_mngt_bdev.o 00:03:10.750 CC lib/ftl/mngt/ftl_mngt_shutdown.o 00:03:10.750 CC lib/ftl/mngt/ftl_mngt_startup.o 00:03:11.007 CC lib/ftl/mngt/ftl_mngt_md.o 00:03:11.007 CC lib/ftl/mngt/ftl_mngt_misc.o 00:03:11.007 CC lib/ftl/mngt/ftl_mngt_ioch.o 00:03:11.007 CC lib/ftl/mngt/ftl_mngt_l2p.o 00:03:11.007 CC lib/ftl/mngt/ftl_mngt_band.o 00:03:11.007 CC lib/ftl/mngt/ftl_mngt_self_test.o 00:03:11.265 LIB libspdk_iscsi.a 00:03:11.265 CC lib/ftl/mngt/ftl_mngt_p2l.o 00:03:11.265 CC lib/ftl/mngt/ftl_mngt_recovery.o 00:03:11.265 CC lib/ftl/mngt/ftl_mngt_upgrade.o 00:03:11.265 SO libspdk_iscsi.so.8.0 00:03:11.265 CC lib/ftl/utils/ftl_conf.o 00:03:11.265 CC lib/ftl/utils/ftl_md.o 00:03:11.265 CC lib/ftl/utils/ftl_mempool.o 00:03:11.265 LIB libspdk_nvmf.a 00:03:11.265 SYMLINK libspdk_iscsi.so 00:03:11.265 CC lib/ftl/utils/ftl_bitmap.o 00:03:11.523 CC lib/ftl/utils/ftl_property.o 00:03:11.523 CC lib/ftl/utils/ftl_layout_tracker_bdev.o 00:03:11.523 CC lib/ftl/upgrade/ftl_layout_upgrade.o 00:03:11.523 SO libspdk_nvmf.so.19.0 00:03:11.523 CC lib/ftl/upgrade/ftl_sb_upgrade.o 00:03:11.523 CC lib/ftl/upgrade/ftl_p2l_upgrade.o 00:03:11.523 CC lib/ftl/upgrade/ftl_band_upgrade.o 00:03:11.523 CC lib/ftl/upgrade/ftl_chunk_upgrade.o 00:03:11.781 CC lib/ftl/upgrade/ftl_trim_upgrade.o 00:03:11.781 SYMLINK libspdk_nvmf.so 00:03:11.781 CC lib/ftl/upgrade/ftl_sb_v3.o 00:03:11.781 CC lib/ftl/upgrade/ftl_sb_v5.o 00:03:11.781 CC lib/ftl/nvc/ftl_nvc_dev.o 00:03:11.781 CC lib/ftl/nvc/ftl_nvc_bdev_vss.o 00:03:11.781 CC lib/ftl/nvc/ftl_nvc_bdev_non_vss.o 00:03:11.781 CC lib/ftl/nvc/ftl_nvc_bdev_common.o 00:03:11.781 LIB libspdk_vhost.a 00:03:11.781 CC lib/ftl/base/ftl_base_dev.o 00:03:11.781 CC lib/ftl/base/ftl_base_bdev.o 00:03:11.781 SO libspdk_vhost.so.8.0 00:03:11.781 CC lib/ftl/ftl_trace.o 00:03:12.039 SYMLINK libspdk_vhost.so 00:03:12.040 LIB libspdk_ftl.a 00:03:12.297 SO libspdk_ftl.so.9.0 00:03:12.865 SYMLINK libspdk_ftl.so 00:03:13.124 CC module/env_dpdk/env_dpdk_rpc.o 00:03:13.124 CC module/accel/dsa/accel_dsa.o 00:03:13.124 CC module/sock/posix/posix.o 00:03:13.125 CC module/accel/ioat/accel_ioat.o 00:03:13.125 CC module/accel/iaa/accel_iaa.o 00:03:13.125 CC module/keyring/file/keyring.o 00:03:13.125 CC module/scheduler/dynamic/scheduler_dynamic.o 00:03:13.125 CC module/blob/bdev/blob_bdev.o 00:03:13.125 CC module/fsdev/aio/fsdev_aio.o 00:03:13.125 CC module/accel/error/accel_error.o 00:03:13.125 LIB libspdk_env_dpdk_rpc.a 00:03:13.125 SO libspdk_env_dpdk_rpc.so.6.0 00:03:13.125 SYMLINK libspdk_env_dpdk_rpc.so 00:03:13.125 CC module/fsdev/aio/fsdev_aio_rpc.o 00:03:13.383 CC module/keyring/file/keyring_rpc.o 00:03:13.383 CC module/accel/ioat/accel_ioat_rpc.o 00:03:13.383 CC module/accel/iaa/accel_iaa_rpc.o 00:03:13.383 CC module/accel/error/accel_error_rpc.o 00:03:13.383 LIB libspdk_scheduler_dynamic.a 00:03:13.383 SO libspdk_scheduler_dynamic.so.4.0 00:03:13.383 LIB libspdk_blob_bdev.a 00:03:13.383 CC module/accel/dsa/accel_dsa_rpc.o 00:03:13.383 CC module/fsdev/aio/linux_aio_mgr.o 00:03:13.383 LIB libspdk_keyring_file.a 00:03:13.383 SO libspdk_blob_bdev.so.11.0 00:03:13.383 SYMLINK libspdk_scheduler_dynamic.so 00:03:13.383 SO libspdk_keyring_file.so.2.0 00:03:13.383 LIB libspdk_accel_ioat.a 00:03:13.383 LIB libspdk_accel_iaa.a 00:03:13.383 LIB libspdk_accel_error.a 00:03:13.383 SO libspdk_accel_ioat.so.6.0 00:03:13.383 SYMLINK libspdk_blob_bdev.so 00:03:13.383 SO libspdk_accel_error.so.2.0 00:03:13.383 SO libspdk_accel_iaa.so.3.0 00:03:13.641 SYMLINK libspdk_keyring_file.so 00:03:13.641 SYMLINK libspdk_accel_ioat.so 00:03:13.641 LIB libspdk_accel_dsa.a 00:03:13.641 SYMLINK libspdk_accel_iaa.so 00:03:13.641 SYMLINK libspdk_accel_error.so 00:03:13.641 SO libspdk_accel_dsa.so.5.0 00:03:13.641 CC module/scheduler/dpdk_governor/dpdk_governor.o 00:03:13.641 SYMLINK libspdk_accel_dsa.so 00:03:13.641 CC module/keyring/linux/keyring.o 00:03:13.641 CC module/scheduler/gscheduler/gscheduler.o 00:03:13.641 LIB libspdk_fsdev_aio.a 00:03:13.900 LIB libspdk_scheduler_dpdk_governor.a 00:03:13.900 SO libspdk_fsdev_aio.so.1.0 00:03:13.900 CC module/bdev/delay/vbdev_delay.o 00:03:13.900 CC module/bdev/gpt/gpt.o 00:03:13.900 SO libspdk_scheduler_dpdk_governor.so.4.0 00:03:13.900 CC module/bdev/error/vbdev_error.o 00:03:13.900 CC module/bdev/lvol/vbdev_lvol.o 00:03:13.900 LIB libspdk_sock_posix.a 00:03:13.900 CC module/blobfs/bdev/blobfs_bdev.o 00:03:13.900 CC module/keyring/linux/keyring_rpc.o 00:03:13.900 SYMLINK libspdk_fsdev_aio.so 00:03:13.900 SO libspdk_sock_posix.so.6.0 00:03:13.900 CC module/bdev/lvol/vbdev_lvol_rpc.o 00:03:13.900 SYMLINK libspdk_scheduler_dpdk_governor.so 00:03:13.900 CC module/bdev/error/vbdev_error_rpc.o 00:03:13.900 LIB libspdk_scheduler_gscheduler.a 00:03:13.900 SO libspdk_scheduler_gscheduler.so.4.0 00:03:13.900 SYMLINK libspdk_sock_posix.so 00:03:13.900 LIB libspdk_keyring_linux.a 00:03:13.900 SYMLINK libspdk_scheduler_gscheduler.so 00:03:13.900 CC module/bdev/delay/vbdev_delay_rpc.o 00:03:13.900 SO libspdk_keyring_linux.so.1.0 00:03:13.900 CC module/blobfs/bdev/blobfs_bdev_rpc.o 00:03:13.900 CC module/bdev/gpt/vbdev_gpt.o 00:03:14.158 SYMLINK libspdk_keyring_linux.so 00:03:14.158 LIB libspdk_bdev_error.a 00:03:14.158 CC module/bdev/malloc/bdev_malloc.o 00:03:14.158 SO libspdk_bdev_error.so.6.0 00:03:14.158 LIB libspdk_bdev_delay.a 00:03:14.158 SYMLINK libspdk_bdev_error.so 00:03:14.158 SO libspdk_bdev_delay.so.6.0 00:03:14.158 LIB libspdk_blobfs_bdev.a 00:03:14.158 CC module/bdev/null/bdev_null.o 00:03:14.158 CC module/bdev/nvme/bdev_nvme.o 00:03:14.158 SO libspdk_blobfs_bdev.so.6.0 00:03:14.158 SYMLINK libspdk_bdev_delay.so 00:03:14.416 LIB libspdk_bdev_gpt.a 00:03:14.416 CC module/bdev/malloc/bdev_malloc_rpc.o 00:03:14.416 SYMLINK libspdk_blobfs_bdev.so 00:03:14.417 SO libspdk_bdev_gpt.so.6.0 00:03:14.417 CC module/bdev/passthru/vbdev_passthru.o 00:03:14.417 LIB libspdk_bdev_lvol.a 00:03:14.417 CC module/bdev/raid/bdev_raid.o 00:03:14.417 CC module/bdev/split/vbdev_split.o 00:03:14.417 SO libspdk_bdev_lvol.so.6.0 00:03:14.417 SYMLINK libspdk_bdev_gpt.so 00:03:14.417 CC module/bdev/split/vbdev_split_rpc.o 00:03:14.417 SYMLINK libspdk_bdev_lvol.so 00:03:14.417 CC module/bdev/nvme/bdev_nvme_rpc.o 00:03:14.417 CC module/bdev/raid/bdev_raid_rpc.o 00:03:14.417 LIB libspdk_bdev_malloc.a 00:03:14.417 CC module/bdev/null/bdev_null_rpc.o 00:03:14.417 CC module/bdev/zone_block/vbdev_zone_block.o 00:03:14.675 SO libspdk_bdev_malloc.so.6.0 00:03:14.675 SYMLINK libspdk_bdev_malloc.so 00:03:14.675 CC module/bdev/raid/bdev_raid_sb.o 00:03:14.675 CC module/bdev/zone_block/vbdev_zone_block_rpc.o 00:03:14.675 LIB libspdk_bdev_split.a 00:03:14.675 CC module/bdev/passthru/vbdev_passthru_rpc.o 00:03:14.675 SO libspdk_bdev_split.so.6.0 00:03:14.675 LIB libspdk_bdev_null.a 00:03:14.675 CC module/bdev/raid/raid0.o 00:03:14.675 SO libspdk_bdev_null.so.6.0 00:03:14.675 SYMLINK libspdk_bdev_split.so 00:03:14.675 CC module/bdev/raid/raid1.o 00:03:14.933 CC module/bdev/raid/concat.o 00:03:14.933 SYMLINK libspdk_bdev_null.so 00:03:14.933 LIB libspdk_bdev_passthru.a 00:03:14.933 LIB libspdk_bdev_zone_block.a 00:03:14.933 SO libspdk_bdev_passthru.so.6.0 00:03:14.933 SO libspdk_bdev_zone_block.so.6.0 00:03:14.933 CC module/bdev/nvme/nvme_rpc.o 00:03:14.933 SYMLINK libspdk_bdev_passthru.so 00:03:14.933 CC module/bdev/aio/bdev_aio.o 00:03:14.933 SYMLINK libspdk_bdev_zone_block.so 00:03:14.933 CC module/bdev/aio/bdev_aio_rpc.o 00:03:15.191 CC module/bdev/nvme/bdev_mdns_client.o 00:03:15.191 CC module/bdev/nvme/vbdev_opal.o 00:03:15.191 CC module/bdev/ftl/bdev_ftl.o 00:03:15.191 CC module/bdev/iscsi/bdev_iscsi.o 00:03:15.191 CC module/bdev/nvme/vbdev_opal_rpc.o 00:03:15.191 CC module/bdev/virtio/bdev_virtio_scsi.o 00:03:15.191 CC module/bdev/virtio/bdev_virtio_blk.o 00:03:15.191 LIB libspdk_bdev_raid.a 00:03:15.450 LIB libspdk_bdev_aio.a 00:03:15.450 SO libspdk_bdev_aio.so.6.0 00:03:15.450 CC module/bdev/virtio/bdev_virtio_rpc.o 00:03:15.450 CC module/bdev/ftl/bdev_ftl_rpc.o 00:03:15.450 SO libspdk_bdev_raid.so.6.0 00:03:15.450 CC module/bdev/iscsi/bdev_iscsi_rpc.o 00:03:15.450 SYMLINK libspdk_bdev_aio.so 00:03:15.450 CC module/bdev/nvme/bdev_nvme_cuse_rpc.o 00:03:15.450 SYMLINK libspdk_bdev_raid.so 00:03:15.450 LIB libspdk_bdev_iscsi.a 00:03:15.708 LIB libspdk_bdev_ftl.a 00:03:15.708 SO libspdk_bdev_iscsi.so.6.0 00:03:15.708 SO libspdk_bdev_ftl.so.6.0 00:03:15.708 SYMLINK libspdk_bdev_iscsi.so 00:03:15.708 LIB libspdk_bdev_virtio.a 00:03:15.708 SYMLINK libspdk_bdev_ftl.so 00:03:15.708 SO libspdk_bdev_virtio.so.6.0 00:03:15.708 SYMLINK libspdk_bdev_virtio.so 00:03:16.274 LIB libspdk_bdev_nvme.a 00:03:16.533 SO libspdk_bdev_nvme.so.7.0 00:03:16.533 SYMLINK libspdk_bdev_nvme.so 00:03:17.106 CC module/event/subsystems/sock/sock.o 00:03:17.106 CC module/event/subsystems/vmd/vmd.o 00:03:17.106 CC module/event/subsystems/vmd/vmd_rpc.o 00:03:17.106 CC module/event/subsystems/scheduler/scheduler.o 00:03:17.106 CC module/event/subsystems/keyring/keyring.o 00:03:17.106 CC module/event/subsystems/vhost_blk/vhost_blk.o 00:03:17.106 CC module/event/subsystems/iobuf/iobuf.o 00:03:17.106 CC module/event/subsystems/iobuf/iobuf_rpc.o 00:03:17.106 CC module/event/subsystems/fsdev/fsdev.o 00:03:17.106 LIB libspdk_event_scheduler.a 00:03:17.106 LIB libspdk_event_sock.a 00:03:17.106 LIB libspdk_event_keyring.a 00:03:17.106 SO libspdk_event_scheduler.so.4.0 00:03:17.106 LIB libspdk_event_vhost_blk.a 00:03:17.106 SO libspdk_event_sock.so.5.0 00:03:17.106 SO libspdk_event_keyring.so.1.0 00:03:17.106 LIB libspdk_event_vmd.a 00:03:17.106 LIB libspdk_event_iobuf.a 00:03:17.106 LIB libspdk_event_fsdev.a 00:03:17.365 SO libspdk_event_vhost_blk.so.3.0 00:03:17.365 SO libspdk_event_vmd.so.6.0 00:03:17.365 SYMLINK libspdk_event_keyring.so 00:03:17.365 SO libspdk_event_fsdev.so.1.0 00:03:17.365 SO libspdk_event_iobuf.so.3.0 00:03:17.365 SYMLINK libspdk_event_scheduler.so 00:03:17.365 SYMLINK libspdk_event_sock.so 00:03:17.365 SYMLINK libspdk_event_vhost_blk.so 00:03:17.365 SYMLINK libspdk_event_vmd.so 00:03:17.365 SYMLINK libspdk_event_fsdev.so 00:03:17.365 SYMLINK libspdk_event_iobuf.so 00:03:17.623 CC module/event/subsystems/accel/accel.o 00:03:17.623 LIB libspdk_event_accel.a 00:03:17.882 SO libspdk_event_accel.so.6.0 00:03:17.882 SYMLINK libspdk_event_accel.so 00:03:18.140 CC module/event/subsystems/bdev/bdev.o 00:03:18.398 LIB libspdk_event_bdev.a 00:03:18.398 SO libspdk_event_bdev.so.6.0 00:03:18.398 SYMLINK libspdk_event_bdev.so 00:03:18.656 CC module/event/subsystems/ublk/ublk.o 00:03:18.656 CC module/event/subsystems/nbd/nbd.o 00:03:18.656 CC module/event/subsystems/scsi/scsi.o 00:03:18.656 CC module/event/subsystems/nvmf/nvmf_rpc.o 00:03:18.656 CC module/event/subsystems/nvmf/nvmf_tgt.o 00:03:18.914 LIB libspdk_event_nbd.a 00:03:18.915 LIB libspdk_event_ublk.a 00:03:18.915 LIB libspdk_event_scsi.a 00:03:18.915 SO libspdk_event_nbd.so.6.0 00:03:18.915 SO libspdk_event_ublk.so.3.0 00:03:18.915 SO libspdk_event_scsi.so.6.0 00:03:18.915 SYMLINK libspdk_event_nbd.so 00:03:18.915 SYMLINK libspdk_event_ublk.so 00:03:18.915 LIB libspdk_event_nvmf.a 00:03:19.206 SYMLINK libspdk_event_scsi.so 00:03:19.206 SO libspdk_event_nvmf.so.6.0 00:03:19.206 SYMLINK libspdk_event_nvmf.so 00:03:19.206 CC module/event/subsystems/iscsi/iscsi.o 00:03:19.206 CC module/event/subsystems/vhost_scsi/vhost_scsi.o 00:03:19.473 LIB libspdk_event_iscsi.a 00:03:19.473 LIB libspdk_event_vhost_scsi.a 00:03:19.473 SO libspdk_event_iscsi.so.6.0 00:03:19.473 SO libspdk_event_vhost_scsi.so.3.0 00:03:19.473 SYMLINK libspdk_event_iscsi.so 00:03:19.473 SYMLINK libspdk_event_vhost_scsi.so 00:03:19.730 SO libspdk.so.6.0 00:03:19.730 SYMLINK libspdk.so 00:03:19.988 CC app/spdk_lspci/spdk_lspci.o 00:03:19.988 CC app/spdk_nvme_perf/perf.o 00:03:19.988 CXX app/trace/trace.o 00:03:19.988 CC app/trace_record/trace_record.o 00:03:19.988 CC app/spdk_nvme_identify/identify.o 00:03:19.988 CC app/iscsi_tgt/iscsi_tgt.o 00:03:19.988 CC app/nvmf_tgt/nvmf_main.o 00:03:19.988 CC app/spdk_tgt/spdk_tgt.o 00:03:19.988 CC test/thread/poller_perf/poller_perf.o 00:03:20.247 CC examples/util/zipf/zipf.o 00:03:20.247 LINK spdk_lspci 00:03:20.247 LINK nvmf_tgt 00:03:20.247 LINK spdk_trace_record 00:03:20.247 LINK poller_perf 00:03:20.247 LINK iscsi_tgt 00:03:20.247 LINK zipf 00:03:20.505 LINK spdk_tgt 00:03:20.505 LINK spdk_trace 00:03:20.505 CC app/spdk_nvme_discover/discovery_aer.o 00:03:20.505 CC app/spdk_top/spdk_top.o 00:03:20.763 CC app/spdk_dd/spdk_dd.o 00:03:20.763 LINK spdk_nvme_discover 00:03:20.763 CC examples/ioat/perf/perf.o 00:03:20.763 CC test/dma/test_dma/test_dma.o 00:03:20.763 CC app/vhost/vhost.o 00:03:20.763 CC app/fio/nvme/fio_plugin.o 00:03:20.763 CC examples/vmd/lsvmd/lsvmd.o 00:03:20.763 LINK spdk_nvme_perf 00:03:20.763 LINK spdk_nvme_identify 00:03:21.021 LINK ioat_perf 00:03:21.021 LINK lsvmd 00:03:21.021 LINK vhost 00:03:21.021 LINK spdk_dd 00:03:21.021 CC test/app/bdev_svc/bdev_svc.o 00:03:21.021 TEST_HEADER include/spdk/accel.h 00:03:21.021 TEST_HEADER include/spdk/accel_module.h 00:03:21.021 TEST_HEADER include/spdk/assert.h 00:03:21.021 TEST_HEADER include/spdk/barrier.h 00:03:21.021 TEST_HEADER include/spdk/base64.h 00:03:21.021 TEST_HEADER include/spdk/bdev.h 00:03:21.021 TEST_HEADER include/spdk/bdev_module.h 00:03:21.021 TEST_HEADER include/spdk/bdev_zone.h 00:03:21.021 TEST_HEADER include/spdk/bit_array.h 00:03:21.021 TEST_HEADER include/spdk/bit_pool.h 00:03:21.021 TEST_HEADER include/spdk/blob_bdev.h 00:03:21.021 TEST_HEADER include/spdk/blobfs_bdev.h 00:03:21.021 TEST_HEADER include/spdk/blobfs.h 00:03:21.021 TEST_HEADER include/spdk/blob.h 00:03:21.021 TEST_HEADER include/spdk/conf.h 00:03:21.021 TEST_HEADER include/spdk/config.h 00:03:21.021 TEST_HEADER include/spdk/cpuset.h 00:03:21.021 TEST_HEADER include/spdk/crc16.h 00:03:21.021 TEST_HEADER include/spdk/crc32.h 00:03:21.021 TEST_HEADER include/spdk/crc64.h 00:03:21.021 TEST_HEADER include/spdk/dif.h 00:03:21.021 TEST_HEADER include/spdk/dma.h 00:03:21.021 TEST_HEADER include/spdk/endian.h 00:03:21.021 TEST_HEADER include/spdk/env_dpdk.h 00:03:21.021 TEST_HEADER include/spdk/env.h 00:03:21.279 TEST_HEADER include/spdk/event.h 00:03:21.279 TEST_HEADER include/spdk/fd_group.h 00:03:21.279 TEST_HEADER include/spdk/fd.h 00:03:21.279 TEST_HEADER include/spdk/file.h 00:03:21.279 TEST_HEADER include/spdk/fsdev.h 00:03:21.279 TEST_HEADER include/spdk/fsdev_module.h 00:03:21.279 TEST_HEADER include/spdk/ftl.h 00:03:21.279 CC test/app/fuzz/nvme_fuzz/nvme_fuzz.o 00:03:21.279 TEST_HEADER include/spdk/fuse_dispatcher.h 00:03:21.279 TEST_HEADER include/spdk/gpt_spec.h 00:03:21.279 CC examples/ioat/verify/verify.o 00:03:21.279 TEST_HEADER include/spdk/hexlify.h 00:03:21.279 TEST_HEADER include/spdk/histogram_data.h 00:03:21.279 TEST_HEADER include/spdk/idxd.h 00:03:21.279 TEST_HEADER include/spdk/idxd_spec.h 00:03:21.279 TEST_HEADER include/spdk/init.h 00:03:21.279 TEST_HEADER include/spdk/ioat.h 00:03:21.279 TEST_HEADER include/spdk/ioat_spec.h 00:03:21.279 TEST_HEADER include/spdk/iscsi_spec.h 00:03:21.279 TEST_HEADER include/spdk/json.h 00:03:21.279 TEST_HEADER include/spdk/jsonrpc.h 00:03:21.279 TEST_HEADER include/spdk/keyring.h 00:03:21.279 TEST_HEADER include/spdk/keyring_module.h 00:03:21.279 TEST_HEADER include/spdk/likely.h 00:03:21.279 TEST_HEADER include/spdk/log.h 00:03:21.279 TEST_HEADER include/spdk/lvol.h 00:03:21.279 TEST_HEADER include/spdk/md5.h 00:03:21.279 TEST_HEADER include/spdk/memory.h 00:03:21.279 TEST_HEADER include/spdk/mmio.h 00:03:21.279 TEST_HEADER include/spdk/nbd.h 00:03:21.279 CC examples/vmd/led/led.o 00:03:21.279 TEST_HEADER include/spdk/net.h 00:03:21.279 TEST_HEADER include/spdk/notify.h 00:03:21.279 TEST_HEADER include/spdk/nvme.h 00:03:21.279 TEST_HEADER include/spdk/nvme_intel.h 00:03:21.279 TEST_HEADER include/spdk/nvme_ocssd.h 00:03:21.279 TEST_HEADER include/spdk/nvme_ocssd_spec.h 00:03:21.279 TEST_HEADER include/spdk/nvme_spec.h 00:03:21.279 TEST_HEADER include/spdk/nvme_zns.h 00:03:21.279 TEST_HEADER include/spdk/nvmf_cmd.h 00:03:21.279 TEST_HEADER include/spdk/nvmf_fc_spec.h 00:03:21.279 TEST_HEADER include/spdk/nvmf.h 00:03:21.279 TEST_HEADER include/spdk/nvmf_spec.h 00:03:21.280 TEST_HEADER include/spdk/nvmf_transport.h 00:03:21.280 TEST_HEADER include/spdk/opal.h 00:03:21.280 TEST_HEADER include/spdk/opal_spec.h 00:03:21.280 TEST_HEADER include/spdk/pci_ids.h 00:03:21.280 TEST_HEADER include/spdk/pipe.h 00:03:21.280 TEST_HEADER include/spdk/queue.h 00:03:21.280 TEST_HEADER include/spdk/reduce.h 00:03:21.280 TEST_HEADER include/spdk/rpc.h 00:03:21.280 TEST_HEADER include/spdk/scheduler.h 00:03:21.280 LINK test_dma 00:03:21.280 TEST_HEADER include/spdk/scsi.h 00:03:21.280 LINK bdev_svc 00:03:21.280 TEST_HEADER include/spdk/scsi_spec.h 00:03:21.280 TEST_HEADER include/spdk/sock.h 00:03:21.280 TEST_HEADER include/spdk/stdinc.h 00:03:21.280 TEST_HEADER include/spdk/string.h 00:03:21.280 TEST_HEADER include/spdk/thread.h 00:03:21.280 TEST_HEADER include/spdk/trace.h 00:03:21.280 TEST_HEADER include/spdk/trace_parser.h 00:03:21.280 TEST_HEADER include/spdk/tree.h 00:03:21.280 TEST_HEADER include/spdk/ublk.h 00:03:21.280 TEST_HEADER include/spdk/util.h 00:03:21.280 TEST_HEADER include/spdk/uuid.h 00:03:21.280 TEST_HEADER include/spdk/version.h 00:03:21.280 TEST_HEADER include/spdk/vfio_user_pci.h 00:03:21.280 TEST_HEADER include/spdk/vfio_user_spec.h 00:03:21.280 TEST_HEADER include/spdk/vhost.h 00:03:21.280 TEST_HEADER include/spdk/vmd.h 00:03:21.280 TEST_HEADER include/spdk/xor.h 00:03:21.280 TEST_HEADER include/spdk/zipf.h 00:03:21.280 CXX test/cpp_headers/accel.o 00:03:21.280 LINK spdk_nvme 00:03:21.280 LINK led 00:03:21.538 CC test/env/mem_callbacks/mem_callbacks.o 00:03:21.538 LINK verify 00:03:21.538 CC test/event/event_perf/event_perf.o 00:03:21.538 CXX test/cpp_headers/accel_module.o 00:03:21.538 CC app/fio/bdev/fio_plugin.o 00:03:21.538 CC test/rpc_client/rpc_client_test.o 00:03:21.538 CC test/event/reactor/reactor.o 00:03:21.538 LINK nvme_fuzz 00:03:21.538 LINK spdk_top 00:03:21.538 LINK event_perf 00:03:21.796 CXX test/cpp_headers/assert.o 00:03:21.796 LINK reactor 00:03:21.796 LINK rpc_client_test 00:03:21.796 CC examples/idxd/perf/perf.o 00:03:21.796 CC test/accel/dif/dif.o 00:03:21.796 CC test/app/fuzz/iscsi_fuzz/iscsi_fuzz.o 00:03:21.796 CC test/event/reactor_perf/reactor_perf.o 00:03:21.796 CXX test/cpp_headers/barrier.o 00:03:21.796 CC test/event/app_repeat/app_repeat.o 00:03:22.055 CC test/app/histogram_perf/histogram_perf.o 00:03:22.055 LINK mem_callbacks 00:03:22.055 CXX test/cpp_headers/base64.o 00:03:22.055 LINK reactor_perf 00:03:22.055 LINK app_repeat 00:03:22.055 LINK spdk_bdev 00:03:22.055 LINK histogram_perf 00:03:22.313 LINK idxd_perf 00:03:22.313 CXX test/cpp_headers/bdev.o 00:03:22.313 CC test/env/vtophys/vtophys.o 00:03:22.313 CC test/event/scheduler/scheduler.o 00:03:22.313 CC examples/interrupt_tgt/interrupt_tgt.o 00:03:22.313 CC test/env/env_dpdk_post_init/env_dpdk_post_init.o 00:03:22.313 LINK vtophys 00:03:22.571 CC examples/thread/thread/thread_ex.o 00:03:22.571 CC examples/sock/hello_world/hello_sock.o 00:03:22.571 CXX test/cpp_headers/bdev_module.o 00:03:22.571 LINK dif 00:03:22.571 LINK interrupt_tgt 00:03:22.571 LINK scheduler 00:03:22.571 CXX test/cpp_headers/bdev_zone.o 00:03:22.571 LINK env_dpdk_post_init 00:03:22.830 LINK thread 00:03:22.830 LINK hello_sock 00:03:22.830 CC test/env/memory/memory_ut.o 00:03:22.830 CXX test/cpp_headers/bit_array.o 00:03:22.830 CC test/env/pci/pci_ut.o 00:03:22.830 CC test/app/jsoncat/jsoncat.o 00:03:22.830 CC test/app/stub/stub.o 00:03:22.830 CXX test/cpp_headers/bit_pool.o 00:03:23.089 LINK jsoncat 00:03:23.089 CC test/blobfs/mkfs/mkfs.o 00:03:23.089 LINK stub 00:03:23.089 CXX test/cpp_headers/blob_bdev.o 00:03:23.089 CC examples/nvme/hello_world/hello_world.o 00:03:23.089 CC examples/fsdev/hello_world/hello_fsdev.o 00:03:23.348 LINK pci_ut 00:03:23.348 LINK mkfs 00:03:23.348 CC examples/nvme/reconnect/reconnect.o 00:03:23.348 CXX test/cpp_headers/blobfs_bdev.o 00:03:23.348 LINK hello_world 00:03:23.606 CC examples/accel/perf/accel_perf.o 00:03:23.606 CXX test/cpp_headers/blobfs.o 00:03:23.606 LINK hello_fsdev 00:03:23.606 LINK iscsi_fuzz 00:03:23.606 CC test/app/fuzz/vhost_fuzz/vhost_fuzz_rpc.o 00:03:23.606 LINK reconnect 00:03:23.874 CC examples/blob/hello_world/hello_blob.o 00:03:23.874 CC examples/blob/cli/blobcli.o 00:03:23.874 CC test/app/fuzz/vhost_fuzz/vhost_fuzz.o 00:03:23.874 CXX test/cpp_headers/blob.o 00:03:23.874 CC examples/nvme/nvme_manage/nvme_manage.o 00:03:23.874 CXX test/cpp_headers/conf.o 00:03:23.874 CC examples/nvme/arbitration/arbitration.o 00:03:24.132 LINK hello_blob 00:03:24.132 LINK memory_ut 00:03:24.132 LINK accel_perf 00:03:24.132 CC test/lvol/esnap/esnap.o 00:03:24.132 CXX test/cpp_headers/config.o 00:03:24.132 CXX test/cpp_headers/cpuset.o 00:03:24.132 LINK vhost_fuzz 00:03:24.390 LINK blobcli 00:03:24.391 LINK arbitration 00:03:24.391 CC examples/nvme/hotplug/hotplug.o 00:03:24.391 CXX test/cpp_headers/crc16.o 00:03:24.391 CC examples/nvme/cmb_copy/cmb_copy.o 00:03:24.391 CC examples/nvme/abort/abort.o 00:03:24.391 CC examples/nvme/pmr_persistence/pmr_persistence.o 00:03:24.391 LINK nvme_manage 00:03:24.649 CXX test/cpp_headers/crc32.o 00:03:24.649 LINK cmb_copy 00:03:24.649 CXX test/cpp_headers/crc64.o 00:03:24.649 LINK hotplug 00:03:24.649 LINK pmr_persistence 00:03:24.907 LINK abort 00:03:24.907 CC examples/bdev/hello_world/hello_bdev.o 00:03:24.907 CXX test/cpp_headers/dif.o 00:03:24.907 CC test/nvme/aer/aer.o 00:03:24.907 CXX test/cpp_headers/dma.o 00:03:24.907 CC test/nvme/reset/reset.o 00:03:24.907 CC test/nvme/sgl/sgl.o 00:03:24.907 CXX test/cpp_headers/endian.o 00:03:25.165 CC examples/bdev/bdevperf/bdevperf.o 00:03:25.165 LINK hello_bdev 00:03:25.165 CC test/nvme/e2edp/nvme_dp.o 00:03:25.165 CXX test/cpp_headers/env_dpdk.o 00:03:25.165 LINK aer 00:03:25.422 LINK reset 00:03:25.422 LINK sgl 00:03:25.422 CC test/bdev/bdevio/bdevio.o 00:03:25.422 CXX test/cpp_headers/env.o 00:03:25.422 CC test/nvme/overhead/overhead.o 00:03:25.422 LINK nvme_dp 00:03:25.680 CC test/nvme/err_injection/err_injection.o 00:03:25.680 CXX test/cpp_headers/event.o 00:03:25.680 CC test/nvme/startup/startup.o 00:03:25.680 CC test/nvme/reserve/reserve.o 00:03:25.680 CXX test/cpp_headers/fd_group.o 00:03:25.680 LINK err_injection 00:03:25.680 LINK bdevio 00:03:25.680 LINK startup 00:03:25.680 CC test/nvme/simple_copy/simple_copy.o 00:03:25.939 LINK reserve 00:03:25.939 LINK overhead 00:03:25.939 LINK bdevperf 00:03:25.939 CXX test/cpp_headers/fd.o 00:03:25.939 CXX test/cpp_headers/file.o 00:03:26.197 LINK simple_copy 00:03:26.197 CC test/nvme/connect_stress/connect_stress.o 00:03:26.197 CC test/nvme/boot_partition/boot_partition.o 00:03:26.197 CXX test/cpp_headers/fsdev.o 00:03:26.197 CXX test/cpp_headers/fsdev_module.o 00:03:26.455 CC test/nvme/compliance/nvme_compliance.o 00:03:26.455 CXX test/cpp_headers/ftl.o 00:03:26.455 CC test/nvme/fused_ordering/fused_ordering.o 00:03:26.455 LINK boot_partition 00:03:26.455 LINK connect_stress 00:03:26.715 CC test/nvme/doorbell_aers/doorbell_aers.o 00:03:26.715 CXX test/cpp_headers/fuse_dispatcher.o 00:03:26.715 CC test/nvme/fdp/fdp.o 00:03:26.715 LINK fused_ordering 00:03:26.715 CC test/nvme/cuse/cuse.o 00:03:26.715 LINK nvme_compliance 00:03:26.715 CXX test/cpp_headers/gpt_spec.o 00:03:26.974 CXX test/cpp_headers/hexlify.o 00:03:26.974 LINK doorbell_aers 00:03:26.974 CXX test/cpp_headers/histogram_data.o 00:03:26.974 CXX test/cpp_headers/idxd.o 00:03:26.974 CC examples/nvmf/nvmf/nvmf.o 00:03:26.974 CXX test/cpp_headers/idxd_spec.o 00:03:27.233 CXX test/cpp_headers/init.o 00:03:27.233 LINK fdp 00:03:27.233 CXX test/cpp_headers/ioat.o 00:03:27.233 CXX test/cpp_headers/ioat_spec.o 00:03:27.233 CXX test/cpp_headers/iscsi_spec.o 00:03:27.233 CXX test/cpp_headers/json.o 00:03:27.233 CXX test/cpp_headers/jsonrpc.o 00:03:27.492 CXX test/cpp_headers/keyring.o 00:03:27.492 CXX test/cpp_headers/keyring_module.o 00:03:27.492 CXX test/cpp_headers/likely.o 00:03:27.492 CXX test/cpp_headers/log.o 00:03:27.492 LINK nvmf 00:03:27.492 CXX test/cpp_headers/lvol.o 00:03:27.492 CXX test/cpp_headers/md5.o 00:03:27.492 CXX test/cpp_headers/memory.o 00:03:27.492 CXX test/cpp_headers/mmio.o 00:03:27.492 CXX test/cpp_headers/nbd.o 00:03:27.750 CXX test/cpp_headers/net.o 00:03:27.750 CXX test/cpp_headers/notify.o 00:03:27.750 CXX test/cpp_headers/nvme.o 00:03:27.750 CXX test/cpp_headers/nvme_intel.o 00:03:27.750 CXX test/cpp_headers/nvme_ocssd.o 00:03:27.750 CXX test/cpp_headers/nvme_ocssd_spec.o 00:03:27.750 CXX test/cpp_headers/nvme_spec.o 00:03:27.750 CXX test/cpp_headers/nvme_zns.o 00:03:28.009 CXX test/cpp_headers/nvmf_cmd.o 00:03:28.009 CXX test/cpp_headers/nvmf_fc_spec.o 00:03:28.009 CXX test/cpp_headers/nvmf.o 00:03:28.009 CXX test/cpp_headers/nvmf_spec.o 00:03:28.009 CXX test/cpp_headers/nvmf_transport.o 00:03:28.009 CXX test/cpp_headers/opal.o 00:03:28.009 CXX test/cpp_headers/opal_spec.o 00:03:28.009 CXX test/cpp_headers/pci_ids.o 00:03:28.267 CXX test/cpp_headers/pipe.o 00:03:28.267 CXX test/cpp_headers/queue.o 00:03:28.267 CXX test/cpp_headers/reduce.o 00:03:28.267 CXX test/cpp_headers/rpc.o 00:03:28.267 CXX test/cpp_headers/scheduler.o 00:03:28.267 CXX test/cpp_headers/scsi.o 00:03:28.267 CXX test/cpp_headers/scsi_spec.o 00:03:28.267 LINK cuse 00:03:28.267 CXX test/cpp_headers/sock.o 00:03:28.267 CXX test/cpp_headers/stdinc.o 00:03:28.267 CXX test/cpp_headers/string.o 00:03:28.267 CXX test/cpp_headers/thread.o 00:03:28.525 CXX test/cpp_headers/trace.o 00:03:28.525 CXX test/cpp_headers/trace_parser.o 00:03:28.525 CXX test/cpp_headers/tree.o 00:03:28.525 CXX test/cpp_headers/ublk.o 00:03:28.525 CXX test/cpp_headers/util.o 00:03:28.525 CXX test/cpp_headers/uuid.o 00:03:28.526 CXX test/cpp_headers/version.o 00:03:28.526 CXX test/cpp_headers/vfio_user_pci.o 00:03:28.526 CXX test/cpp_headers/vfio_user_spec.o 00:03:28.526 CXX test/cpp_headers/vhost.o 00:03:28.526 CXX test/cpp_headers/vmd.o 00:03:28.526 CXX test/cpp_headers/xor.o 00:03:28.784 CXX test/cpp_headers/zipf.o 00:03:30.196 LINK esnap 00:03:30.455 00:03:30.455 real 1m31.901s 00:03:30.455 user 8m26.402s 00:03:30.455 sys 1m48.603s 00:03:30.455 11:14:11 make -- common/autotest_common.sh@1126 -- $ xtrace_disable 00:03:30.455 11:14:11 make -- common/autotest_common.sh@10 -- $ set +x 00:03:30.455 ************************************ 00:03:30.455 END TEST make 00:03:30.455 ************************************ 00:03:30.455 11:14:12 -- spdk/autobuild.sh@1 -- $ stop_monitor_resources 00:03:30.455 11:14:12 -- pm/common@29 -- $ signal_monitor_resources TERM 00:03:30.455 11:14:12 -- pm/common@40 -- $ local monitor pid pids signal=TERM 00:03:30.455 11:14:12 -- pm/common@42 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:03:30.455 11:14:12 -- pm/common@43 -- $ [[ -e /home/vagrant/spdk_repo/spdk/../output/power/collect-cpu-load.pid ]] 00:03:30.455 11:14:12 -- pm/common@44 -- $ pid=5289 00:03:30.455 11:14:12 -- pm/common@50 -- $ kill -TERM 5289 00:03:30.455 11:14:12 -- pm/common@42 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:03:30.455 11:14:12 -- pm/common@43 -- $ [[ -e /home/vagrant/spdk_repo/spdk/../output/power/collect-vmstat.pid ]] 00:03:30.455 11:14:12 -- pm/common@44 -- $ pid=5291 00:03:30.455 11:14:12 -- pm/common@50 -- $ kill -TERM 5291 00:03:30.455 11:14:12 -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:03:30.455 11:14:12 -- common/autotest_common.sh@1681 -- # lcov --version 00:03:30.455 11:14:12 -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:03:30.714 11:14:12 -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:03:30.714 11:14:12 -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:03:30.714 11:14:12 -- scripts/common.sh@333 -- # local ver1 ver1_l 00:03:30.714 11:14:12 -- scripts/common.sh@334 -- # local ver2 ver2_l 00:03:30.714 11:14:12 -- scripts/common.sh@336 -- # IFS=.-: 00:03:30.714 11:14:12 -- scripts/common.sh@336 -- # read -ra ver1 00:03:30.714 11:14:12 -- scripts/common.sh@337 -- # IFS=.-: 00:03:30.714 11:14:12 -- scripts/common.sh@337 -- # read -ra ver2 00:03:30.714 11:14:12 -- scripts/common.sh@338 -- # local 'op=<' 00:03:30.714 11:14:12 -- scripts/common.sh@340 -- # ver1_l=2 00:03:30.714 11:14:12 -- scripts/common.sh@341 -- # ver2_l=1 00:03:30.714 11:14:12 -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:03:30.714 11:14:12 -- scripts/common.sh@344 -- # case "$op" in 00:03:30.714 11:14:12 -- scripts/common.sh@345 -- # : 1 00:03:30.714 11:14:12 -- scripts/common.sh@364 -- # (( v = 0 )) 00:03:30.714 11:14:12 -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:03:30.714 11:14:12 -- scripts/common.sh@365 -- # decimal 1 00:03:30.714 11:14:12 -- scripts/common.sh@353 -- # local d=1 00:03:30.714 11:14:12 -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:03:30.714 11:14:12 -- scripts/common.sh@355 -- # echo 1 00:03:30.714 11:14:12 -- scripts/common.sh@365 -- # ver1[v]=1 00:03:30.714 11:14:12 -- scripts/common.sh@366 -- # decimal 2 00:03:30.714 11:14:12 -- scripts/common.sh@353 -- # local d=2 00:03:30.714 11:14:12 -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:03:30.714 11:14:12 -- scripts/common.sh@355 -- # echo 2 00:03:30.714 11:14:12 -- scripts/common.sh@366 -- # ver2[v]=2 00:03:30.714 11:14:12 -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:03:30.714 11:14:12 -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:03:30.714 11:14:12 -- scripts/common.sh@368 -- # return 0 00:03:30.714 11:14:12 -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:03:30.714 11:14:12 -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:03:30.714 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:30.714 --rc genhtml_branch_coverage=1 00:03:30.714 --rc genhtml_function_coverage=1 00:03:30.714 --rc genhtml_legend=1 00:03:30.714 --rc geninfo_all_blocks=1 00:03:30.714 --rc geninfo_unexecuted_blocks=1 00:03:30.714 00:03:30.714 ' 00:03:30.714 11:14:12 -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:03:30.714 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:30.714 --rc genhtml_branch_coverage=1 00:03:30.714 --rc genhtml_function_coverage=1 00:03:30.714 --rc genhtml_legend=1 00:03:30.714 --rc geninfo_all_blocks=1 00:03:30.714 --rc geninfo_unexecuted_blocks=1 00:03:30.714 00:03:30.714 ' 00:03:30.714 11:14:12 -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:03:30.714 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:30.714 --rc genhtml_branch_coverage=1 00:03:30.714 --rc genhtml_function_coverage=1 00:03:30.714 --rc genhtml_legend=1 00:03:30.714 --rc geninfo_all_blocks=1 00:03:30.714 --rc geninfo_unexecuted_blocks=1 00:03:30.714 00:03:30.714 ' 00:03:30.714 11:14:12 -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:03:30.714 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:30.714 --rc genhtml_branch_coverage=1 00:03:30.714 --rc genhtml_function_coverage=1 00:03:30.714 --rc genhtml_legend=1 00:03:30.714 --rc geninfo_all_blocks=1 00:03:30.714 --rc geninfo_unexecuted_blocks=1 00:03:30.714 00:03:30.714 ' 00:03:30.714 11:14:12 -- spdk/autotest.sh@25 -- # source /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh 00:03:30.714 11:14:12 -- nvmf/common.sh@7 -- # uname -s 00:03:30.714 11:14:12 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:03:30.714 11:14:12 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:03:30.714 11:14:12 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:03:30.714 11:14:12 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:03:30.714 11:14:12 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:03:30.714 11:14:12 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:03:30.714 11:14:12 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:03:30.714 11:14:12 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:03:30.714 11:14:12 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:03:30.714 11:14:12 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:03:30.714 11:14:12 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:03:30.714 11:14:12 -- nvmf/common.sh@18 -- # NVME_HOSTID=3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:03:30.714 11:14:12 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:03:30.714 11:14:12 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:03:30.714 11:14:12 -- nvmf/common.sh@21 -- # NET_TYPE=virt 00:03:30.714 11:14:12 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:03:30.714 11:14:12 -- nvmf/common.sh@49 -- # source /home/vagrant/spdk_repo/spdk/scripts/common.sh 00:03:30.714 11:14:12 -- scripts/common.sh@15 -- # shopt -s extglob 00:03:30.714 11:14:12 -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:03:30.714 11:14:12 -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:03:30.714 11:14:12 -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:03:30.714 11:14:12 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:03:30.714 11:14:12 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:03:30.714 11:14:12 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:03:30.714 11:14:12 -- paths/export.sh@5 -- # export PATH 00:03:30.714 11:14:12 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:03:30.714 11:14:12 -- nvmf/common.sh@51 -- # : 0 00:03:30.714 11:14:12 -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:03:30.714 11:14:12 -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:03:30.714 11:14:12 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:03:30.714 11:14:12 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:03:30.714 11:14:12 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:03:30.714 11:14:12 -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:03:30.714 /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:03:30.714 11:14:12 -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:03:30.714 11:14:12 -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:03:30.714 11:14:12 -- nvmf/common.sh@55 -- # have_pci_nics=0 00:03:30.714 11:14:12 -- spdk/autotest.sh@27 -- # '[' 0 -ne 0 ']' 00:03:30.714 11:14:12 -- spdk/autotest.sh@32 -- # uname -s 00:03:30.714 11:14:12 -- spdk/autotest.sh@32 -- # '[' Linux = Linux ']' 00:03:30.714 11:14:12 -- spdk/autotest.sh@33 -- # old_core_pattern='|/usr/lib/systemd/systemd-coredump %P %u %g %s %t %c %h' 00:03:30.714 11:14:12 -- spdk/autotest.sh@34 -- # mkdir -p /home/vagrant/spdk_repo/spdk/../output/coredumps 00:03:30.714 11:14:12 -- spdk/autotest.sh@39 -- # echo '|/home/vagrant/spdk_repo/spdk/scripts/core-collector.sh %P %s %t' 00:03:30.714 11:14:12 -- spdk/autotest.sh@40 -- # echo /home/vagrant/spdk_repo/spdk/../output/coredumps 00:03:30.714 11:14:12 -- spdk/autotest.sh@44 -- # modprobe nbd 00:03:30.714 11:14:12 -- spdk/autotest.sh@46 -- # type -P udevadm 00:03:30.714 11:14:12 -- spdk/autotest.sh@46 -- # udevadm=/usr/sbin/udevadm 00:03:30.714 11:14:12 -- spdk/autotest.sh@48 -- # udevadm_pid=56139 00:03:30.714 11:14:12 -- spdk/autotest.sh@47 -- # /usr/sbin/udevadm monitor --property 00:03:30.714 11:14:12 -- spdk/autotest.sh@53 -- # start_monitor_resources 00:03:30.714 11:14:12 -- pm/common@17 -- # local monitor 00:03:30.714 11:14:12 -- pm/common@19 -- # for monitor in "${MONITOR_RESOURCES[@]}" 00:03:30.714 11:14:12 -- pm/common@19 -- # for monitor in "${MONITOR_RESOURCES[@]}" 00:03:30.714 11:14:12 -- pm/common@25 -- # sleep 1 00:03:30.714 11:14:12 -- pm/common@21 -- # date +%s 00:03:30.714 11:14:12 -- pm/common@21 -- # date +%s 00:03:30.714 11:14:12 -- pm/common@21 -- # /home/vagrant/spdk_repo/spdk/scripts/perf/pm/collect-vmstat -d /home/vagrant/spdk_repo/spdk/../output/power -l -p monitor.autotest.sh.1728299652 00:03:30.714 11:14:12 -- pm/common@21 -- # /home/vagrant/spdk_repo/spdk/scripts/perf/pm/collect-cpu-load -d /home/vagrant/spdk_repo/spdk/../output/power -l -p monitor.autotest.sh.1728299652 00:03:30.714 Redirecting to /home/vagrant/spdk_repo/spdk/../output/power/monitor.autotest.sh.1728299652_collect-vmstat.pm.log 00:03:30.714 Redirecting to /home/vagrant/spdk_repo/spdk/../output/power/monitor.autotest.sh.1728299652_collect-cpu-load.pm.log 00:03:31.649 11:14:13 -- spdk/autotest.sh@55 -- # trap 'autotest_cleanup || :; exit 1' SIGINT SIGTERM EXIT 00:03:31.649 11:14:13 -- spdk/autotest.sh@57 -- # timing_enter autotest 00:03:31.649 11:14:13 -- common/autotest_common.sh@724 -- # xtrace_disable 00:03:31.649 11:14:13 -- common/autotest_common.sh@10 -- # set +x 00:03:31.649 11:14:13 -- spdk/autotest.sh@59 -- # create_test_list 00:03:31.649 11:14:13 -- common/autotest_common.sh@748 -- # xtrace_disable 00:03:31.649 11:14:13 -- common/autotest_common.sh@10 -- # set +x 00:03:31.908 11:14:13 -- spdk/autotest.sh@61 -- # dirname /home/vagrant/spdk_repo/spdk/autotest.sh 00:03:31.908 11:14:13 -- spdk/autotest.sh@61 -- # readlink -f /home/vagrant/spdk_repo/spdk 00:03:31.908 11:14:13 -- spdk/autotest.sh@61 -- # src=/home/vagrant/spdk_repo/spdk 00:03:31.908 11:14:13 -- spdk/autotest.sh@62 -- # out=/home/vagrant/spdk_repo/spdk/../output 00:03:31.908 11:14:13 -- spdk/autotest.sh@63 -- # cd /home/vagrant/spdk_repo/spdk 00:03:31.908 11:14:13 -- spdk/autotest.sh@65 -- # freebsd_update_contigmem_mod 00:03:31.908 11:14:13 -- common/autotest_common.sh@1455 -- # uname 00:03:31.908 11:14:13 -- common/autotest_common.sh@1455 -- # '[' Linux = FreeBSD ']' 00:03:31.908 11:14:13 -- spdk/autotest.sh@66 -- # freebsd_set_maxsock_buf 00:03:31.908 11:14:13 -- common/autotest_common.sh@1475 -- # uname 00:03:31.908 11:14:13 -- common/autotest_common.sh@1475 -- # [[ Linux = FreeBSD ]] 00:03:31.908 11:14:13 -- spdk/autotest.sh@68 -- # [[ y == y ]] 00:03:31.908 11:14:13 -- spdk/autotest.sh@70 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 --version 00:03:31.908 lcov: LCOV version 1.15 00:03:31.908 11:14:13 -- spdk/autotest.sh@72 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -c --no-external -i -t Baseline -d /home/vagrant/spdk_repo/spdk -o /home/vagrant/spdk_repo/spdk/../output/cov_base.info 00:03:50.021 /home/vagrant/spdk_repo/spdk/lib/nvme/nvme_stubs.gcno:no functions found 00:03:50.021 geninfo: WARNING: GCOV did not produce any data for /home/vagrant/spdk_repo/spdk/lib/nvme/nvme_stubs.gcno 00:04:04.905 11:14:45 -- spdk/autotest.sh@76 -- # timing_enter pre_cleanup 00:04:04.905 11:14:45 -- common/autotest_common.sh@724 -- # xtrace_disable 00:04:04.905 11:14:45 -- common/autotest_common.sh@10 -- # set +x 00:04:04.905 11:14:45 -- spdk/autotest.sh@78 -- # rm -f 00:04:04.905 11:14:45 -- spdk/autotest.sh@81 -- # /home/vagrant/spdk_repo/spdk/scripts/setup.sh reset 00:04:04.905 0000:00:03.0 (1af4 1001): Active devices: mount@vda:vda2,mount@vda:vda3,mount@vda:vda5, so not binding PCI dev 00:04:04.905 0000:00:11.0 (1b36 0010): Already using the nvme driver 00:04:04.905 0000:00:10.0 (1b36 0010): Already using the nvme driver 00:04:04.905 11:14:46 -- spdk/autotest.sh@83 -- # get_zoned_devs 00:04:04.905 11:14:46 -- common/autotest_common.sh@1655 -- # zoned_devs=() 00:04:04.905 11:14:46 -- common/autotest_common.sh@1655 -- # local -gA zoned_devs 00:04:04.905 11:14:46 -- common/autotest_common.sh@1656 -- # local nvme bdf 00:04:04.905 11:14:46 -- common/autotest_common.sh@1658 -- # for nvme in /sys/block/nvme* 00:04:04.905 11:14:46 -- common/autotest_common.sh@1659 -- # is_block_zoned nvme0n1 00:04:04.905 11:14:46 -- common/autotest_common.sh@1648 -- # local device=nvme0n1 00:04:04.905 11:14:46 -- common/autotest_common.sh@1650 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:04:04.905 11:14:46 -- common/autotest_common.sh@1651 -- # [[ none != none ]] 00:04:04.905 11:14:46 -- common/autotest_common.sh@1658 -- # for nvme in /sys/block/nvme* 00:04:04.905 11:14:46 -- common/autotest_common.sh@1659 -- # is_block_zoned nvme1n1 00:04:04.905 11:14:46 -- common/autotest_common.sh@1648 -- # local device=nvme1n1 00:04:04.905 11:14:46 -- common/autotest_common.sh@1650 -- # [[ -e /sys/block/nvme1n1/queue/zoned ]] 00:04:04.905 11:14:46 -- common/autotest_common.sh@1651 -- # [[ none != none ]] 00:04:04.905 11:14:46 -- common/autotest_common.sh@1658 -- # for nvme in /sys/block/nvme* 00:04:04.905 11:14:46 -- common/autotest_common.sh@1659 -- # is_block_zoned nvme1n2 00:04:04.905 11:14:46 -- common/autotest_common.sh@1648 -- # local device=nvme1n2 00:04:04.905 11:14:46 -- common/autotest_common.sh@1650 -- # [[ -e /sys/block/nvme1n2/queue/zoned ]] 00:04:04.905 11:14:46 -- common/autotest_common.sh@1651 -- # [[ none != none ]] 00:04:04.905 11:14:46 -- common/autotest_common.sh@1658 -- # for nvme in /sys/block/nvme* 00:04:04.905 11:14:46 -- common/autotest_common.sh@1659 -- # is_block_zoned nvme1n3 00:04:04.905 11:14:46 -- common/autotest_common.sh@1648 -- # local device=nvme1n3 00:04:04.905 11:14:46 -- common/autotest_common.sh@1650 -- # [[ -e /sys/block/nvme1n3/queue/zoned ]] 00:04:04.905 11:14:46 -- common/autotest_common.sh@1651 -- # [[ none != none ]] 00:04:04.905 11:14:46 -- spdk/autotest.sh@85 -- # (( 0 > 0 )) 00:04:04.905 11:14:46 -- spdk/autotest.sh@97 -- # for dev in /dev/nvme*n!(*p*) 00:04:04.905 11:14:46 -- spdk/autotest.sh@99 -- # [[ -z '' ]] 00:04:04.905 11:14:46 -- spdk/autotest.sh@100 -- # block_in_use /dev/nvme0n1 00:04:04.905 11:14:46 -- scripts/common.sh@381 -- # local block=/dev/nvme0n1 pt 00:04:04.905 11:14:46 -- scripts/common.sh@390 -- # /home/vagrant/spdk_repo/spdk/scripts/spdk-gpt.py /dev/nvme0n1 00:04:04.905 No valid GPT data, bailing 00:04:04.905 11:14:46 -- scripts/common.sh@394 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:04:04.905 11:14:46 -- scripts/common.sh@394 -- # pt= 00:04:04.905 11:14:46 -- scripts/common.sh@395 -- # return 1 00:04:04.905 11:14:46 -- spdk/autotest.sh@101 -- # dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=1 00:04:04.905 1+0 records in 00:04:04.905 1+0 records out 00:04:04.905 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00412394 s, 254 MB/s 00:04:04.905 11:14:46 -- spdk/autotest.sh@97 -- # for dev in /dev/nvme*n!(*p*) 00:04:04.905 11:14:46 -- spdk/autotest.sh@99 -- # [[ -z '' ]] 00:04:04.905 11:14:46 -- spdk/autotest.sh@100 -- # block_in_use /dev/nvme1n1 00:04:04.905 11:14:46 -- scripts/common.sh@381 -- # local block=/dev/nvme1n1 pt 00:04:04.905 11:14:46 -- scripts/common.sh@390 -- # /home/vagrant/spdk_repo/spdk/scripts/spdk-gpt.py /dev/nvme1n1 00:04:04.905 No valid GPT data, bailing 00:04:04.905 11:14:46 -- scripts/common.sh@394 -- # blkid -s PTTYPE -o value /dev/nvme1n1 00:04:04.905 11:14:46 -- scripts/common.sh@394 -- # pt= 00:04:04.905 11:14:46 -- scripts/common.sh@395 -- # return 1 00:04:04.905 11:14:46 -- spdk/autotest.sh@101 -- # dd if=/dev/zero of=/dev/nvme1n1 bs=1M count=1 00:04:04.905 1+0 records in 00:04:04.905 1+0 records out 00:04:04.905 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00468077 s, 224 MB/s 00:04:04.905 11:14:46 -- spdk/autotest.sh@97 -- # for dev in /dev/nvme*n!(*p*) 00:04:04.905 11:14:46 -- spdk/autotest.sh@99 -- # [[ -z '' ]] 00:04:04.905 11:14:46 -- spdk/autotest.sh@100 -- # block_in_use /dev/nvme1n2 00:04:04.905 11:14:46 -- scripts/common.sh@381 -- # local block=/dev/nvme1n2 pt 00:04:04.905 11:14:46 -- scripts/common.sh@390 -- # /home/vagrant/spdk_repo/spdk/scripts/spdk-gpt.py /dev/nvme1n2 00:04:04.905 No valid GPT data, bailing 00:04:04.905 11:14:46 -- scripts/common.sh@394 -- # blkid -s PTTYPE -o value /dev/nvme1n2 00:04:04.905 11:14:46 -- scripts/common.sh@394 -- # pt= 00:04:04.905 11:14:46 -- scripts/common.sh@395 -- # return 1 00:04:04.905 11:14:46 -- spdk/autotest.sh@101 -- # dd if=/dev/zero of=/dev/nvme1n2 bs=1M count=1 00:04:04.905 1+0 records in 00:04:04.905 1+0 records out 00:04:04.905 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00448084 s, 234 MB/s 00:04:04.905 11:14:46 -- spdk/autotest.sh@97 -- # for dev in /dev/nvme*n!(*p*) 00:04:04.905 11:14:46 -- spdk/autotest.sh@99 -- # [[ -z '' ]] 00:04:04.905 11:14:46 -- spdk/autotest.sh@100 -- # block_in_use /dev/nvme1n3 00:04:04.905 11:14:46 -- scripts/common.sh@381 -- # local block=/dev/nvme1n3 pt 00:04:04.905 11:14:46 -- scripts/common.sh@390 -- # /home/vagrant/spdk_repo/spdk/scripts/spdk-gpt.py /dev/nvme1n3 00:04:05.164 No valid GPT data, bailing 00:04:05.164 11:14:46 -- scripts/common.sh@394 -- # blkid -s PTTYPE -o value /dev/nvme1n3 00:04:05.164 11:14:46 -- scripts/common.sh@394 -- # pt= 00:04:05.164 11:14:46 -- scripts/common.sh@395 -- # return 1 00:04:05.164 11:14:46 -- spdk/autotest.sh@101 -- # dd if=/dev/zero of=/dev/nvme1n3 bs=1M count=1 00:04:05.164 1+0 records in 00:04:05.164 1+0 records out 00:04:05.164 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00425535 s, 246 MB/s 00:04:05.164 11:14:46 -- spdk/autotest.sh@105 -- # sync 00:04:05.164 11:14:46 -- spdk/autotest.sh@107 -- # xtrace_disable_per_cmd reap_spdk_processes 00:04:05.164 11:14:46 -- common/autotest_common.sh@22 -- # eval 'reap_spdk_processes 12> /dev/null' 00:04:05.164 11:14:46 -- common/autotest_common.sh@22 -- # reap_spdk_processes 00:04:07.066 11:14:48 -- spdk/autotest.sh@111 -- # uname -s 00:04:07.066 11:14:48 -- spdk/autotest.sh@111 -- # [[ Linux == Linux ]] 00:04:07.066 11:14:48 -- spdk/autotest.sh@111 -- # [[ 0 -eq 1 ]] 00:04:07.066 11:14:48 -- spdk/autotest.sh@115 -- # /home/vagrant/spdk_repo/spdk/scripts/setup.sh status 00:04:08.001 0000:00:03.0 (1af4 1001): Active devices: mount@vda:vda2,mount@vda:vda3,mount@vda:vda5, so not binding PCI dev 00:04:08.001 Hugepages 00:04:08.001 node hugesize free / total 00:04:08.001 node0 1048576kB 0 / 0 00:04:08.001 node0 2048kB 0 / 0 00:04:08.001 00:04:08.001 Type BDF Vendor Device NUMA Driver Device Block devices 00:04:08.001 virtio 0000:00:03.0 1af4 1001 unknown virtio-pci - vda 00:04:08.001 NVMe 0000:00:10.0 1b36 0010 unknown nvme nvme0 nvme0n1 00:04:08.001 NVMe 0000:00:11.0 1b36 0010 unknown nvme nvme1 nvme1n1 nvme1n2 nvme1n3 00:04:08.001 11:14:49 -- spdk/autotest.sh@117 -- # uname -s 00:04:08.001 11:14:49 -- spdk/autotest.sh@117 -- # [[ Linux == Linux ]] 00:04:08.001 11:14:49 -- spdk/autotest.sh@119 -- # nvme_namespace_revert 00:04:08.001 11:14:49 -- common/autotest_common.sh@1514 -- # /home/vagrant/spdk_repo/spdk/scripts/setup.sh 00:04:08.937 0000:00:03.0 (1af4 1001): Active devices: mount@vda:vda2,mount@vda:vda3,mount@vda:vda5, so not binding PCI dev 00:04:08.937 0000:00:10.0 (1b36 0010): nvme -> uio_pci_generic 00:04:08.937 0000:00:11.0 (1b36 0010): nvme -> uio_pci_generic 00:04:08.937 11:14:50 -- common/autotest_common.sh@1515 -- # sleep 1 00:04:09.870 11:14:51 -- common/autotest_common.sh@1516 -- # bdfs=() 00:04:09.870 11:14:51 -- common/autotest_common.sh@1516 -- # local bdfs 00:04:09.870 11:14:51 -- common/autotest_common.sh@1518 -- # bdfs=($(get_nvme_bdfs)) 00:04:09.870 11:14:51 -- common/autotest_common.sh@1518 -- # get_nvme_bdfs 00:04:09.870 11:14:51 -- common/autotest_common.sh@1496 -- # bdfs=() 00:04:09.870 11:14:51 -- common/autotest_common.sh@1496 -- # local bdfs 00:04:09.870 11:14:51 -- common/autotest_common.sh@1497 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:04:09.870 11:14:51 -- common/autotest_common.sh@1497 -- # jq -r '.config[].params.traddr' 00:04:09.870 11:14:51 -- common/autotest_common.sh@1497 -- # /home/vagrant/spdk_repo/spdk/scripts/gen_nvme.sh 00:04:09.870 11:14:51 -- common/autotest_common.sh@1498 -- # (( 2 == 0 )) 00:04:09.870 11:14:51 -- common/autotest_common.sh@1502 -- # printf '%s\n' 0000:00:10.0 0000:00:11.0 00:04:09.870 11:14:51 -- common/autotest_common.sh@1520 -- # /home/vagrant/spdk_repo/spdk/scripts/setup.sh reset 00:04:10.436 0000:00:03.0 (1af4 1001): Active devices: mount@vda:vda2,mount@vda:vda3,mount@vda:vda5, so not binding PCI dev 00:04:10.436 Waiting for block devices as requested 00:04:10.436 0000:00:11.0 (1b36 0010): uio_pci_generic -> nvme 00:04:10.436 0000:00:10.0 (1b36 0010): uio_pci_generic -> nvme 00:04:10.695 11:14:52 -- common/autotest_common.sh@1522 -- # for bdf in "${bdfs[@]}" 00:04:10.695 11:14:52 -- common/autotest_common.sh@1523 -- # get_nvme_ctrlr_from_bdf 0000:00:10.0 00:04:10.695 11:14:52 -- common/autotest_common.sh@1485 -- # readlink -f /sys/class/nvme/nvme0 /sys/class/nvme/nvme1 00:04:10.695 11:14:52 -- common/autotest_common.sh@1485 -- # grep 0000:00:10.0/nvme/nvme 00:04:10.695 11:14:52 -- common/autotest_common.sh@1485 -- # bdf_sysfs_path=/sys/devices/pci0000:00/0000:00:10.0/nvme/nvme1 00:04:10.695 11:14:52 -- common/autotest_common.sh@1486 -- # [[ -z /sys/devices/pci0000:00/0000:00:10.0/nvme/nvme1 ]] 00:04:10.695 11:14:52 -- common/autotest_common.sh@1490 -- # basename /sys/devices/pci0000:00/0000:00:10.0/nvme/nvme1 00:04:10.695 11:14:52 -- common/autotest_common.sh@1490 -- # printf '%s\n' nvme1 00:04:10.695 11:14:52 -- common/autotest_common.sh@1523 -- # nvme_ctrlr=/dev/nvme1 00:04:10.695 11:14:52 -- common/autotest_common.sh@1524 -- # [[ -z /dev/nvme1 ]] 00:04:10.695 11:14:52 -- common/autotest_common.sh@1529 -- # grep oacs 00:04:10.695 11:14:52 -- common/autotest_common.sh@1529 -- # nvme id-ctrl /dev/nvme1 00:04:10.695 11:14:52 -- common/autotest_common.sh@1529 -- # cut -d: -f2 00:04:10.695 11:14:52 -- common/autotest_common.sh@1529 -- # oacs=' 0x12a' 00:04:10.695 11:14:52 -- common/autotest_common.sh@1530 -- # oacs_ns_manage=8 00:04:10.695 11:14:52 -- common/autotest_common.sh@1532 -- # [[ 8 -ne 0 ]] 00:04:10.695 11:14:52 -- common/autotest_common.sh@1538 -- # nvme id-ctrl /dev/nvme1 00:04:10.695 11:14:52 -- common/autotest_common.sh@1538 -- # grep unvmcap 00:04:10.695 11:14:52 -- common/autotest_common.sh@1538 -- # cut -d: -f2 00:04:10.695 11:14:52 -- common/autotest_common.sh@1538 -- # unvmcap=' 0' 00:04:10.695 11:14:52 -- common/autotest_common.sh@1539 -- # [[ 0 -eq 0 ]] 00:04:10.695 11:14:52 -- common/autotest_common.sh@1541 -- # continue 00:04:10.695 11:14:52 -- common/autotest_common.sh@1522 -- # for bdf in "${bdfs[@]}" 00:04:10.695 11:14:52 -- common/autotest_common.sh@1523 -- # get_nvme_ctrlr_from_bdf 0000:00:11.0 00:04:10.695 11:14:52 -- common/autotest_common.sh@1485 -- # grep 0000:00:11.0/nvme/nvme 00:04:10.695 11:14:52 -- common/autotest_common.sh@1485 -- # readlink -f /sys/class/nvme/nvme0 /sys/class/nvme/nvme1 00:04:10.695 11:14:52 -- common/autotest_common.sh@1485 -- # bdf_sysfs_path=/sys/devices/pci0000:00/0000:00:11.0/nvme/nvme0 00:04:10.695 11:14:52 -- common/autotest_common.sh@1486 -- # [[ -z /sys/devices/pci0000:00/0000:00:11.0/nvme/nvme0 ]] 00:04:10.695 11:14:52 -- common/autotest_common.sh@1490 -- # basename /sys/devices/pci0000:00/0000:00:11.0/nvme/nvme0 00:04:10.695 11:14:52 -- common/autotest_common.sh@1490 -- # printf '%s\n' nvme0 00:04:10.695 11:14:52 -- common/autotest_common.sh@1523 -- # nvme_ctrlr=/dev/nvme0 00:04:10.695 11:14:52 -- common/autotest_common.sh@1524 -- # [[ -z /dev/nvme0 ]] 00:04:10.695 11:14:52 -- common/autotest_common.sh@1529 -- # nvme id-ctrl /dev/nvme0 00:04:10.695 11:14:52 -- common/autotest_common.sh@1529 -- # grep oacs 00:04:10.695 11:14:52 -- common/autotest_common.sh@1529 -- # cut -d: -f2 00:04:10.695 11:14:52 -- common/autotest_common.sh@1529 -- # oacs=' 0x12a' 00:04:10.695 11:14:52 -- common/autotest_common.sh@1530 -- # oacs_ns_manage=8 00:04:10.695 11:14:52 -- common/autotest_common.sh@1532 -- # [[ 8 -ne 0 ]] 00:04:10.695 11:14:52 -- common/autotest_common.sh@1538 -- # nvme id-ctrl /dev/nvme0 00:04:10.695 11:14:52 -- common/autotest_common.sh@1538 -- # grep unvmcap 00:04:10.695 11:14:52 -- common/autotest_common.sh@1538 -- # cut -d: -f2 00:04:10.695 11:14:52 -- common/autotest_common.sh@1538 -- # unvmcap=' 0' 00:04:10.695 11:14:52 -- common/autotest_common.sh@1539 -- # [[ 0 -eq 0 ]] 00:04:10.695 11:14:52 -- common/autotest_common.sh@1541 -- # continue 00:04:10.695 11:14:52 -- spdk/autotest.sh@122 -- # timing_exit pre_cleanup 00:04:10.695 11:14:52 -- common/autotest_common.sh@730 -- # xtrace_disable 00:04:10.695 11:14:52 -- common/autotest_common.sh@10 -- # set +x 00:04:10.695 11:14:52 -- spdk/autotest.sh@125 -- # timing_enter afterboot 00:04:10.695 11:14:52 -- common/autotest_common.sh@724 -- # xtrace_disable 00:04:10.695 11:14:52 -- common/autotest_common.sh@10 -- # set +x 00:04:10.695 11:14:52 -- spdk/autotest.sh@126 -- # /home/vagrant/spdk_repo/spdk/scripts/setup.sh 00:04:11.262 0000:00:03.0 (1af4 1001): Active devices: mount@vda:vda2,mount@vda:vda3,mount@vda:vda5, so not binding PCI dev 00:04:11.520 0000:00:10.0 (1b36 0010): nvme -> uio_pci_generic 00:04:11.520 0000:00:11.0 (1b36 0010): nvme -> uio_pci_generic 00:04:11.520 11:14:53 -- spdk/autotest.sh@127 -- # timing_exit afterboot 00:04:11.520 11:14:53 -- common/autotest_common.sh@730 -- # xtrace_disable 00:04:11.520 11:14:53 -- common/autotest_common.sh@10 -- # set +x 00:04:11.520 11:14:53 -- spdk/autotest.sh@131 -- # opal_revert_cleanup 00:04:11.520 11:14:53 -- common/autotest_common.sh@1576 -- # mapfile -t bdfs 00:04:11.520 11:14:53 -- common/autotest_common.sh@1576 -- # get_nvme_bdfs_by_id 0x0a54 00:04:11.520 11:14:53 -- common/autotest_common.sh@1561 -- # bdfs=() 00:04:11.520 11:14:53 -- common/autotest_common.sh@1561 -- # _bdfs=() 00:04:11.520 11:14:53 -- common/autotest_common.sh@1561 -- # local bdfs _bdfs 00:04:11.520 11:14:53 -- common/autotest_common.sh@1562 -- # _bdfs=($(get_nvme_bdfs)) 00:04:11.520 11:14:53 -- common/autotest_common.sh@1562 -- # get_nvme_bdfs 00:04:11.520 11:14:53 -- common/autotest_common.sh@1496 -- # bdfs=() 00:04:11.520 11:14:53 -- common/autotest_common.sh@1496 -- # local bdfs 00:04:11.520 11:14:53 -- common/autotest_common.sh@1497 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:04:11.520 11:14:53 -- common/autotest_common.sh@1497 -- # /home/vagrant/spdk_repo/spdk/scripts/gen_nvme.sh 00:04:11.520 11:14:53 -- common/autotest_common.sh@1497 -- # jq -r '.config[].params.traddr' 00:04:11.778 11:14:53 -- common/autotest_common.sh@1498 -- # (( 2 == 0 )) 00:04:11.778 11:14:53 -- common/autotest_common.sh@1502 -- # printf '%s\n' 0000:00:10.0 0000:00:11.0 00:04:11.778 11:14:53 -- common/autotest_common.sh@1563 -- # for bdf in "${_bdfs[@]}" 00:04:11.778 11:14:53 -- common/autotest_common.sh@1564 -- # cat /sys/bus/pci/devices/0000:00:10.0/device 00:04:11.778 11:14:53 -- common/autotest_common.sh@1564 -- # device=0x0010 00:04:11.778 11:14:53 -- common/autotest_common.sh@1565 -- # [[ 0x0010 == \0\x\0\a\5\4 ]] 00:04:11.778 11:14:53 -- common/autotest_common.sh@1563 -- # for bdf in "${_bdfs[@]}" 00:04:11.778 11:14:53 -- common/autotest_common.sh@1564 -- # cat /sys/bus/pci/devices/0000:00:11.0/device 00:04:11.778 11:14:53 -- common/autotest_common.sh@1564 -- # device=0x0010 00:04:11.778 11:14:53 -- common/autotest_common.sh@1565 -- # [[ 0x0010 == \0\x\0\a\5\4 ]] 00:04:11.778 11:14:53 -- common/autotest_common.sh@1570 -- # (( 0 > 0 )) 00:04:11.778 11:14:53 -- common/autotest_common.sh@1570 -- # return 0 00:04:11.778 11:14:53 -- common/autotest_common.sh@1577 -- # [[ -z '' ]] 00:04:11.778 11:14:53 -- common/autotest_common.sh@1578 -- # return 0 00:04:11.778 11:14:53 -- spdk/autotest.sh@137 -- # '[' 0 -eq 1 ']' 00:04:11.778 11:14:53 -- spdk/autotest.sh@141 -- # '[' 1 -eq 1 ']' 00:04:11.778 11:14:53 -- spdk/autotest.sh@142 -- # [[ 0 -eq 1 ]] 00:04:11.778 11:14:53 -- spdk/autotest.sh@142 -- # [[ 0 -eq 1 ]] 00:04:11.778 11:14:53 -- spdk/autotest.sh@149 -- # timing_enter lib 00:04:11.778 11:14:53 -- common/autotest_common.sh@724 -- # xtrace_disable 00:04:11.778 11:14:53 -- common/autotest_common.sh@10 -- # set +x 00:04:11.778 11:14:53 -- spdk/autotest.sh@151 -- # [[ 0 -eq 1 ]] 00:04:11.778 11:14:53 -- spdk/autotest.sh@155 -- # run_test env /home/vagrant/spdk_repo/spdk/test/env/env.sh 00:04:11.778 11:14:53 -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:04:11.778 11:14:53 -- common/autotest_common.sh@1107 -- # xtrace_disable 00:04:11.778 11:14:53 -- common/autotest_common.sh@10 -- # set +x 00:04:11.778 ************************************ 00:04:11.778 START TEST env 00:04:11.778 ************************************ 00:04:11.778 11:14:53 env -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/env/env.sh 00:04:11.778 * Looking for test storage... 00:04:11.778 * Found test storage at /home/vagrant/spdk_repo/spdk/test/env 00:04:11.778 11:14:53 env -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:04:11.778 11:14:53 env -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:04:11.778 11:14:53 env -- common/autotest_common.sh@1681 -- # lcov --version 00:04:11.778 11:14:53 env -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:04:11.778 11:14:53 env -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:04:11.778 11:14:53 env -- scripts/common.sh@333 -- # local ver1 ver1_l 00:04:11.778 11:14:53 env -- scripts/common.sh@334 -- # local ver2 ver2_l 00:04:11.778 11:14:53 env -- scripts/common.sh@336 -- # IFS=.-: 00:04:11.778 11:14:53 env -- scripts/common.sh@336 -- # read -ra ver1 00:04:11.778 11:14:53 env -- scripts/common.sh@337 -- # IFS=.-: 00:04:11.778 11:14:53 env -- scripts/common.sh@337 -- # read -ra ver2 00:04:11.778 11:14:53 env -- scripts/common.sh@338 -- # local 'op=<' 00:04:11.778 11:14:53 env -- scripts/common.sh@340 -- # ver1_l=2 00:04:11.778 11:14:53 env -- scripts/common.sh@341 -- # ver2_l=1 00:04:11.778 11:14:53 env -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:04:11.778 11:14:53 env -- scripts/common.sh@344 -- # case "$op" in 00:04:11.778 11:14:53 env -- scripts/common.sh@345 -- # : 1 00:04:11.778 11:14:53 env -- scripts/common.sh@364 -- # (( v = 0 )) 00:04:11.778 11:14:53 env -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:11.778 11:14:53 env -- scripts/common.sh@365 -- # decimal 1 00:04:11.778 11:14:53 env -- scripts/common.sh@353 -- # local d=1 00:04:11.779 11:14:53 env -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:11.779 11:14:53 env -- scripts/common.sh@355 -- # echo 1 00:04:11.779 11:14:53 env -- scripts/common.sh@365 -- # ver1[v]=1 00:04:12.037 11:14:53 env -- scripts/common.sh@366 -- # decimal 2 00:04:12.037 11:14:53 env -- scripts/common.sh@353 -- # local d=2 00:04:12.037 11:14:53 env -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:12.037 11:14:53 env -- scripts/common.sh@355 -- # echo 2 00:04:12.037 11:14:53 env -- scripts/common.sh@366 -- # ver2[v]=2 00:04:12.037 11:14:53 env -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:04:12.037 11:14:53 env -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:04:12.037 11:14:53 env -- scripts/common.sh@368 -- # return 0 00:04:12.037 11:14:53 env -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:12.037 11:14:53 env -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:04:12.037 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:12.037 --rc genhtml_branch_coverage=1 00:04:12.037 --rc genhtml_function_coverage=1 00:04:12.037 --rc genhtml_legend=1 00:04:12.037 --rc geninfo_all_blocks=1 00:04:12.037 --rc geninfo_unexecuted_blocks=1 00:04:12.037 00:04:12.037 ' 00:04:12.037 11:14:53 env -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:04:12.037 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:12.037 --rc genhtml_branch_coverage=1 00:04:12.037 --rc genhtml_function_coverage=1 00:04:12.037 --rc genhtml_legend=1 00:04:12.037 --rc geninfo_all_blocks=1 00:04:12.037 --rc geninfo_unexecuted_blocks=1 00:04:12.037 00:04:12.037 ' 00:04:12.037 11:14:53 env -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:04:12.037 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:12.037 --rc genhtml_branch_coverage=1 00:04:12.037 --rc genhtml_function_coverage=1 00:04:12.037 --rc genhtml_legend=1 00:04:12.037 --rc geninfo_all_blocks=1 00:04:12.037 --rc geninfo_unexecuted_blocks=1 00:04:12.037 00:04:12.037 ' 00:04:12.037 11:14:53 env -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:04:12.037 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:12.037 --rc genhtml_branch_coverage=1 00:04:12.037 --rc genhtml_function_coverage=1 00:04:12.037 --rc genhtml_legend=1 00:04:12.037 --rc geninfo_all_blocks=1 00:04:12.037 --rc geninfo_unexecuted_blocks=1 00:04:12.037 00:04:12.037 ' 00:04:12.037 11:14:53 env -- env/env.sh@10 -- # run_test env_memory /home/vagrant/spdk_repo/spdk/test/env/memory/memory_ut 00:04:12.037 11:14:53 env -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:04:12.037 11:14:53 env -- common/autotest_common.sh@1107 -- # xtrace_disable 00:04:12.037 11:14:53 env -- common/autotest_common.sh@10 -- # set +x 00:04:12.037 ************************************ 00:04:12.037 START TEST env_memory 00:04:12.037 ************************************ 00:04:12.037 11:14:53 env.env_memory -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/env/memory/memory_ut 00:04:12.037 00:04:12.037 00:04:12.037 CUnit - A unit testing framework for C - Version 2.1-3 00:04:12.037 http://cunit.sourceforge.net/ 00:04:12.037 00:04:12.037 00:04:12.037 Suite: memory 00:04:12.037 Test: alloc and free memory map ...[2024-10-07 11:14:53.551236] /home/vagrant/spdk_repo/spdk/lib/env_dpdk/memory.c: 283:spdk_mem_map_alloc: *ERROR*: Initial mem_map notify failed 00:04:12.037 passed 00:04:12.037 Test: mem map translation ...[2024-10-07 11:14:53.582109] /home/vagrant/spdk_repo/spdk/lib/env_dpdk/memory.c: 595:spdk_mem_map_set_translation: *ERROR*: invalid spdk_mem_map_set_translation parameters, vaddr=2097152 len=1234 00:04:12.037 [2024-10-07 11:14:53.582148] /home/vagrant/spdk_repo/spdk/lib/env_dpdk/memory.c: 595:spdk_mem_map_set_translation: *ERROR*: invalid spdk_mem_map_set_translation parameters, vaddr=1234 len=2097152 00:04:12.037 [2024-10-07 11:14:53.582204] /home/vagrant/spdk_repo/spdk/lib/env_dpdk/memory.c: 589:spdk_mem_map_set_translation: *ERROR*: invalid usermode virtual address 281474976710656 00:04:12.037 [2024-10-07 11:14:53.582215] /home/vagrant/spdk_repo/spdk/lib/env_dpdk/memory.c: 605:spdk_mem_map_set_translation: *ERROR*: could not get 0xffffffe00000 map 00:04:12.037 passed 00:04:12.037 Test: mem map registration ...[2024-10-07 11:14:53.646202] /home/vagrant/spdk_repo/spdk/lib/env_dpdk/memory.c: 347:spdk_mem_register: *ERROR*: invalid spdk_mem_register parameters, vaddr=200000 len=1234 00:04:12.037 [2024-10-07 11:14:53.646253] /home/vagrant/spdk_repo/spdk/lib/env_dpdk/memory.c: 347:spdk_mem_register: *ERROR*: invalid spdk_mem_register parameters, vaddr=4d2 len=2097152 00:04:12.037 passed 00:04:12.037 Test: mem map adjacent registrations ...passed 00:04:12.037 00:04:12.037 Run Summary: Type Total Ran Passed Failed Inactive 00:04:12.037 suites 1 1 n/a 0 0 00:04:12.037 tests 4 4 4 0 0 00:04:12.037 asserts 152 152 152 0 n/a 00:04:12.037 00:04:12.037 Elapsed time = 0.214 seconds 00:04:12.037 00:04:12.037 real 0m0.231s 00:04:12.037 user 0m0.214s 00:04:12.037 sys 0m0.012s 00:04:12.037 11:14:53 env.env_memory -- common/autotest_common.sh@1126 -- # xtrace_disable 00:04:12.037 11:14:53 env.env_memory -- common/autotest_common.sh@10 -- # set +x 00:04:12.037 ************************************ 00:04:12.037 END TEST env_memory 00:04:12.037 ************************************ 00:04:12.296 11:14:53 env -- env/env.sh@11 -- # run_test env_vtophys /home/vagrant/spdk_repo/spdk/test/env/vtophys/vtophys 00:04:12.296 11:14:53 env -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:04:12.296 11:14:53 env -- common/autotest_common.sh@1107 -- # xtrace_disable 00:04:12.296 11:14:53 env -- common/autotest_common.sh@10 -- # set +x 00:04:12.296 ************************************ 00:04:12.296 START TEST env_vtophys 00:04:12.296 ************************************ 00:04:12.296 11:14:53 env.env_vtophys -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/env/vtophys/vtophys 00:04:12.296 EAL: lib.eal log level changed from notice to debug 00:04:12.296 EAL: Detected lcore 0 as core 0 on socket 0 00:04:12.296 EAL: Detected lcore 1 as core 0 on socket 0 00:04:12.296 EAL: Detected lcore 2 as core 0 on socket 0 00:04:12.296 EAL: Detected lcore 3 as core 0 on socket 0 00:04:12.296 EAL: Detected lcore 4 as core 0 on socket 0 00:04:12.296 EAL: Detected lcore 5 as core 0 on socket 0 00:04:12.296 EAL: Detected lcore 6 as core 0 on socket 0 00:04:12.296 EAL: Detected lcore 7 as core 0 on socket 0 00:04:12.296 EAL: Detected lcore 8 as core 0 on socket 0 00:04:12.296 EAL: Detected lcore 9 as core 0 on socket 0 00:04:12.296 EAL: Maximum logical cores by configuration: 128 00:04:12.296 EAL: Detected CPU lcores: 10 00:04:12.296 EAL: Detected NUMA nodes: 1 00:04:12.296 EAL: Checking presence of .so 'librte_eal.so.24.1' 00:04:12.296 EAL: Detected shared linkage of DPDK 00:04:12.296 EAL: No shared files mode enabled, IPC will be disabled 00:04:12.296 EAL: Selected IOVA mode 'PA' 00:04:12.296 EAL: Probing VFIO support... 00:04:12.296 EAL: Module /sys/module/vfio not found! error 2 (No such file or directory) 00:04:12.296 EAL: VFIO modules not loaded, skipping VFIO support... 00:04:12.296 EAL: Ask a virtual area of 0x2e000 bytes 00:04:12.296 EAL: Virtual area found at 0x200000000000 (size = 0x2e000) 00:04:12.296 EAL: Setting up physically contiguous memory... 00:04:12.296 EAL: Setting maximum number of open files to 524288 00:04:12.296 EAL: Detected memory type: socket_id:0 hugepage_sz:2097152 00:04:12.296 EAL: Creating 4 segment lists: n_segs:8192 socket_id:0 hugepage_sz:2097152 00:04:12.296 EAL: Ask a virtual area of 0x61000 bytes 00:04:12.296 EAL: Virtual area found at 0x20000002e000 (size = 0x61000) 00:04:12.296 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:04:12.296 EAL: Ask a virtual area of 0x400000000 bytes 00:04:12.296 EAL: Virtual area found at 0x200000200000 (size = 0x400000000) 00:04:12.296 EAL: VA reserved for memseg list at 0x200000200000, size 400000000 00:04:12.296 EAL: Ask a virtual area of 0x61000 bytes 00:04:12.296 EAL: Virtual area found at 0x200400200000 (size = 0x61000) 00:04:12.296 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:04:12.296 EAL: Ask a virtual area of 0x400000000 bytes 00:04:12.296 EAL: Virtual area found at 0x200400400000 (size = 0x400000000) 00:04:12.296 EAL: VA reserved for memseg list at 0x200400400000, size 400000000 00:04:12.296 EAL: Ask a virtual area of 0x61000 bytes 00:04:12.296 EAL: Virtual area found at 0x200800400000 (size = 0x61000) 00:04:12.296 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:04:12.296 EAL: Ask a virtual area of 0x400000000 bytes 00:04:12.296 EAL: Virtual area found at 0x200800600000 (size = 0x400000000) 00:04:12.296 EAL: VA reserved for memseg list at 0x200800600000, size 400000000 00:04:12.296 EAL: Ask a virtual area of 0x61000 bytes 00:04:12.296 EAL: Virtual area found at 0x200c00600000 (size = 0x61000) 00:04:12.296 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:04:12.296 EAL: Ask a virtual area of 0x400000000 bytes 00:04:12.296 EAL: Virtual area found at 0x200c00800000 (size = 0x400000000) 00:04:12.296 EAL: VA reserved for memseg list at 0x200c00800000, size 400000000 00:04:12.296 EAL: Hugepages will be freed exactly as allocated. 00:04:12.296 EAL: No shared files mode enabled, IPC is disabled 00:04:12.296 EAL: No shared files mode enabled, IPC is disabled 00:04:12.296 EAL: TSC frequency is ~2200000 KHz 00:04:12.296 EAL: Main lcore 0 is ready (tid=7f357f00ea00;cpuset=[0]) 00:04:12.296 EAL: Trying to obtain current memory policy. 00:04:12.296 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:12.296 EAL: Restoring previous memory policy: 0 00:04:12.296 EAL: request: mp_malloc_sync 00:04:12.296 EAL: No shared files mode enabled, IPC is disabled 00:04:12.296 EAL: Heap on socket 0 was expanded by 2MB 00:04:12.296 EAL: Module /sys/module/vfio not found! error 2 (No such file or directory) 00:04:12.296 EAL: No PCI address specified using 'addr=' in: bus=pci 00:04:12.296 EAL: Mem event callback 'spdk:(nil)' registered 00:04:12.296 EAL: Module /sys/module/vfio_pci not found! error 2 (No such file or directory) 00:04:12.296 00:04:12.296 00:04:12.296 CUnit - A unit testing framework for C - Version 2.1-3 00:04:12.296 http://cunit.sourceforge.net/ 00:04:12.296 00:04:12.296 00:04:12.296 Suite: components_suite 00:04:12.296 Test: vtophys_malloc_test ...passed 00:04:12.296 Test: vtophys_spdk_malloc_test ...EAL: Trying to obtain current memory policy. 00:04:12.296 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:12.296 EAL: Restoring previous memory policy: 4 00:04:12.297 EAL: Calling mem event callback 'spdk:(nil)' 00:04:12.297 EAL: request: mp_malloc_sync 00:04:12.297 EAL: No shared files mode enabled, IPC is disabled 00:04:12.297 EAL: Heap on socket 0 was expanded by 4MB 00:04:12.297 EAL: Calling mem event callback 'spdk:(nil)' 00:04:12.297 EAL: request: mp_malloc_sync 00:04:12.297 EAL: No shared files mode enabled, IPC is disabled 00:04:12.297 EAL: Heap on socket 0 was shrunk by 4MB 00:04:12.297 EAL: Trying to obtain current memory policy. 00:04:12.297 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:12.297 EAL: Restoring previous memory policy: 4 00:04:12.297 EAL: Calling mem event callback 'spdk:(nil)' 00:04:12.297 EAL: request: mp_malloc_sync 00:04:12.297 EAL: No shared files mode enabled, IPC is disabled 00:04:12.297 EAL: Heap on socket 0 was expanded by 6MB 00:04:12.297 EAL: Calling mem event callback 'spdk:(nil)' 00:04:12.297 EAL: request: mp_malloc_sync 00:04:12.297 EAL: No shared files mode enabled, IPC is disabled 00:04:12.297 EAL: Heap on socket 0 was shrunk by 6MB 00:04:12.297 EAL: Trying to obtain current memory policy. 00:04:12.297 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:12.297 EAL: Restoring previous memory policy: 4 00:04:12.297 EAL: Calling mem event callback 'spdk:(nil)' 00:04:12.297 EAL: request: mp_malloc_sync 00:04:12.297 EAL: No shared files mode enabled, IPC is disabled 00:04:12.297 EAL: Heap on socket 0 was expanded by 10MB 00:04:12.297 EAL: Calling mem event callback 'spdk:(nil)' 00:04:12.297 EAL: request: mp_malloc_sync 00:04:12.297 EAL: No shared files mode enabled, IPC is disabled 00:04:12.297 EAL: Heap on socket 0 was shrunk by 10MB 00:04:12.297 EAL: Trying to obtain current memory policy. 00:04:12.297 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:12.297 EAL: Restoring previous memory policy: 4 00:04:12.297 EAL: Calling mem event callback 'spdk:(nil)' 00:04:12.297 EAL: request: mp_malloc_sync 00:04:12.297 EAL: No shared files mode enabled, IPC is disabled 00:04:12.297 EAL: Heap on socket 0 was expanded by 18MB 00:04:12.297 EAL: Calling mem event callback 'spdk:(nil)' 00:04:12.297 EAL: request: mp_malloc_sync 00:04:12.297 EAL: No shared files mode enabled, IPC is disabled 00:04:12.297 EAL: Heap on socket 0 was shrunk by 18MB 00:04:12.297 EAL: Trying to obtain current memory policy. 00:04:12.297 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:12.297 EAL: Restoring previous memory policy: 4 00:04:12.297 EAL: Calling mem event callback 'spdk:(nil)' 00:04:12.297 EAL: request: mp_malloc_sync 00:04:12.297 EAL: No shared files mode enabled, IPC is disabled 00:04:12.297 EAL: Heap on socket 0 was expanded by 34MB 00:04:12.297 EAL: Calling mem event callback 'spdk:(nil)' 00:04:12.297 EAL: request: mp_malloc_sync 00:04:12.297 EAL: No shared files mode enabled, IPC is disabled 00:04:12.297 EAL: Heap on socket 0 was shrunk by 34MB 00:04:12.297 EAL: Trying to obtain current memory policy. 00:04:12.297 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:12.297 EAL: Restoring previous memory policy: 4 00:04:12.297 EAL: Calling mem event callback 'spdk:(nil)' 00:04:12.297 EAL: request: mp_malloc_sync 00:04:12.297 EAL: No shared files mode enabled, IPC is disabled 00:04:12.297 EAL: Heap on socket 0 was expanded by 66MB 00:04:12.555 EAL: Calling mem event callback 'spdk:(nil)' 00:04:12.555 EAL: request: mp_malloc_sync 00:04:12.555 EAL: No shared files mode enabled, IPC is disabled 00:04:12.555 EAL: Heap on socket 0 was shrunk by 66MB 00:04:12.555 EAL: Trying to obtain current memory policy. 00:04:12.555 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:12.555 EAL: Restoring previous memory policy: 4 00:04:12.555 EAL: Calling mem event callback 'spdk:(nil)' 00:04:12.555 EAL: request: mp_malloc_sync 00:04:12.555 EAL: No shared files mode enabled, IPC is disabled 00:04:12.555 EAL: Heap on socket 0 was expanded by 130MB 00:04:12.555 EAL: Calling mem event callback 'spdk:(nil)' 00:04:12.555 EAL: request: mp_malloc_sync 00:04:12.555 EAL: No shared files mode enabled, IPC is disabled 00:04:12.555 EAL: Heap on socket 0 was shrunk by 130MB 00:04:12.555 EAL: Trying to obtain current memory policy. 00:04:12.555 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:12.555 EAL: Restoring previous memory policy: 4 00:04:12.555 EAL: Calling mem event callback 'spdk:(nil)' 00:04:12.555 EAL: request: mp_malloc_sync 00:04:12.555 EAL: No shared files mode enabled, IPC is disabled 00:04:12.555 EAL: Heap on socket 0 was expanded by 258MB 00:04:12.814 EAL: Calling mem event callback 'spdk:(nil)' 00:04:12.814 EAL: request: mp_malloc_sync 00:04:12.814 EAL: No shared files mode enabled, IPC is disabled 00:04:12.814 EAL: Heap on socket 0 was shrunk by 258MB 00:04:12.814 EAL: Trying to obtain current memory policy. 00:04:12.814 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:13.073 EAL: Restoring previous memory policy: 4 00:04:13.073 EAL: Calling mem event callback 'spdk:(nil)' 00:04:13.073 EAL: request: mp_malloc_sync 00:04:13.073 EAL: No shared files mode enabled, IPC is disabled 00:04:13.073 EAL: Heap on socket 0 was expanded by 514MB 00:04:13.073 EAL: Calling mem event callback 'spdk:(nil)' 00:04:13.331 EAL: request: mp_malloc_sync 00:04:13.331 EAL: No shared files mode enabled, IPC is disabled 00:04:13.331 EAL: Heap on socket 0 was shrunk by 514MB 00:04:13.331 EAL: Trying to obtain current memory policy. 00:04:13.331 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:13.589 EAL: Restoring previous memory policy: 4 00:04:13.589 EAL: Calling mem event callback 'spdk:(nil)' 00:04:13.589 EAL: request: mp_malloc_sync 00:04:13.589 EAL: No shared files mode enabled, IPC is disabled 00:04:13.589 EAL: Heap on socket 0 was expanded by 1026MB 00:04:14.155 EAL: Calling mem event callback 'spdk:(nil)' 00:04:14.413 passed 00:04:14.413 00:04:14.413 EAL: request: mp_malloc_sync 00:04:14.413 EAL: No shared files mode enabled, IPC is disabled 00:04:14.413 EAL: Heap on socket 0 was shrunk by 1026MB 00:04:14.413 Run Summary: Type Total Ran Passed Failed Inactive 00:04:14.413 suites 1 1 n/a 0 0 00:04:14.413 tests 2 2 2 0 0 00:04:14.413 asserts 5491 5491 5491 0 n/a 00:04:14.413 00:04:14.413 Elapsed time = 1.888 seconds 00:04:14.413 EAL: Calling mem event callback 'spdk:(nil)' 00:04:14.413 EAL: request: mp_malloc_sync 00:04:14.413 EAL: No shared files mode enabled, IPC is disabled 00:04:14.413 EAL: Heap on socket 0 was shrunk by 2MB 00:04:14.413 EAL: No shared files mode enabled, IPC is disabled 00:04:14.413 EAL: No shared files mode enabled, IPC is disabled 00:04:14.413 EAL: No shared files mode enabled, IPC is disabled 00:04:14.413 00:04:14.413 real 0m2.099s 00:04:14.413 user 0m1.193s 00:04:14.413 sys 0m0.766s 00:04:14.413 11:14:55 env.env_vtophys -- common/autotest_common.sh@1126 -- # xtrace_disable 00:04:14.413 11:14:55 env.env_vtophys -- common/autotest_common.sh@10 -- # set +x 00:04:14.413 ************************************ 00:04:14.413 END TEST env_vtophys 00:04:14.413 ************************************ 00:04:14.413 11:14:55 env -- env/env.sh@12 -- # run_test env_pci /home/vagrant/spdk_repo/spdk/test/env/pci/pci_ut 00:04:14.413 11:14:55 env -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:04:14.413 11:14:55 env -- common/autotest_common.sh@1107 -- # xtrace_disable 00:04:14.413 11:14:55 env -- common/autotest_common.sh@10 -- # set +x 00:04:14.413 ************************************ 00:04:14.413 START TEST env_pci 00:04:14.413 ************************************ 00:04:14.413 11:14:55 env.env_pci -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/env/pci/pci_ut 00:04:14.413 00:04:14.413 00:04:14.413 CUnit - A unit testing framework for C - Version 2.1-3 00:04:14.413 http://cunit.sourceforge.net/ 00:04:14.413 00:04:14.413 00:04:14.413 Suite: pci 00:04:14.413 Test: pci_hook ...[2024-10-07 11:14:55.949807] /home/vagrant/spdk_repo/spdk/lib/env_dpdk/pci.c:1049:spdk_pci_device_claim: *ERROR*: Cannot create lock on device /var/tmp/spdk_pci_lock_10000:00:01.0, probably process 58376 has claimed it 00:04:14.413 passed 00:04:14.413 00:04:14.413 Run Summary: Type Total Ran Passed Failed Inactive 00:04:14.413 suites 1 1 n/a 0 0 00:04:14.413 tests 1 1 1 0 0 00:04:14.413 asserts 25 25 25 0 n/a 00:04:14.413 00:04:14.413 Elapsed time = 0.002 seconds 00:04:14.414 EAL: Cannot find device (10000:00:01.0) 00:04:14.414 EAL: Failed to attach device on primary process 00:04:14.414 00:04:14.414 real 0m0.020s 00:04:14.414 user 0m0.010s 00:04:14.414 sys 0m0.010s 00:04:14.414 11:14:55 env.env_pci -- common/autotest_common.sh@1126 -- # xtrace_disable 00:04:14.414 11:14:55 env.env_pci -- common/autotest_common.sh@10 -- # set +x 00:04:14.414 ************************************ 00:04:14.414 END TEST env_pci 00:04:14.414 ************************************ 00:04:14.414 11:14:55 env -- env/env.sh@14 -- # argv='-c 0x1 ' 00:04:14.414 11:14:55 env -- env/env.sh@15 -- # uname 00:04:14.414 11:14:55 env -- env/env.sh@15 -- # '[' Linux = Linux ']' 00:04:14.414 11:14:55 env -- env/env.sh@22 -- # argv+=--base-virtaddr=0x200000000000 00:04:14.414 11:14:55 env -- env/env.sh@24 -- # run_test env_dpdk_post_init /home/vagrant/spdk_repo/spdk/test/env/env_dpdk_post_init/env_dpdk_post_init -c 0x1 --base-virtaddr=0x200000000000 00:04:14.414 11:14:56 env -- common/autotest_common.sh@1101 -- # '[' 5 -le 1 ']' 00:04:14.414 11:14:56 env -- common/autotest_common.sh@1107 -- # xtrace_disable 00:04:14.414 11:14:56 env -- common/autotest_common.sh@10 -- # set +x 00:04:14.414 ************************************ 00:04:14.414 START TEST env_dpdk_post_init 00:04:14.414 ************************************ 00:04:14.414 11:14:56 env.env_dpdk_post_init -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/env/env_dpdk_post_init/env_dpdk_post_init -c 0x1 --base-virtaddr=0x200000000000 00:04:14.414 EAL: Detected CPU lcores: 10 00:04:14.414 EAL: Detected NUMA nodes: 1 00:04:14.414 EAL: Detected shared linkage of DPDK 00:04:14.414 EAL: Multi-process socket /var/run/dpdk/rte/mp_socket 00:04:14.414 EAL: Selected IOVA mode 'PA' 00:04:14.672 TELEMETRY: No legacy callbacks, legacy socket not created 00:04:14.672 EAL: Probe PCI driver: spdk_nvme (1b36:0010) device: 0000:00:10.0 (socket -1) 00:04:14.672 EAL: Probe PCI driver: spdk_nvme (1b36:0010) device: 0000:00:11.0 (socket -1) 00:04:14.672 Starting DPDK initialization... 00:04:14.672 Starting SPDK post initialization... 00:04:14.672 SPDK NVMe probe 00:04:14.672 Attaching to 0000:00:10.0 00:04:14.672 Attaching to 0000:00:11.0 00:04:14.672 Attached to 0000:00:10.0 00:04:14.672 Attached to 0000:00:11.0 00:04:14.672 Cleaning up... 00:04:14.672 00:04:14.672 real 0m0.185s 00:04:14.672 user 0m0.046s 00:04:14.672 sys 0m0.039s 00:04:14.672 11:14:56 env.env_dpdk_post_init -- common/autotest_common.sh@1126 -- # xtrace_disable 00:04:14.672 ************************************ 00:04:14.672 END TEST env_dpdk_post_init 00:04:14.672 11:14:56 env.env_dpdk_post_init -- common/autotest_common.sh@10 -- # set +x 00:04:14.672 ************************************ 00:04:14.672 11:14:56 env -- env/env.sh@26 -- # uname 00:04:14.672 11:14:56 env -- env/env.sh@26 -- # '[' Linux = Linux ']' 00:04:14.672 11:14:56 env -- env/env.sh@29 -- # run_test env_mem_callbacks /home/vagrant/spdk_repo/spdk/test/env/mem_callbacks/mem_callbacks 00:04:14.672 11:14:56 env -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:04:14.672 11:14:56 env -- common/autotest_common.sh@1107 -- # xtrace_disable 00:04:14.672 11:14:56 env -- common/autotest_common.sh@10 -- # set +x 00:04:14.672 ************************************ 00:04:14.672 START TEST env_mem_callbacks 00:04:14.672 ************************************ 00:04:14.672 11:14:56 env.env_mem_callbacks -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/env/mem_callbacks/mem_callbacks 00:04:14.672 EAL: Detected CPU lcores: 10 00:04:14.672 EAL: Detected NUMA nodes: 1 00:04:14.672 EAL: Detected shared linkage of DPDK 00:04:14.672 EAL: Multi-process socket /var/run/dpdk/rte/mp_socket 00:04:14.672 EAL: Selected IOVA mode 'PA' 00:04:14.931 TELEMETRY: No legacy callbacks, legacy socket not created 00:04:14.931 00:04:14.931 00:04:14.931 CUnit - A unit testing framework for C - Version 2.1-3 00:04:14.931 http://cunit.sourceforge.net/ 00:04:14.931 00:04:14.931 00:04:14.931 Suite: memory 00:04:14.931 Test: test ... 00:04:14.931 register 0x200000200000 2097152 00:04:14.931 malloc 3145728 00:04:14.931 register 0x200000400000 4194304 00:04:14.931 buf 0x200000500000 len 3145728 PASSED 00:04:14.931 malloc 64 00:04:14.931 buf 0x2000004fff40 len 64 PASSED 00:04:14.931 malloc 4194304 00:04:14.931 register 0x200000800000 6291456 00:04:14.931 buf 0x200000a00000 len 4194304 PASSED 00:04:14.931 free 0x200000500000 3145728 00:04:14.931 free 0x2000004fff40 64 00:04:14.931 unregister 0x200000400000 4194304 PASSED 00:04:14.931 free 0x200000a00000 4194304 00:04:14.931 unregister 0x200000800000 6291456 PASSED 00:04:14.931 malloc 8388608 00:04:14.931 register 0x200000400000 10485760 00:04:14.931 buf 0x200000600000 len 8388608 PASSED 00:04:14.931 free 0x200000600000 8388608 00:04:14.931 unregister 0x200000400000 10485760 PASSED 00:04:14.931 passed 00:04:14.931 00:04:14.931 Run Summary: Type Total Ran Passed Failed Inactive 00:04:14.931 suites 1 1 n/a 0 0 00:04:14.931 tests 1 1 1 0 0 00:04:14.931 asserts 15 15 15 0 n/a 00:04:14.931 00:04:14.931 Elapsed time = 0.009 seconds 00:04:14.931 ************************************ 00:04:14.931 END TEST env_mem_callbacks 00:04:14.931 ************************************ 00:04:14.931 00:04:14.931 real 0m0.147s 00:04:14.931 user 0m0.023s 00:04:14.931 sys 0m0.023s 00:04:14.931 11:14:56 env.env_mem_callbacks -- common/autotest_common.sh@1126 -- # xtrace_disable 00:04:14.931 11:14:56 env.env_mem_callbacks -- common/autotest_common.sh@10 -- # set +x 00:04:14.931 ************************************ 00:04:14.931 END TEST env 00:04:14.931 ************************************ 00:04:14.931 00:04:14.931 real 0m3.144s 00:04:14.931 user 0m1.698s 00:04:14.931 sys 0m1.093s 00:04:14.931 11:14:56 env -- common/autotest_common.sh@1126 -- # xtrace_disable 00:04:14.931 11:14:56 env -- common/autotest_common.sh@10 -- # set +x 00:04:14.931 11:14:56 -- spdk/autotest.sh@156 -- # run_test rpc /home/vagrant/spdk_repo/spdk/test/rpc/rpc.sh 00:04:14.931 11:14:56 -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:04:14.931 11:14:56 -- common/autotest_common.sh@1107 -- # xtrace_disable 00:04:14.931 11:14:56 -- common/autotest_common.sh@10 -- # set +x 00:04:14.931 ************************************ 00:04:14.931 START TEST rpc 00:04:14.931 ************************************ 00:04:14.931 11:14:56 rpc -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/rpc/rpc.sh 00:04:14.931 * Looking for test storage... 00:04:14.931 * Found test storage at /home/vagrant/spdk_repo/spdk/test/rpc 00:04:14.931 11:14:56 rpc -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:04:14.931 11:14:56 rpc -- common/autotest_common.sh@1681 -- # lcov --version 00:04:14.931 11:14:56 rpc -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:04:15.190 11:14:56 rpc -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:04:15.190 11:14:56 rpc -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:04:15.190 11:14:56 rpc -- scripts/common.sh@333 -- # local ver1 ver1_l 00:04:15.190 11:14:56 rpc -- scripts/common.sh@334 -- # local ver2 ver2_l 00:04:15.190 11:14:56 rpc -- scripts/common.sh@336 -- # IFS=.-: 00:04:15.190 11:14:56 rpc -- scripts/common.sh@336 -- # read -ra ver1 00:04:15.190 11:14:56 rpc -- scripts/common.sh@337 -- # IFS=.-: 00:04:15.190 11:14:56 rpc -- scripts/common.sh@337 -- # read -ra ver2 00:04:15.190 11:14:56 rpc -- scripts/common.sh@338 -- # local 'op=<' 00:04:15.190 11:14:56 rpc -- scripts/common.sh@340 -- # ver1_l=2 00:04:15.191 11:14:56 rpc -- scripts/common.sh@341 -- # ver2_l=1 00:04:15.191 11:14:56 rpc -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:04:15.191 11:14:56 rpc -- scripts/common.sh@344 -- # case "$op" in 00:04:15.191 11:14:56 rpc -- scripts/common.sh@345 -- # : 1 00:04:15.191 11:14:56 rpc -- scripts/common.sh@364 -- # (( v = 0 )) 00:04:15.191 11:14:56 rpc -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:15.191 11:14:56 rpc -- scripts/common.sh@365 -- # decimal 1 00:04:15.191 11:14:56 rpc -- scripts/common.sh@353 -- # local d=1 00:04:15.191 11:14:56 rpc -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:15.191 11:14:56 rpc -- scripts/common.sh@355 -- # echo 1 00:04:15.191 11:14:56 rpc -- scripts/common.sh@365 -- # ver1[v]=1 00:04:15.191 11:14:56 rpc -- scripts/common.sh@366 -- # decimal 2 00:04:15.191 11:14:56 rpc -- scripts/common.sh@353 -- # local d=2 00:04:15.191 11:14:56 rpc -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:15.191 11:14:56 rpc -- scripts/common.sh@355 -- # echo 2 00:04:15.191 11:14:56 rpc -- scripts/common.sh@366 -- # ver2[v]=2 00:04:15.191 11:14:56 rpc -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:04:15.191 11:14:56 rpc -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:04:15.191 11:14:56 rpc -- scripts/common.sh@368 -- # return 0 00:04:15.191 11:14:56 rpc -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:15.191 11:14:56 rpc -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:04:15.191 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:15.191 --rc genhtml_branch_coverage=1 00:04:15.191 --rc genhtml_function_coverage=1 00:04:15.191 --rc genhtml_legend=1 00:04:15.191 --rc geninfo_all_blocks=1 00:04:15.191 --rc geninfo_unexecuted_blocks=1 00:04:15.191 00:04:15.191 ' 00:04:15.191 11:14:56 rpc -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:04:15.191 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:15.191 --rc genhtml_branch_coverage=1 00:04:15.191 --rc genhtml_function_coverage=1 00:04:15.191 --rc genhtml_legend=1 00:04:15.191 --rc geninfo_all_blocks=1 00:04:15.191 --rc geninfo_unexecuted_blocks=1 00:04:15.191 00:04:15.191 ' 00:04:15.191 11:14:56 rpc -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:04:15.191 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:15.191 --rc genhtml_branch_coverage=1 00:04:15.191 --rc genhtml_function_coverage=1 00:04:15.191 --rc genhtml_legend=1 00:04:15.191 --rc geninfo_all_blocks=1 00:04:15.191 --rc geninfo_unexecuted_blocks=1 00:04:15.191 00:04:15.191 ' 00:04:15.191 11:14:56 rpc -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:04:15.191 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:15.191 --rc genhtml_branch_coverage=1 00:04:15.191 --rc genhtml_function_coverage=1 00:04:15.191 --rc genhtml_legend=1 00:04:15.191 --rc geninfo_all_blocks=1 00:04:15.191 --rc geninfo_unexecuted_blocks=1 00:04:15.191 00:04:15.191 ' 00:04:15.191 11:14:56 rpc -- rpc/rpc.sh@65 -- # spdk_pid=58494 00:04:15.191 11:14:56 rpc -- rpc/rpc.sh@64 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_tgt -e bdev 00:04:15.191 11:14:56 rpc -- rpc/rpc.sh@66 -- # trap 'killprocess $spdk_pid; exit 1' SIGINT SIGTERM EXIT 00:04:15.191 11:14:56 rpc -- rpc/rpc.sh@67 -- # waitforlisten 58494 00:04:15.191 11:14:56 rpc -- common/autotest_common.sh@831 -- # '[' -z 58494 ']' 00:04:15.191 11:14:56 rpc -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:15.191 11:14:56 rpc -- common/autotest_common.sh@836 -- # local max_retries=100 00:04:15.191 11:14:56 rpc -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:15.191 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:15.191 11:14:56 rpc -- common/autotest_common.sh@840 -- # xtrace_disable 00:04:15.191 11:14:56 rpc -- common/autotest_common.sh@10 -- # set +x 00:04:15.191 [2024-10-07 11:14:56.771515] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:04:15.191 [2024-10-07 11:14:56.771789] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid58494 ] 00:04:15.452 [2024-10-07 11:14:56.906821] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:15.452 [2024-10-07 11:14:57.050182] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask bdev specified. 00:04:15.452 [2024-10-07 11:14:57.050590] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s spdk_tgt -p 58494' to capture a snapshot of events at runtime. 00:04:15.452 [2024-10-07 11:14:57.050613] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:04:15.452 [2024-10-07 11:14:57.050622] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:04:15.452 [2024-10-07 11:14:57.050630] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/spdk_tgt_trace.pid58494 for offline analysis/debug. 00:04:15.452 [2024-10-07 11:14:57.051179] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:04:16.387 11:14:57 rpc -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:04:16.387 11:14:57 rpc -- common/autotest_common.sh@864 -- # return 0 00:04:16.387 11:14:57 rpc -- rpc/rpc.sh@69 -- # export PYTHONPATH=:/home/vagrant/spdk_repo/spdk/python:/home/vagrant/spdk_repo/spdk/test/rpc_plugins:/home/vagrant/spdk_repo/spdk/python:/home/vagrant/spdk_repo/spdk/test/rpc_plugins:/home/vagrant/spdk_repo/spdk/test/rpc 00:04:16.387 11:14:57 rpc -- rpc/rpc.sh@69 -- # PYTHONPATH=:/home/vagrant/spdk_repo/spdk/python:/home/vagrant/spdk_repo/spdk/test/rpc_plugins:/home/vagrant/spdk_repo/spdk/python:/home/vagrant/spdk_repo/spdk/test/rpc_plugins:/home/vagrant/spdk_repo/spdk/test/rpc 00:04:16.387 11:14:57 rpc -- rpc/rpc.sh@72 -- # rpc=rpc_cmd 00:04:16.387 11:14:57 rpc -- rpc/rpc.sh@73 -- # run_test rpc_integrity rpc_integrity 00:04:16.387 11:14:57 rpc -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:04:16.387 11:14:57 rpc -- common/autotest_common.sh@1107 -- # xtrace_disable 00:04:16.387 11:14:57 rpc -- common/autotest_common.sh@10 -- # set +x 00:04:16.387 ************************************ 00:04:16.387 START TEST rpc_integrity 00:04:16.387 ************************************ 00:04:16.387 11:14:57 rpc.rpc_integrity -- common/autotest_common.sh@1125 -- # rpc_integrity 00:04:16.387 11:14:57 rpc.rpc_integrity -- rpc/rpc.sh@12 -- # rpc_cmd bdev_get_bdevs 00:04:16.387 11:14:57 rpc.rpc_integrity -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:16.387 11:14:57 rpc.rpc_integrity -- common/autotest_common.sh@10 -- # set +x 00:04:16.387 11:14:57 rpc.rpc_integrity -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:16.387 11:14:57 rpc.rpc_integrity -- rpc/rpc.sh@12 -- # bdevs='[]' 00:04:16.387 11:14:57 rpc.rpc_integrity -- rpc/rpc.sh@13 -- # jq length 00:04:16.387 11:14:57 rpc.rpc_integrity -- rpc/rpc.sh@13 -- # '[' 0 == 0 ']' 00:04:16.387 11:14:57 rpc.rpc_integrity -- rpc/rpc.sh@15 -- # rpc_cmd bdev_malloc_create 8 512 00:04:16.387 11:14:57 rpc.rpc_integrity -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:16.387 11:14:57 rpc.rpc_integrity -- common/autotest_common.sh@10 -- # set +x 00:04:16.387 11:14:57 rpc.rpc_integrity -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:16.387 11:14:57 rpc.rpc_integrity -- rpc/rpc.sh@15 -- # malloc=Malloc0 00:04:16.387 11:14:57 rpc.rpc_integrity -- rpc/rpc.sh@16 -- # rpc_cmd bdev_get_bdevs 00:04:16.387 11:14:57 rpc.rpc_integrity -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:16.387 11:14:57 rpc.rpc_integrity -- common/autotest_common.sh@10 -- # set +x 00:04:16.387 11:14:57 rpc.rpc_integrity -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:16.387 11:14:57 rpc.rpc_integrity -- rpc/rpc.sh@16 -- # bdevs='[ 00:04:16.387 { 00:04:16.387 "aliases": [ 00:04:16.387 "9819f1bf-5ae2-4aed-a4fd-93f1ccfc634f" 00:04:16.387 ], 00:04:16.387 "assigned_rate_limits": { 00:04:16.387 "r_mbytes_per_sec": 0, 00:04:16.387 "rw_ios_per_sec": 0, 00:04:16.387 "rw_mbytes_per_sec": 0, 00:04:16.387 "w_mbytes_per_sec": 0 00:04:16.387 }, 00:04:16.387 "block_size": 512, 00:04:16.387 "claimed": false, 00:04:16.387 "driver_specific": {}, 00:04:16.387 "memory_domains": [ 00:04:16.387 { 00:04:16.387 "dma_device_id": "system", 00:04:16.387 "dma_device_type": 1 00:04:16.387 }, 00:04:16.387 { 00:04:16.387 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:16.387 "dma_device_type": 2 00:04:16.387 } 00:04:16.387 ], 00:04:16.387 "name": "Malloc0", 00:04:16.387 "num_blocks": 16384, 00:04:16.387 "product_name": "Malloc disk", 00:04:16.387 "supported_io_types": { 00:04:16.387 "abort": true, 00:04:16.387 "compare": false, 00:04:16.387 "compare_and_write": false, 00:04:16.387 "copy": true, 00:04:16.387 "flush": true, 00:04:16.387 "get_zone_info": false, 00:04:16.387 "nvme_admin": false, 00:04:16.387 "nvme_io": false, 00:04:16.387 "nvme_io_md": false, 00:04:16.387 "nvme_iov_md": false, 00:04:16.387 "read": true, 00:04:16.387 "reset": true, 00:04:16.387 "seek_data": false, 00:04:16.387 "seek_hole": false, 00:04:16.387 "unmap": true, 00:04:16.387 "write": true, 00:04:16.387 "write_zeroes": true, 00:04:16.387 "zcopy": true, 00:04:16.387 "zone_append": false, 00:04:16.387 "zone_management": false 00:04:16.387 }, 00:04:16.387 "uuid": "9819f1bf-5ae2-4aed-a4fd-93f1ccfc634f", 00:04:16.387 "zoned": false 00:04:16.387 } 00:04:16.387 ]' 00:04:16.387 11:14:57 rpc.rpc_integrity -- rpc/rpc.sh@17 -- # jq length 00:04:16.387 11:14:57 rpc.rpc_integrity -- rpc/rpc.sh@17 -- # '[' 1 == 1 ']' 00:04:16.387 11:14:57 rpc.rpc_integrity -- rpc/rpc.sh@19 -- # rpc_cmd bdev_passthru_create -b Malloc0 -p Passthru0 00:04:16.387 11:14:57 rpc.rpc_integrity -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:16.387 11:14:57 rpc.rpc_integrity -- common/autotest_common.sh@10 -- # set +x 00:04:16.387 [2024-10-07 11:14:57.978368] vbdev_passthru.c: 607:vbdev_passthru_register: *NOTICE*: Match on Malloc0 00:04:16.387 [2024-10-07 11:14:57.978607] vbdev_passthru.c: 635:vbdev_passthru_register: *NOTICE*: base bdev opened 00:04:16.387 [2024-10-07 11:14:57.978636] vbdev_passthru.c: 681:vbdev_passthru_register: *NOTICE*: io_device created at: 0x0x20c3ca0 00:04:16.387 [2024-10-07 11:14:57.978647] vbdev_passthru.c: 696:vbdev_passthru_register: *NOTICE*: bdev claimed 00:04:16.387 [2024-10-07 11:14:57.980109] vbdev_passthru.c: 709:vbdev_passthru_register: *NOTICE*: pt_bdev registered 00:04:16.387 [2024-10-07 11:14:57.980135] vbdev_passthru.c: 710:vbdev_passthru_register: *NOTICE*: created pt_bdev for: Passthru0 00:04:16.387 Passthru0 00:04:16.387 11:14:57 rpc.rpc_integrity -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:16.387 11:14:57 rpc.rpc_integrity -- rpc/rpc.sh@20 -- # rpc_cmd bdev_get_bdevs 00:04:16.387 11:14:57 rpc.rpc_integrity -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:16.387 11:14:57 rpc.rpc_integrity -- common/autotest_common.sh@10 -- # set +x 00:04:16.387 11:14:58 rpc.rpc_integrity -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:16.387 11:14:58 rpc.rpc_integrity -- rpc/rpc.sh@20 -- # bdevs='[ 00:04:16.387 { 00:04:16.387 "aliases": [ 00:04:16.387 "9819f1bf-5ae2-4aed-a4fd-93f1ccfc634f" 00:04:16.387 ], 00:04:16.387 "assigned_rate_limits": { 00:04:16.387 "r_mbytes_per_sec": 0, 00:04:16.387 "rw_ios_per_sec": 0, 00:04:16.387 "rw_mbytes_per_sec": 0, 00:04:16.387 "w_mbytes_per_sec": 0 00:04:16.387 }, 00:04:16.387 "block_size": 512, 00:04:16.387 "claim_type": "exclusive_write", 00:04:16.387 "claimed": true, 00:04:16.387 "driver_specific": {}, 00:04:16.387 "memory_domains": [ 00:04:16.387 { 00:04:16.387 "dma_device_id": "system", 00:04:16.387 "dma_device_type": 1 00:04:16.387 }, 00:04:16.387 { 00:04:16.387 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:16.387 "dma_device_type": 2 00:04:16.387 } 00:04:16.387 ], 00:04:16.387 "name": "Malloc0", 00:04:16.387 "num_blocks": 16384, 00:04:16.387 "product_name": "Malloc disk", 00:04:16.387 "supported_io_types": { 00:04:16.388 "abort": true, 00:04:16.388 "compare": false, 00:04:16.388 "compare_and_write": false, 00:04:16.388 "copy": true, 00:04:16.388 "flush": true, 00:04:16.388 "get_zone_info": false, 00:04:16.388 "nvme_admin": false, 00:04:16.388 "nvme_io": false, 00:04:16.388 "nvme_io_md": false, 00:04:16.388 "nvme_iov_md": false, 00:04:16.388 "read": true, 00:04:16.388 "reset": true, 00:04:16.388 "seek_data": false, 00:04:16.388 "seek_hole": false, 00:04:16.388 "unmap": true, 00:04:16.388 "write": true, 00:04:16.388 "write_zeroes": true, 00:04:16.388 "zcopy": true, 00:04:16.388 "zone_append": false, 00:04:16.388 "zone_management": false 00:04:16.388 }, 00:04:16.388 "uuid": "9819f1bf-5ae2-4aed-a4fd-93f1ccfc634f", 00:04:16.388 "zoned": false 00:04:16.388 }, 00:04:16.388 { 00:04:16.388 "aliases": [ 00:04:16.388 "2a6c861d-bf7f-5081-ac00-39b381ed648b" 00:04:16.388 ], 00:04:16.388 "assigned_rate_limits": { 00:04:16.388 "r_mbytes_per_sec": 0, 00:04:16.388 "rw_ios_per_sec": 0, 00:04:16.388 "rw_mbytes_per_sec": 0, 00:04:16.388 "w_mbytes_per_sec": 0 00:04:16.388 }, 00:04:16.388 "block_size": 512, 00:04:16.388 "claimed": false, 00:04:16.388 "driver_specific": { 00:04:16.388 "passthru": { 00:04:16.388 "base_bdev_name": "Malloc0", 00:04:16.388 "name": "Passthru0" 00:04:16.388 } 00:04:16.388 }, 00:04:16.388 "memory_domains": [ 00:04:16.388 { 00:04:16.388 "dma_device_id": "system", 00:04:16.388 "dma_device_type": 1 00:04:16.388 }, 00:04:16.388 { 00:04:16.388 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:16.388 "dma_device_type": 2 00:04:16.388 } 00:04:16.388 ], 00:04:16.388 "name": "Passthru0", 00:04:16.388 "num_blocks": 16384, 00:04:16.388 "product_name": "passthru", 00:04:16.388 "supported_io_types": { 00:04:16.388 "abort": true, 00:04:16.388 "compare": false, 00:04:16.388 "compare_and_write": false, 00:04:16.388 "copy": true, 00:04:16.388 "flush": true, 00:04:16.388 "get_zone_info": false, 00:04:16.388 "nvme_admin": false, 00:04:16.388 "nvme_io": false, 00:04:16.388 "nvme_io_md": false, 00:04:16.388 "nvme_iov_md": false, 00:04:16.388 "read": true, 00:04:16.388 "reset": true, 00:04:16.388 "seek_data": false, 00:04:16.388 "seek_hole": false, 00:04:16.388 "unmap": true, 00:04:16.388 "write": true, 00:04:16.388 "write_zeroes": true, 00:04:16.388 "zcopy": true, 00:04:16.388 "zone_append": false, 00:04:16.388 "zone_management": false 00:04:16.388 }, 00:04:16.388 "uuid": "2a6c861d-bf7f-5081-ac00-39b381ed648b", 00:04:16.388 "zoned": false 00:04:16.388 } 00:04:16.388 ]' 00:04:16.388 11:14:58 rpc.rpc_integrity -- rpc/rpc.sh@21 -- # jq length 00:04:16.388 11:14:58 rpc.rpc_integrity -- rpc/rpc.sh@21 -- # '[' 2 == 2 ']' 00:04:16.388 11:14:58 rpc.rpc_integrity -- rpc/rpc.sh@23 -- # rpc_cmd bdev_passthru_delete Passthru0 00:04:16.388 11:14:58 rpc.rpc_integrity -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:16.388 11:14:58 rpc.rpc_integrity -- common/autotest_common.sh@10 -- # set +x 00:04:16.388 11:14:58 rpc.rpc_integrity -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:16.388 11:14:58 rpc.rpc_integrity -- rpc/rpc.sh@24 -- # rpc_cmd bdev_malloc_delete Malloc0 00:04:16.388 11:14:58 rpc.rpc_integrity -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:16.388 11:14:58 rpc.rpc_integrity -- common/autotest_common.sh@10 -- # set +x 00:04:16.388 11:14:58 rpc.rpc_integrity -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:16.388 11:14:58 rpc.rpc_integrity -- rpc/rpc.sh@25 -- # rpc_cmd bdev_get_bdevs 00:04:16.388 11:14:58 rpc.rpc_integrity -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:16.388 11:14:58 rpc.rpc_integrity -- common/autotest_common.sh@10 -- # set +x 00:04:16.647 11:14:58 rpc.rpc_integrity -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:16.647 11:14:58 rpc.rpc_integrity -- rpc/rpc.sh@25 -- # bdevs='[]' 00:04:16.647 11:14:58 rpc.rpc_integrity -- rpc/rpc.sh@26 -- # jq length 00:04:16.647 11:14:58 rpc.rpc_integrity -- rpc/rpc.sh@26 -- # '[' 0 == 0 ']' 00:04:16.647 00:04:16.647 real 0m0.338s 00:04:16.647 user 0m0.223s 00:04:16.647 sys 0m0.035s 00:04:16.647 11:14:58 rpc.rpc_integrity -- common/autotest_common.sh@1126 -- # xtrace_disable 00:04:16.647 11:14:58 rpc.rpc_integrity -- common/autotest_common.sh@10 -- # set +x 00:04:16.647 ************************************ 00:04:16.647 END TEST rpc_integrity 00:04:16.647 ************************************ 00:04:16.647 11:14:58 rpc -- rpc/rpc.sh@74 -- # run_test rpc_plugins rpc_plugins 00:04:16.647 11:14:58 rpc -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:04:16.647 11:14:58 rpc -- common/autotest_common.sh@1107 -- # xtrace_disable 00:04:16.647 11:14:58 rpc -- common/autotest_common.sh@10 -- # set +x 00:04:16.647 ************************************ 00:04:16.647 START TEST rpc_plugins 00:04:16.647 ************************************ 00:04:16.647 11:14:58 rpc.rpc_plugins -- common/autotest_common.sh@1125 -- # rpc_plugins 00:04:16.647 11:14:58 rpc.rpc_plugins -- rpc/rpc.sh@30 -- # rpc_cmd --plugin rpc_plugin create_malloc 00:04:16.647 11:14:58 rpc.rpc_plugins -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:16.647 11:14:58 rpc.rpc_plugins -- common/autotest_common.sh@10 -- # set +x 00:04:16.647 11:14:58 rpc.rpc_plugins -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:16.647 11:14:58 rpc.rpc_plugins -- rpc/rpc.sh@30 -- # malloc=Malloc1 00:04:16.647 11:14:58 rpc.rpc_plugins -- rpc/rpc.sh@31 -- # rpc_cmd bdev_get_bdevs 00:04:16.647 11:14:58 rpc.rpc_plugins -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:16.647 11:14:58 rpc.rpc_plugins -- common/autotest_common.sh@10 -- # set +x 00:04:16.647 11:14:58 rpc.rpc_plugins -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:16.647 11:14:58 rpc.rpc_plugins -- rpc/rpc.sh@31 -- # bdevs='[ 00:04:16.647 { 00:04:16.647 "aliases": [ 00:04:16.647 "e47cce37-3702-4e88-ad3a-7dd588773817" 00:04:16.647 ], 00:04:16.647 "assigned_rate_limits": { 00:04:16.647 "r_mbytes_per_sec": 0, 00:04:16.647 "rw_ios_per_sec": 0, 00:04:16.647 "rw_mbytes_per_sec": 0, 00:04:16.647 "w_mbytes_per_sec": 0 00:04:16.647 }, 00:04:16.647 "block_size": 4096, 00:04:16.647 "claimed": false, 00:04:16.647 "driver_specific": {}, 00:04:16.647 "memory_domains": [ 00:04:16.647 { 00:04:16.647 "dma_device_id": "system", 00:04:16.647 "dma_device_type": 1 00:04:16.647 }, 00:04:16.647 { 00:04:16.647 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:16.647 "dma_device_type": 2 00:04:16.647 } 00:04:16.647 ], 00:04:16.647 "name": "Malloc1", 00:04:16.647 "num_blocks": 256, 00:04:16.647 "product_name": "Malloc disk", 00:04:16.647 "supported_io_types": { 00:04:16.647 "abort": true, 00:04:16.647 "compare": false, 00:04:16.647 "compare_and_write": false, 00:04:16.647 "copy": true, 00:04:16.647 "flush": true, 00:04:16.647 "get_zone_info": false, 00:04:16.647 "nvme_admin": false, 00:04:16.647 "nvme_io": false, 00:04:16.647 "nvme_io_md": false, 00:04:16.647 "nvme_iov_md": false, 00:04:16.647 "read": true, 00:04:16.647 "reset": true, 00:04:16.647 "seek_data": false, 00:04:16.647 "seek_hole": false, 00:04:16.647 "unmap": true, 00:04:16.647 "write": true, 00:04:16.647 "write_zeroes": true, 00:04:16.647 "zcopy": true, 00:04:16.648 "zone_append": false, 00:04:16.648 "zone_management": false 00:04:16.648 }, 00:04:16.648 "uuid": "e47cce37-3702-4e88-ad3a-7dd588773817", 00:04:16.648 "zoned": false 00:04:16.648 } 00:04:16.648 ]' 00:04:16.648 11:14:58 rpc.rpc_plugins -- rpc/rpc.sh@32 -- # jq length 00:04:16.648 11:14:58 rpc.rpc_plugins -- rpc/rpc.sh@32 -- # '[' 1 == 1 ']' 00:04:16.648 11:14:58 rpc.rpc_plugins -- rpc/rpc.sh@34 -- # rpc_cmd --plugin rpc_plugin delete_malloc Malloc1 00:04:16.648 11:14:58 rpc.rpc_plugins -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:16.648 11:14:58 rpc.rpc_plugins -- common/autotest_common.sh@10 -- # set +x 00:04:16.648 11:14:58 rpc.rpc_plugins -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:16.648 11:14:58 rpc.rpc_plugins -- rpc/rpc.sh@35 -- # rpc_cmd bdev_get_bdevs 00:04:16.648 11:14:58 rpc.rpc_plugins -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:16.648 11:14:58 rpc.rpc_plugins -- common/autotest_common.sh@10 -- # set +x 00:04:16.648 11:14:58 rpc.rpc_plugins -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:16.648 11:14:58 rpc.rpc_plugins -- rpc/rpc.sh@35 -- # bdevs='[]' 00:04:16.648 11:14:58 rpc.rpc_plugins -- rpc/rpc.sh@36 -- # jq length 00:04:16.906 11:14:58 rpc.rpc_plugins -- rpc/rpc.sh@36 -- # '[' 0 == 0 ']' 00:04:16.906 00:04:16.906 real 0m0.157s 00:04:16.906 user 0m0.099s 00:04:16.906 sys 0m0.019s 00:04:16.906 11:14:58 rpc.rpc_plugins -- common/autotest_common.sh@1126 -- # xtrace_disable 00:04:16.906 11:14:58 rpc.rpc_plugins -- common/autotest_common.sh@10 -- # set +x 00:04:16.906 ************************************ 00:04:16.906 END TEST rpc_plugins 00:04:16.906 ************************************ 00:04:16.906 11:14:58 rpc -- rpc/rpc.sh@75 -- # run_test rpc_trace_cmd_test rpc_trace_cmd_test 00:04:16.906 11:14:58 rpc -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:04:16.906 11:14:58 rpc -- common/autotest_common.sh@1107 -- # xtrace_disable 00:04:16.906 11:14:58 rpc -- common/autotest_common.sh@10 -- # set +x 00:04:16.906 ************************************ 00:04:16.906 START TEST rpc_trace_cmd_test 00:04:16.906 ************************************ 00:04:16.906 11:14:58 rpc.rpc_trace_cmd_test -- common/autotest_common.sh@1125 -- # rpc_trace_cmd_test 00:04:16.906 11:14:58 rpc.rpc_trace_cmd_test -- rpc/rpc.sh@40 -- # local info 00:04:16.906 11:14:58 rpc.rpc_trace_cmd_test -- rpc/rpc.sh@42 -- # rpc_cmd trace_get_info 00:04:16.906 11:14:58 rpc.rpc_trace_cmd_test -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:16.906 11:14:58 rpc.rpc_trace_cmd_test -- common/autotest_common.sh@10 -- # set +x 00:04:16.906 11:14:58 rpc.rpc_trace_cmd_test -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:16.906 11:14:58 rpc.rpc_trace_cmd_test -- rpc/rpc.sh@42 -- # info='{ 00:04:16.906 "bdev": { 00:04:16.906 "mask": "0x8", 00:04:16.906 "tpoint_mask": "0xffffffffffffffff" 00:04:16.906 }, 00:04:16.906 "bdev_nvme": { 00:04:16.906 "mask": "0x4000", 00:04:16.906 "tpoint_mask": "0x0" 00:04:16.906 }, 00:04:16.906 "bdev_raid": { 00:04:16.906 "mask": "0x20000", 00:04:16.906 "tpoint_mask": "0x0" 00:04:16.906 }, 00:04:16.906 "blob": { 00:04:16.906 "mask": "0x10000", 00:04:16.906 "tpoint_mask": "0x0" 00:04:16.906 }, 00:04:16.906 "blobfs": { 00:04:16.906 "mask": "0x80", 00:04:16.906 "tpoint_mask": "0x0" 00:04:16.906 }, 00:04:16.906 "dsa": { 00:04:16.906 "mask": "0x200", 00:04:16.906 "tpoint_mask": "0x0" 00:04:16.906 }, 00:04:16.906 "ftl": { 00:04:16.906 "mask": "0x40", 00:04:16.906 "tpoint_mask": "0x0" 00:04:16.906 }, 00:04:16.906 "iaa": { 00:04:16.906 "mask": "0x1000", 00:04:16.906 "tpoint_mask": "0x0" 00:04:16.906 }, 00:04:16.906 "iscsi_conn": { 00:04:16.906 "mask": "0x2", 00:04:16.906 "tpoint_mask": "0x0" 00:04:16.906 }, 00:04:16.906 "nvme_pcie": { 00:04:16.906 "mask": "0x800", 00:04:16.906 "tpoint_mask": "0x0" 00:04:16.906 }, 00:04:16.906 "nvme_tcp": { 00:04:16.906 "mask": "0x2000", 00:04:16.906 "tpoint_mask": "0x0" 00:04:16.906 }, 00:04:16.906 "nvmf_rdma": { 00:04:16.906 "mask": "0x10", 00:04:16.906 "tpoint_mask": "0x0" 00:04:16.906 }, 00:04:16.906 "nvmf_tcp": { 00:04:16.906 "mask": "0x20", 00:04:16.906 "tpoint_mask": "0x0" 00:04:16.906 }, 00:04:16.906 "scheduler": { 00:04:16.906 "mask": "0x40000", 00:04:16.906 "tpoint_mask": "0x0" 00:04:16.906 }, 00:04:16.906 "scsi": { 00:04:16.906 "mask": "0x4", 00:04:16.906 "tpoint_mask": "0x0" 00:04:16.906 }, 00:04:16.906 "sock": { 00:04:16.906 "mask": "0x8000", 00:04:16.906 "tpoint_mask": "0x0" 00:04:16.906 }, 00:04:16.906 "thread": { 00:04:16.906 "mask": "0x400", 00:04:16.906 "tpoint_mask": "0x0" 00:04:16.906 }, 00:04:16.906 "tpoint_group_mask": "0x8", 00:04:16.906 "tpoint_shm_path": "/dev/shm/spdk_tgt_trace.pid58494" 00:04:16.906 }' 00:04:16.906 11:14:58 rpc.rpc_trace_cmd_test -- rpc/rpc.sh@43 -- # jq length 00:04:16.906 11:14:58 rpc.rpc_trace_cmd_test -- rpc/rpc.sh@43 -- # '[' 19 -gt 2 ']' 00:04:16.906 11:14:58 rpc.rpc_trace_cmd_test -- rpc/rpc.sh@44 -- # jq 'has("tpoint_group_mask")' 00:04:16.906 11:14:58 rpc.rpc_trace_cmd_test -- rpc/rpc.sh@44 -- # '[' true = true ']' 00:04:16.906 11:14:58 rpc.rpc_trace_cmd_test -- rpc/rpc.sh@45 -- # jq 'has("tpoint_shm_path")' 00:04:16.906 11:14:58 rpc.rpc_trace_cmd_test -- rpc/rpc.sh@45 -- # '[' true = true ']' 00:04:16.906 11:14:58 rpc.rpc_trace_cmd_test -- rpc/rpc.sh@46 -- # jq 'has("bdev")' 00:04:17.202 11:14:58 rpc.rpc_trace_cmd_test -- rpc/rpc.sh@46 -- # '[' true = true ']' 00:04:17.202 11:14:58 rpc.rpc_trace_cmd_test -- rpc/rpc.sh@47 -- # jq -r .bdev.tpoint_mask 00:04:17.202 11:14:58 rpc.rpc_trace_cmd_test -- rpc/rpc.sh@47 -- # '[' 0xffffffffffffffff '!=' 0x0 ']' 00:04:17.202 00:04:17.202 real 0m0.269s 00:04:17.202 user 0m0.231s 00:04:17.202 sys 0m0.028s 00:04:17.202 11:14:58 rpc.rpc_trace_cmd_test -- common/autotest_common.sh@1126 -- # xtrace_disable 00:04:17.202 ************************************ 00:04:17.202 END TEST rpc_trace_cmd_test 00:04:17.202 11:14:58 rpc.rpc_trace_cmd_test -- common/autotest_common.sh@10 -- # set +x 00:04:17.202 ************************************ 00:04:17.202 11:14:58 rpc -- rpc/rpc.sh@76 -- # [[ 1 -eq 1 ]] 00:04:17.202 11:14:58 rpc -- rpc/rpc.sh@77 -- # run_test go_rpc go_rpc 00:04:17.202 11:14:58 rpc -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:04:17.202 11:14:58 rpc -- common/autotest_common.sh@1107 -- # xtrace_disable 00:04:17.202 11:14:58 rpc -- common/autotest_common.sh@10 -- # set +x 00:04:17.202 ************************************ 00:04:17.202 START TEST go_rpc 00:04:17.202 ************************************ 00:04:17.202 11:14:58 rpc.go_rpc -- common/autotest_common.sh@1125 -- # go_rpc 00:04:17.202 11:14:58 rpc.go_rpc -- rpc/rpc.sh@51 -- # /home/vagrant/spdk_repo/spdk/build/examples/hello_gorpc 00:04:17.202 11:14:58 rpc.go_rpc -- rpc/rpc.sh@51 -- # bdevs='[]' 00:04:17.202 11:14:58 rpc.go_rpc -- rpc/rpc.sh@52 -- # jq length 00:04:17.202 11:14:58 rpc.go_rpc -- rpc/rpc.sh@52 -- # '[' 0 == 0 ']' 00:04:17.202 11:14:58 rpc.go_rpc -- rpc/rpc.sh@54 -- # rpc_cmd bdev_malloc_create 8 512 00:04:17.202 11:14:58 rpc.go_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:17.202 11:14:58 rpc.go_rpc -- common/autotest_common.sh@10 -- # set +x 00:04:17.202 11:14:58 rpc.go_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:17.202 11:14:58 rpc.go_rpc -- rpc/rpc.sh@54 -- # malloc=Malloc2 00:04:17.202 11:14:58 rpc.go_rpc -- rpc/rpc.sh@56 -- # /home/vagrant/spdk_repo/spdk/build/examples/hello_gorpc 00:04:17.202 11:14:58 rpc.go_rpc -- rpc/rpc.sh@56 -- # bdevs='[{"aliases":["b9e04055-59e0-4dc7-a7c8-7a9e915f1088"],"assigned_rate_limits":{"r_mbytes_per_sec":0,"rw_ios_per_sec":0,"rw_mbytes_per_sec":0,"w_mbytes_per_sec":0},"block_size":512,"claimed":false,"driver_specific":{},"memory_domains":[{"dma_device_id":"system","dma_device_type":1},{"dma_device_id":"SPDK_ACCEL_DMA_DEVICE","dma_device_type":2}],"name":"Malloc2","num_blocks":16384,"product_name":"Malloc disk","supported_io_types":{"abort":true,"compare":false,"compare_and_write":false,"copy":true,"flush":true,"get_zone_info":false,"nvme_admin":false,"nvme_io":false,"nvme_io_md":false,"nvme_iov_md":false,"read":true,"reset":true,"seek_data":false,"seek_hole":false,"unmap":true,"write":true,"write_zeroes":true,"zcopy":true,"zone_append":false,"zone_management":false},"uuid":"b9e04055-59e0-4dc7-a7c8-7a9e915f1088","zoned":false}]' 00:04:17.202 11:14:58 rpc.go_rpc -- rpc/rpc.sh@57 -- # jq length 00:04:17.202 11:14:58 rpc.go_rpc -- rpc/rpc.sh@57 -- # '[' 1 == 1 ']' 00:04:17.202 11:14:58 rpc.go_rpc -- rpc/rpc.sh@59 -- # rpc_cmd bdev_malloc_delete Malloc2 00:04:17.202 11:14:58 rpc.go_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:17.202 11:14:58 rpc.go_rpc -- common/autotest_common.sh@10 -- # set +x 00:04:17.202 11:14:58 rpc.go_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:17.202 11:14:58 rpc.go_rpc -- rpc/rpc.sh@60 -- # /home/vagrant/spdk_repo/spdk/build/examples/hello_gorpc 00:04:17.202 11:14:58 rpc.go_rpc -- rpc/rpc.sh@60 -- # bdevs='[]' 00:04:17.202 11:14:58 rpc.go_rpc -- rpc/rpc.sh@61 -- # jq length 00:04:17.460 ************************************ 00:04:17.460 END TEST go_rpc 00:04:17.460 ************************************ 00:04:17.460 11:14:58 rpc.go_rpc -- rpc/rpc.sh@61 -- # '[' 0 == 0 ']' 00:04:17.460 00:04:17.460 real 0m0.218s 00:04:17.460 user 0m0.143s 00:04:17.460 sys 0m0.038s 00:04:17.460 11:14:58 rpc.go_rpc -- common/autotest_common.sh@1126 -- # xtrace_disable 00:04:17.460 11:14:58 rpc.go_rpc -- common/autotest_common.sh@10 -- # set +x 00:04:17.460 11:14:58 rpc -- rpc/rpc.sh@80 -- # rpc=rpc_cmd 00:04:17.460 11:14:58 rpc -- rpc/rpc.sh@81 -- # run_test rpc_daemon_integrity rpc_integrity 00:04:17.460 11:14:58 rpc -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:04:17.460 11:14:58 rpc -- common/autotest_common.sh@1107 -- # xtrace_disable 00:04:17.460 11:14:58 rpc -- common/autotest_common.sh@10 -- # set +x 00:04:17.460 ************************************ 00:04:17.460 START TEST rpc_daemon_integrity 00:04:17.460 ************************************ 00:04:17.460 11:14:59 rpc.rpc_daemon_integrity -- common/autotest_common.sh@1125 -- # rpc_integrity 00:04:17.460 11:14:59 rpc.rpc_daemon_integrity -- rpc/rpc.sh@12 -- # rpc_cmd bdev_get_bdevs 00:04:17.460 11:14:59 rpc.rpc_daemon_integrity -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:17.460 11:14:59 rpc.rpc_daemon_integrity -- common/autotest_common.sh@10 -- # set +x 00:04:17.460 11:14:59 rpc.rpc_daemon_integrity -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:17.460 11:14:59 rpc.rpc_daemon_integrity -- rpc/rpc.sh@12 -- # bdevs='[]' 00:04:17.460 11:14:59 rpc.rpc_daemon_integrity -- rpc/rpc.sh@13 -- # jq length 00:04:17.460 11:14:59 rpc.rpc_daemon_integrity -- rpc/rpc.sh@13 -- # '[' 0 == 0 ']' 00:04:17.460 11:14:59 rpc.rpc_daemon_integrity -- rpc/rpc.sh@15 -- # rpc_cmd bdev_malloc_create 8 512 00:04:17.460 11:14:59 rpc.rpc_daemon_integrity -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:17.460 11:14:59 rpc.rpc_daemon_integrity -- common/autotest_common.sh@10 -- # set +x 00:04:17.460 11:14:59 rpc.rpc_daemon_integrity -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:17.460 11:14:59 rpc.rpc_daemon_integrity -- rpc/rpc.sh@15 -- # malloc=Malloc3 00:04:17.460 11:14:59 rpc.rpc_daemon_integrity -- rpc/rpc.sh@16 -- # rpc_cmd bdev_get_bdevs 00:04:17.460 11:14:59 rpc.rpc_daemon_integrity -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:17.460 11:14:59 rpc.rpc_daemon_integrity -- common/autotest_common.sh@10 -- # set +x 00:04:17.460 11:14:59 rpc.rpc_daemon_integrity -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:17.460 11:14:59 rpc.rpc_daemon_integrity -- rpc/rpc.sh@16 -- # bdevs='[ 00:04:17.460 { 00:04:17.460 "aliases": [ 00:04:17.460 "5ec3751a-0191-4f5d-b1d8-40476d3b733e" 00:04:17.460 ], 00:04:17.460 "assigned_rate_limits": { 00:04:17.460 "r_mbytes_per_sec": 0, 00:04:17.460 "rw_ios_per_sec": 0, 00:04:17.460 "rw_mbytes_per_sec": 0, 00:04:17.460 "w_mbytes_per_sec": 0 00:04:17.460 }, 00:04:17.460 "block_size": 512, 00:04:17.460 "claimed": false, 00:04:17.460 "driver_specific": {}, 00:04:17.460 "memory_domains": [ 00:04:17.460 { 00:04:17.460 "dma_device_id": "system", 00:04:17.460 "dma_device_type": 1 00:04:17.460 }, 00:04:17.460 { 00:04:17.460 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:17.460 "dma_device_type": 2 00:04:17.460 } 00:04:17.460 ], 00:04:17.460 "name": "Malloc3", 00:04:17.460 "num_blocks": 16384, 00:04:17.460 "product_name": "Malloc disk", 00:04:17.460 "supported_io_types": { 00:04:17.460 "abort": true, 00:04:17.460 "compare": false, 00:04:17.460 "compare_and_write": false, 00:04:17.460 "copy": true, 00:04:17.460 "flush": true, 00:04:17.460 "get_zone_info": false, 00:04:17.460 "nvme_admin": false, 00:04:17.460 "nvme_io": false, 00:04:17.460 "nvme_io_md": false, 00:04:17.460 "nvme_iov_md": false, 00:04:17.461 "read": true, 00:04:17.461 "reset": true, 00:04:17.461 "seek_data": false, 00:04:17.461 "seek_hole": false, 00:04:17.461 "unmap": true, 00:04:17.461 "write": true, 00:04:17.461 "write_zeroes": true, 00:04:17.461 "zcopy": true, 00:04:17.461 "zone_append": false, 00:04:17.461 "zone_management": false 00:04:17.461 }, 00:04:17.461 "uuid": "5ec3751a-0191-4f5d-b1d8-40476d3b733e", 00:04:17.461 "zoned": false 00:04:17.461 } 00:04:17.461 ]' 00:04:17.461 11:14:59 rpc.rpc_daemon_integrity -- rpc/rpc.sh@17 -- # jq length 00:04:17.461 11:14:59 rpc.rpc_daemon_integrity -- rpc/rpc.sh@17 -- # '[' 1 == 1 ']' 00:04:17.461 11:14:59 rpc.rpc_daemon_integrity -- rpc/rpc.sh@19 -- # rpc_cmd bdev_passthru_create -b Malloc3 -p Passthru0 00:04:17.461 11:14:59 rpc.rpc_daemon_integrity -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:17.461 11:14:59 rpc.rpc_daemon_integrity -- common/autotest_common.sh@10 -- # set +x 00:04:17.461 [2024-10-07 11:14:59.156523] vbdev_passthru.c: 607:vbdev_passthru_register: *NOTICE*: Match on Malloc3 00:04:17.461 [2024-10-07 11:14:59.156574] vbdev_passthru.c: 635:vbdev_passthru_register: *NOTICE*: base bdev opened 00:04:17.461 [2024-10-07 11:14:59.156592] vbdev_passthru.c: 681:vbdev_passthru_register: *NOTICE*: io_device created at: 0x0x211ff20 00:04:17.461 [2024-10-07 11:14:59.156610] vbdev_passthru.c: 696:vbdev_passthru_register: *NOTICE*: bdev claimed 00:04:17.461 [2024-10-07 11:14:59.157951] vbdev_passthru.c: 709:vbdev_passthru_register: *NOTICE*: pt_bdev registered 00:04:17.461 [2024-10-07 11:14:59.157980] vbdev_passthru.c: 710:vbdev_passthru_register: *NOTICE*: created pt_bdev for: Passthru0 00:04:17.461 Passthru0 00:04:17.461 11:14:59 rpc.rpc_daemon_integrity -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:17.461 11:14:59 rpc.rpc_daemon_integrity -- rpc/rpc.sh@20 -- # rpc_cmd bdev_get_bdevs 00:04:17.461 11:14:59 rpc.rpc_daemon_integrity -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:17.461 11:14:59 rpc.rpc_daemon_integrity -- common/autotest_common.sh@10 -- # set +x 00:04:17.720 11:14:59 rpc.rpc_daemon_integrity -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:17.720 11:14:59 rpc.rpc_daemon_integrity -- rpc/rpc.sh@20 -- # bdevs='[ 00:04:17.720 { 00:04:17.720 "aliases": [ 00:04:17.720 "5ec3751a-0191-4f5d-b1d8-40476d3b733e" 00:04:17.720 ], 00:04:17.720 "assigned_rate_limits": { 00:04:17.720 "r_mbytes_per_sec": 0, 00:04:17.720 "rw_ios_per_sec": 0, 00:04:17.720 "rw_mbytes_per_sec": 0, 00:04:17.720 "w_mbytes_per_sec": 0 00:04:17.720 }, 00:04:17.720 "block_size": 512, 00:04:17.720 "claim_type": "exclusive_write", 00:04:17.720 "claimed": true, 00:04:17.720 "driver_specific": {}, 00:04:17.720 "memory_domains": [ 00:04:17.720 { 00:04:17.720 "dma_device_id": "system", 00:04:17.720 "dma_device_type": 1 00:04:17.720 }, 00:04:17.720 { 00:04:17.720 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:17.720 "dma_device_type": 2 00:04:17.720 } 00:04:17.720 ], 00:04:17.720 "name": "Malloc3", 00:04:17.720 "num_blocks": 16384, 00:04:17.720 "product_name": "Malloc disk", 00:04:17.720 "supported_io_types": { 00:04:17.720 "abort": true, 00:04:17.720 "compare": false, 00:04:17.720 "compare_and_write": false, 00:04:17.720 "copy": true, 00:04:17.720 "flush": true, 00:04:17.720 "get_zone_info": false, 00:04:17.720 "nvme_admin": false, 00:04:17.720 "nvme_io": false, 00:04:17.720 "nvme_io_md": false, 00:04:17.720 "nvme_iov_md": false, 00:04:17.720 "read": true, 00:04:17.720 "reset": true, 00:04:17.720 "seek_data": false, 00:04:17.720 "seek_hole": false, 00:04:17.720 "unmap": true, 00:04:17.720 "write": true, 00:04:17.720 "write_zeroes": true, 00:04:17.720 "zcopy": true, 00:04:17.720 "zone_append": false, 00:04:17.720 "zone_management": false 00:04:17.720 }, 00:04:17.720 "uuid": "5ec3751a-0191-4f5d-b1d8-40476d3b733e", 00:04:17.720 "zoned": false 00:04:17.720 }, 00:04:17.720 { 00:04:17.720 "aliases": [ 00:04:17.720 "a34d2461-cd2c-557f-983f-9d20f7be0e68" 00:04:17.720 ], 00:04:17.720 "assigned_rate_limits": { 00:04:17.720 "r_mbytes_per_sec": 0, 00:04:17.720 "rw_ios_per_sec": 0, 00:04:17.720 "rw_mbytes_per_sec": 0, 00:04:17.720 "w_mbytes_per_sec": 0 00:04:17.720 }, 00:04:17.720 "block_size": 512, 00:04:17.720 "claimed": false, 00:04:17.720 "driver_specific": { 00:04:17.720 "passthru": { 00:04:17.720 "base_bdev_name": "Malloc3", 00:04:17.720 "name": "Passthru0" 00:04:17.720 } 00:04:17.720 }, 00:04:17.720 "memory_domains": [ 00:04:17.720 { 00:04:17.720 "dma_device_id": "system", 00:04:17.720 "dma_device_type": 1 00:04:17.720 }, 00:04:17.720 { 00:04:17.720 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:17.720 "dma_device_type": 2 00:04:17.720 } 00:04:17.720 ], 00:04:17.720 "name": "Passthru0", 00:04:17.720 "num_blocks": 16384, 00:04:17.720 "product_name": "passthru", 00:04:17.720 "supported_io_types": { 00:04:17.720 "abort": true, 00:04:17.720 "compare": false, 00:04:17.720 "compare_and_write": false, 00:04:17.720 "copy": true, 00:04:17.720 "flush": true, 00:04:17.720 "get_zone_info": false, 00:04:17.720 "nvme_admin": false, 00:04:17.720 "nvme_io": false, 00:04:17.720 "nvme_io_md": false, 00:04:17.720 "nvme_iov_md": false, 00:04:17.720 "read": true, 00:04:17.720 "reset": true, 00:04:17.720 "seek_data": false, 00:04:17.720 "seek_hole": false, 00:04:17.720 "unmap": true, 00:04:17.720 "write": true, 00:04:17.720 "write_zeroes": true, 00:04:17.720 "zcopy": true, 00:04:17.720 "zone_append": false, 00:04:17.720 "zone_management": false 00:04:17.720 }, 00:04:17.720 "uuid": "a34d2461-cd2c-557f-983f-9d20f7be0e68", 00:04:17.720 "zoned": false 00:04:17.720 } 00:04:17.720 ]' 00:04:17.720 11:14:59 rpc.rpc_daemon_integrity -- rpc/rpc.sh@21 -- # jq length 00:04:17.720 11:14:59 rpc.rpc_daemon_integrity -- rpc/rpc.sh@21 -- # '[' 2 == 2 ']' 00:04:17.720 11:14:59 rpc.rpc_daemon_integrity -- rpc/rpc.sh@23 -- # rpc_cmd bdev_passthru_delete Passthru0 00:04:17.720 11:14:59 rpc.rpc_daemon_integrity -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:17.720 11:14:59 rpc.rpc_daemon_integrity -- common/autotest_common.sh@10 -- # set +x 00:04:17.720 11:14:59 rpc.rpc_daemon_integrity -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:17.720 11:14:59 rpc.rpc_daemon_integrity -- rpc/rpc.sh@24 -- # rpc_cmd bdev_malloc_delete Malloc3 00:04:17.720 11:14:59 rpc.rpc_daemon_integrity -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:17.720 11:14:59 rpc.rpc_daemon_integrity -- common/autotest_common.sh@10 -- # set +x 00:04:17.720 11:14:59 rpc.rpc_daemon_integrity -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:17.720 11:14:59 rpc.rpc_daemon_integrity -- rpc/rpc.sh@25 -- # rpc_cmd bdev_get_bdevs 00:04:17.720 11:14:59 rpc.rpc_daemon_integrity -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:17.720 11:14:59 rpc.rpc_daemon_integrity -- common/autotest_common.sh@10 -- # set +x 00:04:17.720 11:14:59 rpc.rpc_daemon_integrity -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:17.720 11:14:59 rpc.rpc_daemon_integrity -- rpc/rpc.sh@25 -- # bdevs='[]' 00:04:17.720 11:14:59 rpc.rpc_daemon_integrity -- rpc/rpc.sh@26 -- # jq length 00:04:17.720 ************************************ 00:04:17.720 END TEST rpc_daemon_integrity 00:04:17.720 ************************************ 00:04:17.720 11:14:59 rpc.rpc_daemon_integrity -- rpc/rpc.sh@26 -- # '[' 0 == 0 ']' 00:04:17.720 00:04:17.720 real 0m0.329s 00:04:17.720 user 0m0.227s 00:04:17.720 sys 0m0.031s 00:04:17.720 11:14:59 rpc.rpc_daemon_integrity -- common/autotest_common.sh@1126 -- # xtrace_disable 00:04:17.720 11:14:59 rpc.rpc_daemon_integrity -- common/autotest_common.sh@10 -- # set +x 00:04:17.720 11:14:59 rpc -- rpc/rpc.sh@83 -- # trap - SIGINT SIGTERM EXIT 00:04:17.720 11:14:59 rpc -- rpc/rpc.sh@84 -- # killprocess 58494 00:04:17.720 11:14:59 rpc -- common/autotest_common.sh@950 -- # '[' -z 58494 ']' 00:04:17.720 11:14:59 rpc -- common/autotest_common.sh@954 -- # kill -0 58494 00:04:17.721 11:14:59 rpc -- common/autotest_common.sh@955 -- # uname 00:04:17.721 11:14:59 rpc -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:04:17.721 11:14:59 rpc -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 58494 00:04:17.721 killing process with pid 58494 00:04:17.721 11:14:59 rpc -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:04:17.721 11:14:59 rpc -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:04:17.721 11:14:59 rpc -- common/autotest_common.sh@968 -- # echo 'killing process with pid 58494' 00:04:17.721 11:14:59 rpc -- common/autotest_common.sh@969 -- # kill 58494 00:04:17.721 11:14:59 rpc -- common/autotest_common.sh@974 -- # wait 58494 00:04:18.287 00:04:18.287 real 0m3.341s 00:04:18.287 user 0m4.258s 00:04:18.287 sys 0m0.892s 00:04:18.287 11:14:59 rpc -- common/autotest_common.sh@1126 -- # xtrace_disable 00:04:18.287 11:14:59 rpc -- common/autotest_common.sh@10 -- # set +x 00:04:18.287 ************************************ 00:04:18.287 END TEST rpc 00:04:18.287 ************************************ 00:04:18.287 11:14:59 -- spdk/autotest.sh@157 -- # run_test skip_rpc /home/vagrant/spdk_repo/spdk/test/rpc/skip_rpc.sh 00:04:18.287 11:14:59 -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:04:18.287 11:14:59 -- common/autotest_common.sh@1107 -- # xtrace_disable 00:04:18.287 11:14:59 -- common/autotest_common.sh@10 -- # set +x 00:04:18.287 ************************************ 00:04:18.287 START TEST skip_rpc 00:04:18.288 ************************************ 00:04:18.288 11:14:59 skip_rpc -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/rpc/skip_rpc.sh 00:04:18.288 * Looking for test storage... 00:04:18.288 * Found test storage at /home/vagrant/spdk_repo/spdk/test/rpc 00:04:18.288 11:14:59 skip_rpc -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:04:18.288 11:14:59 skip_rpc -- common/autotest_common.sh@1681 -- # lcov --version 00:04:18.288 11:14:59 skip_rpc -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:04:18.546 11:15:00 skip_rpc -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:04:18.546 11:15:00 skip_rpc -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:04:18.546 11:15:00 skip_rpc -- scripts/common.sh@333 -- # local ver1 ver1_l 00:04:18.546 11:15:00 skip_rpc -- scripts/common.sh@334 -- # local ver2 ver2_l 00:04:18.546 11:15:00 skip_rpc -- scripts/common.sh@336 -- # IFS=.-: 00:04:18.546 11:15:00 skip_rpc -- scripts/common.sh@336 -- # read -ra ver1 00:04:18.546 11:15:00 skip_rpc -- scripts/common.sh@337 -- # IFS=.-: 00:04:18.546 11:15:00 skip_rpc -- scripts/common.sh@337 -- # read -ra ver2 00:04:18.546 11:15:00 skip_rpc -- scripts/common.sh@338 -- # local 'op=<' 00:04:18.546 11:15:00 skip_rpc -- scripts/common.sh@340 -- # ver1_l=2 00:04:18.546 11:15:00 skip_rpc -- scripts/common.sh@341 -- # ver2_l=1 00:04:18.546 11:15:00 skip_rpc -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:04:18.546 11:15:00 skip_rpc -- scripts/common.sh@344 -- # case "$op" in 00:04:18.546 11:15:00 skip_rpc -- scripts/common.sh@345 -- # : 1 00:04:18.546 11:15:00 skip_rpc -- scripts/common.sh@364 -- # (( v = 0 )) 00:04:18.546 11:15:00 skip_rpc -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:18.546 11:15:00 skip_rpc -- scripts/common.sh@365 -- # decimal 1 00:04:18.546 11:15:00 skip_rpc -- scripts/common.sh@353 -- # local d=1 00:04:18.546 11:15:00 skip_rpc -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:18.546 11:15:00 skip_rpc -- scripts/common.sh@355 -- # echo 1 00:04:18.546 11:15:00 skip_rpc -- scripts/common.sh@365 -- # ver1[v]=1 00:04:18.546 11:15:00 skip_rpc -- scripts/common.sh@366 -- # decimal 2 00:04:18.546 11:15:00 skip_rpc -- scripts/common.sh@353 -- # local d=2 00:04:18.546 11:15:00 skip_rpc -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:18.546 11:15:00 skip_rpc -- scripts/common.sh@355 -- # echo 2 00:04:18.546 11:15:00 skip_rpc -- scripts/common.sh@366 -- # ver2[v]=2 00:04:18.546 11:15:00 skip_rpc -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:04:18.546 11:15:00 skip_rpc -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:04:18.546 11:15:00 skip_rpc -- scripts/common.sh@368 -- # return 0 00:04:18.546 11:15:00 skip_rpc -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:18.546 11:15:00 skip_rpc -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:04:18.546 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:18.546 --rc genhtml_branch_coverage=1 00:04:18.546 --rc genhtml_function_coverage=1 00:04:18.546 --rc genhtml_legend=1 00:04:18.546 --rc geninfo_all_blocks=1 00:04:18.546 --rc geninfo_unexecuted_blocks=1 00:04:18.546 00:04:18.546 ' 00:04:18.546 11:15:00 skip_rpc -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:04:18.546 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:18.546 --rc genhtml_branch_coverage=1 00:04:18.546 --rc genhtml_function_coverage=1 00:04:18.546 --rc genhtml_legend=1 00:04:18.546 --rc geninfo_all_blocks=1 00:04:18.546 --rc geninfo_unexecuted_blocks=1 00:04:18.546 00:04:18.546 ' 00:04:18.546 11:15:00 skip_rpc -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:04:18.546 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:18.546 --rc genhtml_branch_coverage=1 00:04:18.546 --rc genhtml_function_coverage=1 00:04:18.546 --rc genhtml_legend=1 00:04:18.546 --rc geninfo_all_blocks=1 00:04:18.546 --rc geninfo_unexecuted_blocks=1 00:04:18.546 00:04:18.546 ' 00:04:18.546 11:15:00 skip_rpc -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:04:18.546 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:18.546 --rc genhtml_branch_coverage=1 00:04:18.546 --rc genhtml_function_coverage=1 00:04:18.546 --rc genhtml_legend=1 00:04:18.546 --rc geninfo_all_blocks=1 00:04:18.546 --rc geninfo_unexecuted_blocks=1 00:04:18.546 00:04:18.546 ' 00:04:18.546 11:15:00 skip_rpc -- rpc/skip_rpc.sh@11 -- # CONFIG_PATH=/home/vagrant/spdk_repo/spdk/test/rpc/config.json 00:04:18.546 11:15:00 skip_rpc -- rpc/skip_rpc.sh@12 -- # LOG_PATH=/home/vagrant/spdk_repo/spdk/test/rpc/log.txt 00:04:18.546 11:15:00 skip_rpc -- rpc/skip_rpc.sh@73 -- # run_test skip_rpc test_skip_rpc 00:04:18.546 11:15:00 skip_rpc -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:04:18.546 11:15:00 skip_rpc -- common/autotest_common.sh@1107 -- # xtrace_disable 00:04:18.546 11:15:00 skip_rpc -- common/autotest_common.sh@10 -- # set +x 00:04:18.546 ************************************ 00:04:18.546 START TEST skip_rpc 00:04:18.546 ************************************ 00:04:18.546 11:15:00 skip_rpc.skip_rpc -- common/autotest_common.sh@1125 -- # test_skip_rpc 00:04:18.546 11:15:00 skip_rpc.skip_rpc -- rpc/skip_rpc.sh@16 -- # local spdk_pid=58767 00:04:18.546 11:15:00 skip_rpc.skip_rpc -- rpc/skip_rpc.sh@18 -- # trap 'killprocess $spdk_pid; exit 1' SIGINT SIGTERM EXIT 00:04:18.546 11:15:00 skip_rpc.skip_rpc -- rpc/skip_rpc.sh@15 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_tgt --no-rpc-server -m 0x1 00:04:18.546 11:15:00 skip_rpc.skip_rpc -- rpc/skip_rpc.sh@19 -- # sleep 5 00:04:18.546 [2024-10-07 11:15:00.160631] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:04:18.546 [2024-10-07 11:15:00.160965] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid58767 ] 00:04:18.805 [2024-10-07 11:15:00.302621] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:18.805 [2024-10-07 11:15:00.424011] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:04:24.092 11:15:05 skip_rpc.skip_rpc -- rpc/skip_rpc.sh@21 -- # NOT rpc_cmd spdk_get_version 00:04:24.092 11:15:05 skip_rpc.skip_rpc -- common/autotest_common.sh@650 -- # local es=0 00:04:24.092 11:15:05 skip_rpc.skip_rpc -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd spdk_get_version 00:04:24.092 11:15:05 skip_rpc.skip_rpc -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:04:24.092 11:15:05 skip_rpc.skip_rpc -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:04:24.092 11:15:05 skip_rpc.skip_rpc -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:04:24.092 11:15:05 skip_rpc.skip_rpc -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:04:24.092 11:15:05 skip_rpc.skip_rpc -- common/autotest_common.sh@653 -- # rpc_cmd spdk_get_version 00:04:24.093 11:15:05 skip_rpc.skip_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:24.093 11:15:05 skip_rpc.skip_rpc -- common/autotest_common.sh@10 -- # set +x 00:04:24.093 2024/10/07 11:15:05 error on client creation, err: error during client creation for Unix socket, err: could not connect to a Unix socket on address /var/tmp/spdk.sock, err: dial unix /var/tmp/spdk.sock: connect: no such file or directory 00:04:24.093 11:15:05 skip_rpc.skip_rpc -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:04:24.093 11:15:05 skip_rpc.skip_rpc -- common/autotest_common.sh@653 -- # es=1 00:04:24.093 11:15:05 skip_rpc.skip_rpc -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:04:24.093 11:15:05 skip_rpc.skip_rpc -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:04:24.093 11:15:05 skip_rpc.skip_rpc -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:04:24.093 11:15:05 skip_rpc.skip_rpc -- rpc/skip_rpc.sh@22 -- # trap - SIGINT SIGTERM EXIT 00:04:24.093 11:15:05 skip_rpc.skip_rpc -- rpc/skip_rpc.sh@23 -- # killprocess 58767 00:04:24.093 11:15:05 skip_rpc.skip_rpc -- common/autotest_common.sh@950 -- # '[' -z 58767 ']' 00:04:24.093 11:15:05 skip_rpc.skip_rpc -- common/autotest_common.sh@954 -- # kill -0 58767 00:04:24.093 11:15:05 skip_rpc.skip_rpc -- common/autotest_common.sh@955 -- # uname 00:04:24.093 11:15:05 skip_rpc.skip_rpc -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:04:24.093 11:15:05 skip_rpc.skip_rpc -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 58767 00:04:24.093 11:15:05 skip_rpc.skip_rpc -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:04:24.093 11:15:05 skip_rpc.skip_rpc -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:04:24.093 11:15:05 skip_rpc.skip_rpc -- common/autotest_common.sh@968 -- # echo 'killing process with pid 58767' 00:04:24.093 killing process with pid 58767 00:04:24.093 11:15:05 skip_rpc.skip_rpc -- common/autotest_common.sh@969 -- # kill 58767 00:04:24.093 11:15:05 skip_rpc.skip_rpc -- common/autotest_common.sh@974 -- # wait 58767 00:04:24.093 00:04:24.093 real 0m5.474s 00:04:24.093 user 0m5.077s 00:04:24.093 sys 0m0.306s 00:04:24.093 11:15:05 skip_rpc.skip_rpc -- common/autotest_common.sh@1126 -- # xtrace_disable 00:04:24.093 11:15:05 skip_rpc.skip_rpc -- common/autotest_common.sh@10 -- # set +x 00:04:24.093 ************************************ 00:04:24.093 END TEST skip_rpc 00:04:24.093 ************************************ 00:04:24.093 11:15:05 skip_rpc -- rpc/skip_rpc.sh@74 -- # run_test skip_rpc_with_json test_skip_rpc_with_json 00:04:24.093 11:15:05 skip_rpc -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:04:24.093 11:15:05 skip_rpc -- common/autotest_common.sh@1107 -- # xtrace_disable 00:04:24.093 11:15:05 skip_rpc -- common/autotest_common.sh@10 -- # set +x 00:04:24.093 ************************************ 00:04:24.093 START TEST skip_rpc_with_json 00:04:24.093 ************************************ 00:04:24.093 11:15:05 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@1125 -- # test_skip_rpc_with_json 00:04:24.093 11:15:05 skip_rpc.skip_rpc_with_json -- rpc/skip_rpc.sh@44 -- # gen_json_config 00:04:24.093 11:15:05 skip_rpc.skip_rpc_with_json -- rpc/skip_rpc.sh@28 -- # local spdk_pid=58860 00:04:24.093 11:15:05 skip_rpc.skip_rpc_with_json -- rpc/skip_rpc.sh@30 -- # trap 'killprocess $spdk_pid; exit 1' SIGINT SIGTERM EXIT 00:04:24.093 11:15:05 skip_rpc.skip_rpc_with_json -- rpc/skip_rpc.sh@27 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_tgt -m 0x1 00:04:24.093 11:15:05 skip_rpc.skip_rpc_with_json -- rpc/skip_rpc.sh@31 -- # waitforlisten 58860 00:04:24.093 11:15:05 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@831 -- # '[' -z 58860 ']' 00:04:24.093 11:15:05 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:24.093 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:24.093 11:15:05 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@836 -- # local max_retries=100 00:04:24.093 11:15:05 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:24.093 11:15:05 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@840 -- # xtrace_disable 00:04:24.093 11:15:05 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@10 -- # set +x 00:04:24.093 [2024-10-07 11:15:05.679409] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:04:24.093 [2024-10-07 11:15:05.679553] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid58860 ] 00:04:24.351 [2024-10-07 11:15:05.815272] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:24.351 [2024-10-07 11:15:05.925609] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:04:25.285 11:15:06 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:04:25.285 11:15:06 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@864 -- # return 0 00:04:25.285 11:15:06 skip_rpc.skip_rpc_with_json -- rpc/skip_rpc.sh@34 -- # rpc_cmd nvmf_get_transports --trtype tcp 00:04:25.285 11:15:06 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:25.285 11:15:06 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@10 -- # set +x 00:04:25.285 [2024-10-07 11:15:06.722621] nvmf_rpc.c:2703:rpc_nvmf_get_transports: *ERROR*: transport 'tcp' does not exist 00:04:25.285 2024/10/07 11:15:06 error on JSON-RPC call, method: nvmf_get_transports, params: map[trtype:tcp], err: error received for nvmf_get_transports method, err: Code=-19 Msg=No such device 00:04:25.285 request: 00:04:25.285 { 00:04:25.285 "method": "nvmf_get_transports", 00:04:25.285 "params": { 00:04:25.285 "trtype": "tcp" 00:04:25.285 } 00:04:25.285 } 00:04:25.285 Got JSON-RPC error response 00:04:25.285 GoRPCClient: error on JSON-RPC call 00:04:25.285 11:15:06 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:04:25.285 11:15:06 skip_rpc.skip_rpc_with_json -- rpc/skip_rpc.sh@34 -- # rpc_cmd nvmf_create_transport -t tcp 00:04:25.285 11:15:06 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:25.285 11:15:06 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@10 -- # set +x 00:04:25.285 [2024-10-07 11:15:06.734683] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:04:25.285 11:15:06 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:25.285 11:15:06 skip_rpc.skip_rpc_with_json -- rpc/skip_rpc.sh@36 -- # rpc_cmd save_config 00:04:25.285 11:15:06 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:25.285 11:15:06 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@10 -- # set +x 00:04:25.285 11:15:06 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:25.285 11:15:06 skip_rpc.skip_rpc_with_json -- rpc/skip_rpc.sh@37 -- # cat /home/vagrant/spdk_repo/spdk/test/rpc/config.json 00:04:25.285 { 00:04:25.285 "subsystems": [ 00:04:25.285 { 00:04:25.285 "subsystem": "fsdev", 00:04:25.285 "config": [ 00:04:25.285 { 00:04:25.285 "method": "fsdev_set_opts", 00:04:25.286 "params": { 00:04:25.286 "fsdev_io_cache_size": 256, 00:04:25.286 "fsdev_io_pool_size": 65535 00:04:25.286 } 00:04:25.286 } 00:04:25.286 ] 00:04:25.286 }, 00:04:25.286 { 00:04:25.286 "subsystem": "keyring", 00:04:25.286 "config": [] 00:04:25.286 }, 00:04:25.286 { 00:04:25.286 "subsystem": "iobuf", 00:04:25.286 "config": [ 00:04:25.286 { 00:04:25.286 "method": "iobuf_set_options", 00:04:25.286 "params": { 00:04:25.286 "large_bufsize": 135168, 00:04:25.286 "large_pool_count": 1024, 00:04:25.286 "small_bufsize": 8192, 00:04:25.286 "small_pool_count": 8192 00:04:25.286 } 00:04:25.286 } 00:04:25.286 ] 00:04:25.286 }, 00:04:25.286 { 00:04:25.286 "subsystem": "sock", 00:04:25.286 "config": [ 00:04:25.286 { 00:04:25.286 "method": "sock_set_default_impl", 00:04:25.286 "params": { 00:04:25.286 "impl_name": "posix" 00:04:25.286 } 00:04:25.286 }, 00:04:25.286 { 00:04:25.286 "method": "sock_impl_set_options", 00:04:25.286 "params": { 00:04:25.286 "enable_ktls": false, 00:04:25.286 "enable_placement_id": 0, 00:04:25.286 "enable_quickack": false, 00:04:25.286 "enable_recv_pipe": true, 00:04:25.286 "enable_zerocopy_send_client": false, 00:04:25.286 "enable_zerocopy_send_server": true, 00:04:25.286 "impl_name": "ssl", 00:04:25.286 "recv_buf_size": 4096, 00:04:25.286 "send_buf_size": 4096, 00:04:25.286 "tls_version": 0, 00:04:25.286 "zerocopy_threshold": 0 00:04:25.286 } 00:04:25.286 }, 00:04:25.286 { 00:04:25.286 "method": "sock_impl_set_options", 00:04:25.286 "params": { 00:04:25.286 "enable_ktls": false, 00:04:25.286 "enable_placement_id": 0, 00:04:25.286 "enable_quickack": false, 00:04:25.286 "enable_recv_pipe": true, 00:04:25.286 "enable_zerocopy_send_client": false, 00:04:25.286 "enable_zerocopy_send_server": true, 00:04:25.286 "impl_name": "posix", 00:04:25.286 "recv_buf_size": 2097152, 00:04:25.286 "send_buf_size": 2097152, 00:04:25.286 "tls_version": 0, 00:04:25.286 "zerocopy_threshold": 0 00:04:25.286 } 00:04:25.286 } 00:04:25.286 ] 00:04:25.286 }, 00:04:25.286 { 00:04:25.286 "subsystem": "vmd", 00:04:25.286 "config": [] 00:04:25.286 }, 00:04:25.286 { 00:04:25.286 "subsystem": "accel", 00:04:25.286 "config": [ 00:04:25.286 { 00:04:25.286 "method": "accel_set_options", 00:04:25.286 "params": { 00:04:25.286 "buf_count": 2048, 00:04:25.286 "large_cache_size": 16, 00:04:25.286 "sequence_count": 2048, 00:04:25.286 "small_cache_size": 128, 00:04:25.286 "task_count": 2048 00:04:25.286 } 00:04:25.286 } 00:04:25.286 ] 00:04:25.286 }, 00:04:25.286 { 00:04:25.286 "subsystem": "bdev", 00:04:25.286 "config": [ 00:04:25.286 { 00:04:25.286 "method": "bdev_set_options", 00:04:25.286 "params": { 00:04:25.286 "bdev_auto_examine": true, 00:04:25.286 "bdev_io_cache_size": 256, 00:04:25.286 "bdev_io_pool_size": 65535, 00:04:25.286 "iobuf_large_cache_size": 16, 00:04:25.286 "iobuf_small_cache_size": 128 00:04:25.286 } 00:04:25.286 }, 00:04:25.286 { 00:04:25.286 "method": "bdev_raid_set_options", 00:04:25.286 "params": { 00:04:25.286 "process_max_bandwidth_mb_sec": 0, 00:04:25.286 "process_window_size_kb": 1024 00:04:25.286 } 00:04:25.286 }, 00:04:25.286 { 00:04:25.286 "method": "bdev_iscsi_set_options", 00:04:25.286 "params": { 00:04:25.286 "timeout_sec": 30 00:04:25.286 } 00:04:25.286 }, 00:04:25.286 { 00:04:25.286 "method": "bdev_nvme_set_options", 00:04:25.286 "params": { 00:04:25.286 "action_on_timeout": "none", 00:04:25.286 "allow_accel_sequence": false, 00:04:25.286 "arbitration_burst": 0, 00:04:25.286 "bdev_retry_count": 3, 00:04:25.286 "ctrlr_loss_timeout_sec": 0, 00:04:25.286 "delay_cmd_submit": true, 00:04:25.286 "dhchap_dhgroups": [ 00:04:25.286 "null", 00:04:25.286 "ffdhe2048", 00:04:25.286 "ffdhe3072", 00:04:25.286 "ffdhe4096", 00:04:25.286 "ffdhe6144", 00:04:25.286 "ffdhe8192" 00:04:25.286 ], 00:04:25.286 "dhchap_digests": [ 00:04:25.286 "sha256", 00:04:25.286 "sha384", 00:04:25.286 "sha512" 00:04:25.286 ], 00:04:25.286 "disable_auto_failback": false, 00:04:25.286 "fast_io_fail_timeout_sec": 0, 00:04:25.286 "generate_uuids": false, 00:04:25.286 "high_priority_weight": 0, 00:04:25.286 "io_path_stat": false, 00:04:25.286 "io_queue_requests": 0, 00:04:25.286 "keep_alive_timeout_ms": 10000, 00:04:25.286 "low_priority_weight": 0, 00:04:25.286 "medium_priority_weight": 0, 00:04:25.286 "nvme_adminq_poll_period_us": 10000, 00:04:25.286 "nvme_error_stat": false, 00:04:25.286 "nvme_ioq_poll_period_us": 0, 00:04:25.286 "rdma_cm_event_timeout_ms": 0, 00:04:25.286 "rdma_max_cq_size": 0, 00:04:25.286 "rdma_srq_size": 0, 00:04:25.286 "reconnect_delay_sec": 0, 00:04:25.286 "timeout_admin_us": 0, 00:04:25.286 "timeout_us": 0, 00:04:25.286 "transport_ack_timeout": 0, 00:04:25.286 "transport_retry_count": 4, 00:04:25.286 "transport_tos": 0 00:04:25.286 } 00:04:25.286 }, 00:04:25.286 { 00:04:25.286 "method": "bdev_nvme_set_hotplug", 00:04:25.286 "params": { 00:04:25.286 "enable": false, 00:04:25.286 "period_us": 100000 00:04:25.286 } 00:04:25.286 }, 00:04:25.286 { 00:04:25.286 "method": "bdev_wait_for_examine" 00:04:25.286 } 00:04:25.286 ] 00:04:25.286 }, 00:04:25.286 { 00:04:25.286 "subsystem": "scsi", 00:04:25.286 "config": null 00:04:25.286 }, 00:04:25.286 { 00:04:25.286 "subsystem": "scheduler", 00:04:25.286 "config": [ 00:04:25.286 { 00:04:25.286 "method": "framework_set_scheduler", 00:04:25.286 "params": { 00:04:25.286 "name": "static" 00:04:25.286 } 00:04:25.286 } 00:04:25.286 ] 00:04:25.286 }, 00:04:25.286 { 00:04:25.286 "subsystem": "vhost_scsi", 00:04:25.286 "config": [] 00:04:25.286 }, 00:04:25.286 { 00:04:25.286 "subsystem": "vhost_blk", 00:04:25.286 "config": [] 00:04:25.286 }, 00:04:25.286 { 00:04:25.286 "subsystem": "ublk", 00:04:25.286 "config": [] 00:04:25.286 }, 00:04:25.286 { 00:04:25.286 "subsystem": "nbd", 00:04:25.286 "config": [] 00:04:25.286 }, 00:04:25.286 { 00:04:25.286 "subsystem": "nvmf", 00:04:25.286 "config": [ 00:04:25.286 { 00:04:25.286 "method": "nvmf_set_config", 00:04:25.286 "params": { 00:04:25.286 "admin_cmd_passthru": { 00:04:25.286 "identify_ctrlr": false 00:04:25.286 }, 00:04:25.286 "dhchap_dhgroups": [ 00:04:25.286 "null", 00:04:25.286 "ffdhe2048", 00:04:25.286 "ffdhe3072", 00:04:25.286 "ffdhe4096", 00:04:25.286 "ffdhe6144", 00:04:25.286 "ffdhe8192" 00:04:25.286 ], 00:04:25.286 "dhchap_digests": [ 00:04:25.286 "sha256", 00:04:25.286 "sha384", 00:04:25.286 "sha512" 00:04:25.286 ], 00:04:25.286 "discovery_filter": "match_any" 00:04:25.286 } 00:04:25.286 }, 00:04:25.286 { 00:04:25.286 "method": "nvmf_set_max_subsystems", 00:04:25.286 "params": { 00:04:25.286 "max_subsystems": 1024 00:04:25.286 } 00:04:25.286 }, 00:04:25.286 { 00:04:25.286 "method": "nvmf_set_crdt", 00:04:25.286 "params": { 00:04:25.286 "crdt1": 0, 00:04:25.286 "crdt2": 0, 00:04:25.286 "crdt3": 0 00:04:25.286 } 00:04:25.286 }, 00:04:25.286 { 00:04:25.286 "method": "nvmf_create_transport", 00:04:25.286 "params": { 00:04:25.286 "abort_timeout_sec": 1, 00:04:25.286 "ack_timeout": 0, 00:04:25.286 "buf_cache_size": 4294967295, 00:04:25.286 "c2h_success": true, 00:04:25.286 "data_wr_pool_size": 0, 00:04:25.286 "dif_insert_or_strip": false, 00:04:25.286 "in_capsule_data_size": 4096, 00:04:25.286 "io_unit_size": 131072, 00:04:25.286 "max_aq_depth": 128, 00:04:25.286 "max_io_qpairs_per_ctrlr": 127, 00:04:25.286 "max_io_size": 131072, 00:04:25.286 "max_queue_depth": 128, 00:04:25.286 "num_shared_buffers": 511, 00:04:25.286 "sock_priority": 0, 00:04:25.286 "trtype": "TCP", 00:04:25.286 "zcopy": false 00:04:25.286 } 00:04:25.286 } 00:04:25.286 ] 00:04:25.286 }, 00:04:25.286 { 00:04:25.286 "subsystem": "iscsi", 00:04:25.286 "config": [ 00:04:25.286 { 00:04:25.286 "method": "iscsi_set_options", 00:04:25.286 "params": { 00:04:25.286 "allow_duplicated_isid": false, 00:04:25.286 "chap_group": 0, 00:04:25.286 "data_out_pool_size": 2048, 00:04:25.286 "default_time2retain": 20, 00:04:25.286 "default_time2wait": 2, 00:04:25.286 "disable_chap": false, 00:04:25.286 "error_recovery_level": 0, 00:04:25.286 "first_burst_length": 8192, 00:04:25.286 "immediate_data": true, 00:04:25.286 "immediate_data_pool_size": 16384, 00:04:25.286 "max_connections_per_session": 2, 00:04:25.286 "max_large_datain_per_connection": 64, 00:04:25.286 "max_queue_depth": 64, 00:04:25.286 "max_r2t_per_connection": 4, 00:04:25.286 "max_sessions": 128, 00:04:25.286 "mutual_chap": false, 00:04:25.286 "node_base": "iqn.2016-06.io.spdk", 00:04:25.286 "nop_in_interval": 30, 00:04:25.286 "nop_timeout": 60, 00:04:25.286 "pdu_pool_size": 36864, 00:04:25.286 "require_chap": false 00:04:25.286 } 00:04:25.286 } 00:04:25.287 ] 00:04:25.287 } 00:04:25.287 ] 00:04:25.287 } 00:04:25.287 11:15:06 skip_rpc.skip_rpc_with_json -- rpc/skip_rpc.sh@39 -- # trap - SIGINT SIGTERM EXIT 00:04:25.287 11:15:06 skip_rpc.skip_rpc_with_json -- rpc/skip_rpc.sh@40 -- # killprocess 58860 00:04:25.287 11:15:06 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@950 -- # '[' -z 58860 ']' 00:04:25.287 11:15:06 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@954 -- # kill -0 58860 00:04:25.287 11:15:06 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@955 -- # uname 00:04:25.287 11:15:06 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:04:25.287 11:15:06 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 58860 00:04:25.287 11:15:06 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:04:25.287 killing process with pid 58860 00:04:25.287 11:15:06 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:04:25.287 11:15:06 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@968 -- # echo 'killing process with pid 58860' 00:04:25.287 11:15:06 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@969 -- # kill 58860 00:04:25.287 11:15:06 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@974 -- # wait 58860 00:04:25.852 11:15:07 skip_rpc.skip_rpc_with_json -- rpc/skip_rpc.sh@47 -- # local spdk_pid=58899 00:04:25.852 11:15:07 skip_rpc.skip_rpc_with_json -- rpc/skip_rpc.sh@48 -- # sleep 5 00:04:25.852 11:15:07 skip_rpc.skip_rpc_with_json -- rpc/skip_rpc.sh@46 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_tgt --no-rpc-server -m 0x1 --json /home/vagrant/spdk_repo/spdk/test/rpc/config.json 00:04:31.117 11:15:12 skip_rpc.skip_rpc_with_json -- rpc/skip_rpc.sh@50 -- # killprocess 58899 00:04:31.117 11:15:12 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@950 -- # '[' -z 58899 ']' 00:04:31.117 11:15:12 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@954 -- # kill -0 58899 00:04:31.117 11:15:12 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@955 -- # uname 00:04:31.117 11:15:12 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:04:31.117 11:15:12 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 58899 00:04:31.117 11:15:12 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:04:31.117 killing process with pid 58899 00:04:31.117 11:15:12 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:04:31.117 11:15:12 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@968 -- # echo 'killing process with pid 58899' 00:04:31.117 11:15:12 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@969 -- # kill 58899 00:04:31.117 11:15:12 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@974 -- # wait 58899 00:04:31.376 11:15:13 skip_rpc.skip_rpc_with_json -- rpc/skip_rpc.sh@51 -- # grep -q 'TCP Transport Init' /home/vagrant/spdk_repo/spdk/test/rpc/log.txt 00:04:31.376 11:15:13 skip_rpc.skip_rpc_with_json -- rpc/skip_rpc.sh@52 -- # rm /home/vagrant/spdk_repo/spdk/test/rpc/log.txt 00:04:31.376 00:04:31.376 real 0m7.430s 00:04:31.376 user 0m7.146s 00:04:31.376 sys 0m0.751s 00:04:31.376 11:15:13 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@1126 -- # xtrace_disable 00:04:31.376 ************************************ 00:04:31.376 END TEST skip_rpc_with_json 00:04:31.376 ************************************ 00:04:31.376 11:15:13 skip_rpc.skip_rpc_with_json -- common/autotest_common.sh@10 -- # set +x 00:04:31.376 11:15:13 skip_rpc -- rpc/skip_rpc.sh@75 -- # run_test skip_rpc_with_delay test_skip_rpc_with_delay 00:04:31.376 11:15:13 skip_rpc -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:04:31.634 11:15:13 skip_rpc -- common/autotest_common.sh@1107 -- # xtrace_disable 00:04:31.634 11:15:13 skip_rpc -- common/autotest_common.sh@10 -- # set +x 00:04:31.634 ************************************ 00:04:31.634 START TEST skip_rpc_with_delay 00:04:31.634 ************************************ 00:04:31.634 11:15:13 skip_rpc.skip_rpc_with_delay -- common/autotest_common.sh@1125 -- # test_skip_rpc_with_delay 00:04:31.634 11:15:13 skip_rpc.skip_rpc_with_delay -- rpc/skip_rpc.sh@57 -- # NOT /home/vagrant/spdk_repo/spdk/build/bin/spdk_tgt --no-rpc-server -m 0x1 --wait-for-rpc 00:04:31.634 11:15:13 skip_rpc.skip_rpc_with_delay -- common/autotest_common.sh@650 -- # local es=0 00:04:31.634 11:15:13 skip_rpc.skip_rpc_with_delay -- common/autotest_common.sh@652 -- # valid_exec_arg /home/vagrant/spdk_repo/spdk/build/bin/spdk_tgt --no-rpc-server -m 0x1 --wait-for-rpc 00:04:31.634 11:15:13 skip_rpc.skip_rpc_with_delay -- common/autotest_common.sh@638 -- # local arg=/home/vagrant/spdk_repo/spdk/build/bin/spdk_tgt 00:04:31.634 11:15:13 skip_rpc.skip_rpc_with_delay -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:04:31.634 11:15:13 skip_rpc.skip_rpc_with_delay -- common/autotest_common.sh@642 -- # type -t /home/vagrant/spdk_repo/spdk/build/bin/spdk_tgt 00:04:31.634 11:15:13 skip_rpc.skip_rpc_with_delay -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:04:31.634 11:15:13 skip_rpc.skip_rpc_with_delay -- common/autotest_common.sh@644 -- # type -P /home/vagrant/spdk_repo/spdk/build/bin/spdk_tgt 00:04:31.634 11:15:13 skip_rpc.skip_rpc_with_delay -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:04:31.634 11:15:13 skip_rpc.skip_rpc_with_delay -- common/autotest_common.sh@644 -- # arg=/home/vagrant/spdk_repo/spdk/build/bin/spdk_tgt 00:04:31.634 11:15:13 skip_rpc.skip_rpc_with_delay -- common/autotest_common.sh@644 -- # [[ -x /home/vagrant/spdk_repo/spdk/build/bin/spdk_tgt ]] 00:04:31.634 11:15:13 skip_rpc.skip_rpc_with_delay -- common/autotest_common.sh@653 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_tgt --no-rpc-server -m 0x1 --wait-for-rpc 00:04:31.634 [2024-10-07 11:15:13.167534] app.c: 840:spdk_app_start: *ERROR*: Cannot use '--wait-for-rpc' if no RPC server is going to be started. 00:04:31.634 [2024-10-07 11:15:13.167644] app.c: 719:unclaim_cpu_cores: *ERROR*: Failed to unlink lock fd for core 0, errno: 2 00:04:31.634 11:15:13 skip_rpc.skip_rpc_with_delay -- common/autotest_common.sh@653 -- # es=1 00:04:31.634 11:15:13 skip_rpc.skip_rpc_with_delay -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:04:31.634 11:15:13 skip_rpc.skip_rpc_with_delay -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:04:31.634 11:15:13 skip_rpc.skip_rpc_with_delay -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:04:31.634 00:04:31.634 real 0m0.089s 00:04:31.634 user 0m0.052s 00:04:31.634 sys 0m0.036s 00:04:31.634 ************************************ 00:04:31.634 END TEST skip_rpc_with_delay 00:04:31.634 ************************************ 00:04:31.634 11:15:13 skip_rpc.skip_rpc_with_delay -- common/autotest_common.sh@1126 -- # xtrace_disable 00:04:31.634 11:15:13 skip_rpc.skip_rpc_with_delay -- common/autotest_common.sh@10 -- # set +x 00:04:31.634 11:15:13 skip_rpc -- rpc/skip_rpc.sh@77 -- # uname 00:04:31.634 11:15:13 skip_rpc -- rpc/skip_rpc.sh@77 -- # '[' Linux '!=' FreeBSD ']' 00:04:31.634 11:15:13 skip_rpc -- rpc/skip_rpc.sh@78 -- # run_test exit_on_failed_rpc_init test_exit_on_failed_rpc_init 00:04:31.634 11:15:13 skip_rpc -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:04:31.634 11:15:13 skip_rpc -- common/autotest_common.sh@1107 -- # xtrace_disable 00:04:31.634 11:15:13 skip_rpc -- common/autotest_common.sh@10 -- # set +x 00:04:31.634 ************************************ 00:04:31.634 START TEST exit_on_failed_rpc_init 00:04:31.634 ************************************ 00:04:31.634 11:15:13 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@1125 -- # test_exit_on_failed_rpc_init 00:04:31.634 11:15:13 skip_rpc.exit_on_failed_rpc_init -- rpc/skip_rpc.sh@62 -- # local spdk_pid=59009 00:04:31.634 11:15:13 skip_rpc.exit_on_failed_rpc_init -- rpc/skip_rpc.sh@61 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_tgt -m 0x1 00:04:31.634 11:15:13 skip_rpc.exit_on_failed_rpc_init -- rpc/skip_rpc.sh@63 -- # waitforlisten 59009 00:04:31.634 11:15:13 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@831 -- # '[' -z 59009 ']' 00:04:31.634 11:15:13 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:31.634 11:15:13 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@836 -- # local max_retries=100 00:04:31.634 11:15:13 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:31.634 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:31.634 11:15:13 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@840 -- # xtrace_disable 00:04:31.634 11:15:13 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@10 -- # set +x 00:04:31.634 [2024-10-07 11:15:13.309751] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:04:31.634 [2024-10-07 11:15:13.309836] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid59009 ] 00:04:31.892 [2024-10-07 11:15:13.443615] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:31.892 [2024-10-07 11:15:13.597082] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:04:32.825 11:15:14 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:04:32.825 11:15:14 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@864 -- # return 0 00:04:32.825 11:15:14 skip_rpc.exit_on_failed_rpc_init -- rpc/skip_rpc.sh@65 -- # trap 'killprocess $spdk_pid; exit 1' SIGINT SIGTERM EXIT 00:04:32.825 11:15:14 skip_rpc.exit_on_failed_rpc_init -- rpc/skip_rpc.sh@67 -- # NOT /home/vagrant/spdk_repo/spdk/build/bin/spdk_tgt -m 0x2 00:04:32.825 11:15:14 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@650 -- # local es=0 00:04:32.825 11:15:14 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@652 -- # valid_exec_arg /home/vagrant/spdk_repo/spdk/build/bin/spdk_tgt -m 0x2 00:04:32.825 11:15:14 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@638 -- # local arg=/home/vagrant/spdk_repo/spdk/build/bin/spdk_tgt 00:04:32.825 11:15:14 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:04:32.825 11:15:14 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@642 -- # type -t /home/vagrant/spdk_repo/spdk/build/bin/spdk_tgt 00:04:32.825 11:15:14 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:04:32.825 11:15:14 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@644 -- # type -P /home/vagrant/spdk_repo/spdk/build/bin/spdk_tgt 00:04:32.825 11:15:14 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:04:32.825 11:15:14 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@644 -- # arg=/home/vagrant/spdk_repo/spdk/build/bin/spdk_tgt 00:04:32.825 11:15:14 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@644 -- # [[ -x /home/vagrant/spdk_repo/spdk/build/bin/spdk_tgt ]] 00:04:32.825 11:15:14 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@653 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_tgt -m 0x2 00:04:32.825 [2024-10-07 11:15:14.438726] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:04:32.825 [2024-10-07 11:15:14.438830] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid59044 ] 00:04:33.083 [2024-10-07 11:15:14.573788] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:33.083 [2024-10-07 11:15:14.696567] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:04:33.083 [2024-10-07 11:15:14.696674] rpc.c: 180:_spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:04:33.083 [2024-10-07 11:15:14.696693] rpc.c: 166:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:04:33.083 [2024-10-07 11:15:14.696703] app.c:1062:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:04:33.083 11:15:14 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@653 -- # es=234 00:04:33.083 11:15:14 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:04:33.083 11:15:14 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@662 -- # es=106 00:04:33.083 11:15:14 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@663 -- # case "$es" in 00:04:33.083 11:15:14 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@670 -- # es=1 00:04:33.083 11:15:14 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:04:33.083 11:15:14 skip_rpc.exit_on_failed_rpc_init -- rpc/skip_rpc.sh@69 -- # trap - SIGINT SIGTERM EXIT 00:04:33.083 11:15:14 skip_rpc.exit_on_failed_rpc_init -- rpc/skip_rpc.sh@70 -- # killprocess 59009 00:04:33.083 11:15:14 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@950 -- # '[' -z 59009 ']' 00:04:33.083 11:15:14 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@954 -- # kill -0 59009 00:04:33.341 11:15:14 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@955 -- # uname 00:04:33.341 11:15:14 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:04:33.341 11:15:14 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 59009 00:04:33.341 11:15:14 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:04:33.341 killing process with pid 59009 00:04:33.341 11:15:14 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:04:33.341 11:15:14 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@968 -- # echo 'killing process with pid 59009' 00:04:33.341 11:15:14 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@969 -- # kill 59009 00:04:33.341 11:15:14 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@974 -- # wait 59009 00:04:33.907 00:04:33.907 real 0m2.157s 00:04:33.907 user 0m2.455s 00:04:33.907 sys 0m0.542s 00:04:33.907 11:15:15 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@1126 -- # xtrace_disable 00:04:33.907 11:15:15 skip_rpc.exit_on_failed_rpc_init -- common/autotest_common.sh@10 -- # set +x 00:04:33.907 ************************************ 00:04:33.907 END TEST exit_on_failed_rpc_init 00:04:33.907 ************************************ 00:04:33.907 11:15:15 skip_rpc -- rpc/skip_rpc.sh@81 -- # rm /home/vagrant/spdk_repo/spdk/test/rpc/config.json 00:04:33.907 00:04:33.907 real 0m15.564s 00:04:33.907 user 0m14.915s 00:04:33.907 sys 0m1.854s 00:04:33.907 11:15:15 skip_rpc -- common/autotest_common.sh@1126 -- # xtrace_disable 00:04:33.907 11:15:15 skip_rpc -- common/autotest_common.sh@10 -- # set +x 00:04:33.907 ************************************ 00:04:33.907 END TEST skip_rpc 00:04:33.907 ************************************ 00:04:33.908 11:15:15 -- spdk/autotest.sh@158 -- # run_test rpc_client /home/vagrant/spdk_repo/spdk/test/rpc_client/rpc_client.sh 00:04:33.908 11:15:15 -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:04:33.908 11:15:15 -- common/autotest_common.sh@1107 -- # xtrace_disable 00:04:33.908 11:15:15 -- common/autotest_common.sh@10 -- # set +x 00:04:33.908 ************************************ 00:04:33.908 START TEST rpc_client 00:04:33.908 ************************************ 00:04:33.908 11:15:15 rpc_client -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/rpc_client/rpc_client.sh 00:04:33.908 * Looking for test storage... 00:04:33.908 * Found test storage at /home/vagrant/spdk_repo/spdk/test/rpc_client 00:04:33.908 11:15:15 rpc_client -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:04:33.908 11:15:15 rpc_client -- common/autotest_common.sh@1681 -- # lcov --version 00:04:33.908 11:15:15 rpc_client -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:04:34.166 11:15:15 rpc_client -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:04:34.166 11:15:15 rpc_client -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:04:34.166 11:15:15 rpc_client -- scripts/common.sh@333 -- # local ver1 ver1_l 00:04:34.166 11:15:15 rpc_client -- scripts/common.sh@334 -- # local ver2 ver2_l 00:04:34.166 11:15:15 rpc_client -- scripts/common.sh@336 -- # IFS=.-: 00:04:34.166 11:15:15 rpc_client -- scripts/common.sh@336 -- # read -ra ver1 00:04:34.166 11:15:15 rpc_client -- scripts/common.sh@337 -- # IFS=.-: 00:04:34.166 11:15:15 rpc_client -- scripts/common.sh@337 -- # read -ra ver2 00:04:34.166 11:15:15 rpc_client -- scripts/common.sh@338 -- # local 'op=<' 00:04:34.166 11:15:15 rpc_client -- scripts/common.sh@340 -- # ver1_l=2 00:04:34.166 11:15:15 rpc_client -- scripts/common.sh@341 -- # ver2_l=1 00:04:34.166 11:15:15 rpc_client -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:04:34.166 11:15:15 rpc_client -- scripts/common.sh@344 -- # case "$op" in 00:04:34.166 11:15:15 rpc_client -- scripts/common.sh@345 -- # : 1 00:04:34.166 11:15:15 rpc_client -- scripts/common.sh@364 -- # (( v = 0 )) 00:04:34.166 11:15:15 rpc_client -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:34.166 11:15:15 rpc_client -- scripts/common.sh@365 -- # decimal 1 00:04:34.166 11:15:15 rpc_client -- scripts/common.sh@353 -- # local d=1 00:04:34.166 11:15:15 rpc_client -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:34.166 11:15:15 rpc_client -- scripts/common.sh@355 -- # echo 1 00:04:34.166 11:15:15 rpc_client -- scripts/common.sh@365 -- # ver1[v]=1 00:04:34.166 11:15:15 rpc_client -- scripts/common.sh@366 -- # decimal 2 00:04:34.166 11:15:15 rpc_client -- scripts/common.sh@353 -- # local d=2 00:04:34.166 11:15:15 rpc_client -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:34.166 11:15:15 rpc_client -- scripts/common.sh@355 -- # echo 2 00:04:34.166 11:15:15 rpc_client -- scripts/common.sh@366 -- # ver2[v]=2 00:04:34.166 11:15:15 rpc_client -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:04:34.166 11:15:15 rpc_client -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:04:34.166 11:15:15 rpc_client -- scripts/common.sh@368 -- # return 0 00:04:34.166 11:15:15 rpc_client -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:34.166 11:15:15 rpc_client -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:04:34.166 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:34.166 --rc genhtml_branch_coverage=1 00:04:34.166 --rc genhtml_function_coverage=1 00:04:34.166 --rc genhtml_legend=1 00:04:34.166 --rc geninfo_all_blocks=1 00:04:34.166 --rc geninfo_unexecuted_blocks=1 00:04:34.166 00:04:34.166 ' 00:04:34.166 11:15:15 rpc_client -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:04:34.166 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:34.166 --rc genhtml_branch_coverage=1 00:04:34.166 --rc genhtml_function_coverage=1 00:04:34.166 --rc genhtml_legend=1 00:04:34.166 --rc geninfo_all_blocks=1 00:04:34.166 --rc geninfo_unexecuted_blocks=1 00:04:34.166 00:04:34.166 ' 00:04:34.166 11:15:15 rpc_client -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:04:34.166 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:34.166 --rc genhtml_branch_coverage=1 00:04:34.166 --rc genhtml_function_coverage=1 00:04:34.166 --rc genhtml_legend=1 00:04:34.166 --rc geninfo_all_blocks=1 00:04:34.166 --rc geninfo_unexecuted_blocks=1 00:04:34.166 00:04:34.166 ' 00:04:34.166 11:15:15 rpc_client -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:04:34.166 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:34.166 --rc genhtml_branch_coverage=1 00:04:34.166 --rc genhtml_function_coverage=1 00:04:34.166 --rc genhtml_legend=1 00:04:34.166 --rc geninfo_all_blocks=1 00:04:34.166 --rc geninfo_unexecuted_blocks=1 00:04:34.166 00:04:34.166 ' 00:04:34.166 11:15:15 rpc_client -- rpc_client/rpc_client.sh@10 -- # /home/vagrant/spdk_repo/spdk/test/rpc_client/rpc_client_test 00:04:34.166 OK 00:04:34.166 11:15:15 rpc_client -- rpc_client/rpc_client.sh@12 -- # trap - SIGINT SIGTERM EXIT 00:04:34.166 00:04:34.166 real 0m0.203s 00:04:34.166 user 0m0.134s 00:04:34.166 sys 0m0.081s 00:04:34.166 11:15:15 rpc_client -- common/autotest_common.sh@1126 -- # xtrace_disable 00:04:34.166 11:15:15 rpc_client -- common/autotest_common.sh@10 -- # set +x 00:04:34.166 ************************************ 00:04:34.166 END TEST rpc_client 00:04:34.166 ************************************ 00:04:34.166 11:15:15 -- spdk/autotest.sh@159 -- # run_test json_config /home/vagrant/spdk_repo/spdk/test/json_config/json_config.sh 00:04:34.166 11:15:15 -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:04:34.166 11:15:15 -- common/autotest_common.sh@1107 -- # xtrace_disable 00:04:34.166 11:15:15 -- common/autotest_common.sh@10 -- # set +x 00:04:34.166 ************************************ 00:04:34.166 START TEST json_config 00:04:34.166 ************************************ 00:04:34.166 11:15:15 json_config -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/json_config/json_config.sh 00:04:34.166 11:15:15 json_config -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:04:34.166 11:15:15 json_config -- common/autotest_common.sh@1681 -- # lcov --version 00:04:34.167 11:15:15 json_config -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:04:34.426 11:15:15 json_config -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:04:34.426 11:15:15 json_config -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:04:34.426 11:15:15 json_config -- scripts/common.sh@333 -- # local ver1 ver1_l 00:04:34.426 11:15:15 json_config -- scripts/common.sh@334 -- # local ver2 ver2_l 00:04:34.426 11:15:15 json_config -- scripts/common.sh@336 -- # IFS=.-: 00:04:34.426 11:15:15 json_config -- scripts/common.sh@336 -- # read -ra ver1 00:04:34.426 11:15:15 json_config -- scripts/common.sh@337 -- # IFS=.-: 00:04:34.426 11:15:15 json_config -- scripts/common.sh@337 -- # read -ra ver2 00:04:34.426 11:15:15 json_config -- scripts/common.sh@338 -- # local 'op=<' 00:04:34.426 11:15:15 json_config -- scripts/common.sh@340 -- # ver1_l=2 00:04:34.426 11:15:15 json_config -- scripts/common.sh@341 -- # ver2_l=1 00:04:34.426 11:15:15 json_config -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:04:34.426 11:15:15 json_config -- scripts/common.sh@344 -- # case "$op" in 00:04:34.426 11:15:15 json_config -- scripts/common.sh@345 -- # : 1 00:04:34.426 11:15:15 json_config -- scripts/common.sh@364 -- # (( v = 0 )) 00:04:34.426 11:15:15 json_config -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:34.426 11:15:15 json_config -- scripts/common.sh@365 -- # decimal 1 00:04:34.426 11:15:15 json_config -- scripts/common.sh@353 -- # local d=1 00:04:34.426 11:15:15 json_config -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:34.426 11:15:15 json_config -- scripts/common.sh@355 -- # echo 1 00:04:34.426 11:15:15 json_config -- scripts/common.sh@365 -- # ver1[v]=1 00:04:34.426 11:15:15 json_config -- scripts/common.sh@366 -- # decimal 2 00:04:34.426 11:15:15 json_config -- scripts/common.sh@353 -- # local d=2 00:04:34.426 11:15:15 json_config -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:34.426 11:15:15 json_config -- scripts/common.sh@355 -- # echo 2 00:04:34.426 11:15:15 json_config -- scripts/common.sh@366 -- # ver2[v]=2 00:04:34.426 11:15:15 json_config -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:04:34.426 11:15:15 json_config -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:04:34.426 11:15:15 json_config -- scripts/common.sh@368 -- # return 0 00:04:34.426 11:15:15 json_config -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:34.426 11:15:15 json_config -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:04:34.426 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:34.426 --rc genhtml_branch_coverage=1 00:04:34.426 --rc genhtml_function_coverage=1 00:04:34.426 --rc genhtml_legend=1 00:04:34.426 --rc geninfo_all_blocks=1 00:04:34.426 --rc geninfo_unexecuted_blocks=1 00:04:34.426 00:04:34.426 ' 00:04:34.426 11:15:15 json_config -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:04:34.426 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:34.426 --rc genhtml_branch_coverage=1 00:04:34.426 --rc genhtml_function_coverage=1 00:04:34.426 --rc genhtml_legend=1 00:04:34.426 --rc geninfo_all_blocks=1 00:04:34.426 --rc geninfo_unexecuted_blocks=1 00:04:34.426 00:04:34.426 ' 00:04:34.426 11:15:15 json_config -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:04:34.426 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:34.426 --rc genhtml_branch_coverage=1 00:04:34.426 --rc genhtml_function_coverage=1 00:04:34.426 --rc genhtml_legend=1 00:04:34.426 --rc geninfo_all_blocks=1 00:04:34.426 --rc geninfo_unexecuted_blocks=1 00:04:34.426 00:04:34.426 ' 00:04:34.426 11:15:15 json_config -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:04:34.426 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:34.426 --rc genhtml_branch_coverage=1 00:04:34.426 --rc genhtml_function_coverage=1 00:04:34.426 --rc genhtml_legend=1 00:04:34.426 --rc geninfo_all_blocks=1 00:04:34.426 --rc geninfo_unexecuted_blocks=1 00:04:34.426 00:04:34.426 ' 00:04:34.426 11:15:15 json_config -- json_config/json_config.sh@8 -- # source /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh 00:04:34.426 11:15:15 json_config -- nvmf/common.sh@7 -- # uname -s 00:04:34.426 11:15:15 json_config -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:04:34.426 11:15:15 json_config -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:04:34.426 11:15:15 json_config -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:04:34.426 11:15:15 json_config -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:04:34.426 11:15:15 json_config -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:04:34.426 11:15:15 json_config -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:04:34.426 11:15:15 json_config -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:04:34.426 11:15:15 json_config -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:04:34.426 11:15:15 json_config -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:04:34.426 11:15:15 json_config -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:04:34.426 11:15:15 json_config -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:04:34.426 11:15:15 json_config -- nvmf/common.sh@18 -- # NVME_HOSTID=3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:04:34.426 11:15:15 json_config -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:04:34.426 11:15:15 json_config -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:04:34.426 11:15:15 json_config -- nvmf/common.sh@21 -- # NET_TYPE=phy-fallback 00:04:34.426 11:15:15 json_config -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:04:34.426 11:15:15 json_config -- nvmf/common.sh@49 -- # source /home/vagrant/spdk_repo/spdk/scripts/common.sh 00:04:34.426 11:15:15 json_config -- scripts/common.sh@15 -- # shopt -s extglob 00:04:34.426 11:15:15 json_config -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:04:34.426 11:15:15 json_config -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:04:34.426 11:15:15 json_config -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:04:34.426 11:15:15 json_config -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:34.426 11:15:15 json_config -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:34.426 11:15:15 json_config -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:34.426 11:15:15 json_config -- paths/export.sh@5 -- # export PATH 00:04:34.426 11:15:15 json_config -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:34.426 11:15:15 json_config -- nvmf/common.sh@51 -- # : 0 00:04:34.426 11:15:15 json_config -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:04:34.426 11:15:15 json_config -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:04:34.426 11:15:15 json_config -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:04:34.426 11:15:15 json_config -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:04:34.426 11:15:15 json_config -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:04:34.426 11:15:15 json_config -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:04:34.426 /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:04:34.426 11:15:15 json_config -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:04:34.426 11:15:15 json_config -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:04:34.426 11:15:15 json_config -- nvmf/common.sh@55 -- # have_pci_nics=0 00:04:34.426 11:15:15 json_config -- json_config/json_config.sh@9 -- # source /home/vagrant/spdk_repo/spdk/test/json_config/common.sh 00:04:34.426 11:15:15 json_config -- json_config/json_config.sh@11 -- # [[ 0 -eq 1 ]] 00:04:34.426 11:15:15 json_config -- json_config/json_config.sh@15 -- # [[ 0 -ne 1 ]] 00:04:34.426 11:15:15 json_config -- json_config/json_config.sh@15 -- # [[ 0 -eq 1 ]] 00:04:34.426 11:15:15 json_config -- json_config/json_config.sh@26 -- # (( SPDK_TEST_BLOCKDEV + SPDK_TEST_ISCSI + SPDK_TEST_NVMF + SPDK_TEST_VHOST + SPDK_TEST_VHOST_INIT + SPDK_TEST_RBD == 0 )) 00:04:34.426 11:15:15 json_config -- json_config/json_config.sh@31 -- # app_pid=(['target']='' ['initiator']='') 00:04:34.426 11:15:15 json_config -- json_config/json_config.sh@31 -- # declare -A app_pid 00:04:34.426 11:15:15 json_config -- json_config/json_config.sh@32 -- # app_socket=(['target']='/var/tmp/spdk_tgt.sock' ['initiator']='/var/tmp/spdk_initiator.sock') 00:04:34.426 11:15:15 json_config -- json_config/json_config.sh@32 -- # declare -A app_socket 00:04:34.426 11:15:15 json_config -- json_config/json_config.sh@33 -- # app_params=(['target']='-m 0x1 -s 1024' ['initiator']='-m 0x2 -g -u -s 1024') 00:04:34.426 11:15:15 json_config -- json_config/json_config.sh@33 -- # declare -A app_params 00:04:34.426 11:15:15 json_config -- json_config/json_config.sh@34 -- # configs_path=(['target']='/home/vagrant/spdk_repo/spdk/spdk_tgt_config.json' ['initiator']='/home/vagrant/spdk_repo/spdk/spdk_initiator_config.json') 00:04:34.426 11:15:15 json_config -- json_config/json_config.sh@34 -- # declare -A configs_path 00:04:34.426 11:15:15 json_config -- json_config/json_config.sh@40 -- # last_event_id=0 00:04:34.426 11:15:15 json_config -- json_config/json_config.sh@362 -- # trap 'on_error_exit "${FUNCNAME}" "${LINENO}"' ERR 00:04:34.426 INFO: JSON configuration test init 00:04:34.426 11:15:15 json_config -- json_config/json_config.sh@363 -- # echo 'INFO: JSON configuration test init' 00:04:34.426 11:15:15 json_config -- json_config/json_config.sh@364 -- # json_config_test_init 00:04:34.426 11:15:15 json_config -- json_config/json_config.sh@269 -- # timing_enter json_config_test_init 00:04:34.426 11:15:15 json_config -- common/autotest_common.sh@724 -- # xtrace_disable 00:04:34.426 11:15:15 json_config -- common/autotest_common.sh@10 -- # set +x 00:04:34.427 11:15:15 json_config -- json_config/json_config.sh@270 -- # timing_enter json_config_setup_target 00:04:34.427 11:15:15 json_config -- common/autotest_common.sh@724 -- # xtrace_disable 00:04:34.427 11:15:15 json_config -- common/autotest_common.sh@10 -- # set +x 00:04:34.427 11:15:15 json_config -- json_config/json_config.sh@272 -- # json_config_test_start_app target --wait-for-rpc 00:04:34.427 11:15:15 json_config -- json_config/common.sh@9 -- # local app=target 00:04:34.427 11:15:15 json_config -- json_config/common.sh@10 -- # shift 00:04:34.427 11:15:15 json_config -- json_config/common.sh@12 -- # [[ -n 22 ]] 00:04:34.427 11:15:15 json_config -- json_config/common.sh@13 -- # [[ -z '' ]] 00:04:34.427 11:15:15 json_config -- json_config/common.sh@15 -- # local app_extra_params= 00:04:34.427 11:15:15 json_config -- json_config/common.sh@16 -- # [[ 0 -eq 1 ]] 00:04:34.427 11:15:15 json_config -- json_config/common.sh@16 -- # [[ 0 -eq 1 ]] 00:04:34.427 11:15:15 json_config -- json_config/common.sh@22 -- # app_pid["$app"]=59184 00:04:34.427 11:15:15 json_config -- json_config/common.sh@24 -- # echo 'Waiting for target to run...' 00:04:34.427 Waiting for target to run... 00:04:34.427 11:15:15 json_config -- json_config/common.sh@25 -- # waitforlisten 59184 /var/tmp/spdk_tgt.sock 00:04:34.427 11:15:15 json_config -- json_config/common.sh@21 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --wait-for-rpc 00:04:34.427 11:15:15 json_config -- common/autotest_common.sh@831 -- # '[' -z 59184 ']' 00:04:34.427 11:15:15 json_config -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:04:34.427 11:15:15 json_config -- common/autotest_common.sh@836 -- # local max_retries=100 00:04:34.427 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:04:34.427 11:15:15 json_config -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:04:34.427 11:15:15 json_config -- common/autotest_common.sh@840 -- # xtrace_disable 00:04:34.427 11:15:15 json_config -- common/autotest_common.sh@10 -- # set +x 00:04:34.427 [2024-10-07 11:15:16.058086] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:04:34.427 [2024-10-07 11:15:16.058229] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid59184 ] 00:04:34.993 [2024-10-07 11:15:16.602796] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:35.251 [2024-10-07 11:15:16.733260] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:04:35.510 11:15:17 json_config -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:04:35.510 11:15:17 json_config -- common/autotest_common.sh@864 -- # return 0 00:04:35.510 00:04:35.510 11:15:17 json_config -- json_config/common.sh@26 -- # echo '' 00:04:35.510 11:15:17 json_config -- json_config/json_config.sh@276 -- # create_accel_config 00:04:35.510 11:15:17 json_config -- json_config/json_config.sh@100 -- # timing_enter create_accel_config 00:04:35.510 11:15:17 json_config -- common/autotest_common.sh@724 -- # xtrace_disable 00:04:35.510 11:15:17 json_config -- common/autotest_common.sh@10 -- # set +x 00:04:35.510 11:15:17 json_config -- json_config/json_config.sh@102 -- # [[ 0 -eq 1 ]] 00:04:35.510 11:15:17 json_config -- json_config/json_config.sh@108 -- # timing_exit create_accel_config 00:04:35.510 11:15:17 json_config -- common/autotest_common.sh@730 -- # xtrace_disable 00:04:35.510 11:15:17 json_config -- common/autotest_common.sh@10 -- # set +x 00:04:35.510 11:15:17 json_config -- json_config/json_config.sh@280 -- # /home/vagrant/spdk_repo/spdk/scripts/gen_nvme.sh --json-with-subsystems 00:04:35.510 11:15:17 json_config -- json_config/json_config.sh@281 -- # tgt_rpc load_config 00:04:35.510 11:15:17 json_config -- json_config/common.sh@57 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock load_config 00:04:36.076 11:15:17 json_config -- json_config/json_config.sh@283 -- # tgt_check_notification_types 00:04:36.076 11:15:17 json_config -- json_config/json_config.sh@43 -- # timing_enter tgt_check_notification_types 00:04:36.076 11:15:17 json_config -- common/autotest_common.sh@724 -- # xtrace_disable 00:04:36.076 11:15:17 json_config -- common/autotest_common.sh@10 -- # set +x 00:04:36.076 11:15:17 json_config -- json_config/json_config.sh@45 -- # local ret=0 00:04:36.076 11:15:17 json_config -- json_config/json_config.sh@46 -- # enabled_types=('bdev_register' 'bdev_unregister') 00:04:36.076 11:15:17 json_config -- json_config/json_config.sh@46 -- # local enabled_types 00:04:36.076 11:15:17 json_config -- json_config/json_config.sh@47 -- # [[ y == y ]] 00:04:36.076 11:15:17 json_config -- json_config/json_config.sh@48 -- # enabled_types+=("fsdev_register" "fsdev_unregister") 00:04:36.076 11:15:17 json_config -- json_config/json_config.sh@51 -- # tgt_rpc notify_get_types 00:04:36.076 11:15:17 json_config -- json_config/json_config.sh@51 -- # jq -r '.[]' 00:04:36.076 11:15:17 json_config -- json_config/common.sh@57 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock notify_get_types 00:04:36.341 11:15:18 json_config -- json_config/json_config.sh@51 -- # get_types=('fsdev_register' 'fsdev_unregister' 'bdev_register' 'bdev_unregister') 00:04:36.341 11:15:18 json_config -- json_config/json_config.sh@51 -- # local get_types 00:04:36.341 11:15:18 json_config -- json_config/json_config.sh@53 -- # local type_diff 00:04:36.341 11:15:18 json_config -- json_config/json_config.sh@54 -- # echo bdev_register bdev_unregister fsdev_register fsdev_unregister fsdev_register fsdev_unregister bdev_register bdev_unregister 00:04:36.341 11:15:18 json_config -- json_config/json_config.sh@54 -- # tr ' ' '\n' 00:04:36.341 11:15:18 json_config -- json_config/json_config.sh@54 -- # sort 00:04:36.341 11:15:18 json_config -- json_config/json_config.sh@54 -- # uniq -u 00:04:36.341 11:15:18 json_config -- json_config/json_config.sh@54 -- # type_diff= 00:04:36.341 11:15:18 json_config -- json_config/json_config.sh@56 -- # [[ -n '' ]] 00:04:36.341 11:15:18 json_config -- json_config/json_config.sh@61 -- # timing_exit tgt_check_notification_types 00:04:36.341 11:15:18 json_config -- common/autotest_common.sh@730 -- # xtrace_disable 00:04:36.341 11:15:18 json_config -- common/autotest_common.sh@10 -- # set +x 00:04:36.599 11:15:18 json_config -- json_config/json_config.sh@62 -- # return 0 00:04:36.599 11:15:18 json_config -- json_config/json_config.sh@285 -- # [[ 0 -eq 1 ]] 00:04:36.599 11:15:18 json_config -- json_config/json_config.sh@289 -- # [[ 0 -eq 1 ]] 00:04:36.599 11:15:18 json_config -- json_config/json_config.sh@293 -- # [[ 0 -eq 1 ]] 00:04:36.599 11:15:18 json_config -- json_config/json_config.sh@297 -- # [[ 1 -eq 1 ]] 00:04:36.599 11:15:18 json_config -- json_config/json_config.sh@298 -- # create_nvmf_subsystem_config 00:04:36.599 11:15:18 json_config -- json_config/json_config.sh@237 -- # timing_enter create_nvmf_subsystem_config 00:04:36.599 11:15:18 json_config -- common/autotest_common.sh@724 -- # xtrace_disable 00:04:36.599 11:15:18 json_config -- common/autotest_common.sh@10 -- # set +x 00:04:36.599 11:15:18 json_config -- json_config/json_config.sh@239 -- # NVMF_FIRST_TARGET_IP=127.0.0.1 00:04:36.599 11:15:18 json_config -- json_config/json_config.sh@240 -- # [[ tcp == \r\d\m\a ]] 00:04:36.599 11:15:18 json_config -- json_config/json_config.sh@244 -- # [[ -z 127.0.0.1 ]] 00:04:36.599 11:15:18 json_config -- json_config/json_config.sh@249 -- # tgt_rpc bdev_malloc_create 8 512 --name MallocForNvmf0 00:04:36.599 11:15:18 json_config -- json_config/common.sh@57 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 8 512 --name MallocForNvmf0 00:04:36.855 MallocForNvmf0 00:04:36.855 11:15:18 json_config -- json_config/json_config.sh@250 -- # tgt_rpc bdev_malloc_create 4 1024 --name MallocForNvmf1 00:04:36.855 11:15:18 json_config -- json_config/common.sh@57 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 4 1024 --name MallocForNvmf1 00:04:37.113 MallocForNvmf1 00:04:37.113 11:15:18 json_config -- json_config/json_config.sh@252 -- # tgt_rpc nvmf_create_transport -t tcp -u 8192 -c 0 00:04:37.113 11:15:18 json_config -- json_config/common.sh@57 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_create_transport -t tcp -u 8192 -c 0 00:04:37.370 [2024-10-07 11:15:18.886472] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:04:37.370 11:15:18 json_config -- json_config/json_config.sh@253 -- # tgt_rpc nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:04:37.370 11:15:18 json_config -- json_config/common.sh@57 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:04:37.628 11:15:19 json_config -- json_config/json_config.sh@254 -- # tgt_rpc nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf0 00:04:37.628 11:15:19 json_config -- json_config/common.sh@57 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf0 00:04:37.885 11:15:19 json_config -- json_config/json_config.sh@255 -- # tgt_rpc nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf1 00:04:37.885 11:15:19 json_config -- json_config/common.sh@57 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf1 00:04:38.143 11:15:19 json_config -- json_config/json_config.sh@256 -- # tgt_rpc nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 127.0.0.1 -s 4420 00:04:38.143 11:15:19 json_config -- json_config/common.sh@57 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 127.0.0.1 -s 4420 00:04:38.401 [2024-10-07 11:15:19.939122] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4420 *** 00:04:38.401 11:15:19 json_config -- json_config/json_config.sh@258 -- # timing_exit create_nvmf_subsystem_config 00:04:38.401 11:15:19 json_config -- common/autotest_common.sh@730 -- # xtrace_disable 00:04:38.401 11:15:19 json_config -- common/autotest_common.sh@10 -- # set +x 00:04:38.401 11:15:19 json_config -- json_config/json_config.sh@300 -- # timing_exit json_config_setup_target 00:04:38.401 11:15:19 json_config -- common/autotest_common.sh@730 -- # xtrace_disable 00:04:38.401 11:15:19 json_config -- common/autotest_common.sh@10 -- # set +x 00:04:38.401 11:15:20 json_config -- json_config/json_config.sh@302 -- # [[ 0 -eq 1 ]] 00:04:38.401 11:15:20 json_config -- json_config/json_config.sh@307 -- # tgt_rpc bdev_malloc_create 8 512 --name MallocBdevForConfigChangeCheck 00:04:38.401 11:15:20 json_config -- json_config/common.sh@57 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 8 512 --name MallocBdevForConfigChangeCheck 00:04:38.658 MallocBdevForConfigChangeCheck 00:04:38.658 11:15:20 json_config -- json_config/json_config.sh@309 -- # timing_exit json_config_test_init 00:04:38.658 11:15:20 json_config -- common/autotest_common.sh@730 -- # xtrace_disable 00:04:38.658 11:15:20 json_config -- common/autotest_common.sh@10 -- # set +x 00:04:38.914 11:15:20 json_config -- json_config/json_config.sh@366 -- # tgt_rpc save_config 00:04:38.914 11:15:20 json_config -- json_config/common.sh@57 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:04:39.171 INFO: shutting down applications... 00:04:39.171 11:15:20 json_config -- json_config/json_config.sh@368 -- # echo 'INFO: shutting down applications...' 00:04:39.171 11:15:20 json_config -- json_config/json_config.sh@369 -- # [[ 0 -eq 1 ]] 00:04:39.171 11:15:20 json_config -- json_config/json_config.sh@375 -- # json_config_clear target 00:04:39.171 11:15:20 json_config -- json_config/json_config.sh@339 -- # [[ -n 22 ]] 00:04:39.171 11:15:20 json_config -- json_config/json_config.sh@340 -- # /home/vagrant/spdk_repo/spdk/test/json_config/clear_config.py -s /var/tmp/spdk_tgt.sock clear_config 00:04:39.427 Calling clear_iscsi_subsystem 00:04:39.427 Calling clear_nvmf_subsystem 00:04:39.427 Calling clear_nbd_subsystem 00:04:39.427 Calling clear_ublk_subsystem 00:04:39.427 Calling clear_vhost_blk_subsystem 00:04:39.427 Calling clear_vhost_scsi_subsystem 00:04:39.427 Calling clear_bdev_subsystem 00:04:39.684 11:15:21 json_config -- json_config/json_config.sh@344 -- # local config_filter=/home/vagrant/spdk_repo/spdk/test/json_config/config_filter.py 00:04:39.684 11:15:21 json_config -- json_config/json_config.sh@350 -- # count=100 00:04:39.684 11:15:21 json_config -- json_config/json_config.sh@351 -- # '[' 100 -gt 0 ']' 00:04:39.684 11:15:21 json_config -- json_config/json_config.sh@352 -- # /home/vagrant/spdk_repo/spdk/test/json_config/config_filter.py -method delete_global_parameters 00:04:39.684 11:15:21 json_config -- json_config/json_config.sh@352 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:04:39.684 11:15:21 json_config -- json_config/json_config.sh@352 -- # /home/vagrant/spdk_repo/spdk/test/json_config/config_filter.py -method check_empty 00:04:39.949 11:15:21 json_config -- json_config/json_config.sh@352 -- # break 00:04:39.949 11:15:21 json_config -- json_config/json_config.sh@357 -- # '[' 100 -eq 0 ']' 00:04:39.949 11:15:21 json_config -- json_config/json_config.sh@376 -- # json_config_test_shutdown_app target 00:04:39.949 11:15:21 json_config -- json_config/common.sh@31 -- # local app=target 00:04:39.949 11:15:21 json_config -- json_config/common.sh@34 -- # [[ -n 22 ]] 00:04:39.949 11:15:21 json_config -- json_config/common.sh@35 -- # [[ -n 59184 ]] 00:04:39.949 11:15:21 json_config -- json_config/common.sh@38 -- # kill -SIGINT 59184 00:04:39.949 11:15:21 json_config -- json_config/common.sh@40 -- # (( i = 0 )) 00:04:39.949 11:15:21 json_config -- json_config/common.sh@40 -- # (( i < 30 )) 00:04:39.949 11:15:21 json_config -- json_config/common.sh@41 -- # kill -0 59184 00:04:39.949 11:15:21 json_config -- json_config/common.sh@45 -- # sleep 0.5 00:04:40.534 11:15:22 json_config -- json_config/common.sh@40 -- # (( i++ )) 00:04:40.534 11:15:22 json_config -- json_config/common.sh@40 -- # (( i < 30 )) 00:04:40.534 11:15:22 json_config -- json_config/common.sh@41 -- # kill -0 59184 00:04:40.534 11:15:22 json_config -- json_config/common.sh@42 -- # app_pid["$app"]= 00:04:40.534 11:15:22 json_config -- json_config/common.sh@43 -- # break 00:04:40.534 11:15:22 json_config -- json_config/common.sh@48 -- # [[ -n '' ]] 00:04:40.534 SPDK target shutdown done 00:04:40.534 11:15:22 json_config -- json_config/common.sh@53 -- # echo 'SPDK target shutdown done' 00:04:40.534 INFO: relaunching applications... 00:04:40.534 11:15:22 json_config -- json_config/json_config.sh@378 -- # echo 'INFO: relaunching applications...' 00:04:40.534 11:15:22 json_config -- json_config/json_config.sh@379 -- # json_config_test_start_app target --json /home/vagrant/spdk_repo/spdk/spdk_tgt_config.json 00:04:40.534 11:15:22 json_config -- json_config/common.sh@9 -- # local app=target 00:04:40.534 11:15:22 json_config -- json_config/common.sh@10 -- # shift 00:04:40.534 11:15:22 json_config -- json_config/common.sh@12 -- # [[ -n 22 ]] 00:04:40.534 11:15:22 json_config -- json_config/common.sh@13 -- # [[ -z '' ]] 00:04:40.534 11:15:22 json_config -- json_config/common.sh@15 -- # local app_extra_params= 00:04:40.534 11:15:22 json_config -- json_config/common.sh@16 -- # [[ 0 -eq 1 ]] 00:04:40.534 11:15:22 json_config -- json_config/common.sh@16 -- # [[ 0 -eq 1 ]] 00:04:40.534 11:15:22 json_config -- json_config/common.sh@22 -- # app_pid["$app"]=59469 00:04:40.534 Waiting for target to run... 00:04:40.534 11:15:22 json_config -- json_config/common.sh@21 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --json /home/vagrant/spdk_repo/spdk/spdk_tgt_config.json 00:04:40.534 11:15:22 json_config -- json_config/common.sh@24 -- # echo 'Waiting for target to run...' 00:04:40.534 11:15:22 json_config -- json_config/common.sh@25 -- # waitforlisten 59469 /var/tmp/spdk_tgt.sock 00:04:40.534 11:15:22 json_config -- common/autotest_common.sh@831 -- # '[' -z 59469 ']' 00:04:40.534 11:15:22 json_config -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:04:40.534 11:15:22 json_config -- common/autotest_common.sh@836 -- # local max_retries=100 00:04:40.534 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:04:40.534 11:15:22 json_config -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:04:40.534 11:15:22 json_config -- common/autotest_common.sh@840 -- # xtrace_disable 00:04:40.534 11:15:22 json_config -- common/autotest_common.sh@10 -- # set +x 00:04:40.534 [2024-10-07 11:15:22.178163] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:04:40.534 [2024-10-07 11:15:22.178266] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid59469 ] 00:04:41.099 [2024-10-07 11:15:22.604906] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:41.099 [2024-10-07 11:15:22.718216] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:04:41.665 [2024-10-07 11:15:23.080257] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:04:41.665 [2024-10-07 11:15:23.112558] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4420 *** 00:04:41.665 11:15:23 json_config -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:04:41.665 00:04:41.665 11:15:23 json_config -- common/autotest_common.sh@864 -- # return 0 00:04:41.665 11:15:23 json_config -- json_config/common.sh@26 -- # echo '' 00:04:41.665 11:15:23 json_config -- json_config/json_config.sh@380 -- # [[ 0 -eq 1 ]] 00:04:41.665 INFO: Checking if target configuration is the same... 00:04:41.665 11:15:23 json_config -- json_config/json_config.sh@384 -- # echo 'INFO: Checking if target configuration is the same...' 00:04:41.665 11:15:23 json_config -- json_config/json_config.sh@385 -- # /home/vagrant/spdk_repo/spdk/test/json_config/json_diff.sh /dev/fd/62 /home/vagrant/spdk_repo/spdk/spdk_tgt_config.json 00:04:41.665 11:15:23 json_config -- json_config/json_config.sh@385 -- # tgt_rpc save_config 00:04:41.665 11:15:23 json_config -- json_config/common.sh@57 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:04:41.665 + '[' 2 -ne 2 ']' 00:04:41.665 +++ dirname /home/vagrant/spdk_repo/spdk/test/json_config/json_diff.sh 00:04:41.665 ++ readlink -f /home/vagrant/spdk_repo/spdk/test/json_config/../.. 00:04:41.665 + rootdir=/home/vagrant/spdk_repo/spdk 00:04:41.665 +++ basename /dev/fd/62 00:04:41.665 ++ mktemp /tmp/62.XXX 00:04:41.665 + tmp_file_1=/tmp/62.Xou 00:04:41.665 +++ basename /home/vagrant/spdk_repo/spdk/spdk_tgt_config.json 00:04:41.665 ++ mktemp /tmp/spdk_tgt_config.json.XXX 00:04:41.665 + tmp_file_2=/tmp/spdk_tgt_config.json.3Z6 00:04:41.665 + ret=0 00:04:41.665 + /home/vagrant/spdk_repo/spdk/test/json_config/config_filter.py -method sort 00:04:42.230 + /home/vagrant/spdk_repo/spdk/test/json_config/config_filter.py -method sort 00:04:42.230 + diff -u /tmp/62.Xou /tmp/spdk_tgt_config.json.3Z6 00:04:42.230 INFO: JSON config files are the same 00:04:42.230 + echo 'INFO: JSON config files are the same' 00:04:42.230 + rm /tmp/62.Xou /tmp/spdk_tgt_config.json.3Z6 00:04:42.230 + exit 0 00:04:42.230 11:15:23 json_config -- json_config/json_config.sh@386 -- # [[ 0 -eq 1 ]] 00:04:42.230 INFO: changing configuration and checking if this can be detected... 00:04:42.230 11:15:23 json_config -- json_config/json_config.sh@391 -- # echo 'INFO: changing configuration and checking if this can be detected...' 00:04:42.230 11:15:23 json_config -- json_config/json_config.sh@393 -- # tgt_rpc bdev_malloc_delete MallocBdevForConfigChangeCheck 00:04:42.230 11:15:23 json_config -- json_config/common.sh@57 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_delete MallocBdevForConfigChangeCheck 00:04:42.489 11:15:24 json_config -- json_config/json_config.sh@394 -- # /home/vagrant/spdk_repo/spdk/test/json_config/json_diff.sh /dev/fd/62 /home/vagrant/spdk_repo/spdk/spdk_tgt_config.json 00:04:42.489 11:15:24 json_config -- json_config/json_config.sh@394 -- # tgt_rpc save_config 00:04:42.489 11:15:24 json_config -- json_config/common.sh@57 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:04:42.489 + '[' 2 -ne 2 ']' 00:04:42.489 +++ dirname /home/vagrant/spdk_repo/spdk/test/json_config/json_diff.sh 00:04:42.489 ++ readlink -f /home/vagrant/spdk_repo/spdk/test/json_config/../.. 00:04:42.489 + rootdir=/home/vagrant/spdk_repo/spdk 00:04:42.489 +++ basename /dev/fd/62 00:04:42.489 ++ mktemp /tmp/62.XXX 00:04:42.489 + tmp_file_1=/tmp/62.686 00:04:42.489 +++ basename /home/vagrant/spdk_repo/spdk/spdk_tgt_config.json 00:04:42.489 ++ mktemp /tmp/spdk_tgt_config.json.XXX 00:04:42.489 + tmp_file_2=/tmp/spdk_tgt_config.json.N6I 00:04:42.489 + ret=0 00:04:42.489 + /home/vagrant/spdk_repo/spdk/test/json_config/config_filter.py -method sort 00:04:43.055 + /home/vagrant/spdk_repo/spdk/test/json_config/config_filter.py -method sort 00:04:43.055 + diff -u /tmp/62.686 /tmp/spdk_tgt_config.json.N6I 00:04:43.055 + ret=1 00:04:43.055 + echo '=== Start of file: /tmp/62.686 ===' 00:04:43.055 + cat /tmp/62.686 00:04:43.055 + echo '=== End of file: /tmp/62.686 ===' 00:04:43.055 + echo '' 00:04:43.055 + echo '=== Start of file: /tmp/spdk_tgt_config.json.N6I ===' 00:04:43.055 + cat /tmp/spdk_tgt_config.json.N6I 00:04:43.055 + echo '=== End of file: /tmp/spdk_tgt_config.json.N6I ===' 00:04:43.055 + echo '' 00:04:43.055 + rm /tmp/62.686 /tmp/spdk_tgt_config.json.N6I 00:04:43.055 + exit 1 00:04:43.055 INFO: configuration change detected. 00:04:43.056 11:15:24 json_config -- json_config/json_config.sh@398 -- # echo 'INFO: configuration change detected.' 00:04:43.056 11:15:24 json_config -- json_config/json_config.sh@401 -- # json_config_test_fini 00:04:43.056 11:15:24 json_config -- json_config/json_config.sh@313 -- # timing_enter json_config_test_fini 00:04:43.056 11:15:24 json_config -- common/autotest_common.sh@724 -- # xtrace_disable 00:04:43.056 11:15:24 json_config -- common/autotest_common.sh@10 -- # set +x 00:04:43.056 11:15:24 json_config -- json_config/json_config.sh@314 -- # local ret=0 00:04:43.056 11:15:24 json_config -- json_config/json_config.sh@316 -- # [[ -n '' ]] 00:04:43.056 11:15:24 json_config -- json_config/json_config.sh@324 -- # [[ -n 59469 ]] 00:04:43.056 11:15:24 json_config -- json_config/json_config.sh@327 -- # cleanup_bdev_subsystem_config 00:04:43.056 11:15:24 json_config -- json_config/json_config.sh@191 -- # timing_enter cleanup_bdev_subsystem_config 00:04:43.056 11:15:24 json_config -- common/autotest_common.sh@724 -- # xtrace_disable 00:04:43.056 11:15:24 json_config -- common/autotest_common.sh@10 -- # set +x 00:04:43.056 11:15:24 json_config -- json_config/json_config.sh@193 -- # [[ 0 -eq 1 ]] 00:04:43.056 11:15:24 json_config -- json_config/json_config.sh@200 -- # uname -s 00:04:43.056 11:15:24 json_config -- json_config/json_config.sh@200 -- # [[ Linux = Linux ]] 00:04:43.056 11:15:24 json_config -- json_config/json_config.sh@201 -- # rm -f /sample_aio 00:04:43.056 11:15:24 json_config -- json_config/json_config.sh@204 -- # [[ 0 -eq 1 ]] 00:04:43.056 11:15:24 json_config -- json_config/json_config.sh@208 -- # timing_exit cleanup_bdev_subsystem_config 00:04:43.056 11:15:24 json_config -- common/autotest_common.sh@730 -- # xtrace_disable 00:04:43.056 11:15:24 json_config -- common/autotest_common.sh@10 -- # set +x 00:04:43.056 11:15:24 json_config -- json_config/json_config.sh@330 -- # killprocess 59469 00:04:43.056 11:15:24 json_config -- common/autotest_common.sh@950 -- # '[' -z 59469 ']' 00:04:43.056 11:15:24 json_config -- common/autotest_common.sh@954 -- # kill -0 59469 00:04:43.056 11:15:24 json_config -- common/autotest_common.sh@955 -- # uname 00:04:43.056 11:15:24 json_config -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:04:43.056 11:15:24 json_config -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 59469 00:04:43.056 11:15:24 json_config -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:04:43.056 11:15:24 json_config -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:04:43.056 killing process with pid 59469 00:04:43.056 11:15:24 json_config -- common/autotest_common.sh@968 -- # echo 'killing process with pid 59469' 00:04:43.056 11:15:24 json_config -- common/autotest_common.sh@969 -- # kill 59469 00:04:43.056 11:15:24 json_config -- common/autotest_common.sh@974 -- # wait 59469 00:04:43.314 11:15:25 json_config -- json_config/json_config.sh@333 -- # rm -f /home/vagrant/spdk_repo/spdk/spdk_initiator_config.json /home/vagrant/spdk_repo/spdk/spdk_tgt_config.json 00:04:43.314 11:15:25 json_config -- json_config/json_config.sh@334 -- # timing_exit json_config_test_fini 00:04:43.314 11:15:25 json_config -- common/autotest_common.sh@730 -- # xtrace_disable 00:04:43.314 11:15:25 json_config -- common/autotest_common.sh@10 -- # set +x 00:04:43.572 11:15:25 json_config -- json_config/json_config.sh@335 -- # return 0 00:04:43.572 INFO: Success 00:04:43.572 11:15:25 json_config -- json_config/json_config.sh@403 -- # echo 'INFO: Success' 00:04:43.572 00:04:43.572 real 0m9.299s 00:04:43.572 user 0m13.415s 00:04:43.572 sys 0m2.033s 00:04:43.572 11:15:25 json_config -- common/autotest_common.sh@1126 -- # xtrace_disable 00:04:43.572 11:15:25 json_config -- common/autotest_common.sh@10 -- # set +x 00:04:43.572 ************************************ 00:04:43.572 END TEST json_config 00:04:43.572 ************************************ 00:04:43.572 11:15:25 -- spdk/autotest.sh@160 -- # run_test json_config_extra_key /home/vagrant/spdk_repo/spdk/test/json_config/json_config_extra_key.sh 00:04:43.572 11:15:25 -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:04:43.572 11:15:25 -- common/autotest_common.sh@1107 -- # xtrace_disable 00:04:43.572 11:15:25 -- common/autotest_common.sh@10 -- # set +x 00:04:43.572 ************************************ 00:04:43.572 START TEST json_config_extra_key 00:04:43.572 ************************************ 00:04:43.572 11:15:25 json_config_extra_key -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/json_config/json_config_extra_key.sh 00:04:43.572 11:15:25 json_config_extra_key -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:04:43.572 11:15:25 json_config_extra_key -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:04:43.572 11:15:25 json_config_extra_key -- common/autotest_common.sh@1681 -- # lcov --version 00:04:43.572 11:15:25 json_config_extra_key -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:04:43.572 11:15:25 json_config_extra_key -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:04:43.572 11:15:25 json_config_extra_key -- scripts/common.sh@333 -- # local ver1 ver1_l 00:04:43.572 11:15:25 json_config_extra_key -- scripts/common.sh@334 -- # local ver2 ver2_l 00:04:43.572 11:15:25 json_config_extra_key -- scripts/common.sh@336 -- # IFS=.-: 00:04:43.572 11:15:25 json_config_extra_key -- scripts/common.sh@336 -- # read -ra ver1 00:04:43.572 11:15:25 json_config_extra_key -- scripts/common.sh@337 -- # IFS=.-: 00:04:43.572 11:15:25 json_config_extra_key -- scripts/common.sh@337 -- # read -ra ver2 00:04:43.572 11:15:25 json_config_extra_key -- scripts/common.sh@338 -- # local 'op=<' 00:04:43.572 11:15:25 json_config_extra_key -- scripts/common.sh@340 -- # ver1_l=2 00:04:43.572 11:15:25 json_config_extra_key -- scripts/common.sh@341 -- # ver2_l=1 00:04:43.572 11:15:25 json_config_extra_key -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:04:43.572 11:15:25 json_config_extra_key -- scripts/common.sh@344 -- # case "$op" in 00:04:43.572 11:15:25 json_config_extra_key -- scripts/common.sh@345 -- # : 1 00:04:43.572 11:15:25 json_config_extra_key -- scripts/common.sh@364 -- # (( v = 0 )) 00:04:43.572 11:15:25 json_config_extra_key -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:43.572 11:15:25 json_config_extra_key -- scripts/common.sh@365 -- # decimal 1 00:04:43.572 11:15:25 json_config_extra_key -- scripts/common.sh@353 -- # local d=1 00:04:43.572 11:15:25 json_config_extra_key -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:43.572 11:15:25 json_config_extra_key -- scripts/common.sh@355 -- # echo 1 00:04:43.572 11:15:25 json_config_extra_key -- scripts/common.sh@365 -- # ver1[v]=1 00:04:43.572 11:15:25 json_config_extra_key -- scripts/common.sh@366 -- # decimal 2 00:04:43.572 11:15:25 json_config_extra_key -- scripts/common.sh@353 -- # local d=2 00:04:43.572 11:15:25 json_config_extra_key -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:43.572 11:15:25 json_config_extra_key -- scripts/common.sh@355 -- # echo 2 00:04:43.572 11:15:25 json_config_extra_key -- scripts/common.sh@366 -- # ver2[v]=2 00:04:43.572 11:15:25 json_config_extra_key -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:04:43.572 11:15:25 json_config_extra_key -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:04:43.572 11:15:25 json_config_extra_key -- scripts/common.sh@368 -- # return 0 00:04:43.572 11:15:25 json_config_extra_key -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:43.572 11:15:25 json_config_extra_key -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:04:43.572 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:43.572 --rc genhtml_branch_coverage=1 00:04:43.572 --rc genhtml_function_coverage=1 00:04:43.572 --rc genhtml_legend=1 00:04:43.572 --rc geninfo_all_blocks=1 00:04:43.572 --rc geninfo_unexecuted_blocks=1 00:04:43.572 00:04:43.572 ' 00:04:43.572 11:15:25 json_config_extra_key -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:04:43.572 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:43.572 --rc genhtml_branch_coverage=1 00:04:43.572 --rc genhtml_function_coverage=1 00:04:43.572 --rc genhtml_legend=1 00:04:43.572 --rc geninfo_all_blocks=1 00:04:43.572 --rc geninfo_unexecuted_blocks=1 00:04:43.572 00:04:43.572 ' 00:04:43.572 11:15:25 json_config_extra_key -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:04:43.572 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:43.572 --rc genhtml_branch_coverage=1 00:04:43.572 --rc genhtml_function_coverage=1 00:04:43.572 --rc genhtml_legend=1 00:04:43.572 --rc geninfo_all_blocks=1 00:04:43.572 --rc geninfo_unexecuted_blocks=1 00:04:43.572 00:04:43.572 ' 00:04:43.572 11:15:25 json_config_extra_key -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:04:43.572 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:43.572 --rc genhtml_branch_coverage=1 00:04:43.572 --rc genhtml_function_coverage=1 00:04:43.572 --rc genhtml_legend=1 00:04:43.572 --rc geninfo_all_blocks=1 00:04:43.572 --rc geninfo_unexecuted_blocks=1 00:04:43.572 00:04:43.572 ' 00:04:43.572 11:15:25 json_config_extra_key -- json_config/json_config_extra_key.sh@9 -- # source /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh 00:04:43.572 11:15:25 json_config_extra_key -- nvmf/common.sh@7 -- # uname -s 00:04:43.572 11:15:25 json_config_extra_key -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:04:43.572 11:15:25 json_config_extra_key -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:04:43.572 11:15:25 json_config_extra_key -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:04:43.572 11:15:25 json_config_extra_key -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:04:43.572 11:15:25 json_config_extra_key -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:04:43.572 11:15:25 json_config_extra_key -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:04:43.572 11:15:25 json_config_extra_key -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:04:43.572 11:15:25 json_config_extra_key -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:04:43.572 11:15:25 json_config_extra_key -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:04:43.572 11:15:25 json_config_extra_key -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:04:43.572 11:15:25 json_config_extra_key -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:04:43.572 11:15:25 json_config_extra_key -- nvmf/common.sh@18 -- # NVME_HOSTID=3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:04:43.572 11:15:25 json_config_extra_key -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:04:43.572 11:15:25 json_config_extra_key -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:04:43.572 11:15:25 json_config_extra_key -- nvmf/common.sh@21 -- # NET_TYPE=phy-fallback 00:04:43.572 11:15:25 json_config_extra_key -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:04:43.572 11:15:25 json_config_extra_key -- nvmf/common.sh@49 -- # source /home/vagrant/spdk_repo/spdk/scripts/common.sh 00:04:43.572 11:15:25 json_config_extra_key -- scripts/common.sh@15 -- # shopt -s extglob 00:04:43.830 11:15:25 json_config_extra_key -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:04:43.830 11:15:25 json_config_extra_key -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:04:43.830 11:15:25 json_config_extra_key -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:04:43.830 11:15:25 json_config_extra_key -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:43.830 11:15:25 json_config_extra_key -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:43.830 11:15:25 json_config_extra_key -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:43.830 11:15:25 json_config_extra_key -- paths/export.sh@5 -- # export PATH 00:04:43.830 11:15:25 json_config_extra_key -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:43.830 11:15:25 json_config_extra_key -- nvmf/common.sh@51 -- # : 0 00:04:43.830 11:15:25 json_config_extra_key -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:04:43.830 11:15:25 json_config_extra_key -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:04:43.830 11:15:25 json_config_extra_key -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:04:43.830 11:15:25 json_config_extra_key -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:04:43.830 11:15:25 json_config_extra_key -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:04:43.830 11:15:25 json_config_extra_key -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:04:43.830 /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:04:43.830 11:15:25 json_config_extra_key -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:04:43.830 11:15:25 json_config_extra_key -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:04:43.830 11:15:25 json_config_extra_key -- nvmf/common.sh@55 -- # have_pci_nics=0 00:04:43.830 11:15:25 json_config_extra_key -- json_config/json_config_extra_key.sh@10 -- # source /home/vagrant/spdk_repo/spdk/test/json_config/common.sh 00:04:43.830 11:15:25 json_config_extra_key -- json_config/json_config_extra_key.sh@17 -- # app_pid=(['target']='') 00:04:43.830 11:15:25 json_config_extra_key -- json_config/json_config_extra_key.sh@17 -- # declare -A app_pid 00:04:43.830 11:15:25 json_config_extra_key -- json_config/json_config_extra_key.sh@18 -- # app_socket=(['target']='/var/tmp/spdk_tgt.sock') 00:04:43.830 11:15:25 json_config_extra_key -- json_config/json_config_extra_key.sh@18 -- # declare -A app_socket 00:04:43.830 11:15:25 json_config_extra_key -- json_config/json_config_extra_key.sh@19 -- # app_params=(['target']='-m 0x1 -s 1024') 00:04:43.830 11:15:25 json_config_extra_key -- json_config/json_config_extra_key.sh@19 -- # declare -A app_params 00:04:43.830 11:15:25 json_config_extra_key -- json_config/json_config_extra_key.sh@20 -- # configs_path=(['target']='/home/vagrant/spdk_repo/spdk/test/json_config/extra_key.json') 00:04:43.830 11:15:25 json_config_extra_key -- json_config/json_config_extra_key.sh@20 -- # declare -A configs_path 00:04:43.830 11:15:25 json_config_extra_key -- json_config/json_config_extra_key.sh@22 -- # trap 'on_error_exit "${FUNCNAME}" "${LINENO}"' ERR 00:04:43.830 INFO: launching applications... 00:04:43.830 11:15:25 json_config_extra_key -- json_config/json_config_extra_key.sh@24 -- # echo 'INFO: launching applications...' 00:04:43.830 11:15:25 json_config_extra_key -- json_config/json_config_extra_key.sh@25 -- # json_config_test_start_app target --json /home/vagrant/spdk_repo/spdk/test/json_config/extra_key.json 00:04:43.830 11:15:25 json_config_extra_key -- json_config/common.sh@9 -- # local app=target 00:04:43.830 11:15:25 json_config_extra_key -- json_config/common.sh@10 -- # shift 00:04:43.830 11:15:25 json_config_extra_key -- json_config/common.sh@12 -- # [[ -n 22 ]] 00:04:43.830 11:15:25 json_config_extra_key -- json_config/common.sh@13 -- # [[ -z '' ]] 00:04:43.830 11:15:25 json_config_extra_key -- json_config/common.sh@15 -- # local app_extra_params= 00:04:43.830 11:15:25 json_config_extra_key -- json_config/common.sh@16 -- # [[ 0 -eq 1 ]] 00:04:43.830 11:15:25 json_config_extra_key -- json_config/common.sh@16 -- # [[ 0 -eq 1 ]] 00:04:43.830 11:15:25 json_config_extra_key -- json_config/common.sh@22 -- # app_pid["$app"]=59652 00:04:43.830 Waiting for target to run... 00:04:43.830 11:15:25 json_config_extra_key -- json_config/common.sh@24 -- # echo 'Waiting for target to run...' 00:04:43.830 11:15:25 json_config_extra_key -- json_config/common.sh@25 -- # waitforlisten 59652 /var/tmp/spdk_tgt.sock 00:04:43.830 11:15:25 json_config_extra_key -- common/autotest_common.sh@831 -- # '[' -z 59652 ']' 00:04:43.830 11:15:25 json_config_extra_key -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:04:43.830 11:15:25 json_config_extra_key -- common/autotest_common.sh@836 -- # local max_retries=100 00:04:43.830 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:04:43.830 11:15:25 json_config_extra_key -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:04:43.830 11:15:25 json_config_extra_key -- json_config/common.sh@21 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --json /home/vagrant/spdk_repo/spdk/test/json_config/extra_key.json 00:04:43.830 11:15:25 json_config_extra_key -- common/autotest_common.sh@840 -- # xtrace_disable 00:04:43.831 11:15:25 json_config_extra_key -- common/autotest_common.sh@10 -- # set +x 00:04:43.831 [2024-10-07 11:15:25.368941] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:04:43.831 [2024-10-07 11:15:25.369075] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid59652 ] 00:04:44.395 [2024-10-07 11:15:25.905849] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:44.395 [2024-10-07 11:15:26.007846] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:04:44.961 11:15:26 json_config_extra_key -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:04:44.961 11:15:26 json_config_extra_key -- common/autotest_common.sh@864 -- # return 0 00:04:44.961 00:04:44.961 11:15:26 json_config_extra_key -- json_config/common.sh@26 -- # echo '' 00:04:44.961 INFO: shutting down applications... 00:04:44.961 11:15:26 json_config_extra_key -- json_config/json_config_extra_key.sh@27 -- # echo 'INFO: shutting down applications...' 00:04:44.961 11:15:26 json_config_extra_key -- json_config/json_config_extra_key.sh@28 -- # json_config_test_shutdown_app target 00:04:44.961 11:15:26 json_config_extra_key -- json_config/common.sh@31 -- # local app=target 00:04:44.961 11:15:26 json_config_extra_key -- json_config/common.sh@34 -- # [[ -n 22 ]] 00:04:44.961 11:15:26 json_config_extra_key -- json_config/common.sh@35 -- # [[ -n 59652 ]] 00:04:44.961 11:15:26 json_config_extra_key -- json_config/common.sh@38 -- # kill -SIGINT 59652 00:04:44.961 11:15:26 json_config_extra_key -- json_config/common.sh@40 -- # (( i = 0 )) 00:04:44.961 11:15:26 json_config_extra_key -- json_config/common.sh@40 -- # (( i < 30 )) 00:04:44.961 11:15:26 json_config_extra_key -- json_config/common.sh@41 -- # kill -0 59652 00:04:44.961 11:15:26 json_config_extra_key -- json_config/common.sh@45 -- # sleep 0.5 00:04:45.525 11:15:26 json_config_extra_key -- json_config/common.sh@40 -- # (( i++ )) 00:04:45.525 11:15:26 json_config_extra_key -- json_config/common.sh@40 -- # (( i < 30 )) 00:04:45.525 11:15:26 json_config_extra_key -- json_config/common.sh@41 -- # kill -0 59652 00:04:45.525 11:15:26 json_config_extra_key -- json_config/common.sh@42 -- # app_pid["$app"]= 00:04:45.525 11:15:26 json_config_extra_key -- json_config/common.sh@43 -- # break 00:04:45.525 11:15:26 json_config_extra_key -- json_config/common.sh@48 -- # [[ -n '' ]] 00:04:45.525 SPDK target shutdown done 00:04:45.525 11:15:26 json_config_extra_key -- json_config/common.sh@53 -- # echo 'SPDK target shutdown done' 00:04:45.525 Success 00:04:45.525 11:15:26 json_config_extra_key -- json_config/json_config_extra_key.sh@30 -- # echo Success 00:04:45.525 00:04:45.525 real 0m1.868s 00:04:45.525 user 0m1.744s 00:04:45.525 sys 0m0.580s 00:04:45.525 11:15:26 json_config_extra_key -- common/autotest_common.sh@1126 -- # xtrace_disable 00:04:45.525 ************************************ 00:04:45.525 END TEST json_config_extra_key 00:04:45.525 11:15:26 json_config_extra_key -- common/autotest_common.sh@10 -- # set +x 00:04:45.525 ************************************ 00:04:45.525 11:15:27 -- spdk/autotest.sh@161 -- # run_test alias_rpc /home/vagrant/spdk_repo/spdk/test/json_config/alias_rpc/alias_rpc.sh 00:04:45.525 11:15:27 -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:04:45.525 11:15:27 -- common/autotest_common.sh@1107 -- # xtrace_disable 00:04:45.525 11:15:27 -- common/autotest_common.sh@10 -- # set +x 00:04:45.525 ************************************ 00:04:45.525 START TEST alias_rpc 00:04:45.525 ************************************ 00:04:45.525 11:15:27 alias_rpc -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/json_config/alias_rpc/alias_rpc.sh 00:04:45.525 * Looking for test storage... 00:04:45.525 * Found test storage at /home/vagrant/spdk_repo/spdk/test/json_config/alias_rpc 00:04:45.525 11:15:27 alias_rpc -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:04:45.525 11:15:27 alias_rpc -- common/autotest_common.sh@1681 -- # lcov --version 00:04:45.525 11:15:27 alias_rpc -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:04:45.525 11:15:27 alias_rpc -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:04:45.525 11:15:27 alias_rpc -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:04:45.525 11:15:27 alias_rpc -- scripts/common.sh@333 -- # local ver1 ver1_l 00:04:45.525 11:15:27 alias_rpc -- scripts/common.sh@334 -- # local ver2 ver2_l 00:04:45.525 11:15:27 alias_rpc -- scripts/common.sh@336 -- # IFS=.-: 00:04:45.525 11:15:27 alias_rpc -- scripts/common.sh@336 -- # read -ra ver1 00:04:45.525 11:15:27 alias_rpc -- scripts/common.sh@337 -- # IFS=.-: 00:04:45.525 11:15:27 alias_rpc -- scripts/common.sh@337 -- # read -ra ver2 00:04:45.525 11:15:27 alias_rpc -- scripts/common.sh@338 -- # local 'op=<' 00:04:45.525 11:15:27 alias_rpc -- scripts/common.sh@340 -- # ver1_l=2 00:04:45.525 11:15:27 alias_rpc -- scripts/common.sh@341 -- # ver2_l=1 00:04:45.525 11:15:27 alias_rpc -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:04:45.525 11:15:27 alias_rpc -- scripts/common.sh@344 -- # case "$op" in 00:04:45.525 11:15:27 alias_rpc -- scripts/common.sh@345 -- # : 1 00:04:45.525 11:15:27 alias_rpc -- scripts/common.sh@364 -- # (( v = 0 )) 00:04:45.525 11:15:27 alias_rpc -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:45.525 11:15:27 alias_rpc -- scripts/common.sh@365 -- # decimal 1 00:04:45.525 11:15:27 alias_rpc -- scripts/common.sh@353 -- # local d=1 00:04:45.525 11:15:27 alias_rpc -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:45.525 11:15:27 alias_rpc -- scripts/common.sh@355 -- # echo 1 00:04:45.525 11:15:27 alias_rpc -- scripts/common.sh@365 -- # ver1[v]=1 00:04:45.525 11:15:27 alias_rpc -- scripts/common.sh@366 -- # decimal 2 00:04:45.525 11:15:27 alias_rpc -- scripts/common.sh@353 -- # local d=2 00:04:45.525 11:15:27 alias_rpc -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:45.525 11:15:27 alias_rpc -- scripts/common.sh@355 -- # echo 2 00:04:45.525 11:15:27 alias_rpc -- scripts/common.sh@366 -- # ver2[v]=2 00:04:45.525 11:15:27 alias_rpc -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:04:45.525 11:15:27 alias_rpc -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:04:45.525 11:15:27 alias_rpc -- scripts/common.sh@368 -- # return 0 00:04:45.525 11:15:27 alias_rpc -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:45.525 11:15:27 alias_rpc -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:04:45.525 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:45.525 --rc genhtml_branch_coverage=1 00:04:45.525 --rc genhtml_function_coverage=1 00:04:45.525 --rc genhtml_legend=1 00:04:45.525 --rc geninfo_all_blocks=1 00:04:45.525 --rc geninfo_unexecuted_blocks=1 00:04:45.525 00:04:45.525 ' 00:04:45.525 11:15:27 alias_rpc -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:04:45.525 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:45.525 --rc genhtml_branch_coverage=1 00:04:45.525 --rc genhtml_function_coverage=1 00:04:45.525 --rc genhtml_legend=1 00:04:45.525 --rc geninfo_all_blocks=1 00:04:45.525 --rc geninfo_unexecuted_blocks=1 00:04:45.525 00:04:45.525 ' 00:04:45.525 11:15:27 alias_rpc -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:04:45.525 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:45.525 --rc genhtml_branch_coverage=1 00:04:45.525 --rc genhtml_function_coverage=1 00:04:45.525 --rc genhtml_legend=1 00:04:45.525 --rc geninfo_all_blocks=1 00:04:45.525 --rc geninfo_unexecuted_blocks=1 00:04:45.525 00:04:45.525 ' 00:04:45.525 11:15:27 alias_rpc -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:04:45.525 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:45.525 --rc genhtml_branch_coverage=1 00:04:45.525 --rc genhtml_function_coverage=1 00:04:45.525 --rc genhtml_legend=1 00:04:45.525 --rc geninfo_all_blocks=1 00:04:45.525 --rc geninfo_unexecuted_blocks=1 00:04:45.525 00:04:45.525 ' 00:04:45.525 11:15:27 alias_rpc -- alias_rpc/alias_rpc.sh@10 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:04:45.525 11:15:27 alias_rpc -- alias_rpc/alias_rpc.sh@13 -- # spdk_tgt_pid=59742 00:04:45.525 11:15:27 alias_rpc -- alias_rpc/alias_rpc.sh@14 -- # waitforlisten 59742 00:04:45.525 11:15:27 alias_rpc -- alias_rpc/alias_rpc.sh@12 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_tgt 00:04:45.525 11:15:27 alias_rpc -- common/autotest_common.sh@831 -- # '[' -z 59742 ']' 00:04:45.525 11:15:27 alias_rpc -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:45.525 11:15:27 alias_rpc -- common/autotest_common.sh@836 -- # local max_retries=100 00:04:45.525 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:45.525 11:15:27 alias_rpc -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:45.525 11:15:27 alias_rpc -- common/autotest_common.sh@840 -- # xtrace_disable 00:04:45.525 11:15:27 alias_rpc -- common/autotest_common.sh@10 -- # set +x 00:04:45.782 [2024-10-07 11:15:27.269609] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:04:45.782 [2024-10-07 11:15:27.269725] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid59742 ] 00:04:45.782 [2024-10-07 11:15:27.407926] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:46.039 [2024-10-07 11:15:27.525440] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:04:46.604 11:15:28 alias_rpc -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:04:46.604 11:15:28 alias_rpc -- common/autotest_common.sh@864 -- # return 0 00:04:46.604 11:15:28 alias_rpc -- alias_rpc/alias_rpc.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py load_config -i 00:04:47.167 11:15:28 alias_rpc -- alias_rpc/alias_rpc.sh@19 -- # killprocess 59742 00:04:47.167 11:15:28 alias_rpc -- common/autotest_common.sh@950 -- # '[' -z 59742 ']' 00:04:47.167 11:15:28 alias_rpc -- common/autotest_common.sh@954 -- # kill -0 59742 00:04:47.167 11:15:28 alias_rpc -- common/autotest_common.sh@955 -- # uname 00:04:47.167 11:15:28 alias_rpc -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:04:47.167 11:15:28 alias_rpc -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 59742 00:04:47.168 11:15:28 alias_rpc -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:04:47.168 11:15:28 alias_rpc -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:04:47.168 11:15:28 alias_rpc -- common/autotest_common.sh@968 -- # echo 'killing process with pid 59742' 00:04:47.168 killing process with pid 59742 00:04:47.168 11:15:28 alias_rpc -- common/autotest_common.sh@969 -- # kill 59742 00:04:47.168 11:15:28 alias_rpc -- common/autotest_common.sh@974 -- # wait 59742 00:04:47.425 00:04:47.425 real 0m2.064s 00:04:47.425 user 0m2.408s 00:04:47.425 sys 0m0.490s 00:04:47.425 11:15:29 alias_rpc -- common/autotest_common.sh@1126 -- # xtrace_disable 00:04:47.425 11:15:29 alias_rpc -- common/autotest_common.sh@10 -- # set +x 00:04:47.425 ************************************ 00:04:47.425 END TEST alias_rpc 00:04:47.425 ************************************ 00:04:47.425 11:15:29 -- spdk/autotest.sh@163 -- # [[ 1 -eq 0 ]] 00:04:47.425 11:15:29 -- spdk/autotest.sh@167 -- # run_test dpdk_mem_utility /home/vagrant/spdk_repo/spdk/test/dpdk_memory_utility/test_dpdk_mem_info.sh 00:04:47.425 11:15:29 -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:04:47.425 11:15:29 -- common/autotest_common.sh@1107 -- # xtrace_disable 00:04:47.425 11:15:29 -- common/autotest_common.sh@10 -- # set +x 00:04:47.682 ************************************ 00:04:47.682 START TEST dpdk_mem_utility 00:04:47.682 ************************************ 00:04:47.682 11:15:29 dpdk_mem_utility -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/dpdk_memory_utility/test_dpdk_mem_info.sh 00:04:47.682 * Looking for test storage... 00:04:47.682 * Found test storage at /home/vagrant/spdk_repo/spdk/test/dpdk_memory_utility 00:04:47.682 11:15:29 dpdk_mem_utility -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:04:47.682 11:15:29 dpdk_mem_utility -- common/autotest_common.sh@1681 -- # lcov --version 00:04:47.682 11:15:29 dpdk_mem_utility -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:04:47.682 11:15:29 dpdk_mem_utility -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:04:47.682 11:15:29 dpdk_mem_utility -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:04:47.682 11:15:29 dpdk_mem_utility -- scripts/common.sh@333 -- # local ver1 ver1_l 00:04:47.682 11:15:29 dpdk_mem_utility -- scripts/common.sh@334 -- # local ver2 ver2_l 00:04:47.682 11:15:29 dpdk_mem_utility -- scripts/common.sh@336 -- # IFS=.-: 00:04:47.682 11:15:29 dpdk_mem_utility -- scripts/common.sh@336 -- # read -ra ver1 00:04:47.682 11:15:29 dpdk_mem_utility -- scripts/common.sh@337 -- # IFS=.-: 00:04:47.682 11:15:29 dpdk_mem_utility -- scripts/common.sh@337 -- # read -ra ver2 00:04:47.682 11:15:29 dpdk_mem_utility -- scripts/common.sh@338 -- # local 'op=<' 00:04:47.682 11:15:29 dpdk_mem_utility -- scripts/common.sh@340 -- # ver1_l=2 00:04:47.682 11:15:29 dpdk_mem_utility -- scripts/common.sh@341 -- # ver2_l=1 00:04:47.682 11:15:29 dpdk_mem_utility -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:04:47.682 11:15:29 dpdk_mem_utility -- scripts/common.sh@344 -- # case "$op" in 00:04:47.682 11:15:29 dpdk_mem_utility -- scripts/common.sh@345 -- # : 1 00:04:47.682 11:15:29 dpdk_mem_utility -- scripts/common.sh@364 -- # (( v = 0 )) 00:04:47.683 11:15:29 dpdk_mem_utility -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:47.683 11:15:29 dpdk_mem_utility -- scripts/common.sh@365 -- # decimal 1 00:04:47.683 11:15:29 dpdk_mem_utility -- scripts/common.sh@353 -- # local d=1 00:04:47.683 11:15:29 dpdk_mem_utility -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:47.683 11:15:29 dpdk_mem_utility -- scripts/common.sh@355 -- # echo 1 00:04:47.683 11:15:29 dpdk_mem_utility -- scripts/common.sh@365 -- # ver1[v]=1 00:04:47.683 11:15:29 dpdk_mem_utility -- scripts/common.sh@366 -- # decimal 2 00:04:47.683 11:15:29 dpdk_mem_utility -- scripts/common.sh@353 -- # local d=2 00:04:47.683 11:15:29 dpdk_mem_utility -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:47.683 11:15:29 dpdk_mem_utility -- scripts/common.sh@355 -- # echo 2 00:04:47.683 11:15:29 dpdk_mem_utility -- scripts/common.sh@366 -- # ver2[v]=2 00:04:47.683 11:15:29 dpdk_mem_utility -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:04:47.683 11:15:29 dpdk_mem_utility -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:04:47.683 11:15:29 dpdk_mem_utility -- scripts/common.sh@368 -- # return 0 00:04:47.683 11:15:29 dpdk_mem_utility -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:47.683 11:15:29 dpdk_mem_utility -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:04:47.683 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:47.683 --rc genhtml_branch_coverage=1 00:04:47.683 --rc genhtml_function_coverage=1 00:04:47.683 --rc genhtml_legend=1 00:04:47.683 --rc geninfo_all_blocks=1 00:04:47.683 --rc geninfo_unexecuted_blocks=1 00:04:47.683 00:04:47.683 ' 00:04:47.683 11:15:29 dpdk_mem_utility -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:04:47.683 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:47.683 --rc genhtml_branch_coverage=1 00:04:47.683 --rc genhtml_function_coverage=1 00:04:47.683 --rc genhtml_legend=1 00:04:47.683 --rc geninfo_all_blocks=1 00:04:47.683 --rc geninfo_unexecuted_blocks=1 00:04:47.683 00:04:47.683 ' 00:04:47.683 11:15:29 dpdk_mem_utility -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:04:47.683 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:47.683 --rc genhtml_branch_coverage=1 00:04:47.683 --rc genhtml_function_coverage=1 00:04:47.683 --rc genhtml_legend=1 00:04:47.683 --rc geninfo_all_blocks=1 00:04:47.683 --rc geninfo_unexecuted_blocks=1 00:04:47.683 00:04:47.683 ' 00:04:47.683 11:15:29 dpdk_mem_utility -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:04:47.683 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:47.683 --rc genhtml_branch_coverage=1 00:04:47.683 --rc genhtml_function_coverage=1 00:04:47.683 --rc genhtml_legend=1 00:04:47.683 --rc geninfo_all_blocks=1 00:04:47.683 --rc geninfo_unexecuted_blocks=1 00:04:47.683 00:04:47.683 ' 00:04:47.683 11:15:29 dpdk_mem_utility -- dpdk_memory_utility/test_dpdk_mem_info.sh@10 -- # MEM_SCRIPT=/home/vagrant/spdk_repo/spdk/scripts/dpdk_mem_info.py 00:04:47.683 11:15:29 dpdk_mem_utility -- dpdk_memory_utility/test_dpdk_mem_info.sh@13 -- # spdkpid=59842 00:04:47.683 11:15:29 dpdk_mem_utility -- dpdk_memory_utility/test_dpdk_mem_info.sh@12 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_tgt 00:04:47.683 11:15:29 dpdk_mem_utility -- dpdk_memory_utility/test_dpdk_mem_info.sh@15 -- # waitforlisten 59842 00:04:47.683 11:15:29 dpdk_mem_utility -- common/autotest_common.sh@831 -- # '[' -z 59842 ']' 00:04:47.683 11:15:29 dpdk_mem_utility -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:47.683 11:15:29 dpdk_mem_utility -- common/autotest_common.sh@836 -- # local max_retries=100 00:04:47.683 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:47.683 11:15:29 dpdk_mem_utility -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:47.683 11:15:29 dpdk_mem_utility -- common/autotest_common.sh@840 -- # xtrace_disable 00:04:47.683 11:15:29 dpdk_mem_utility -- common/autotest_common.sh@10 -- # set +x 00:04:47.941 [2024-10-07 11:15:29.410546] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:04:47.941 [2024-10-07 11:15:29.410654] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid59842 ] 00:04:47.941 [2024-10-07 11:15:29.546697] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:48.204 [2024-10-07 11:15:29.669175] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:04:48.770 11:15:30 dpdk_mem_utility -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:04:48.770 11:15:30 dpdk_mem_utility -- common/autotest_common.sh@864 -- # return 0 00:04:48.770 11:15:30 dpdk_mem_utility -- dpdk_memory_utility/test_dpdk_mem_info.sh@17 -- # trap 'killprocess $spdkpid' SIGINT SIGTERM EXIT 00:04:48.770 11:15:30 dpdk_mem_utility -- dpdk_memory_utility/test_dpdk_mem_info.sh@19 -- # rpc_cmd env_dpdk_get_mem_stats 00:04:48.770 11:15:30 dpdk_mem_utility -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:48.770 11:15:30 dpdk_mem_utility -- common/autotest_common.sh@10 -- # set +x 00:04:48.770 { 00:04:48.770 "filename": "/tmp/spdk_mem_dump.txt" 00:04:48.770 } 00:04:48.770 11:15:30 dpdk_mem_utility -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:48.770 11:15:30 dpdk_mem_utility -- dpdk_memory_utility/test_dpdk_mem_info.sh@21 -- # /home/vagrant/spdk_repo/spdk/scripts/dpdk_mem_info.py 00:04:49.029 DPDK memory size 860.000000 MiB in 1 heap(s) 00:04:49.029 1 heaps totaling size 860.000000 MiB 00:04:49.029 size: 860.000000 MiB heap id: 0 00:04:49.029 end heaps---------- 00:04:49.029 9 mempools totaling size 642.649841 MiB 00:04:49.029 size: 212.674988 MiB name: PDU_immediate_data_Pool 00:04:49.029 size: 158.602051 MiB name: PDU_data_out_Pool 00:04:49.029 size: 92.545471 MiB name: bdev_io_59842 00:04:49.029 size: 51.011292 MiB name: evtpool_59842 00:04:49.029 size: 50.003479 MiB name: msgpool_59842 00:04:49.029 size: 36.509338 MiB name: fsdev_io_59842 00:04:49.029 size: 21.763794 MiB name: PDU_Pool 00:04:49.029 size: 19.513306 MiB name: SCSI_TASK_Pool 00:04:49.029 size: 0.026123 MiB name: Session_Pool 00:04:49.029 end mempools------- 00:04:49.029 6 memzones totaling size 4.142822 MiB 00:04:49.029 size: 1.000366 MiB name: RG_ring_0_59842 00:04:49.029 size: 1.000366 MiB name: RG_ring_1_59842 00:04:49.029 size: 1.000366 MiB name: RG_ring_4_59842 00:04:49.029 size: 1.000366 MiB name: RG_ring_5_59842 00:04:49.029 size: 0.125366 MiB name: RG_ring_2_59842 00:04:49.029 size: 0.015991 MiB name: RG_ring_3_59842 00:04:49.029 end memzones------- 00:04:49.029 11:15:30 dpdk_mem_utility -- dpdk_memory_utility/test_dpdk_mem_info.sh@23 -- # /home/vagrant/spdk_repo/spdk/scripts/dpdk_mem_info.py -m 0 00:04:49.029 heap id: 0 total size: 860.000000 MiB number of busy elements: 279 number of free elements: 16 00:04:49.029 list of free elements. size: 13.941650 MiB 00:04:49.029 element at address: 0x200000400000 with size: 1.999512 MiB 00:04:49.029 element at address: 0x200000800000 with size: 1.996948 MiB 00:04:49.029 element at address: 0x20001bc00000 with size: 0.999878 MiB 00:04:49.029 element at address: 0x20001be00000 with size: 0.999878 MiB 00:04:49.029 element at address: 0x200034a00000 with size: 0.994446 MiB 00:04:49.029 element at address: 0x200009600000 with size: 0.959839 MiB 00:04:49.029 element at address: 0x200015e00000 with size: 0.954285 MiB 00:04:49.029 element at address: 0x20001c000000 with size: 0.936584 MiB 00:04:49.029 element at address: 0x200000200000 with size: 0.834839 MiB 00:04:49.029 element at address: 0x20001d800000 with size: 0.572815 MiB 00:04:49.029 element at address: 0x20000d800000 with size: 0.489441 MiB 00:04:49.029 element at address: 0x200003e00000 with size: 0.487732 MiB 00:04:49.029 element at address: 0x20001c200000 with size: 0.485657 MiB 00:04:49.029 element at address: 0x200007000000 with size: 0.480286 MiB 00:04:49.029 element at address: 0x20002ac00000 with size: 0.397766 MiB 00:04:49.029 element at address: 0x200003a00000 with size: 0.351746 MiB 00:04:49.029 list of standard malloc elements. size: 199.261658 MiB 00:04:49.029 element at address: 0x20000d9fff80 with size: 132.000122 MiB 00:04:49.029 element at address: 0x2000097fff80 with size: 64.000122 MiB 00:04:49.029 element at address: 0x20001bcfff80 with size: 1.000122 MiB 00:04:49.029 element at address: 0x20001befff80 with size: 1.000122 MiB 00:04:49.029 element at address: 0x20001c0fff80 with size: 1.000122 MiB 00:04:49.029 element at address: 0x2000003d9f00 with size: 0.140747 MiB 00:04:49.029 element at address: 0x20001c0eff00 with size: 0.062622 MiB 00:04:49.029 element at address: 0x2000003fdf80 with size: 0.007935 MiB 00:04:49.029 element at address: 0x20001c0efdc0 with size: 0.000305 MiB 00:04:49.029 element at address: 0x2000002d5b80 with size: 0.000183 MiB 00:04:49.029 element at address: 0x2000002d5c40 with size: 0.000183 MiB 00:04:49.029 element at address: 0x2000002d5d00 with size: 0.000183 MiB 00:04:49.029 element at address: 0x2000002d5dc0 with size: 0.000183 MiB 00:04:49.029 element at address: 0x2000002d5e80 with size: 0.000183 MiB 00:04:49.029 element at address: 0x2000002d5f40 with size: 0.000183 MiB 00:04:49.029 element at address: 0x2000002d6000 with size: 0.000183 MiB 00:04:49.029 element at address: 0x2000002d60c0 with size: 0.000183 MiB 00:04:49.029 element at address: 0x2000002d6180 with size: 0.000183 MiB 00:04:49.029 element at address: 0x2000002d6240 with size: 0.000183 MiB 00:04:49.029 element at address: 0x2000002d6300 with size: 0.000183 MiB 00:04:49.029 element at address: 0x2000002d63c0 with size: 0.000183 MiB 00:04:49.029 element at address: 0x2000002d6480 with size: 0.000183 MiB 00:04:49.029 element at address: 0x2000002d6540 with size: 0.000183 MiB 00:04:49.029 element at address: 0x2000002d6600 with size: 0.000183 MiB 00:04:49.029 element at address: 0x2000002d66c0 with size: 0.000183 MiB 00:04:49.029 element at address: 0x2000002d6780 with size: 0.000183 MiB 00:04:49.029 element at address: 0x2000002d6840 with size: 0.000183 MiB 00:04:49.029 element at address: 0x2000002d6900 with size: 0.000183 MiB 00:04:49.029 element at address: 0x2000002d69c0 with size: 0.000183 MiB 00:04:49.029 element at address: 0x2000002d6a80 with size: 0.000183 MiB 00:04:49.029 element at address: 0x2000002d6b40 with size: 0.000183 MiB 00:04:49.029 element at address: 0x2000002d6c00 with size: 0.000183 MiB 00:04:49.029 element at address: 0x2000002d6cc0 with size: 0.000183 MiB 00:04:49.029 element at address: 0x2000002d6d80 with size: 0.000183 MiB 00:04:49.029 element at address: 0x2000002d6e40 with size: 0.000183 MiB 00:04:49.029 element at address: 0x2000002d6f00 with size: 0.000183 MiB 00:04:49.029 element at address: 0x2000002d7100 with size: 0.000183 MiB 00:04:49.029 element at address: 0x2000002d71c0 with size: 0.000183 MiB 00:04:49.029 element at address: 0x2000002d7280 with size: 0.000183 MiB 00:04:49.029 element at address: 0x2000002d7340 with size: 0.000183 MiB 00:04:49.029 element at address: 0x2000002d7400 with size: 0.000183 MiB 00:04:49.029 element at address: 0x2000002d74c0 with size: 0.000183 MiB 00:04:49.029 element at address: 0x2000002d7580 with size: 0.000183 MiB 00:04:49.029 element at address: 0x2000002d7640 with size: 0.000183 MiB 00:04:49.029 element at address: 0x2000002d7700 with size: 0.000183 MiB 00:04:49.029 element at address: 0x2000002d77c0 with size: 0.000183 MiB 00:04:49.029 element at address: 0x2000002d7880 with size: 0.000183 MiB 00:04:49.029 element at address: 0x2000002d7940 with size: 0.000183 MiB 00:04:49.029 element at address: 0x2000002d7a00 with size: 0.000183 MiB 00:04:49.029 element at address: 0x2000002d7ac0 with size: 0.000183 MiB 00:04:49.029 element at address: 0x2000002d7b80 with size: 0.000183 MiB 00:04:49.029 element at address: 0x2000002d7c40 with size: 0.000183 MiB 00:04:49.029 element at address: 0x2000003d9e40 with size: 0.000183 MiB 00:04:49.029 element at address: 0x200003a5a0c0 with size: 0.000183 MiB 00:04:49.029 element at address: 0x200003a5a2c0 with size: 0.000183 MiB 00:04:49.029 element at address: 0x200003a5e580 with size: 0.000183 MiB 00:04:49.029 element at address: 0x200003a7e840 with size: 0.000183 MiB 00:04:49.029 element at address: 0x200003a7e900 with size: 0.000183 MiB 00:04:49.029 element at address: 0x200003a7e9c0 with size: 0.000183 MiB 00:04:49.029 element at address: 0x200003a7ea80 with size: 0.000183 MiB 00:04:49.029 element at address: 0x200003a7eb40 with size: 0.000183 MiB 00:04:49.029 element at address: 0x200003a7ec00 with size: 0.000183 MiB 00:04:49.029 element at address: 0x200003a7ecc0 with size: 0.000183 MiB 00:04:49.029 element at address: 0x200003a7ed80 with size: 0.000183 MiB 00:04:49.029 element at address: 0x200003a7ee40 with size: 0.000183 MiB 00:04:49.030 element at address: 0x200003a7ef00 with size: 0.000183 MiB 00:04:49.030 element at address: 0x200003a7efc0 with size: 0.000183 MiB 00:04:49.030 element at address: 0x200003a7f080 with size: 0.000183 MiB 00:04:49.030 element at address: 0x200003a7f140 with size: 0.000183 MiB 00:04:49.030 element at address: 0x200003a7f200 with size: 0.000183 MiB 00:04:49.030 element at address: 0x200003a7f2c0 with size: 0.000183 MiB 00:04:49.030 element at address: 0x200003a7f380 with size: 0.000183 MiB 00:04:49.030 element at address: 0x200003a7f440 with size: 0.000183 MiB 00:04:49.030 element at address: 0x200003a7f500 with size: 0.000183 MiB 00:04:49.030 element at address: 0x200003a7f5c0 with size: 0.000183 MiB 00:04:49.030 element at address: 0x200003a7f680 with size: 0.000183 MiB 00:04:49.030 element at address: 0x200003aff940 with size: 0.000183 MiB 00:04:49.030 element at address: 0x200003affb40 with size: 0.000183 MiB 00:04:49.030 element at address: 0x200003e7cdc0 with size: 0.000183 MiB 00:04:49.030 element at address: 0x200003e7ce80 with size: 0.000183 MiB 00:04:49.030 element at address: 0x200003e7cf40 with size: 0.000183 MiB 00:04:49.030 element at address: 0x200003e7d000 with size: 0.000183 MiB 00:04:49.030 element at address: 0x200003e7d0c0 with size: 0.000183 MiB 00:04:49.030 element at address: 0x200003e7d180 with size: 0.000183 MiB 00:04:49.030 element at address: 0x200003e7d240 with size: 0.000183 MiB 00:04:49.030 element at address: 0x200003e7d300 with size: 0.000183 MiB 00:04:49.030 element at address: 0x200003e7d3c0 with size: 0.000183 MiB 00:04:49.030 element at address: 0x200003e7d480 with size: 0.000183 MiB 00:04:49.030 element at address: 0x200003e7d540 with size: 0.000183 MiB 00:04:49.030 element at address: 0x200003e7d600 with size: 0.000183 MiB 00:04:49.030 element at address: 0x200003e7d6c0 with size: 0.000183 MiB 00:04:49.030 element at address: 0x200003e7d780 with size: 0.000183 MiB 00:04:49.030 element at address: 0x200003e7d840 with size: 0.000183 MiB 00:04:49.030 element at address: 0x200003e7d900 with size: 0.000183 MiB 00:04:49.030 element at address: 0x200003e7d9c0 with size: 0.000183 MiB 00:04:49.030 element at address: 0x200003e7da80 with size: 0.000183 MiB 00:04:49.030 element at address: 0x200003e7db40 with size: 0.000183 MiB 00:04:49.030 element at address: 0x200003e7dc00 with size: 0.000183 MiB 00:04:49.030 element at address: 0x200003e7dcc0 with size: 0.000183 MiB 00:04:49.030 element at address: 0x200003e7dd80 with size: 0.000183 MiB 00:04:49.030 element at address: 0x200003e7de40 with size: 0.000183 MiB 00:04:49.030 element at address: 0x200003e7df00 with size: 0.000183 MiB 00:04:49.030 element at address: 0x200003e7dfc0 with size: 0.000183 MiB 00:04:49.030 element at address: 0x200003e7e080 with size: 0.000183 MiB 00:04:49.030 element at address: 0x200003e7e140 with size: 0.000183 MiB 00:04:49.030 element at address: 0x200003e7e200 with size: 0.000183 MiB 00:04:49.030 element at address: 0x200003e7e2c0 with size: 0.000183 MiB 00:04:49.030 element at address: 0x200003e7e380 with size: 0.000183 MiB 00:04:49.030 element at address: 0x200003e7e440 with size: 0.000183 MiB 00:04:49.030 element at address: 0x200003e7e500 with size: 0.000183 MiB 00:04:49.030 element at address: 0x200003e7e5c0 with size: 0.000183 MiB 00:04:49.030 element at address: 0x200003e7e680 with size: 0.000183 MiB 00:04:49.030 element at address: 0x200003e7e740 with size: 0.000183 MiB 00:04:49.030 element at address: 0x200003e7e800 with size: 0.000183 MiB 00:04:49.030 element at address: 0x200003e7e8c0 with size: 0.000183 MiB 00:04:49.030 element at address: 0x200003e7e980 with size: 0.000183 MiB 00:04:49.030 element at address: 0x200003e7ea40 with size: 0.000183 MiB 00:04:49.030 element at address: 0x200003e7eb00 with size: 0.000183 MiB 00:04:49.030 element at address: 0x200003e7ebc0 with size: 0.000183 MiB 00:04:49.030 element at address: 0x200003e7ec80 with size: 0.000183 MiB 00:04:49.030 element at address: 0x200003e7ed40 with size: 0.000183 MiB 00:04:49.030 element at address: 0x200003eff000 with size: 0.000183 MiB 00:04:49.030 element at address: 0x200003eff0c0 with size: 0.000183 MiB 00:04:49.030 element at address: 0x20000707af40 with size: 0.000183 MiB 00:04:49.030 element at address: 0x20000707b000 with size: 0.000183 MiB 00:04:49.030 element at address: 0x20000707b0c0 with size: 0.000183 MiB 00:04:49.030 element at address: 0x20000707b180 with size: 0.000183 MiB 00:04:49.030 element at address: 0x20000707b240 with size: 0.000183 MiB 00:04:49.030 element at address: 0x20000707b300 with size: 0.000183 MiB 00:04:49.030 element at address: 0x20000707b3c0 with size: 0.000183 MiB 00:04:49.030 element at address: 0x20000707b480 with size: 0.000183 MiB 00:04:49.030 element at address: 0x20000707b540 with size: 0.000183 MiB 00:04:49.030 element at address: 0x20000707b600 with size: 0.000183 MiB 00:04:49.030 element at address: 0x20000707b6c0 with size: 0.000183 MiB 00:04:49.030 element at address: 0x2000070fb980 with size: 0.000183 MiB 00:04:49.030 element at address: 0x2000096fdd80 with size: 0.000183 MiB 00:04:49.030 element at address: 0x20000d87d4c0 with size: 0.000183 MiB 00:04:49.030 element at address: 0x20000d87d580 with size: 0.000183 MiB 00:04:49.030 element at address: 0x20000d87d640 with size: 0.000183 MiB 00:04:49.030 element at address: 0x20000d87d700 with size: 0.000183 MiB 00:04:49.030 element at address: 0x20000d87d7c0 with size: 0.000183 MiB 00:04:49.030 element at address: 0x20000d87d880 with size: 0.000183 MiB 00:04:49.030 element at address: 0x20000d87d940 with size: 0.000183 MiB 00:04:49.030 element at address: 0x20000d87da00 with size: 0.000183 MiB 00:04:49.030 element at address: 0x20000d87dac0 with size: 0.000183 MiB 00:04:49.030 element at address: 0x20000d8fdd80 with size: 0.000183 MiB 00:04:49.030 element at address: 0x200015ef44c0 with size: 0.000183 MiB 00:04:49.030 element at address: 0x20001c0efc40 with size: 0.000183 MiB 00:04:49.030 element at address: 0x20001c0efd00 with size: 0.000183 MiB 00:04:49.030 element at address: 0x20001c2bc740 with size: 0.000183 MiB 00:04:49.030 element at address: 0x20001d892a40 with size: 0.000183 MiB 00:04:49.030 element at address: 0x20001d892b00 with size: 0.000183 MiB 00:04:49.030 element at address: 0x20001d892bc0 with size: 0.000183 MiB 00:04:49.030 element at address: 0x20001d892c80 with size: 0.000183 MiB 00:04:49.030 element at address: 0x20001d892d40 with size: 0.000183 MiB 00:04:49.030 element at address: 0x20001d892e00 with size: 0.000183 MiB 00:04:49.030 element at address: 0x20001d892ec0 with size: 0.000183 MiB 00:04:49.030 element at address: 0x20001d892f80 with size: 0.000183 MiB 00:04:49.030 element at address: 0x20001d893040 with size: 0.000183 MiB 00:04:49.030 element at address: 0x20001d893100 with size: 0.000183 MiB 00:04:49.030 element at address: 0x20001d8931c0 with size: 0.000183 MiB 00:04:49.030 element at address: 0x20001d893280 with size: 0.000183 MiB 00:04:49.030 element at address: 0x20001d893340 with size: 0.000183 MiB 00:04:49.030 element at address: 0x20001d893400 with size: 0.000183 MiB 00:04:49.030 element at address: 0x20001d8934c0 with size: 0.000183 MiB 00:04:49.030 element at address: 0x20001d893580 with size: 0.000183 MiB 00:04:49.030 element at address: 0x20001d893640 with size: 0.000183 MiB 00:04:49.030 element at address: 0x20001d893700 with size: 0.000183 MiB 00:04:49.030 element at address: 0x20001d8937c0 with size: 0.000183 MiB 00:04:49.030 element at address: 0x20001d893880 with size: 0.000183 MiB 00:04:49.030 element at address: 0x20001d893940 with size: 0.000183 MiB 00:04:49.030 element at address: 0x20001d893a00 with size: 0.000183 MiB 00:04:49.030 element at address: 0x20001d893ac0 with size: 0.000183 MiB 00:04:49.030 element at address: 0x20001d893b80 with size: 0.000183 MiB 00:04:49.030 element at address: 0x20001d893c40 with size: 0.000183 MiB 00:04:49.030 element at address: 0x20001d893d00 with size: 0.000183 MiB 00:04:49.030 element at address: 0x20001d893dc0 with size: 0.000183 MiB 00:04:49.030 element at address: 0x20001d893e80 with size: 0.000183 MiB 00:04:49.030 element at address: 0x20001d893f40 with size: 0.000183 MiB 00:04:49.030 element at address: 0x20001d894000 with size: 0.000183 MiB 00:04:49.030 element at address: 0x20001d8940c0 with size: 0.000183 MiB 00:04:49.030 element at address: 0x20001d894180 with size: 0.000183 MiB 00:04:49.030 element at address: 0x20001d894240 with size: 0.000183 MiB 00:04:49.030 element at address: 0x20001d894300 with size: 0.000183 MiB 00:04:49.030 element at address: 0x20001d8943c0 with size: 0.000183 MiB 00:04:49.030 element at address: 0x20001d894480 with size: 0.000183 MiB 00:04:49.030 element at address: 0x20001d894540 with size: 0.000183 MiB 00:04:49.030 element at address: 0x20001d894600 with size: 0.000183 MiB 00:04:49.030 element at address: 0x20001d8946c0 with size: 0.000183 MiB 00:04:49.030 element at address: 0x20001d894780 with size: 0.000183 MiB 00:04:49.030 element at address: 0x20001d894840 with size: 0.000183 MiB 00:04:49.030 element at address: 0x20001d894900 with size: 0.000183 MiB 00:04:49.030 element at address: 0x20001d8949c0 with size: 0.000183 MiB 00:04:49.030 element at address: 0x20001d894a80 with size: 0.000183 MiB 00:04:49.030 element at address: 0x20001d894b40 with size: 0.000183 MiB 00:04:49.030 element at address: 0x20001d894c00 with size: 0.000183 MiB 00:04:49.030 element at address: 0x20001d894cc0 with size: 0.000183 MiB 00:04:49.030 element at address: 0x20001d894d80 with size: 0.000183 MiB 00:04:49.030 element at address: 0x20001d894e40 with size: 0.000183 MiB 00:04:49.030 element at address: 0x20001d894f00 with size: 0.000183 MiB 00:04:49.030 element at address: 0x20001d894fc0 with size: 0.000183 MiB 00:04:49.030 element at address: 0x20001d895080 with size: 0.000183 MiB 00:04:49.030 element at address: 0x20001d895140 with size: 0.000183 MiB 00:04:49.031 element at address: 0x20001d895200 with size: 0.000183 MiB 00:04:49.031 element at address: 0x20001d8952c0 with size: 0.000183 MiB 00:04:49.031 element at address: 0x20001d895380 with size: 0.000183 MiB 00:04:49.031 element at address: 0x20001d895440 with size: 0.000183 MiB 00:04:49.031 element at address: 0x20002ac65d40 with size: 0.000183 MiB 00:04:49.031 element at address: 0x20002ac65e00 with size: 0.000183 MiB 00:04:49.031 element at address: 0x20002ac6ca00 with size: 0.000183 MiB 00:04:49.031 element at address: 0x20002ac6cc00 with size: 0.000183 MiB 00:04:49.031 element at address: 0x20002ac6ccc0 with size: 0.000183 MiB 00:04:49.031 element at address: 0x20002ac6cd80 with size: 0.000183 MiB 00:04:49.031 element at address: 0x20002ac6ce40 with size: 0.000183 MiB 00:04:49.031 element at address: 0x20002ac6cf00 with size: 0.000183 MiB 00:04:49.031 element at address: 0x20002ac6cfc0 with size: 0.000183 MiB 00:04:49.031 element at address: 0x20002ac6d080 with size: 0.000183 MiB 00:04:49.031 element at address: 0x20002ac6d140 with size: 0.000183 MiB 00:04:49.031 element at address: 0x20002ac6d200 with size: 0.000183 MiB 00:04:49.031 element at address: 0x20002ac6d2c0 with size: 0.000183 MiB 00:04:49.031 element at address: 0x20002ac6d380 with size: 0.000183 MiB 00:04:49.031 element at address: 0x20002ac6d440 with size: 0.000183 MiB 00:04:49.031 element at address: 0x20002ac6d500 with size: 0.000183 MiB 00:04:49.031 element at address: 0x20002ac6d5c0 with size: 0.000183 MiB 00:04:49.031 element at address: 0x20002ac6d680 with size: 0.000183 MiB 00:04:49.031 element at address: 0x20002ac6d740 with size: 0.000183 MiB 00:04:49.031 element at address: 0x20002ac6d800 with size: 0.000183 MiB 00:04:49.031 element at address: 0x20002ac6d8c0 with size: 0.000183 MiB 00:04:49.031 element at address: 0x20002ac6d980 with size: 0.000183 MiB 00:04:49.031 element at address: 0x20002ac6da40 with size: 0.000183 MiB 00:04:49.031 element at address: 0x20002ac6db00 with size: 0.000183 MiB 00:04:49.031 element at address: 0x20002ac6dbc0 with size: 0.000183 MiB 00:04:49.031 element at address: 0x20002ac6dc80 with size: 0.000183 MiB 00:04:49.031 element at address: 0x20002ac6dd40 with size: 0.000183 MiB 00:04:49.031 element at address: 0x20002ac6de00 with size: 0.000183 MiB 00:04:49.031 element at address: 0x20002ac6dec0 with size: 0.000183 MiB 00:04:49.031 element at address: 0x20002ac6df80 with size: 0.000183 MiB 00:04:49.031 element at address: 0x20002ac6e040 with size: 0.000183 MiB 00:04:49.031 element at address: 0x20002ac6e100 with size: 0.000183 MiB 00:04:49.031 element at address: 0x20002ac6e1c0 with size: 0.000183 MiB 00:04:49.031 element at address: 0x20002ac6e280 with size: 0.000183 MiB 00:04:49.031 element at address: 0x20002ac6e340 with size: 0.000183 MiB 00:04:49.031 element at address: 0x20002ac6e400 with size: 0.000183 MiB 00:04:49.031 element at address: 0x20002ac6e4c0 with size: 0.000183 MiB 00:04:49.031 element at address: 0x20002ac6e580 with size: 0.000183 MiB 00:04:49.031 element at address: 0x20002ac6e640 with size: 0.000183 MiB 00:04:49.031 element at address: 0x20002ac6e700 with size: 0.000183 MiB 00:04:49.031 element at address: 0x20002ac6e7c0 with size: 0.000183 MiB 00:04:49.031 element at address: 0x20002ac6e880 with size: 0.000183 MiB 00:04:49.031 element at address: 0x20002ac6e940 with size: 0.000183 MiB 00:04:49.031 element at address: 0x20002ac6ea00 with size: 0.000183 MiB 00:04:49.031 element at address: 0x20002ac6eac0 with size: 0.000183 MiB 00:04:49.031 element at address: 0x20002ac6eb80 with size: 0.000183 MiB 00:04:49.031 element at address: 0x20002ac6ec40 with size: 0.000183 MiB 00:04:49.031 element at address: 0x20002ac6ed00 with size: 0.000183 MiB 00:04:49.031 element at address: 0x20002ac6edc0 with size: 0.000183 MiB 00:04:49.031 element at address: 0x20002ac6ee80 with size: 0.000183 MiB 00:04:49.031 element at address: 0x20002ac6ef40 with size: 0.000183 MiB 00:04:49.031 element at address: 0x20002ac6f000 with size: 0.000183 MiB 00:04:49.031 element at address: 0x20002ac6f0c0 with size: 0.000183 MiB 00:04:49.031 element at address: 0x20002ac6f180 with size: 0.000183 MiB 00:04:49.031 element at address: 0x20002ac6f240 with size: 0.000183 MiB 00:04:49.031 element at address: 0x20002ac6f300 with size: 0.000183 MiB 00:04:49.031 element at address: 0x20002ac6f3c0 with size: 0.000183 MiB 00:04:49.031 element at address: 0x20002ac6f480 with size: 0.000183 MiB 00:04:49.031 element at address: 0x20002ac6f540 with size: 0.000183 MiB 00:04:49.031 element at address: 0x20002ac6f600 with size: 0.000183 MiB 00:04:49.031 element at address: 0x20002ac6f6c0 with size: 0.000183 MiB 00:04:49.031 element at address: 0x20002ac6f780 with size: 0.000183 MiB 00:04:49.031 element at address: 0x20002ac6f840 with size: 0.000183 MiB 00:04:49.031 element at address: 0x20002ac6f900 with size: 0.000183 MiB 00:04:49.031 element at address: 0x20002ac6f9c0 with size: 0.000183 MiB 00:04:49.031 element at address: 0x20002ac6fa80 with size: 0.000183 MiB 00:04:49.031 element at address: 0x20002ac6fb40 with size: 0.000183 MiB 00:04:49.031 element at address: 0x20002ac6fc00 with size: 0.000183 MiB 00:04:49.031 element at address: 0x20002ac6fcc0 with size: 0.000183 MiB 00:04:49.031 element at address: 0x20002ac6fd80 with size: 0.000183 MiB 00:04:49.031 element at address: 0x20002ac6fe40 with size: 0.000183 MiB 00:04:49.031 element at address: 0x20002ac6ff00 with size: 0.000183 MiB 00:04:49.031 list of memzone associated elements. size: 646.796692 MiB 00:04:49.031 element at address: 0x20001d895500 with size: 211.416748 MiB 00:04:49.031 associated memzone info: size: 211.416626 MiB name: MP_PDU_immediate_data_Pool_0 00:04:49.031 element at address: 0x20002ac6ffc0 with size: 157.562561 MiB 00:04:49.031 associated memzone info: size: 157.562439 MiB name: MP_PDU_data_out_Pool_0 00:04:49.031 element at address: 0x200015ff4780 with size: 92.045044 MiB 00:04:49.031 associated memzone info: size: 92.044922 MiB name: MP_bdev_io_59842_0 00:04:49.031 element at address: 0x2000009ff380 with size: 48.003052 MiB 00:04:49.031 associated memzone info: size: 48.002930 MiB name: MP_evtpool_59842_0 00:04:49.031 element at address: 0x200003fff380 with size: 48.003052 MiB 00:04:49.031 associated memzone info: size: 48.002930 MiB name: MP_msgpool_59842_0 00:04:49.031 element at address: 0x2000071fdb80 with size: 36.008911 MiB 00:04:49.031 associated memzone info: size: 36.008789 MiB name: MP_fsdev_io_59842_0 00:04:49.031 element at address: 0x20001c3be940 with size: 20.255554 MiB 00:04:49.031 associated memzone info: size: 20.255432 MiB name: MP_PDU_Pool_0 00:04:49.031 element at address: 0x200034bfeb40 with size: 18.005066 MiB 00:04:49.031 associated memzone info: size: 18.004944 MiB name: MP_SCSI_TASK_Pool_0 00:04:49.031 element at address: 0x2000005ffe00 with size: 2.000488 MiB 00:04:49.031 associated memzone info: size: 2.000366 MiB name: RG_MP_evtpool_59842 00:04:49.031 element at address: 0x200003bffe00 with size: 2.000488 MiB 00:04:49.031 associated memzone info: size: 2.000366 MiB name: RG_MP_msgpool_59842 00:04:49.031 element at address: 0x2000002d7d00 with size: 1.008118 MiB 00:04:49.031 associated memzone info: size: 1.007996 MiB name: MP_evtpool_59842 00:04:49.031 element at address: 0x20000d8fde40 with size: 1.008118 MiB 00:04:49.031 associated memzone info: size: 1.007996 MiB name: MP_PDU_Pool 00:04:49.031 element at address: 0x20001c2bc800 with size: 1.008118 MiB 00:04:49.031 associated memzone info: size: 1.007996 MiB name: MP_PDU_immediate_data_Pool 00:04:49.031 element at address: 0x2000096fde40 with size: 1.008118 MiB 00:04:49.031 associated memzone info: size: 1.007996 MiB name: MP_PDU_data_out_Pool 00:04:49.031 element at address: 0x2000070fba40 with size: 1.008118 MiB 00:04:49.031 associated memzone info: size: 1.007996 MiB name: MP_SCSI_TASK_Pool 00:04:49.031 element at address: 0x200003eff180 with size: 1.000488 MiB 00:04:49.031 associated memzone info: size: 1.000366 MiB name: RG_ring_0_59842 00:04:49.031 element at address: 0x200003affc00 with size: 1.000488 MiB 00:04:49.031 associated memzone info: size: 1.000366 MiB name: RG_ring_1_59842 00:04:49.031 element at address: 0x200015ef4580 with size: 1.000488 MiB 00:04:49.031 associated memzone info: size: 1.000366 MiB name: RG_ring_4_59842 00:04:49.031 element at address: 0x200034afe940 with size: 1.000488 MiB 00:04:49.031 associated memzone info: size: 1.000366 MiB name: RG_ring_5_59842 00:04:49.031 element at address: 0x200003a7f740 with size: 0.500488 MiB 00:04:49.031 associated memzone info: size: 0.500366 MiB name: RG_MP_fsdev_io_59842 00:04:49.031 element at address: 0x200003e7ee00 with size: 0.500488 MiB 00:04:49.031 associated memzone info: size: 0.500366 MiB name: RG_MP_bdev_io_59842 00:04:49.031 element at address: 0x20000d87db80 with size: 0.500488 MiB 00:04:49.031 associated memzone info: size: 0.500366 MiB name: RG_MP_PDU_Pool 00:04:49.031 element at address: 0x20000707b780 with size: 0.500488 MiB 00:04:49.031 associated memzone info: size: 0.500366 MiB name: RG_MP_SCSI_TASK_Pool 00:04:49.031 element at address: 0x20001c27c540 with size: 0.250488 MiB 00:04:49.031 associated memzone info: size: 0.250366 MiB name: RG_MP_PDU_immediate_data_Pool 00:04:49.031 element at address: 0x200003a5e640 with size: 0.125488 MiB 00:04:49.031 associated memzone info: size: 0.125366 MiB name: RG_ring_2_59842 00:04:49.031 element at address: 0x2000096f5b80 with size: 0.031738 MiB 00:04:49.031 associated memzone info: size: 0.031616 MiB name: RG_MP_PDU_data_out_Pool 00:04:49.031 element at address: 0x20002ac65ec0 with size: 0.023743 MiB 00:04:49.031 associated memzone info: size: 0.023621 MiB name: MP_Session_Pool_0 00:04:49.031 element at address: 0x200003a5a380 with size: 0.016113 MiB 00:04:49.031 associated memzone info: size: 0.015991 MiB name: RG_ring_3_59842 00:04:49.031 element at address: 0x20002ac6c000 with size: 0.002441 MiB 00:04:49.031 associated memzone info: size: 0.002319 MiB name: RG_MP_Session_Pool 00:04:49.031 element at address: 0x2000002d6fc0 with size: 0.000305 MiB 00:04:49.031 associated memzone info: size: 0.000183 MiB name: MP_msgpool_59842 00:04:49.031 element at address: 0x200003affa00 with size: 0.000305 MiB 00:04:49.031 associated memzone info: size: 0.000183 MiB name: MP_fsdev_io_59842 00:04:49.031 element at address: 0x200003a5a180 with size: 0.000305 MiB 00:04:49.031 associated memzone info: size: 0.000183 MiB name: MP_bdev_io_59842 00:04:49.031 element at address: 0x20002ac6cac0 with size: 0.000305 MiB 00:04:49.031 associated memzone info: size: 0.000183 MiB name: MP_Session_Pool 00:04:49.031 11:15:30 dpdk_mem_utility -- dpdk_memory_utility/test_dpdk_mem_info.sh@25 -- # trap - SIGINT SIGTERM EXIT 00:04:49.031 11:15:30 dpdk_mem_utility -- dpdk_memory_utility/test_dpdk_mem_info.sh@26 -- # killprocess 59842 00:04:49.031 11:15:30 dpdk_mem_utility -- common/autotest_common.sh@950 -- # '[' -z 59842 ']' 00:04:49.031 11:15:30 dpdk_mem_utility -- common/autotest_common.sh@954 -- # kill -0 59842 00:04:49.031 11:15:30 dpdk_mem_utility -- common/autotest_common.sh@955 -- # uname 00:04:49.031 11:15:30 dpdk_mem_utility -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:04:49.031 11:15:30 dpdk_mem_utility -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 59842 00:04:49.031 11:15:30 dpdk_mem_utility -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:04:49.031 11:15:30 dpdk_mem_utility -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:04:49.031 killing process with pid 59842 00:04:49.031 11:15:30 dpdk_mem_utility -- common/autotest_common.sh@968 -- # echo 'killing process with pid 59842' 00:04:49.032 11:15:30 dpdk_mem_utility -- common/autotest_common.sh@969 -- # kill 59842 00:04:49.032 11:15:30 dpdk_mem_utility -- common/autotest_common.sh@974 -- # wait 59842 00:04:49.625 00:04:49.625 real 0m1.952s 00:04:49.625 user 0m2.133s 00:04:49.625 sys 0m0.496s 00:04:49.625 11:15:31 dpdk_mem_utility -- common/autotest_common.sh@1126 -- # xtrace_disable 00:04:49.625 11:15:31 dpdk_mem_utility -- common/autotest_common.sh@10 -- # set +x 00:04:49.625 ************************************ 00:04:49.625 END TEST dpdk_mem_utility 00:04:49.625 ************************************ 00:04:49.625 11:15:31 -- spdk/autotest.sh@168 -- # run_test event /home/vagrant/spdk_repo/spdk/test/event/event.sh 00:04:49.625 11:15:31 -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:04:49.625 11:15:31 -- common/autotest_common.sh@1107 -- # xtrace_disable 00:04:49.626 11:15:31 -- common/autotest_common.sh@10 -- # set +x 00:04:49.626 ************************************ 00:04:49.626 START TEST event 00:04:49.626 ************************************ 00:04:49.626 11:15:31 event -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/event/event.sh 00:04:49.626 * Looking for test storage... 00:04:49.626 * Found test storage at /home/vagrant/spdk_repo/spdk/test/event 00:04:49.626 11:15:31 event -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:04:49.626 11:15:31 event -- common/autotest_common.sh@1681 -- # lcov --version 00:04:49.626 11:15:31 event -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:04:49.626 11:15:31 event -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:04:49.626 11:15:31 event -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:04:49.626 11:15:31 event -- scripts/common.sh@333 -- # local ver1 ver1_l 00:04:49.626 11:15:31 event -- scripts/common.sh@334 -- # local ver2 ver2_l 00:04:49.626 11:15:31 event -- scripts/common.sh@336 -- # IFS=.-: 00:04:49.626 11:15:31 event -- scripts/common.sh@336 -- # read -ra ver1 00:04:49.626 11:15:31 event -- scripts/common.sh@337 -- # IFS=.-: 00:04:49.626 11:15:31 event -- scripts/common.sh@337 -- # read -ra ver2 00:04:49.626 11:15:31 event -- scripts/common.sh@338 -- # local 'op=<' 00:04:49.626 11:15:31 event -- scripts/common.sh@340 -- # ver1_l=2 00:04:49.626 11:15:31 event -- scripts/common.sh@341 -- # ver2_l=1 00:04:49.626 11:15:31 event -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:04:49.626 11:15:31 event -- scripts/common.sh@344 -- # case "$op" in 00:04:49.626 11:15:31 event -- scripts/common.sh@345 -- # : 1 00:04:49.626 11:15:31 event -- scripts/common.sh@364 -- # (( v = 0 )) 00:04:49.626 11:15:31 event -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:49.626 11:15:31 event -- scripts/common.sh@365 -- # decimal 1 00:04:49.626 11:15:31 event -- scripts/common.sh@353 -- # local d=1 00:04:49.626 11:15:31 event -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:49.626 11:15:31 event -- scripts/common.sh@355 -- # echo 1 00:04:49.626 11:15:31 event -- scripts/common.sh@365 -- # ver1[v]=1 00:04:49.626 11:15:31 event -- scripts/common.sh@366 -- # decimal 2 00:04:49.626 11:15:31 event -- scripts/common.sh@353 -- # local d=2 00:04:49.626 11:15:31 event -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:49.626 11:15:31 event -- scripts/common.sh@355 -- # echo 2 00:04:49.626 11:15:31 event -- scripts/common.sh@366 -- # ver2[v]=2 00:04:49.626 11:15:31 event -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:04:49.626 11:15:31 event -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:04:49.626 11:15:31 event -- scripts/common.sh@368 -- # return 0 00:04:49.626 11:15:31 event -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:49.626 11:15:31 event -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:04:49.626 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:49.626 --rc genhtml_branch_coverage=1 00:04:49.626 --rc genhtml_function_coverage=1 00:04:49.626 --rc genhtml_legend=1 00:04:49.626 --rc geninfo_all_blocks=1 00:04:49.626 --rc geninfo_unexecuted_blocks=1 00:04:49.626 00:04:49.626 ' 00:04:49.626 11:15:31 event -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:04:49.626 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:49.626 --rc genhtml_branch_coverage=1 00:04:49.626 --rc genhtml_function_coverage=1 00:04:49.626 --rc genhtml_legend=1 00:04:49.626 --rc geninfo_all_blocks=1 00:04:49.626 --rc geninfo_unexecuted_blocks=1 00:04:49.626 00:04:49.626 ' 00:04:49.626 11:15:31 event -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:04:49.626 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:49.626 --rc genhtml_branch_coverage=1 00:04:49.626 --rc genhtml_function_coverage=1 00:04:49.626 --rc genhtml_legend=1 00:04:49.626 --rc geninfo_all_blocks=1 00:04:49.626 --rc geninfo_unexecuted_blocks=1 00:04:49.626 00:04:49.626 ' 00:04:49.626 11:15:31 event -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:04:49.626 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:49.626 --rc genhtml_branch_coverage=1 00:04:49.626 --rc genhtml_function_coverage=1 00:04:49.626 --rc genhtml_legend=1 00:04:49.626 --rc geninfo_all_blocks=1 00:04:49.626 --rc geninfo_unexecuted_blocks=1 00:04:49.626 00:04:49.626 ' 00:04:49.626 11:15:31 event -- event/event.sh@9 -- # source /home/vagrant/spdk_repo/spdk/test/bdev/nbd_common.sh 00:04:49.626 11:15:31 event -- bdev/nbd_common.sh@6 -- # set -e 00:04:49.626 11:15:31 event -- event/event.sh@45 -- # run_test event_perf /home/vagrant/spdk_repo/spdk/test/event/event_perf/event_perf -m 0xF -t 1 00:04:49.626 11:15:31 event -- common/autotest_common.sh@1101 -- # '[' 6 -le 1 ']' 00:04:49.626 11:15:31 event -- common/autotest_common.sh@1107 -- # xtrace_disable 00:04:49.626 11:15:31 event -- common/autotest_common.sh@10 -- # set +x 00:04:49.884 ************************************ 00:04:49.884 START TEST event_perf 00:04:49.884 ************************************ 00:04:49.884 11:15:31 event.event_perf -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/event/event_perf/event_perf -m 0xF -t 1 00:04:49.884 Running I/O for 1 seconds...[2024-10-07 11:15:31.362831] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:04:49.884 [2024-10-07 11:15:31.362972] [ DPDK EAL parameters: event_perf --no-shconf -c 0xF --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid59945 ] 00:04:49.884 [2024-10-07 11:15:31.502022] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 4 00:04:50.142 [2024-10-07 11:15:31.632471] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:04:50.142 [2024-10-07 11:15:31.632572] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:04:50.142 Running I/O for 1 seconds...[2024-10-07 11:15:31.632690] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 3 00:04:50.142 [2024-10-07 11:15:31.632693] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:04:51.073 00:04:51.073 lcore 0: 196407 00:04:51.073 lcore 1: 196407 00:04:51.073 lcore 2: 196407 00:04:51.073 lcore 3: 196406 00:04:51.073 done. 00:04:51.073 00:04:51.073 real 0m1.377s 00:04:51.073 user 0m4.182s 00:04:51.073 sys 0m0.071s 00:04:51.073 11:15:32 event.event_perf -- common/autotest_common.sh@1126 -- # xtrace_disable 00:04:51.073 ************************************ 00:04:51.073 11:15:32 event.event_perf -- common/autotest_common.sh@10 -- # set +x 00:04:51.073 END TEST event_perf 00:04:51.073 ************************************ 00:04:51.073 11:15:32 event -- event/event.sh@46 -- # run_test event_reactor /home/vagrant/spdk_repo/spdk/test/event/reactor/reactor -t 1 00:04:51.073 11:15:32 event -- common/autotest_common.sh@1101 -- # '[' 4 -le 1 ']' 00:04:51.073 11:15:32 event -- common/autotest_common.sh@1107 -- # xtrace_disable 00:04:51.073 11:15:32 event -- common/autotest_common.sh@10 -- # set +x 00:04:51.073 ************************************ 00:04:51.073 START TEST event_reactor 00:04:51.073 ************************************ 00:04:51.073 11:15:32 event.event_reactor -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/event/reactor/reactor -t 1 00:04:51.329 [2024-10-07 11:15:32.786614] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:04:51.329 [2024-10-07 11:15:32.786712] [ DPDK EAL parameters: reactor --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid59978 ] 00:04:51.329 [2024-10-07 11:15:32.923697] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:51.329 [2024-10-07 11:15:33.038899] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:04:52.697 test_start 00:04:52.697 oneshot 00:04:52.697 tick 100 00:04:52.697 tick 100 00:04:52.697 tick 250 00:04:52.697 tick 100 00:04:52.697 tick 100 00:04:52.697 tick 250 00:04:52.697 tick 100 00:04:52.697 tick 500 00:04:52.698 tick 100 00:04:52.698 tick 100 00:04:52.698 tick 250 00:04:52.698 tick 100 00:04:52.698 tick 100 00:04:52.698 test_end 00:04:52.698 00:04:52.698 real 0m1.380s 00:04:52.698 user 0m1.224s 00:04:52.698 sys 0m0.049s 00:04:52.698 11:15:34 event.event_reactor -- common/autotest_common.sh@1126 -- # xtrace_disable 00:04:52.698 ************************************ 00:04:52.698 END TEST event_reactor 00:04:52.698 11:15:34 event.event_reactor -- common/autotest_common.sh@10 -- # set +x 00:04:52.698 ************************************ 00:04:52.698 11:15:34 event -- event/event.sh@47 -- # run_test event_reactor_perf /home/vagrant/spdk_repo/spdk/test/event/reactor_perf/reactor_perf -t 1 00:04:52.698 11:15:34 event -- common/autotest_common.sh@1101 -- # '[' 4 -le 1 ']' 00:04:52.698 11:15:34 event -- common/autotest_common.sh@1107 -- # xtrace_disable 00:04:52.698 11:15:34 event -- common/autotest_common.sh@10 -- # set +x 00:04:52.698 ************************************ 00:04:52.698 START TEST event_reactor_perf 00:04:52.698 ************************************ 00:04:52.698 11:15:34 event.event_reactor_perf -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/event/reactor_perf/reactor_perf -t 1 00:04:52.698 [2024-10-07 11:15:34.219920] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:04:52.698 [2024-10-07 11:15:34.220014] [ DPDK EAL parameters: reactor_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid60013 ] 00:04:52.698 [2024-10-07 11:15:34.358263] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:52.955 [2024-10-07 11:15:34.475803] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:04:54.328 test_start 00:04:54.328 test_end 00:04:54.328 Performance: 356011 events per second 00:04:54.328 00:04:54.328 real 0m1.406s 00:04:54.328 user 0m1.240s 00:04:54.328 sys 0m0.056s 00:04:54.328 11:15:35 event.event_reactor_perf -- common/autotest_common.sh@1126 -- # xtrace_disable 00:04:54.328 11:15:35 event.event_reactor_perf -- common/autotest_common.sh@10 -- # set +x 00:04:54.328 ************************************ 00:04:54.328 END TEST event_reactor_perf 00:04:54.328 ************************************ 00:04:54.328 11:15:35 event -- event/event.sh@49 -- # uname -s 00:04:54.328 11:15:35 event -- event/event.sh@49 -- # '[' Linux = Linux ']' 00:04:54.328 11:15:35 event -- event/event.sh@50 -- # run_test event_scheduler /home/vagrant/spdk_repo/spdk/test/event/scheduler/scheduler.sh 00:04:54.328 11:15:35 event -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:04:54.328 11:15:35 event -- common/autotest_common.sh@1107 -- # xtrace_disable 00:04:54.328 11:15:35 event -- common/autotest_common.sh@10 -- # set +x 00:04:54.328 ************************************ 00:04:54.328 START TEST event_scheduler 00:04:54.328 ************************************ 00:04:54.328 11:15:35 event.event_scheduler -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/event/scheduler/scheduler.sh 00:04:54.328 * Looking for test storage... 00:04:54.328 * Found test storage at /home/vagrant/spdk_repo/spdk/test/event/scheduler 00:04:54.328 11:15:35 event.event_scheduler -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:04:54.328 11:15:35 event.event_scheduler -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:04:54.328 11:15:35 event.event_scheduler -- common/autotest_common.sh@1681 -- # lcov --version 00:04:54.328 11:15:35 event.event_scheduler -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:04:54.328 11:15:35 event.event_scheduler -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:04:54.328 11:15:35 event.event_scheduler -- scripts/common.sh@333 -- # local ver1 ver1_l 00:04:54.328 11:15:35 event.event_scheduler -- scripts/common.sh@334 -- # local ver2 ver2_l 00:04:54.328 11:15:35 event.event_scheduler -- scripts/common.sh@336 -- # IFS=.-: 00:04:54.328 11:15:35 event.event_scheduler -- scripts/common.sh@336 -- # read -ra ver1 00:04:54.328 11:15:35 event.event_scheduler -- scripts/common.sh@337 -- # IFS=.-: 00:04:54.328 11:15:35 event.event_scheduler -- scripts/common.sh@337 -- # read -ra ver2 00:04:54.328 11:15:35 event.event_scheduler -- scripts/common.sh@338 -- # local 'op=<' 00:04:54.328 11:15:35 event.event_scheduler -- scripts/common.sh@340 -- # ver1_l=2 00:04:54.328 11:15:35 event.event_scheduler -- scripts/common.sh@341 -- # ver2_l=1 00:04:54.328 11:15:35 event.event_scheduler -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:04:54.328 11:15:35 event.event_scheduler -- scripts/common.sh@344 -- # case "$op" in 00:04:54.329 11:15:35 event.event_scheduler -- scripts/common.sh@345 -- # : 1 00:04:54.329 11:15:35 event.event_scheduler -- scripts/common.sh@364 -- # (( v = 0 )) 00:04:54.329 11:15:35 event.event_scheduler -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:54.329 11:15:35 event.event_scheduler -- scripts/common.sh@365 -- # decimal 1 00:04:54.329 11:15:35 event.event_scheduler -- scripts/common.sh@353 -- # local d=1 00:04:54.329 11:15:35 event.event_scheduler -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:54.329 11:15:35 event.event_scheduler -- scripts/common.sh@355 -- # echo 1 00:04:54.329 11:15:35 event.event_scheduler -- scripts/common.sh@365 -- # ver1[v]=1 00:04:54.329 11:15:35 event.event_scheduler -- scripts/common.sh@366 -- # decimal 2 00:04:54.329 11:15:35 event.event_scheduler -- scripts/common.sh@353 -- # local d=2 00:04:54.329 11:15:35 event.event_scheduler -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:54.329 11:15:35 event.event_scheduler -- scripts/common.sh@355 -- # echo 2 00:04:54.329 11:15:35 event.event_scheduler -- scripts/common.sh@366 -- # ver2[v]=2 00:04:54.329 11:15:35 event.event_scheduler -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:04:54.329 11:15:35 event.event_scheduler -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:04:54.329 11:15:35 event.event_scheduler -- scripts/common.sh@368 -- # return 0 00:04:54.329 11:15:35 event.event_scheduler -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:54.329 11:15:35 event.event_scheduler -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:04:54.329 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:54.329 --rc genhtml_branch_coverage=1 00:04:54.329 --rc genhtml_function_coverage=1 00:04:54.329 --rc genhtml_legend=1 00:04:54.329 --rc geninfo_all_blocks=1 00:04:54.329 --rc geninfo_unexecuted_blocks=1 00:04:54.329 00:04:54.329 ' 00:04:54.329 11:15:35 event.event_scheduler -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:04:54.329 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:54.329 --rc genhtml_branch_coverage=1 00:04:54.329 --rc genhtml_function_coverage=1 00:04:54.329 --rc genhtml_legend=1 00:04:54.329 --rc geninfo_all_blocks=1 00:04:54.329 --rc geninfo_unexecuted_blocks=1 00:04:54.329 00:04:54.329 ' 00:04:54.329 11:15:35 event.event_scheduler -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:04:54.329 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:54.329 --rc genhtml_branch_coverage=1 00:04:54.329 --rc genhtml_function_coverage=1 00:04:54.329 --rc genhtml_legend=1 00:04:54.329 --rc geninfo_all_blocks=1 00:04:54.329 --rc geninfo_unexecuted_blocks=1 00:04:54.329 00:04:54.329 ' 00:04:54.329 11:15:35 event.event_scheduler -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:04:54.329 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:54.329 --rc genhtml_branch_coverage=1 00:04:54.329 --rc genhtml_function_coverage=1 00:04:54.329 --rc genhtml_legend=1 00:04:54.329 --rc geninfo_all_blocks=1 00:04:54.329 --rc geninfo_unexecuted_blocks=1 00:04:54.329 00:04:54.329 ' 00:04:54.329 11:15:35 event.event_scheduler -- scheduler/scheduler.sh@29 -- # rpc=rpc_cmd 00:04:54.329 11:15:35 event.event_scheduler -- scheduler/scheduler.sh@35 -- # scheduler_pid=60083 00:04:54.329 11:15:35 event.event_scheduler -- scheduler/scheduler.sh@36 -- # trap 'killprocess $scheduler_pid; exit 1' SIGINT SIGTERM EXIT 00:04:54.329 11:15:35 event.event_scheduler -- scheduler/scheduler.sh@34 -- # /home/vagrant/spdk_repo/spdk/test/event/scheduler/scheduler -m 0xF -p 0x2 --wait-for-rpc -f 00:04:54.329 11:15:35 event.event_scheduler -- scheduler/scheduler.sh@37 -- # waitforlisten 60083 00:04:54.329 11:15:35 event.event_scheduler -- common/autotest_common.sh@831 -- # '[' -z 60083 ']' 00:04:54.329 11:15:35 event.event_scheduler -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:54.329 11:15:35 event.event_scheduler -- common/autotest_common.sh@836 -- # local max_retries=100 00:04:54.329 11:15:35 event.event_scheduler -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:54.329 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:54.329 11:15:35 event.event_scheduler -- common/autotest_common.sh@840 -- # xtrace_disable 00:04:54.329 11:15:35 event.event_scheduler -- common/autotest_common.sh@10 -- # set +x 00:04:54.329 [2024-10-07 11:15:35.912157] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:04:54.329 [2024-10-07 11:15:35.912273] [ DPDK EAL parameters: scheduler --no-shconf -c 0xF --main-lcore=2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid60083 ] 00:04:54.586 [2024-10-07 11:15:36.051174] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 4 00:04:54.586 [2024-10-07 11:15:36.208299] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:04:54.587 [2024-10-07 11:15:36.208376] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:04:54.587 [2024-10-07 11:15:36.208458] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 3 00:04:54.587 [2024-10-07 11:15:36.208461] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:04:55.520 11:15:37 event.event_scheduler -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:04:55.520 11:15:37 event.event_scheduler -- common/autotest_common.sh@864 -- # return 0 00:04:55.520 11:15:37 event.event_scheduler -- scheduler/scheduler.sh@39 -- # rpc_cmd framework_set_scheduler dynamic 00:04:55.520 11:15:37 event.event_scheduler -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:55.520 11:15:37 event.event_scheduler -- common/autotest_common.sh@10 -- # set +x 00:04:55.520 POWER: failed to open /sys/devices/system/cpu/cpu%u/cpufreq/scaling_governor 00:04:55.520 POWER: Cannot set governor of lcore 0 to userspace 00:04:55.520 POWER: failed to open /sys/devices/system/cpu/cpu%u/cpufreq/scaling_governor 00:04:55.520 POWER: Cannot set governor of lcore 0 to performance 00:04:55.520 POWER: failed to open /sys/devices/system/cpu/cpu%u/cpufreq/scaling_governor 00:04:55.520 POWER: Cannot set governor of lcore 0 to userspace 00:04:55.520 POWER: failed to open /sys/devices/system/cpu/cpu%u/cpufreq/scaling_governor 00:04:55.520 POWER: Cannot set governor of lcore 0 to userspace 00:04:55.520 GUEST_CHANNEL: Opening channel '/dev/virtio-ports/virtio.serial.port.poweragent.0' for lcore 0 00:04:55.520 GUEST_CHANNEL: Unable to connect to '/dev/virtio-ports/virtio.serial.port.poweragent.0' with error No such file or directory 00:04:55.520 POWER: Unable to set Power Management Environment for lcore 0 00:04:55.520 [2024-10-07 11:15:37.028170] dpdk_governor.c: 130:_init_core: *ERROR*: Failed to initialize on core0 00:04:55.520 [2024-10-07 11:15:37.028280] dpdk_governor.c: 191:_init: *ERROR*: Failed to initialize on core0 00:04:55.520 [2024-10-07 11:15:37.028341] scheduler_dynamic.c: 280:init: *NOTICE*: Unable to initialize dpdk governor 00:04:55.520 [2024-10-07 11:15:37.028496] scheduler_dynamic.c: 427:set_opts: *NOTICE*: Setting scheduler load limit to 20 00:04:55.520 [2024-10-07 11:15:37.028663] scheduler_dynamic.c: 429:set_opts: *NOTICE*: Setting scheduler core limit to 80 00:04:55.520 [2024-10-07 11:15:37.028780] scheduler_dynamic.c: 431:set_opts: *NOTICE*: Setting scheduler core busy to 95 00:04:55.520 11:15:37 event.event_scheduler -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:55.520 11:15:37 event.event_scheduler -- scheduler/scheduler.sh@40 -- # rpc_cmd framework_start_init 00:04:55.520 11:15:37 event.event_scheduler -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:55.521 11:15:37 event.event_scheduler -- common/autotest_common.sh@10 -- # set +x 00:04:55.521 [2024-10-07 11:15:37.164439] scheduler.c: 382:test_start: *NOTICE*: Scheduler test application started. 00:04:55.521 11:15:37 event.event_scheduler -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:55.521 11:15:37 event.event_scheduler -- scheduler/scheduler.sh@43 -- # run_test scheduler_create_thread scheduler_create_thread 00:04:55.521 11:15:37 event.event_scheduler -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:04:55.521 11:15:37 event.event_scheduler -- common/autotest_common.sh@1107 -- # xtrace_disable 00:04:55.521 11:15:37 event.event_scheduler -- common/autotest_common.sh@10 -- # set +x 00:04:55.521 ************************************ 00:04:55.521 START TEST scheduler_create_thread 00:04:55.521 ************************************ 00:04:55.521 11:15:37 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@1125 -- # scheduler_create_thread 00:04:55.521 11:15:37 event.event_scheduler.scheduler_create_thread -- scheduler/scheduler.sh@12 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x1 -a 100 00:04:55.521 11:15:37 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:55.521 11:15:37 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@10 -- # set +x 00:04:55.521 2 00:04:55.521 11:15:37 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:55.521 11:15:37 event.event_scheduler.scheduler_create_thread -- scheduler/scheduler.sh@13 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x2 -a 100 00:04:55.521 11:15:37 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:55.521 11:15:37 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@10 -- # set +x 00:04:55.521 3 00:04:55.521 11:15:37 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:55.521 11:15:37 event.event_scheduler.scheduler_create_thread -- scheduler/scheduler.sh@14 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x4 -a 100 00:04:55.521 11:15:37 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:55.521 11:15:37 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@10 -- # set +x 00:04:55.521 4 00:04:55.521 11:15:37 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:55.521 11:15:37 event.event_scheduler.scheduler_create_thread -- scheduler/scheduler.sh@15 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x8 -a 100 00:04:55.521 11:15:37 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:55.521 11:15:37 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@10 -- # set +x 00:04:55.521 5 00:04:55.521 11:15:37 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:55.521 11:15:37 event.event_scheduler.scheduler_create_thread -- scheduler/scheduler.sh@16 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x1 -a 0 00:04:55.521 11:15:37 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:55.521 11:15:37 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@10 -- # set +x 00:04:55.521 6 00:04:55.521 11:15:37 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:55.521 11:15:37 event.event_scheduler.scheduler_create_thread -- scheduler/scheduler.sh@17 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x2 -a 0 00:04:55.521 11:15:37 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:55.521 11:15:37 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@10 -- # set +x 00:04:55.778 7 00:04:55.779 11:15:37 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:55.779 11:15:37 event.event_scheduler.scheduler_create_thread -- scheduler/scheduler.sh@18 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x4 -a 0 00:04:55.779 11:15:37 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:55.779 11:15:37 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@10 -- # set +x 00:04:55.779 8 00:04:55.779 11:15:37 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:55.779 11:15:37 event.event_scheduler.scheduler_create_thread -- scheduler/scheduler.sh@19 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x8 -a 0 00:04:55.779 11:15:37 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:55.779 11:15:37 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@10 -- # set +x 00:04:55.779 9 00:04:55.779 11:15:37 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:55.779 11:15:37 event.event_scheduler.scheduler_create_thread -- scheduler/scheduler.sh@21 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n one_third_active -a 30 00:04:55.779 11:15:37 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:55.779 11:15:37 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@10 -- # set +x 00:04:55.779 10 00:04:55.779 11:15:37 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:55.779 11:15:37 event.event_scheduler.scheduler_create_thread -- scheduler/scheduler.sh@22 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n half_active -a 0 00:04:55.779 11:15:37 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:55.779 11:15:37 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@10 -- # set +x 00:04:55.779 11:15:37 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:55.779 11:15:37 event.event_scheduler.scheduler_create_thread -- scheduler/scheduler.sh@22 -- # thread_id=11 00:04:55.779 11:15:37 event.event_scheduler.scheduler_create_thread -- scheduler/scheduler.sh@23 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_set_active 11 50 00:04:55.779 11:15:37 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:55.779 11:15:37 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@10 -- # set +x 00:04:56.345 11:15:37 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:56.345 11:15:37 event.event_scheduler.scheduler_create_thread -- scheduler/scheduler.sh@25 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n deleted -a 100 00:04:56.345 11:15:37 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:56.345 11:15:37 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@10 -- # set +x 00:04:57.742 11:15:39 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:57.742 11:15:39 event.event_scheduler.scheduler_create_thread -- scheduler/scheduler.sh@25 -- # thread_id=12 00:04:57.742 11:15:39 event.event_scheduler.scheduler_create_thread -- scheduler/scheduler.sh@26 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_delete 12 00:04:57.742 11:15:39 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:57.742 11:15:39 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@10 -- # set +x 00:04:58.676 ************************************ 00:04:58.676 END TEST scheduler_create_thread 00:04:58.676 ************************************ 00:04:58.676 11:15:40 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:58.676 00:04:58.676 real 0m3.093s 00:04:58.676 user 0m0.023s 00:04:58.676 sys 0m0.004s 00:04:58.676 11:15:40 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@1126 -- # xtrace_disable 00:04:58.676 11:15:40 event.event_scheduler.scheduler_create_thread -- common/autotest_common.sh@10 -- # set +x 00:04:58.676 11:15:40 event.event_scheduler -- scheduler/scheduler.sh@45 -- # trap - SIGINT SIGTERM EXIT 00:04:58.676 11:15:40 event.event_scheduler -- scheduler/scheduler.sh@46 -- # killprocess 60083 00:04:58.676 11:15:40 event.event_scheduler -- common/autotest_common.sh@950 -- # '[' -z 60083 ']' 00:04:58.676 11:15:40 event.event_scheduler -- common/autotest_common.sh@954 -- # kill -0 60083 00:04:58.676 11:15:40 event.event_scheduler -- common/autotest_common.sh@955 -- # uname 00:04:58.676 11:15:40 event.event_scheduler -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:04:58.676 11:15:40 event.event_scheduler -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 60083 00:04:58.676 killing process with pid 60083 00:04:58.676 11:15:40 event.event_scheduler -- common/autotest_common.sh@956 -- # process_name=reactor_2 00:04:58.676 11:15:40 event.event_scheduler -- common/autotest_common.sh@960 -- # '[' reactor_2 = sudo ']' 00:04:58.676 11:15:40 event.event_scheduler -- common/autotest_common.sh@968 -- # echo 'killing process with pid 60083' 00:04:58.676 11:15:40 event.event_scheduler -- common/autotest_common.sh@969 -- # kill 60083 00:04:58.676 11:15:40 event.event_scheduler -- common/autotest_common.sh@974 -- # wait 60083 00:04:59.244 [2024-10-07 11:15:40.654767] scheduler.c: 360:test_shutdown: *NOTICE*: Scheduler test application stopped. 00:04:59.503 00:04:59.503 real 0m5.361s 00:04:59.503 user 0m10.567s 00:04:59.503 sys 0m0.453s 00:04:59.503 ************************************ 00:04:59.503 END TEST event_scheduler 00:04:59.503 ************************************ 00:04:59.503 11:15:41 event.event_scheduler -- common/autotest_common.sh@1126 -- # xtrace_disable 00:04:59.503 11:15:41 event.event_scheduler -- common/autotest_common.sh@10 -- # set +x 00:04:59.503 11:15:41 event -- event/event.sh@51 -- # modprobe -n nbd 00:04:59.503 11:15:41 event -- event/event.sh@52 -- # run_test app_repeat app_repeat_test 00:04:59.503 11:15:41 event -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:04:59.503 11:15:41 event -- common/autotest_common.sh@1107 -- # xtrace_disable 00:04:59.503 11:15:41 event -- common/autotest_common.sh@10 -- # set +x 00:04:59.503 ************************************ 00:04:59.503 START TEST app_repeat 00:04:59.503 ************************************ 00:04:59.503 11:15:41 event.app_repeat -- common/autotest_common.sh@1125 -- # app_repeat_test 00:04:59.503 11:15:41 event.app_repeat -- event/event.sh@12 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:59.503 11:15:41 event.app_repeat -- event/event.sh@13 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:59.503 11:15:41 event.app_repeat -- event/event.sh@13 -- # local nbd_list 00:04:59.503 11:15:41 event.app_repeat -- event/event.sh@14 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:59.503 11:15:41 event.app_repeat -- event/event.sh@14 -- # local bdev_list 00:04:59.503 11:15:41 event.app_repeat -- event/event.sh@15 -- # local repeat_times=4 00:04:59.503 11:15:41 event.app_repeat -- event/event.sh@17 -- # modprobe nbd 00:04:59.503 11:15:41 event.app_repeat -- event/event.sh@19 -- # repeat_pid=60206 00:04:59.503 11:15:41 event.app_repeat -- event/event.sh@20 -- # trap 'killprocess $repeat_pid; exit 1' SIGINT SIGTERM EXIT 00:04:59.503 11:15:41 event.app_repeat -- event/event.sh@18 -- # /home/vagrant/spdk_repo/spdk/test/event/app_repeat/app_repeat -r /var/tmp/spdk-nbd.sock -m 0x3 -t 4 00:04:59.503 Process app_repeat pid: 60206 00:04:59.503 11:15:41 event.app_repeat -- event/event.sh@21 -- # echo 'Process app_repeat pid: 60206' 00:04:59.503 11:15:41 event.app_repeat -- event/event.sh@23 -- # for i in {0..2} 00:04:59.503 spdk_app_start Round 0 00:04:59.503 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:04:59.503 11:15:41 event.app_repeat -- event/event.sh@24 -- # echo 'spdk_app_start Round 0' 00:04:59.503 11:15:41 event.app_repeat -- event/event.sh@25 -- # waitforlisten 60206 /var/tmp/spdk-nbd.sock 00:04:59.503 11:15:41 event.app_repeat -- common/autotest_common.sh@831 -- # '[' -z 60206 ']' 00:04:59.503 11:15:41 event.app_repeat -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:04:59.503 11:15:41 event.app_repeat -- common/autotest_common.sh@836 -- # local max_retries=100 00:04:59.503 11:15:41 event.app_repeat -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:04:59.503 11:15:41 event.app_repeat -- common/autotest_common.sh@840 -- # xtrace_disable 00:04:59.503 11:15:41 event.app_repeat -- common/autotest_common.sh@10 -- # set +x 00:04:59.503 [2024-10-07 11:15:41.130213] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:04:59.503 [2024-10-07 11:15:41.130866] [ DPDK EAL parameters: app_repeat --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid60206 ] 00:04:59.761 [2024-10-07 11:15:41.268993] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 2 00:04:59.761 [2024-10-07 11:15:41.446058] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:04:59.761 [2024-10-07 11:15:41.446076] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:05:00.696 11:15:42 event.app_repeat -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:05:00.696 11:15:42 event.app_repeat -- common/autotest_common.sh@864 -- # return 0 00:05:00.696 11:15:42 event.app_repeat -- event/event.sh@27 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:05:00.954 Malloc0 00:05:00.954 11:15:42 event.app_repeat -- event/event.sh@28 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:05:01.212 Malloc1 00:05:01.212 11:15:42 event.app_repeat -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:05:01.212 11:15:42 event.app_repeat -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:01.212 11:15:42 event.app_repeat -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:05:01.212 11:15:42 event.app_repeat -- bdev/nbd_common.sh@91 -- # local bdev_list 00:05:01.212 11:15:42 event.app_repeat -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:01.212 11:15:42 event.app_repeat -- bdev/nbd_common.sh@92 -- # local nbd_list 00:05:01.212 11:15:42 event.app_repeat -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:05:01.212 11:15:42 event.app_repeat -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:01.212 11:15:42 event.app_repeat -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:05:01.212 11:15:42 event.app_repeat -- bdev/nbd_common.sh@10 -- # local bdev_list 00:05:01.212 11:15:42 event.app_repeat -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:01.212 11:15:42 event.app_repeat -- bdev/nbd_common.sh@11 -- # local nbd_list 00:05:01.212 11:15:42 event.app_repeat -- bdev/nbd_common.sh@12 -- # local i 00:05:01.212 11:15:42 event.app_repeat -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:05:01.212 11:15:42 event.app_repeat -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:01.212 11:15:42 event.app_repeat -- bdev/nbd_common.sh@15 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:05:01.471 /dev/nbd0 00:05:01.471 11:15:43 event.app_repeat -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:05:01.471 11:15:43 event.app_repeat -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:05:01.471 11:15:43 event.app_repeat -- common/autotest_common.sh@868 -- # local nbd_name=nbd0 00:05:01.471 11:15:43 event.app_repeat -- common/autotest_common.sh@869 -- # local i 00:05:01.471 11:15:43 event.app_repeat -- common/autotest_common.sh@871 -- # (( i = 1 )) 00:05:01.471 11:15:43 event.app_repeat -- common/autotest_common.sh@871 -- # (( i <= 20 )) 00:05:01.471 11:15:43 event.app_repeat -- common/autotest_common.sh@872 -- # grep -q -w nbd0 /proc/partitions 00:05:01.730 11:15:43 event.app_repeat -- common/autotest_common.sh@873 -- # break 00:05:01.730 11:15:43 event.app_repeat -- common/autotest_common.sh@884 -- # (( i = 1 )) 00:05:01.730 11:15:43 event.app_repeat -- common/autotest_common.sh@884 -- # (( i <= 20 )) 00:05:01.730 11:15:43 event.app_repeat -- common/autotest_common.sh@885 -- # dd if=/dev/nbd0 of=/home/vagrant/spdk_repo/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:05:01.730 1+0 records in 00:05:01.730 1+0 records out 00:05:01.730 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000408883 s, 10.0 MB/s 00:05:01.730 11:15:43 event.app_repeat -- common/autotest_common.sh@886 -- # stat -c %s /home/vagrant/spdk_repo/spdk/test/event/nbdtest 00:05:01.730 11:15:43 event.app_repeat -- common/autotest_common.sh@886 -- # size=4096 00:05:01.730 11:15:43 event.app_repeat -- common/autotest_common.sh@887 -- # rm -f /home/vagrant/spdk_repo/spdk/test/event/nbdtest 00:05:01.730 11:15:43 event.app_repeat -- common/autotest_common.sh@888 -- # '[' 4096 '!=' 0 ']' 00:05:01.730 11:15:43 event.app_repeat -- common/autotest_common.sh@889 -- # return 0 00:05:01.730 11:15:43 event.app_repeat -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:05:01.730 11:15:43 event.app_repeat -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:01.730 11:15:43 event.app_repeat -- bdev/nbd_common.sh@15 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:05:01.988 /dev/nbd1 00:05:01.988 11:15:43 event.app_repeat -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:05:01.988 11:15:43 event.app_repeat -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:05:01.988 11:15:43 event.app_repeat -- common/autotest_common.sh@868 -- # local nbd_name=nbd1 00:05:01.988 11:15:43 event.app_repeat -- common/autotest_common.sh@869 -- # local i 00:05:01.988 11:15:43 event.app_repeat -- common/autotest_common.sh@871 -- # (( i = 1 )) 00:05:01.988 11:15:43 event.app_repeat -- common/autotest_common.sh@871 -- # (( i <= 20 )) 00:05:01.988 11:15:43 event.app_repeat -- common/autotest_common.sh@872 -- # grep -q -w nbd1 /proc/partitions 00:05:01.988 11:15:43 event.app_repeat -- common/autotest_common.sh@873 -- # break 00:05:01.988 11:15:43 event.app_repeat -- common/autotest_common.sh@884 -- # (( i = 1 )) 00:05:01.988 11:15:43 event.app_repeat -- common/autotest_common.sh@884 -- # (( i <= 20 )) 00:05:01.988 11:15:43 event.app_repeat -- common/autotest_common.sh@885 -- # dd if=/dev/nbd1 of=/home/vagrant/spdk_repo/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:05:01.988 1+0 records in 00:05:01.988 1+0 records out 00:05:01.988 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000363966 s, 11.3 MB/s 00:05:01.988 11:15:43 event.app_repeat -- common/autotest_common.sh@886 -- # stat -c %s /home/vagrant/spdk_repo/spdk/test/event/nbdtest 00:05:01.988 11:15:43 event.app_repeat -- common/autotest_common.sh@886 -- # size=4096 00:05:01.988 11:15:43 event.app_repeat -- common/autotest_common.sh@887 -- # rm -f /home/vagrant/spdk_repo/spdk/test/event/nbdtest 00:05:01.988 11:15:43 event.app_repeat -- common/autotest_common.sh@888 -- # '[' 4096 '!=' 0 ']' 00:05:01.988 11:15:43 event.app_repeat -- common/autotest_common.sh@889 -- # return 0 00:05:01.988 11:15:43 event.app_repeat -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:05:01.988 11:15:43 event.app_repeat -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:01.988 11:15:43 event.app_repeat -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:05:01.988 11:15:43 event.app_repeat -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:01.988 11:15:43 event.app_repeat -- bdev/nbd_common.sh@63 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:05:02.248 11:15:43 event.app_repeat -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:05:02.248 { 00:05:02.248 "bdev_name": "Malloc0", 00:05:02.248 "nbd_device": "/dev/nbd0" 00:05:02.248 }, 00:05:02.248 { 00:05:02.248 "bdev_name": "Malloc1", 00:05:02.248 "nbd_device": "/dev/nbd1" 00:05:02.248 } 00:05:02.248 ]' 00:05:02.248 11:15:43 event.app_repeat -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:05:02.248 11:15:43 event.app_repeat -- bdev/nbd_common.sh@64 -- # echo '[ 00:05:02.248 { 00:05:02.248 "bdev_name": "Malloc0", 00:05:02.248 "nbd_device": "/dev/nbd0" 00:05:02.248 }, 00:05:02.248 { 00:05:02.248 "bdev_name": "Malloc1", 00:05:02.248 "nbd_device": "/dev/nbd1" 00:05:02.248 } 00:05:02.248 ]' 00:05:02.248 11:15:43 event.app_repeat -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:05:02.248 /dev/nbd1' 00:05:02.248 11:15:43 event.app_repeat -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:05:02.248 /dev/nbd1' 00:05:02.248 11:15:43 event.app_repeat -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:05:02.248 11:15:43 event.app_repeat -- bdev/nbd_common.sh@65 -- # count=2 00:05:02.248 11:15:43 event.app_repeat -- bdev/nbd_common.sh@66 -- # echo 2 00:05:02.248 11:15:43 event.app_repeat -- bdev/nbd_common.sh@95 -- # count=2 00:05:02.248 11:15:43 event.app_repeat -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:05:02.248 11:15:43 event.app_repeat -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:05:02.248 11:15:43 event.app_repeat -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:02.248 11:15:43 event.app_repeat -- bdev/nbd_common.sh@70 -- # local nbd_list 00:05:02.248 11:15:43 event.app_repeat -- bdev/nbd_common.sh@71 -- # local operation=write 00:05:02.248 11:15:43 event.app_repeat -- bdev/nbd_common.sh@72 -- # local tmp_file=/home/vagrant/spdk_repo/spdk/test/event/nbdrandtest 00:05:02.248 11:15:43 event.app_repeat -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:05:02.248 11:15:43 event.app_repeat -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/home/vagrant/spdk_repo/spdk/test/event/nbdrandtest bs=4096 count=256 00:05:02.248 256+0 records in 00:05:02.248 256+0 records out 00:05:02.248 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739261 s, 142 MB/s 00:05:02.248 11:15:43 event.app_repeat -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:05:02.248 11:15:43 event.app_repeat -- bdev/nbd_common.sh@78 -- # dd if=/home/vagrant/spdk_repo/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:05:02.508 256+0 records in 00:05:02.508 256+0 records out 00:05:02.508 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0277148 s, 37.8 MB/s 00:05:02.508 11:15:43 event.app_repeat -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:05:02.508 11:15:43 event.app_repeat -- bdev/nbd_common.sh@78 -- # dd if=/home/vagrant/spdk_repo/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:05:02.508 256+0 records in 00:05:02.508 256+0 records out 00:05:02.508 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0314827 s, 33.3 MB/s 00:05:02.508 11:15:43 event.app_repeat -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:05:02.508 11:15:43 event.app_repeat -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:02.508 11:15:43 event.app_repeat -- bdev/nbd_common.sh@70 -- # local nbd_list 00:05:02.508 11:15:43 event.app_repeat -- bdev/nbd_common.sh@71 -- # local operation=verify 00:05:02.508 11:15:43 event.app_repeat -- bdev/nbd_common.sh@72 -- # local tmp_file=/home/vagrant/spdk_repo/spdk/test/event/nbdrandtest 00:05:02.508 11:15:43 event.app_repeat -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:05:02.508 11:15:43 event.app_repeat -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:05:02.508 11:15:43 event.app_repeat -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:05:02.508 11:15:43 event.app_repeat -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /home/vagrant/spdk_repo/spdk/test/event/nbdrandtest /dev/nbd0 00:05:02.508 11:15:44 event.app_repeat -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:05:02.508 11:15:44 event.app_repeat -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /home/vagrant/spdk_repo/spdk/test/event/nbdrandtest /dev/nbd1 00:05:02.508 11:15:44 event.app_repeat -- bdev/nbd_common.sh@85 -- # rm /home/vagrant/spdk_repo/spdk/test/event/nbdrandtest 00:05:02.508 11:15:44 event.app_repeat -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:05:02.508 11:15:44 event.app_repeat -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:02.508 11:15:44 event.app_repeat -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:02.508 11:15:44 event.app_repeat -- bdev/nbd_common.sh@50 -- # local nbd_list 00:05:02.508 11:15:44 event.app_repeat -- bdev/nbd_common.sh@51 -- # local i 00:05:02.508 11:15:44 event.app_repeat -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:05:02.508 11:15:44 event.app_repeat -- bdev/nbd_common.sh@54 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:05:02.766 11:15:44 event.app_repeat -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:05:02.766 11:15:44 event.app_repeat -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:05:02.766 11:15:44 event.app_repeat -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:05:02.766 11:15:44 event.app_repeat -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:05:02.766 11:15:44 event.app_repeat -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:05:02.766 11:15:44 event.app_repeat -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:05:02.766 11:15:44 event.app_repeat -- bdev/nbd_common.sh@41 -- # break 00:05:02.766 11:15:44 event.app_repeat -- bdev/nbd_common.sh@45 -- # return 0 00:05:02.766 11:15:44 event.app_repeat -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:05:02.766 11:15:44 event.app_repeat -- bdev/nbd_common.sh@54 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:05:03.334 11:15:44 event.app_repeat -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:05:03.334 11:15:44 event.app_repeat -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:05:03.334 11:15:44 event.app_repeat -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:05:03.334 11:15:44 event.app_repeat -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:05:03.335 11:15:44 event.app_repeat -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:05:03.335 11:15:44 event.app_repeat -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:05:03.335 11:15:44 event.app_repeat -- bdev/nbd_common.sh@41 -- # break 00:05:03.335 11:15:44 event.app_repeat -- bdev/nbd_common.sh@45 -- # return 0 00:05:03.335 11:15:44 event.app_repeat -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:05:03.335 11:15:44 event.app_repeat -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:03.335 11:15:44 event.app_repeat -- bdev/nbd_common.sh@63 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:05:03.594 11:15:45 event.app_repeat -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:05:03.594 11:15:45 event.app_repeat -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:05:03.594 11:15:45 event.app_repeat -- bdev/nbd_common.sh@64 -- # echo '[]' 00:05:03.594 11:15:45 event.app_repeat -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:05:03.594 11:15:45 event.app_repeat -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:05:03.594 11:15:45 event.app_repeat -- bdev/nbd_common.sh@65 -- # echo '' 00:05:03.594 11:15:45 event.app_repeat -- bdev/nbd_common.sh@65 -- # true 00:05:03.594 11:15:45 event.app_repeat -- bdev/nbd_common.sh@65 -- # count=0 00:05:03.594 11:15:45 event.app_repeat -- bdev/nbd_common.sh@66 -- # echo 0 00:05:03.594 11:15:45 event.app_repeat -- bdev/nbd_common.sh@104 -- # count=0 00:05:03.594 11:15:45 event.app_repeat -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:05:03.594 11:15:45 event.app_repeat -- bdev/nbd_common.sh@109 -- # return 0 00:05:03.594 11:15:45 event.app_repeat -- event/event.sh@34 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:05:03.852 11:15:45 event.app_repeat -- event/event.sh@35 -- # sleep 3 00:05:04.419 [2024-10-07 11:15:45.831502] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 2 00:05:04.419 [2024-10-07 11:15:45.983019] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:05:04.419 [2024-10-07 11:15:45.983036] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:05:04.419 [2024-10-07 11:15:46.058496] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:05:04.419 [2024-10-07 11:15:46.058584] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:05:07.076 spdk_app_start Round 1 00:05:07.076 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:05:07.076 11:15:48 event.app_repeat -- event/event.sh@23 -- # for i in {0..2} 00:05:07.076 11:15:48 event.app_repeat -- event/event.sh@24 -- # echo 'spdk_app_start Round 1' 00:05:07.076 11:15:48 event.app_repeat -- event/event.sh@25 -- # waitforlisten 60206 /var/tmp/spdk-nbd.sock 00:05:07.076 11:15:48 event.app_repeat -- common/autotest_common.sh@831 -- # '[' -z 60206 ']' 00:05:07.076 11:15:48 event.app_repeat -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:05:07.076 11:15:48 event.app_repeat -- common/autotest_common.sh@836 -- # local max_retries=100 00:05:07.076 11:15:48 event.app_repeat -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:05:07.076 11:15:48 event.app_repeat -- common/autotest_common.sh@840 -- # xtrace_disable 00:05:07.076 11:15:48 event.app_repeat -- common/autotest_common.sh@10 -- # set +x 00:05:07.334 11:15:48 event.app_repeat -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:05:07.334 11:15:48 event.app_repeat -- common/autotest_common.sh@864 -- # return 0 00:05:07.334 11:15:48 event.app_repeat -- event/event.sh@27 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:05:07.593 Malloc0 00:05:07.593 11:15:49 event.app_repeat -- event/event.sh@28 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:05:07.852 Malloc1 00:05:07.852 11:15:49 event.app_repeat -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:05:07.852 11:15:49 event.app_repeat -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:07.852 11:15:49 event.app_repeat -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:05:07.852 11:15:49 event.app_repeat -- bdev/nbd_common.sh@91 -- # local bdev_list 00:05:07.852 11:15:49 event.app_repeat -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:07.852 11:15:49 event.app_repeat -- bdev/nbd_common.sh@92 -- # local nbd_list 00:05:07.852 11:15:49 event.app_repeat -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:05:07.852 11:15:49 event.app_repeat -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:07.852 11:15:49 event.app_repeat -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:05:07.852 11:15:49 event.app_repeat -- bdev/nbd_common.sh@10 -- # local bdev_list 00:05:07.852 11:15:49 event.app_repeat -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:07.852 11:15:49 event.app_repeat -- bdev/nbd_common.sh@11 -- # local nbd_list 00:05:07.852 11:15:49 event.app_repeat -- bdev/nbd_common.sh@12 -- # local i 00:05:07.852 11:15:49 event.app_repeat -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:05:07.852 11:15:49 event.app_repeat -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:07.852 11:15:49 event.app_repeat -- bdev/nbd_common.sh@15 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:05:08.111 /dev/nbd0 00:05:08.460 11:15:49 event.app_repeat -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:05:08.460 11:15:49 event.app_repeat -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:05:08.460 11:15:49 event.app_repeat -- common/autotest_common.sh@868 -- # local nbd_name=nbd0 00:05:08.460 11:15:49 event.app_repeat -- common/autotest_common.sh@869 -- # local i 00:05:08.460 11:15:49 event.app_repeat -- common/autotest_common.sh@871 -- # (( i = 1 )) 00:05:08.460 11:15:49 event.app_repeat -- common/autotest_common.sh@871 -- # (( i <= 20 )) 00:05:08.460 11:15:49 event.app_repeat -- common/autotest_common.sh@872 -- # grep -q -w nbd0 /proc/partitions 00:05:08.460 11:15:49 event.app_repeat -- common/autotest_common.sh@873 -- # break 00:05:08.460 11:15:49 event.app_repeat -- common/autotest_common.sh@884 -- # (( i = 1 )) 00:05:08.460 11:15:49 event.app_repeat -- common/autotest_common.sh@884 -- # (( i <= 20 )) 00:05:08.460 11:15:49 event.app_repeat -- common/autotest_common.sh@885 -- # dd if=/dev/nbd0 of=/home/vagrant/spdk_repo/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:05:08.460 1+0 records in 00:05:08.460 1+0 records out 00:05:08.460 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000340308 s, 12.0 MB/s 00:05:08.460 11:15:49 event.app_repeat -- common/autotest_common.sh@886 -- # stat -c %s /home/vagrant/spdk_repo/spdk/test/event/nbdtest 00:05:08.460 11:15:49 event.app_repeat -- common/autotest_common.sh@886 -- # size=4096 00:05:08.460 11:15:49 event.app_repeat -- common/autotest_common.sh@887 -- # rm -f /home/vagrant/spdk_repo/spdk/test/event/nbdtest 00:05:08.460 11:15:49 event.app_repeat -- common/autotest_common.sh@888 -- # '[' 4096 '!=' 0 ']' 00:05:08.460 11:15:49 event.app_repeat -- common/autotest_common.sh@889 -- # return 0 00:05:08.460 11:15:49 event.app_repeat -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:05:08.460 11:15:49 event.app_repeat -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:08.460 11:15:49 event.app_repeat -- bdev/nbd_common.sh@15 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:05:08.758 /dev/nbd1 00:05:08.758 11:15:50 event.app_repeat -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:05:08.758 11:15:50 event.app_repeat -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:05:08.758 11:15:50 event.app_repeat -- common/autotest_common.sh@868 -- # local nbd_name=nbd1 00:05:08.758 11:15:50 event.app_repeat -- common/autotest_common.sh@869 -- # local i 00:05:08.758 11:15:50 event.app_repeat -- common/autotest_common.sh@871 -- # (( i = 1 )) 00:05:08.758 11:15:50 event.app_repeat -- common/autotest_common.sh@871 -- # (( i <= 20 )) 00:05:08.758 11:15:50 event.app_repeat -- common/autotest_common.sh@872 -- # grep -q -w nbd1 /proc/partitions 00:05:08.758 11:15:50 event.app_repeat -- common/autotest_common.sh@873 -- # break 00:05:08.758 11:15:50 event.app_repeat -- common/autotest_common.sh@884 -- # (( i = 1 )) 00:05:08.758 11:15:50 event.app_repeat -- common/autotest_common.sh@884 -- # (( i <= 20 )) 00:05:08.758 11:15:50 event.app_repeat -- common/autotest_common.sh@885 -- # dd if=/dev/nbd1 of=/home/vagrant/spdk_repo/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:05:08.758 1+0 records in 00:05:08.758 1+0 records out 00:05:08.758 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000380203 s, 10.8 MB/s 00:05:08.758 11:15:50 event.app_repeat -- common/autotest_common.sh@886 -- # stat -c %s /home/vagrant/spdk_repo/spdk/test/event/nbdtest 00:05:08.758 11:15:50 event.app_repeat -- common/autotest_common.sh@886 -- # size=4096 00:05:08.758 11:15:50 event.app_repeat -- common/autotest_common.sh@887 -- # rm -f /home/vagrant/spdk_repo/spdk/test/event/nbdtest 00:05:08.758 11:15:50 event.app_repeat -- common/autotest_common.sh@888 -- # '[' 4096 '!=' 0 ']' 00:05:08.758 11:15:50 event.app_repeat -- common/autotest_common.sh@889 -- # return 0 00:05:08.758 11:15:50 event.app_repeat -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:05:08.758 11:15:50 event.app_repeat -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:08.758 11:15:50 event.app_repeat -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:05:08.758 11:15:50 event.app_repeat -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:08.758 11:15:50 event.app_repeat -- bdev/nbd_common.sh@63 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:05:09.017 11:15:50 event.app_repeat -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:05:09.017 { 00:05:09.017 "bdev_name": "Malloc0", 00:05:09.017 "nbd_device": "/dev/nbd0" 00:05:09.017 }, 00:05:09.017 { 00:05:09.017 "bdev_name": "Malloc1", 00:05:09.017 "nbd_device": "/dev/nbd1" 00:05:09.017 } 00:05:09.017 ]' 00:05:09.017 11:15:50 event.app_repeat -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:05:09.017 11:15:50 event.app_repeat -- bdev/nbd_common.sh@64 -- # echo '[ 00:05:09.017 { 00:05:09.017 "bdev_name": "Malloc0", 00:05:09.017 "nbd_device": "/dev/nbd0" 00:05:09.017 }, 00:05:09.017 { 00:05:09.017 "bdev_name": "Malloc1", 00:05:09.017 "nbd_device": "/dev/nbd1" 00:05:09.017 } 00:05:09.017 ]' 00:05:09.017 11:15:50 event.app_repeat -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:05:09.017 /dev/nbd1' 00:05:09.017 11:15:50 event.app_repeat -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:05:09.017 /dev/nbd1' 00:05:09.017 11:15:50 event.app_repeat -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:05:09.017 11:15:50 event.app_repeat -- bdev/nbd_common.sh@65 -- # count=2 00:05:09.017 11:15:50 event.app_repeat -- bdev/nbd_common.sh@66 -- # echo 2 00:05:09.017 11:15:50 event.app_repeat -- bdev/nbd_common.sh@95 -- # count=2 00:05:09.017 11:15:50 event.app_repeat -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:05:09.017 11:15:50 event.app_repeat -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:05:09.017 11:15:50 event.app_repeat -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:09.017 11:15:50 event.app_repeat -- bdev/nbd_common.sh@70 -- # local nbd_list 00:05:09.017 11:15:50 event.app_repeat -- bdev/nbd_common.sh@71 -- # local operation=write 00:05:09.017 11:15:50 event.app_repeat -- bdev/nbd_common.sh@72 -- # local tmp_file=/home/vagrant/spdk_repo/spdk/test/event/nbdrandtest 00:05:09.017 11:15:50 event.app_repeat -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:05:09.017 11:15:50 event.app_repeat -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/home/vagrant/spdk_repo/spdk/test/event/nbdrandtest bs=4096 count=256 00:05:09.017 256+0 records in 00:05:09.017 256+0 records out 00:05:09.017 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00926494 s, 113 MB/s 00:05:09.017 11:15:50 event.app_repeat -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:05:09.017 11:15:50 event.app_repeat -- bdev/nbd_common.sh@78 -- # dd if=/home/vagrant/spdk_repo/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:05:09.017 256+0 records in 00:05:09.017 256+0 records out 00:05:09.017 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0235223 s, 44.6 MB/s 00:05:09.017 11:15:50 event.app_repeat -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:05:09.017 11:15:50 event.app_repeat -- bdev/nbd_common.sh@78 -- # dd if=/home/vagrant/spdk_repo/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:05:09.017 256+0 records in 00:05:09.017 256+0 records out 00:05:09.017 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0307624 s, 34.1 MB/s 00:05:09.017 11:15:50 event.app_repeat -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:05:09.017 11:15:50 event.app_repeat -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:09.017 11:15:50 event.app_repeat -- bdev/nbd_common.sh@70 -- # local nbd_list 00:05:09.017 11:15:50 event.app_repeat -- bdev/nbd_common.sh@71 -- # local operation=verify 00:05:09.017 11:15:50 event.app_repeat -- bdev/nbd_common.sh@72 -- # local tmp_file=/home/vagrant/spdk_repo/spdk/test/event/nbdrandtest 00:05:09.017 11:15:50 event.app_repeat -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:05:09.017 11:15:50 event.app_repeat -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:05:09.017 11:15:50 event.app_repeat -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:05:09.017 11:15:50 event.app_repeat -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /home/vagrant/spdk_repo/spdk/test/event/nbdrandtest /dev/nbd0 00:05:09.017 11:15:50 event.app_repeat -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:05:09.017 11:15:50 event.app_repeat -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /home/vagrant/spdk_repo/spdk/test/event/nbdrandtest /dev/nbd1 00:05:09.017 11:15:50 event.app_repeat -- bdev/nbd_common.sh@85 -- # rm /home/vagrant/spdk_repo/spdk/test/event/nbdrandtest 00:05:09.017 11:15:50 event.app_repeat -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:05:09.017 11:15:50 event.app_repeat -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:09.017 11:15:50 event.app_repeat -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:09.017 11:15:50 event.app_repeat -- bdev/nbd_common.sh@50 -- # local nbd_list 00:05:09.017 11:15:50 event.app_repeat -- bdev/nbd_common.sh@51 -- # local i 00:05:09.017 11:15:50 event.app_repeat -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:05:09.017 11:15:50 event.app_repeat -- bdev/nbd_common.sh@54 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:05:09.585 11:15:51 event.app_repeat -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:05:09.585 11:15:51 event.app_repeat -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:05:09.585 11:15:51 event.app_repeat -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:05:09.585 11:15:51 event.app_repeat -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:05:09.585 11:15:51 event.app_repeat -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:05:09.585 11:15:51 event.app_repeat -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:05:09.585 11:15:51 event.app_repeat -- bdev/nbd_common.sh@41 -- # break 00:05:09.586 11:15:51 event.app_repeat -- bdev/nbd_common.sh@45 -- # return 0 00:05:09.586 11:15:51 event.app_repeat -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:05:09.586 11:15:51 event.app_repeat -- bdev/nbd_common.sh@54 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:05:09.844 11:15:51 event.app_repeat -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:05:09.844 11:15:51 event.app_repeat -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:05:09.844 11:15:51 event.app_repeat -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:05:09.844 11:15:51 event.app_repeat -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:05:09.844 11:15:51 event.app_repeat -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:05:09.844 11:15:51 event.app_repeat -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:05:09.844 11:15:51 event.app_repeat -- bdev/nbd_common.sh@41 -- # break 00:05:09.844 11:15:51 event.app_repeat -- bdev/nbd_common.sh@45 -- # return 0 00:05:09.844 11:15:51 event.app_repeat -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:05:09.844 11:15:51 event.app_repeat -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:09.844 11:15:51 event.app_repeat -- bdev/nbd_common.sh@63 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:05:10.103 11:15:51 event.app_repeat -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:05:10.103 11:15:51 event.app_repeat -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:05:10.103 11:15:51 event.app_repeat -- bdev/nbd_common.sh@64 -- # echo '[]' 00:05:10.103 11:15:51 event.app_repeat -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:05:10.103 11:15:51 event.app_repeat -- bdev/nbd_common.sh@65 -- # echo '' 00:05:10.103 11:15:51 event.app_repeat -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:05:10.103 11:15:51 event.app_repeat -- bdev/nbd_common.sh@65 -- # true 00:05:10.103 11:15:51 event.app_repeat -- bdev/nbd_common.sh@65 -- # count=0 00:05:10.103 11:15:51 event.app_repeat -- bdev/nbd_common.sh@66 -- # echo 0 00:05:10.103 11:15:51 event.app_repeat -- bdev/nbd_common.sh@104 -- # count=0 00:05:10.103 11:15:51 event.app_repeat -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:05:10.103 11:15:51 event.app_repeat -- bdev/nbd_common.sh@109 -- # return 0 00:05:10.103 11:15:51 event.app_repeat -- event/event.sh@34 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:05:10.361 11:15:52 event.app_repeat -- event/event.sh@35 -- # sleep 3 00:05:10.927 [2024-10-07 11:15:52.340000] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 2 00:05:10.927 [2024-10-07 11:15:52.486054] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:05:10.928 [2024-10-07 11:15:52.486073] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:05:10.928 [2024-10-07 11:15:52.561104] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:05:10.928 [2024-10-07 11:15:52.561191] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:05:13.460 spdk_app_start Round 2 00:05:13.460 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:05:13.460 11:15:55 event.app_repeat -- event/event.sh@23 -- # for i in {0..2} 00:05:13.460 11:15:55 event.app_repeat -- event/event.sh@24 -- # echo 'spdk_app_start Round 2' 00:05:13.460 11:15:55 event.app_repeat -- event/event.sh@25 -- # waitforlisten 60206 /var/tmp/spdk-nbd.sock 00:05:13.460 11:15:55 event.app_repeat -- common/autotest_common.sh@831 -- # '[' -z 60206 ']' 00:05:13.460 11:15:55 event.app_repeat -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:05:13.460 11:15:55 event.app_repeat -- common/autotest_common.sh@836 -- # local max_retries=100 00:05:13.460 11:15:55 event.app_repeat -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:05:13.460 11:15:55 event.app_repeat -- common/autotest_common.sh@840 -- # xtrace_disable 00:05:13.460 11:15:55 event.app_repeat -- common/autotest_common.sh@10 -- # set +x 00:05:13.719 11:15:55 event.app_repeat -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:05:13.719 11:15:55 event.app_repeat -- common/autotest_common.sh@864 -- # return 0 00:05:13.719 11:15:55 event.app_repeat -- event/event.sh@27 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:05:13.977 Malloc0 00:05:13.977 11:15:55 event.app_repeat -- event/event.sh@28 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:05:14.235 Malloc1 00:05:14.494 11:15:55 event.app_repeat -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:05:14.494 11:15:55 event.app_repeat -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:14.494 11:15:55 event.app_repeat -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:05:14.494 11:15:55 event.app_repeat -- bdev/nbd_common.sh@91 -- # local bdev_list 00:05:14.494 11:15:55 event.app_repeat -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:14.494 11:15:55 event.app_repeat -- bdev/nbd_common.sh@92 -- # local nbd_list 00:05:14.494 11:15:55 event.app_repeat -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:05:14.494 11:15:55 event.app_repeat -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:14.494 11:15:55 event.app_repeat -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:05:14.494 11:15:55 event.app_repeat -- bdev/nbd_common.sh@10 -- # local bdev_list 00:05:14.494 11:15:55 event.app_repeat -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:14.494 11:15:55 event.app_repeat -- bdev/nbd_common.sh@11 -- # local nbd_list 00:05:14.494 11:15:55 event.app_repeat -- bdev/nbd_common.sh@12 -- # local i 00:05:14.494 11:15:55 event.app_repeat -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:05:14.494 11:15:55 event.app_repeat -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:14.494 11:15:55 event.app_repeat -- bdev/nbd_common.sh@15 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:05:14.752 /dev/nbd0 00:05:14.752 11:15:56 event.app_repeat -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:05:14.752 11:15:56 event.app_repeat -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:05:14.752 11:15:56 event.app_repeat -- common/autotest_common.sh@868 -- # local nbd_name=nbd0 00:05:14.752 11:15:56 event.app_repeat -- common/autotest_common.sh@869 -- # local i 00:05:14.752 11:15:56 event.app_repeat -- common/autotest_common.sh@871 -- # (( i = 1 )) 00:05:14.752 11:15:56 event.app_repeat -- common/autotest_common.sh@871 -- # (( i <= 20 )) 00:05:14.752 11:15:56 event.app_repeat -- common/autotest_common.sh@872 -- # grep -q -w nbd0 /proc/partitions 00:05:14.752 11:15:56 event.app_repeat -- common/autotest_common.sh@873 -- # break 00:05:14.752 11:15:56 event.app_repeat -- common/autotest_common.sh@884 -- # (( i = 1 )) 00:05:14.752 11:15:56 event.app_repeat -- common/autotest_common.sh@884 -- # (( i <= 20 )) 00:05:14.752 11:15:56 event.app_repeat -- common/autotest_common.sh@885 -- # dd if=/dev/nbd0 of=/home/vagrant/spdk_repo/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:05:14.752 1+0 records in 00:05:14.752 1+0 records out 00:05:14.752 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000413009 s, 9.9 MB/s 00:05:14.752 11:15:56 event.app_repeat -- common/autotest_common.sh@886 -- # stat -c %s /home/vagrant/spdk_repo/spdk/test/event/nbdtest 00:05:14.752 11:15:56 event.app_repeat -- common/autotest_common.sh@886 -- # size=4096 00:05:14.752 11:15:56 event.app_repeat -- common/autotest_common.sh@887 -- # rm -f /home/vagrant/spdk_repo/spdk/test/event/nbdtest 00:05:14.752 11:15:56 event.app_repeat -- common/autotest_common.sh@888 -- # '[' 4096 '!=' 0 ']' 00:05:14.752 11:15:56 event.app_repeat -- common/autotest_common.sh@889 -- # return 0 00:05:14.752 11:15:56 event.app_repeat -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:05:14.752 11:15:56 event.app_repeat -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:14.752 11:15:56 event.app_repeat -- bdev/nbd_common.sh@15 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:05:15.010 /dev/nbd1 00:05:15.010 11:15:56 event.app_repeat -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:05:15.010 11:15:56 event.app_repeat -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:05:15.010 11:15:56 event.app_repeat -- common/autotest_common.sh@868 -- # local nbd_name=nbd1 00:05:15.010 11:15:56 event.app_repeat -- common/autotest_common.sh@869 -- # local i 00:05:15.010 11:15:56 event.app_repeat -- common/autotest_common.sh@871 -- # (( i = 1 )) 00:05:15.010 11:15:56 event.app_repeat -- common/autotest_common.sh@871 -- # (( i <= 20 )) 00:05:15.010 11:15:56 event.app_repeat -- common/autotest_common.sh@872 -- # grep -q -w nbd1 /proc/partitions 00:05:15.010 11:15:56 event.app_repeat -- common/autotest_common.sh@873 -- # break 00:05:15.010 11:15:56 event.app_repeat -- common/autotest_common.sh@884 -- # (( i = 1 )) 00:05:15.010 11:15:56 event.app_repeat -- common/autotest_common.sh@884 -- # (( i <= 20 )) 00:05:15.010 11:15:56 event.app_repeat -- common/autotest_common.sh@885 -- # dd if=/dev/nbd1 of=/home/vagrant/spdk_repo/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:05:15.010 1+0 records in 00:05:15.010 1+0 records out 00:05:15.010 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000348864 s, 11.7 MB/s 00:05:15.010 11:15:56 event.app_repeat -- common/autotest_common.sh@886 -- # stat -c %s /home/vagrant/spdk_repo/spdk/test/event/nbdtest 00:05:15.010 11:15:56 event.app_repeat -- common/autotest_common.sh@886 -- # size=4096 00:05:15.010 11:15:56 event.app_repeat -- common/autotest_common.sh@887 -- # rm -f /home/vagrant/spdk_repo/spdk/test/event/nbdtest 00:05:15.010 11:15:56 event.app_repeat -- common/autotest_common.sh@888 -- # '[' 4096 '!=' 0 ']' 00:05:15.010 11:15:56 event.app_repeat -- common/autotest_common.sh@889 -- # return 0 00:05:15.010 11:15:56 event.app_repeat -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:05:15.010 11:15:56 event.app_repeat -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:15.010 11:15:56 event.app_repeat -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:05:15.010 11:15:56 event.app_repeat -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:15.011 11:15:56 event.app_repeat -- bdev/nbd_common.sh@63 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:05:15.269 11:15:56 event.app_repeat -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:05:15.269 { 00:05:15.269 "bdev_name": "Malloc0", 00:05:15.269 "nbd_device": "/dev/nbd0" 00:05:15.269 }, 00:05:15.269 { 00:05:15.269 "bdev_name": "Malloc1", 00:05:15.269 "nbd_device": "/dev/nbd1" 00:05:15.269 } 00:05:15.269 ]' 00:05:15.269 11:15:56 event.app_repeat -- bdev/nbd_common.sh@64 -- # echo '[ 00:05:15.269 { 00:05:15.269 "bdev_name": "Malloc0", 00:05:15.269 "nbd_device": "/dev/nbd0" 00:05:15.269 }, 00:05:15.269 { 00:05:15.269 "bdev_name": "Malloc1", 00:05:15.269 "nbd_device": "/dev/nbd1" 00:05:15.269 } 00:05:15.269 ]' 00:05:15.269 11:15:56 event.app_repeat -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:05:15.528 11:15:57 event.app_repeat -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:05:15.528 /dev/nbd1' 00:05:15.528 11:15:57 event.app_repeat -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:05:15.528 /dev/nbd1' 00:05:15.528 11:15:57 event.app_repeat -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:05:15.528 11:15:57 event.app_repeat -- bdev/nbd_common.sh@65 -- # count=2 00:05:15.528 11:15:57 event.app_repeat -- bdev/nbd_common.sh@66 -- # echo 2 00:05:15.528 11:15:57 event.app_repeat -- bdev/nbd_common.sh@95 -- # count=2 00:05:15.528 11:15:57 event.app_repeat -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:05:15.528 11:15:57 event.app_repeat -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:05:15.528 11:15:57 event.app_repeat -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:15.528 11:15:57 event.app_repeat -- bdev/nbd_common.sh@70 -- # local nbd_list 00:05:15.528 11:15:57 event.app_repeat -- bdev/nbd_common.sh@71 -- # local operation=write 00:05:15.528 11:15:57 event.app_repeat -- bdev/nbd_common.sh@72 -- # local tmp_file=/home/vagrant/spdk_repo/spdk/test/event/nbdrandtest 00:05:15.528 11:15:57 event.app_repeat -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:05:15.528 11:15:57 event.app_repeat -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/home/vagrant/spdk_repo/spdk/test/event/nbdrandtest bs=4096 count=256 00:05:15.528 256+0 records in 00:05:15.528 256+0 records out 00:05:15.528 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00851729 s, 123 MB/s 00:05:15.528 11:15:57 event.app_repeat -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:05:15.528 11:15:57 event.app_repeat -- bdev/nbd_common.sh@78 -- # dd if=/home/vagrant/spdk_repo/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:05:15.528 256+0 records in 00:05:15.528 256+0 records out 00:05:15.528 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0220976 s, 47.5 MB/s 00:05:15.528 11:15:57 event.app_repeat -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:05:15.528 11:15:57 event.app_repeat -- bdev/nbd_common.sh@78 -- # dd if=/home/vagrant/spdk_repo/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:05:15.528 256+0 records in 00:05:15.528 256+0 records out 00:05:15.528 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0278939 s, 37.6 MB/s 00:05:15.528 11:15:57 event.app_repeat -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:05:15.528 11:15:57 event.app_repeat -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:15.528 11:15:57 event.app_repeat -- bdev/nbd_common.sh@70 -- # local nbd_list 00:05:15.528 11:15:57 event.app_repeat -- bdev/nbd_common.sh@71 -- # local operation=verify 00:05:15.528 11:15:57 event.app_repeat -- bdev/nbd_common.sh@72 -- # local tmp_file=/home/vagrant/spdk_repo/spdk/test/event/nbdrandtest 00:05:15.528 11:15:57 event.app_repeat -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:05:15.528 11:15:57 event.app_repeat -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:05:15.528 11:15:57 event.app_repeat -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:05:15.528 11:15:57 event.app_repeat -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /home/vagrant/spdk_repo/spdk/test/event/nbdrandtest /dev/nbd0 00:05:15.528 11:15:57 event.app_repeat -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:05:15.528 11:15:57 event.app_repeat -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /home/vagrant/spdk_repo/spdk/test/event/nbdrandtest /dev/nbd1 00:05:15.528 11:15:57 event.app_repeat -- bdev/nbd_common.sh@85 -- # rm /home/vagrant/spdk_repo/spdk/test/event/nbdrandtest 00:05:15.528 11:15:57 event.app_repeat -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:05:15.528 11:15:57 event.app_repeat -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:15.529 11:15:57 event.app_repeat -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:15.529 11:15:57 event.app_repeat -- bdev/nbd_common.sh@50 -- # local nbd_list 00:05:15.529 11:15:57 event.app_repeat -- bdev/nbd_common.sh@51 -- # local i 00:05:15.529 11:15:57 event.app_repeat -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:05:15.529 11:15:57 event.app_repeat -- bdev/nbd_common.sh@54 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:05:15.787 11:15:57 event.app_repeat -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:05:15.787 11:15:57 event.app_repeat -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:05:15.787 11:15:57 event.app_repeat -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:05:15.787 11:15:57 event.app_repeat -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:05:15.787 11:15:57 event.app_repeat -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:05:15.787 11:15:57 event.app_repeat -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:05:15.787 11:15:57 event.app_repeat -- bdev/nbd_common.sh@41 -- # break 00:05:15.787 11:15:57 event.app_repeat -- bdev/nbd_common.sh@45 -- # return 0 00:05:15.787 11:15:57 event.app_repeat -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:05:15.787 11:15:57 event.app_repeat -- bdev/nbd_common.sh@54 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:05:16.046 11:15:57 event.app_repeat -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:05:16.046 11:15:57 event.app_repeat -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:05:16.046 11:15:57 event.app_repeat -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:05:16.046 11:15:57 event.app_repeat -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:05:16.046 11:15:57 event.app_repeat -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:05:16.046 11:15:57 event.app_repeat -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:05:16.046 11:15:57 event.app_repeat -- bdev/nbd_common.sh@41 -- # break 00:05:16.046 11:15:57 event.app_repeat -- bdev/nbd_common.sh@45 -- # return 0 00:05:16.046 11:15:57 event.app_repeat -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:05:16.046 11:15:57 event.app_repeat -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:16.046 11:15:57 event.app_repeat -- bdev/nbd_common.sh@63 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:05:16.304 11:15:57 event.app_repeat -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:05:16.304 11:15:57 event.app_repeat -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:05:16.304 11:15:57 event.app_repeat -- bdev/nbd_common.sh@64 -- # echo '[]' 00:05:16.304 11:15:57 event.app_repeat -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:05:16.304 11:15:57 event.app_repeat -- bdev/nbd_common.sh@65 -- # echo '' 00:05:16.304 11:15:57 event.app_repeat -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:05:16.304 11:15:57 event.app_repeat -- bdev/nbd_common.sh@65 -- # true 00:05:16.305 11:15:58 event.app_repeat -- bdev/nbd_common.sh@65 -- # count=0 00:05:16.305 11:15:58 event.app_repeat -- bdev/nbd_common.sh@66 -- # echo 0 00:05:16.305 11:15:58 event.app_repeat -- bdev/nbd_common.sh@104 -- # count=0 00:05:16.305 11:15:58 event.app_repeat -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:05:16.305 11:15:58 event.app_repeat -- bdev/nbd_common.sh@109 -- # return 0 00:05:16.305 11:15:58 event.app_repeat -- event/event.sh@34 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:05:16.870 11:15:58 event.app_repeat -- event/event.sh@35 -- # sleep 3 00:05:17.128 [2024-10-07 11:15:58.657676] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 2 00:05:17.128 [2024-10-07 11:15:58.797800] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:05:17.128 [2024-10-07 11:15:58.797812] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:05:17.386 [2024-10-07 11:15:58.872543] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:05:17.386 [2024-10-07 11:15:58.872615] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:05:19.919 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:05:19.919 11:16:01 event.app_repeat -- event/event.sh@38 -- # waitforlisten 60206 /var/tmp/spdk-nbd.sock 00:05:19.919 11:16:01 event.app_repeat -- common/autotest_common.sh@831 -- # '[' -z 60206 ']' 00:05:19.919 11:16:01 event.app_repeat -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:05:19.919 11:16:01 event.app_repeat -- common/autotest_common.sh@836 -- # local max_retries=100 00:05:19.919 11:16:01 event.app_repeat -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:05:19.919 11:16:01 event.app_repeat -- common/autotest_common.sh@840 -- # xtrace_disable 00:05:19.919 11:16:01 event.app_repeat -- common/autotest_common.sh@10 -- # set +x 00:05:20.178 11:16:01 event.app_repeat -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:05:20.178 11:16:01 event.app_repeat -- common/autotest_common.sh@864 -- # return 0 00:05:20.178 11:16:01 event.app_repeat -- event/event.sh@39 -- # killprocess 60206 00:05:20.178 11:16:01 event.app_repeat -- common/autotest_common.sh@950 -- # '[' -z 60206 ']' 00:05:20.178 11:16:01 event.app_repeat -- common/autotest_common.sh@954 -- # kill -0 60206 00:05:20.178 11:16:01 event.app_repeat -- common/autotest_common.sh@955 -- # uname 00:05:20.178 11:16:01 event.app_repeat -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:05:20.178 11:16:01 event.app_repeat -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 60206 00:05:20.178 killing process with pid 60206 00:05:20.178 11:16:01 event.app_repeat -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:05:20.178 11:16:01 event.app_repeat -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:05:20.178 11:16:01 event.app_repeat -- common/autotest_common.sh@968 -- # echo 'killing process with pid 60206' 00:05:20.178 11:16:01 event.app_repeat -- common/autotest_common.sh@969 -- # kill 60206 00:05:20.178 11:16:01 event.app_repeat -- common/autotest_common.sh@974 -- # wait 60206 00:05:20.437 spdk_app_start is called in Round 0. 00:05:20.437 Shutdown signal received, stop current app iteration 00:05:20.437 Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 reinitialization... 00:05:20.437 spdk_app_start is called in Round 1. 00:05:20.437 Shutdown signal received, stop current app iteration 00:05:20.437 Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 reinitialization... 00:05:20.437 spdk_app_start is called in Round 2. 00:05:20.437 Shutdown signal received, stop current app iteration 00:05:20.437 Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 reinitialization... 00:05:20.437 spdk_app_start is called in Round 3. 00:05:20.437 Shutdown signal received, stop current app iteration 00:05:20.437 11:16:01 event.app_repeat -- event/event.sh@40 -- # trap - SIGINT SIGTERM EXIT 00:05:20.437 11:16:01 event.app_repeat -- event/event.sh@42 -- # return 0 00:05:20.437 00:05:20.437 real 0m20.866s 00:05:20.437 user 0m46.968s 00:05:20.437 sys 0m3.528s 00:05:20.437 11:16:01 event.app_repeat -- common/autotest_common.sh@1126 -- # xtrace_disable 00:05:20.437 ************************************ 00:05:20.437 END TEST app_repeat 00:05:20.437 ************************************ 00:05:20.437 11:16:01 event.app_repeat -- common/autotest_common.sh@10 -- # set +x 00:05:20.437 11:16:02 event -- event/event.sh@54 -- # (( SPDK_TEST_CRYPTO == 0 )) 00:05:20.437 11:16:02 event -- event/event.sh@55 -- # run_test cpu_locks /home/vagrant/spdk_repo/spdk/test/event/cpu_locks.sh 00:05:20.437 11:16:02 event -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:05:20.437 11:16:02 event -- common/autotest_common.sh@1107 -- # xtrace_disable 00:05:20.437 11:16:02 event -- common/autotest_common.sh@10 -- # set +x 00:05:20.437 ************************************ 00:05:20.437 START TEST cpu_locks 00:05:20.437 ************************************ 00:05:20.437 11:16:02 event.cpu_locks -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/event/cpu_locks.sh 00:05:20.437 * Looking for test storage... 00:05:20.437 * Found test storage at /home/vagrant/spdk_repo/spdk/test/event 00:05:20.437 11:16:02 event.cpu_locks -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:05:20.437 11:16:02 event.cpu_locks -- common/autotest_common.sh@1681 -- # lcov --version 00:05:20.437 11:16:02 event.cpu_locks -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:05:20.698 11:16:02 event.cpu_locks -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:05:20.698 11:16:02 event.cpu_locks -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:05:20.698 11:16:02 event.cpu_locks -- scripts/common.sh@333 -- # local ver1 ver1_l 00:05:20.698 11:16:02 event.cpu_locks -- scripts/common.sh@334 -- # local ver2 ver2_l 00:05:20.698 11:16:02 event.cpu_locks -- scripts/common.sh@336 -- # IFS=.-: 00:05:20.698 11:16:02 event.cpu_locks -- scripts/common.sh@336 -- # read -ra ver1 00:05:20.698 11:16:02 event.cpu_locks -- scripts/common.sh@337 -- # IFS=.-: 00:05:20.698 11:16:02 event.cpu_locks -- scripts/common.sh@337 -- # read -ra ver2 00:05:20.698 11:16:02 event.cpu_locks -- scripts/common.sh@338 -- # local 'op=<' 00:05:20.698 11:16:02 event.cpu_locks -- scripts/common.sh@340 -- # ver1_l=2 00:05:20.698 11:16:02 event.cpu_locks -- scripts/common.sh@341 -- # ver2_l=1 00:05:20.698 11:16:02 event.cpu_locks -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:05:20.698 11:16:02 event.cpu_locks -- scripts/common.sh@344 -- # case "$op" in 00:05:20.698 11:16:02 event.cpu_locks -- scripts/common.sh@345 -- # : 1 00:05:20.698 11:16:02 event.cpu_locks -- scripts/common.sh@364 -- # (( v = 0 )) 00:05:20.698 11:16:02 event.cpu_locks -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:20.698 11:16:02 event.cpu_locks -- scripts/common.sh@365 -- # decimal 1 00:05:20.698 11:16:02 event.cpu_locks -- scripts/common.sh@353 -- # local d=1 00:05:20.698 11:16:02 event.cpu_locks -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:20.698 11:16:02 event.cpu_locks -- scripts/common.sh@355 -- # echo 1 00:05:20.698 11:16:02 event.cpu_locks -- scripts/common.sh@365 -- # ver1[v]=1 00:05:20.698 11:16:02 event.cpu_locks -- scripts/common.sh@366 -- # decimal 2 00:05:20.698 11:16:02 event.cpu_locks -- scripts/common.sh@353 -- # local d=2 00:05:20.698 11:16:02 event.cpu_locks -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:20.698 11:16:02 event.cpu_locks -- scripts/common.sh@355 -- # echo 2 00:05:20.698 11:16:02 event.cpu_locks -- scripts/common.sh@366 -- # ver2[v]=2 00:05:20.698 11:16:02 event.cpu_locks -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:05:20.698 11:16:02 event.cpu_locks -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:05:20.698 11:16:02 event.cpu_locks -- scripts/common.sh@368 -- # return 0 00:05:20.698 11:16:02 event.cpu_locks -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:20.698 11:16:02 event.cpu_locks -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:05:20.698 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:20.698 --rc genhtml_branch_coverage=1 00:05:20.698 --rc genhtml_function_coverage=1 00:05:20.698 --rc genhtml_legend=1 00:05:20.698 --rc geninfo_all_blocks=1 00:05:20.698 --rc geninfo_unexecuted_blocks=1 00:05:20.698 00:05:20.698 ' 00:05:20.698 11:16:02 event.cpu_locks -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:05:20.698 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:20.698 --rc genhtml_branch_coverage=1 00:05:20.698 --rc genhtml_function_coverage=1 00:05:20.698 --rc genhtml_legend=1 00:05:20.698 --rc geninfo_all_blocks=1 00:05:20.698 --rc geninfo_unexecuted_blocks=1 00:05:20.698 00:05:20.698 ' 00:05:20.698 11:16:02 event.cpu_locks -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:05:20.698 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:20.698 --rc genhtml_branch_coverage=1 00:05:20.698 --rc genhtml_function_coverage=1 00:05:20.698 --rc genhtml_legend=1 00:05:20.698 --rc geninfo_all_blocks=1 00:05:20.698 --rc geninfo_unexecuted_blocks=1 00:05:20.698 00:05:20.698 ' 00:05:20.698 11:16:02 event.cpu_locks -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:05:20.698 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:20.698 --rc genhtml_branch_coverage=1 00:05:20.698 --rc genhtml_function_coverage=1 00:05:20.698 --rc genhtml_legend=1 00:05:20.698 --rc geninfo_all_blocks=1 00:05:20.698 --rc geninfo_unexecuted_blocks=1 00:05:20.698 00:05:20.698 ' 00:05:20.698 11:16:02 event.cpu_locks -- event/cpu_locks.sh@11 -- # rpc_sock1=/var/tmp/spdk.sock 00:05:20.698 11:16:02 event.cpu_locks -- event/cpu_locks.sh@12 -- # rpc_sock2=/var/tmp/spdk2.sock 00:05:20.698 11:16:02 event.cpu_locks -- event/cpu_locks.sh@164 -- # trap cleanup EXIT SIGTERM SIGINT 00:05:20.698 11:16:02 event.cpu_locks -- event/cpu_locks.sh@166 -- # run_test default_locks default_locks 00:05:20.698 11:16:02 event.cpu_locks -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:05:20.698 11:16:02 event.cpu_locks -- common/autotest_common.sh@1107 -- # xtrace_disable 00:05:20.698 11:16:02 event.cpu_locks -- common/autotest_common.sh@10 -- # set +x 00:05:20.698 ************************************ 00:05:20.698 START TEST default_locks 00:05:20.698 ************************************ 00:05:20.698 11:16:02 event.cpu_locks.default_locks -- common/autotest_common.sh@1125 -- # default_locks 00:05:20.698 11:16:02 event.cpu_locks.default_locks -- event/cpu_locks.sh@46 -- # spdk_tgt_pid=60868 00:05:20.698 11:16:02 event.cpu_locks.default_locks -- event/cpu_locks.sh@45 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_tgt -m 0x1 00:05:20.698 11:16:02 event.cpu_locks.default_locks -- event/cpu_locks.sh@47 -- # waitforlisten 60868 00:05:20.698 11:16:02 event.cpu_locks.default_locks -- common/autotest_common.sh@831 -- # '[' -z 60868 ']' 00:05:20.698 11:16:02 event.cpu_locks.default_locks -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:20.698 11:16:02 event.cpu_locks.default_locks -- common/autotest_common.sh@836 -- # local max_retries=100 00:05:20.698 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:20.698 11:16:02 event.cpu_locks.default_locks -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:20.698 11:16:02 event.cpu_locks.default_locks -- common/autotest_common.sh@840 -- # xtrace_disable 00:05:20.698 11:16:02 event.cpu_locks.default_locks -- common/autotest_common.sh@10 -- # set +x 00:05:20.698 [2024-10-07 11:16:02.276937] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:05:20.698 [2024-10-07 11:16:02.277036] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid60868 ] 00:05:20.957 [2024-10-07 11:16:02.418210] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:20.957 [2024-10-07 11:16:02.544643] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:05:21.215 11:16:02 event.cpu_locks.default_locks -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:05:21.215 11:16:02 event.cpu_locks.default_locks -- common/autotest_common.sh@864 -- # return 0 00:05:21.215 11:16:02 event.cpu_locks.default_locks -- event/cpu_locks.sh@49 -- # locks_exist 60868 00:05:21.215 11:16:02 event.cpu_locks.default_locks -- event/cpu_locks.sh@22 -- # lslocks -p 60868 00:05:21.215 11:16:02 event.cpu_locks.default_locks -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:05:21.782 11:16:03 event.cpu_locks.default_locks -- event/cpu_locks.sh@50 -- # killprocess 60868 00:05:21.782 11:16:03 event.cpu_locks.default_locks -- common/autotest_common.sh@950 -- # '[' -z 60868 ']' 00:05:21.782 11:16:03 event.cpu_locks.default_locks -- common/autotest_common.sh@954 -- # kill -0 60868 00:05:21.782 11:16:03 event.cpu_locks.default_locks -- common/autotest_common.sh@955 -- # uname 00:05:21.782 11:16:03 event.cpu_locks.default_locks -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:05:21.782 11:16:03 event.cpu_locks.default_locks -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 60868 00:05:21.782 11:16:03 event.cpu_locks.default_locks -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:05:21.782 killing process with pid 60868 00:05:21.782 11:16:03 event.cpu_locks.default_locks -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:05:21.782 11:16:03 event.cpu_locks.default_locks -- common/autotest_common.sh@968 -- # echo 'killing process with pid 60868' 00:05:21.782 11:16:03 event.cpu_locks.default_locks -- common/autotest_common.sh@969 -- # kill 60868 00:05:21.782 11:16:03 event.cpu_locks.default_locks -- common/autotest_common.sh@974 -- # wait 60868 00:05:22.040 11:16:03 event.cpu_locks.default_locks -- event/cpu_locks.sh@52 -- # NOT waitforlisten 60868 00:05:22.040 11:16:03 event.cpu_locks.default_locks -- common/autotest_common.sh@650 -- # local es=0 00:05:22.040 11:16:03 event.cpu_locks.default_locks -- common/autotest_common.sh@652 -- # valid_exec_arg waitforlisten 60868 00:05:22.040 11:16:03 event.cpu_locks.default_locks -- common/autotest_common.sh@638 -- # local arg=waitforlisten 00:05:22.040 11:16:03 event.cpu_locks.default_locks -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:22.040 11:16:03 event.cpu_locks.default_locks -- common/autotest_common.sh@642 -- # type -t waitforlisten 00:05:22.040 11:16:03 event.cpu_locks.default_locks -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:22.040 11:16:03 event.cpu_locks.default_locks -- common/autotest_common.sh@653 -- # waitforlisten 60868 00:05:22.040 11:16:03 event.cpu_locks.default_locks -- common/autotest_common.sh@831 -- # '[' -z 60868 ']' 00:05:22.040 11:16:03 event.cpu_locks.default_locks -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:22.040 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:22.040 11:16:03 event.cpu_locks.default_locks -- common/autotest_common.sh@836 -- # local max_retries=100 00:05:22.040 11:16:03 event.cpu_locks.default_locks -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:22.040 11:16:03 event.cpu_locks.default_locks -- common/autotest_common.sh@840 -- # xtrace_disable 00:05:22.040 ERROR: process (pid: 60868) is no longer running 00:05:22.040 11:16:03 event.cpu_locks.default_locks -- common/autotest_common.sh@10 -- # set +x 00:05:22.040 /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh: line 846: kill: (60868) - No such process 00:05:22.040 11:16:03 event.cpu_locks.default_locks -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:05:22.040 11:16:03 event.cpu_locks.default_locks -- common/autotest_common.sh@864 -- # return 1 00:05:22.040 11:16:03 event.cpu_locks.default_locks -- common/autotest_common.sh@653 -- # es=1 00:05:22.040 11:16:03 event.cpu_locks.default_locks -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:05:22.040 11:16:03 event.cpu_locks.default_locks -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:05:22.040 11:16:03 event.cpu_locks.default_locks -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:05:22.040 11:16:03 event.cpu_locks.default_locks -- event/cpu_locks.sh@54 -- # no_locks 00:05:22.040 11:16:03 event.cpu_locks.default_locks -- event/cpu_locks.sh@26 -- # lock_files=() 00:05:22.040 11:16:03 event.cpu_locks.default_locks -- event/cpu_locks.sh@26 -- # local lock_files 00:05:22.040 11:16:03 event.cpu_locks.default_locks -- event/cpu_locks.sh@27 -- # (( 0 != 0 )) 00:05:22.040 00:05:22.040 real 0m1.508s 00:05:22.040 user 0m1.454s 00:05:22.040 sys 0m0.570s 00:05:22.040 ************************************ 00:05:22.040 END TEST default_locks 00:05:22.040 ************************************ 00:05:22.040 11:16:03 event.cpu_locks.default_locks -- common/autotest_common.sh@1126 -- # xtrace_disable 00:05:22.040 11:16:03 event.cpu_locks.default_locks -- common/autotest_common.sh@10 -- # set +x 00:05:22.299 11:16:03 event.cpu_locks -- event/cpu_locks.sh@167 -- # run_test default_locks_via_rpc default_locks_via_rpc 00:05:22.299 11:16:03 event.cpu_locks -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:05:22.299 11:16:03 event.cpu_locks -- common/autotest_common.sh@1107 -- # xtrace_disable 00:05:22.299 11:16:03 event.cpu_locks -- common/autotest_common.sh@10 -- # set +x 00:05:22.299 ************************************ 00:05:22.299 START TEST default_locks_via_rpc 00:05:22.299 ************************************ 00:05:22.299 11:16:03 event.cpu_locks.default_locks_via_rpc -- common/autotest_common.sh@1125 -- # default_locks_via_rpc 00:05:22.299 11:16:03 event.cpu_locks.default_locks_via_rpc -- event/cpu_locks.sh@62 -- # spdk_tgt_pid=60914 00:05:22.299 11:16:03 event.cpu_locks.default_locks_via_rpc -- event/cpu_locks.sh@61 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_tgt -m 0x1 00:05:22.299 11:16:03 event.cpu_locks.default_locks_via_rpc -- event/cpu_locks.sh@63 -- # waitforlisten 60914 00:05:22.299 11:16:03 event.cpu_locks.default_locks_via_rpc -- common/autotest_common.sh@831 -- # '[' -z 60914 ']' 00:05:22.299 11:16:03 event.cpu_locks.default_locks_via_rpc -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:22.299 11:16:03 event.cpu_locks.default_locks_via_rpc -- common/autotest_common.sh@836 -- # local max_retries=100 00:05:22.299 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:22.299 11:16:03 event.cpu_locks.default_locks_via_rpc -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:22.299 11:16:03 event.cpu_locks.default_locks_via_rpc -- common/autotest_common.sh@840 -- # xtrace_disable 00:05:22.299 11:16:03 event.cpu_locks.default_locks_via_rpc -- common/autotest_common.sh@10 -- # set +x 00:05:22.299 [2024-10-07 11:16:03.854906] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:05:22.299 [2024-10-07 11:16:03.855060] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid60914 ] 00:05:22.299 [2024-10-07 11:16:03.988919] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:22.557 [2024-10-07 11:16:04.107314] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:05:22.817 11:16:04 event.cpu_locks.default_locks_via_rpc -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:05:22.817 11:16:04 event.cpu_locks.default_locks_via_rpc -- common/autotest_common.sh@864 -- # return 0 00:05:22.817 11:16:04 event.cpu_locks.default_locks_via_rpc -- event/cpu_locks.sh@65 -- # rpc_cmd framework_disable_cpumask_locks 00:05:22.817 11:16:04 event.cpu_locks.default_locks_via_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:22.817 11:16:04 event.cpu_locks.default_locks_via_rpc -- common/autotest_common.sh@10 -- # set +x 00:05:22.817 11:16:04 event.cpu_locks.default_locks_via_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:22.817 11:16:04 event.cpu_locks.default_locks_via_rpc -- event/cpu_locks.sh@67 -- # no_locks 00:05:22.817 11:16:04 event.cpu_locks.default_locks_via_rpc -- event/cpu_locks.sh@26 -- # lock_files=() 00:05:22.817 11:16:04 event.cpu_locks.default_locks_via_rpc -- event/cpu_locks.sh@26 -- # local lock_files 00:05:22.817 11:16:04 event.cpu_locks.default_locks_via_rpc -- event/cpu_locks.sh@27 -- # (( 0 != 0 )) 00:05:22.817 11:16:04 event.cpu_locks.default_locks_via_rpc -- event/cpu_locks.sh@69 -- # rpc_cmd framework_enable_cpumask_locks 00:05:22.817 11:16:04 event.cpu_locks.default_locks_via_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:22.817 11:16:04 event.cpu_locks.default_locks_via_rpc -- common/autotest_common.sh@10 -- # set +x 00:05:22.817 11:16:04 event.cpu_locks.default_locks_via_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:22.817 11:16:04 event.cpu_locks.default_locks_via_rpc -- event/cpu_locks.sh@71 -- # locks_exist 60914 00:05:22.817 11:16:04 event.cpu_locks.default_locks_via_rpc -- event/cpu_locks.sh@22 -- # lslocks -p 60914 00:05:22.817 11:16:04 event.cpu_locks.default_locks_via_rpc -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:05:23.383 11:16:04 event.cpu_locks.default_locks_via_rpc -- event/cpu_locks.sh@73 -- # killprocess 60914 00:05:23.383 11:16:04 event.cpu_locks.default_locks_via_rpc -- common/autotest_common.sh@950 -- # '[' -z 60914 ']' 00:05:23.383 11:16:04 event.cpu_locks.default_locks_via_rpc -- common/autotest_common.sh@954 -- # kill -0 60914 00:05:23.383 11:16:04 event.cpu_locks.default_locks_via_rpc -- common/autotest_common.sh@955 -- # uname 00:05:23.383 11:16:04 event.cpu_locks.default_locks_via_rpc -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:05:23.383 11:16:04 event.cpu_locks.default_locks_via_rpc -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 60914 00:05:23.383 11:16:04 event.cpu_locks.default_locks_via_rpc -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:05:23.383 killing process with pid 60914 00:05:23.383 11:16:04 event.cpu_locks.default_locks_via_rpc -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:05:23.383 11:16:04 event.cpu_locks.default_locks_via_rpc -- common/autotest_common.sh@968 -- # echo 'killing process with pid 60914' 00:05:23.383 11:16:04 event.cpu_locks.default_locks_via_rpc -- common/autotest_common.sh@969 -- # kill 60914 00:05:23.383 11:16:04 event.cpu_locks.default_locks_via_rpc -- common/autotest_common.sh@974 -- # wait 60914 00:05:23.950 00:05:23.950 real 0m1.661s 00:05:23.950 user 0m1.668s 00:05:23.950 sys 0m0.566s 00:05:23.950 ************************************ 00:05:23.950 END TEST default_locks_via_rpc 00:05:23.950 ************************************ 00:05:23.950 11:16:05 event.cpu_locks.default_locks_via_rpc -- common/autotest_common.sh@1126 -- # xtrace_disable 00:05:23.950 11:16:05 event.cpu_locks.default_locks_via_rpc -- common/autotest_common.sh@10 -- # set +x 00:05:23.950 11:16:05 event.cpu_locks -- event/cpu_locks.sh@168 -- # run_test non_locking_app_on_locked_coremask non_locking_app_on_locked_coremask 00:05:23.950 11:16:05 event.cpu_locks -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:05:23.950 11:16:05 event.cpu_locks -- common/autotest_common.sh@1107 -- # xtrace_disable 00:05:23.950 11:16:05 event.cpu_locks -- common/autotest_common.sh@10 -- # set +x 00:05:23.950 ************************************ 00:05:23.950 START TEST non_locking_app_on_locked_coremask 00:05:23.950 ************************************ 00:05:23.950 11:16:05 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@1125 -- # non_locking_app_on_locked_coremask 00:05:23.950 11:16:05 event.cpu_locks.non_locking_app_on_locked_coremask -- event/cpu_locks.sh@80 -- # spdk_tgt_pid=60975 00:05:23.950 11:16:05 event.cpu_locks.non_locking_app_on_locked_coremask -- event/cpu_locks.sh@81 -- # waitforlisten 60975 /var/tmp/spdk.sock 00:05:23.950 11:16:05 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@831 -- # '[' -z 60975 ']' 00:05:23.950 11:16:05 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:23.950 11:16:05 event.cpu_locks.non_locking_app_on_locked_coremask -- event/cpu_locks.sh@79 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_tgt -m 0x1 00:05:23.950 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:23.950 11:16:05 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@836 -- # local max_retries=100 00:05:23.950 11:16:05 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:23.950 11:16:05 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@840 -- # xtrace_disable 00:05:23.950 11:16:05 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@10 -- # set +x 00:05:23.950 [2024-10-07 11:16:05.583021] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:05:23.950 [2024-10-07 11:16:05.583153] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid60975 ] 00:05:24.208 [2024-10-07 11:16:05.723047] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:24.208 [2024-10-07 11:16:05.909284] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:05:25.143 11:16:06 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:05:25.143 11:16:06 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@864 -- # return 0 00:05:25.143 11:16:06 event.cpu_locks.non_locking_app_on_locked_coremask -- event/cpu_locks.sh@84 -- # spdk_tgt_pid2=61003 00:05:25.143 11:16:06 event.cpu_locks.non_locking_app_on_locked_coremask -- event/cpu_locks.sh@83 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_tgt -m 0x1 --disable-cpumask-locks -r /var/tmp/spdk2.sock 00:05:25.144 11:16:06 event.cpu_locks.non_locking_app_on_locked_coremask -- event/cpu_locks.sh@85 -- # waitforlisten 61003 /var/tmp/spdk2.sock 00:05:25.144 11:16:06 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@831 -- # '[' -z 61003 ']' 00:05:25.144 11:16:06 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:25.144 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:25.144 11:16:06 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@836 -- # local max_retries=100 00:05:25.144 11:16:06 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:25.144 11:16:06 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@840 -- # xtrace_disable 00:05:25.144 11:16:06 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@10 -- # set +x 00:05:25.144 [2024-10-07 11:16:06.821535] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:05:25.144 [2024-10-07 11:16:06.821650] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid61003 ] 00:05:25.430 [2024-10-07 11:16:06.971274] app.c: 914:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:05:25.430 [2024-10-07 11:16:06.971344] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:25.688 [2024-10-07 11:16:07.293471] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:05:26.625 11:16:08 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:05:26.625 11:16:08 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@864 -- # return 0 00:05:26.625 11:16:08 event.cpu_locks.non_locking_app_on_locked_coremask -- event/cpu_locks.sh@87 -- # locks_exist 60975 00:05:26.625 11:16:08 event.cpu_locks.non_locking_app_on_locked_coremask -- event/cpu_locks.sh@22 -- # lslocks -p 60975 00:05:26.625 11:16:08 event.cpu_locks.non_locking_app_on_locked_coremask -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:05:27.569 11:16:09 event.cpu_locks.non_locking_app_on_locked_coremask -- event/cpu_locks.sh@89 -- # killprocess 60975 00:05:27.569 11:16:09 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@950 -- # '[' -z 60975 ']' 00:05:27.569 11:16:09 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@954 -- # kill -0 60975 00:05:27.569 11:16:09 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@955 -- # uname 00:05:27.569 11:16:09 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:05:27.569 11:16:09 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 60975 00:05:27.569 11:16:09 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:05:27.569 11:16:09 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:05:27.569 killing process with pid 60975 00:05:27.569 11:16:09 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@968 -- # echo 'killing process with pid 60975' 00:05:27.569 11:16:09 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@969 -- # kill 60975 00:05:27.569 11:16:09 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@974 -- # wait 60975 00:05:28.970 11:16:10 event.cpu_locks.non_locking_app_on_locked_coremask -- event/cpu_locks.sh@90 -- # killprocess 61003 00:05:28.970 11:16:10 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@950 -- # '[' -z 61003 ']' 00:05:28.970 11:16:10 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@954 -- # kill -0 61003 00:05:28.970 11:16:10 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@955 -- # uname 00:05:28.970 11:16:10 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:05:28.970 11:16:10 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 61003 00:05:28.970 11:16:10 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:05:28.970 killing process with pid 61003 00:05:28.970 11:16:10 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:05:28.970 11:16:10 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@968 -- # echo 'killing process with pid 61003' 00:05:28.970 11:16:10 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@969 -- # kill 61003 00:05:28.970 11:16:10 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@974 -- # wait 61003 00:05:29.228 00:05:29.228 real 0m5.409s 00:05:29.228 user 0m5.899s 00:05:29.228 sys 0m1.552s 00:05:29.228 ************************************ 00:05:29.228 END TEST non_locking_app_on_locked_coremask 00:05:29.228 ************************************ 00:05:29.228 11:16:10 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@1126 -- # xtrace_disable 00:05:29.228 11:16:10 event.cpu_locks.non_locking_app_on_locked_coremask -- common/autotest_common.sh@10 -- # set +x 00:05:29.486 11:16:10 event.cpu_locks -- event/cpu_locks.sh@169 -- # run_test locking_app_on_unlocked_coremask locking_app_on_unlocked_coremask 00:05:29.486 11:16:10 event.cpu_locks -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:05:29.486 11:16:10 event.cpu_locks -- common/autotest_common.sh@1107 -- # xtrace_disable 00:05:29.486 11:16:10 event.cpu_locks -- common/autotest_common.sh@10 -- # set +x 00:05:29.486 ************************************ 00:05:29.486 START TEST locking_app_on_unlocked_coremask 00:05:29.486 ************************************ 00:05:29.486 11:16:10 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@1125 -- # locking_app_on_unlocked_coremask 00:05:29.486 11:16:10 event.cpu_locks.locking_app_on_unlocked_coremask -- event/cpu_locks.sh@98 -- # spdk_tgt_pid=61093 00:05:29.486 11:16:10 event.cpu_locks.locking_app_on_unlocked_coremask -- event/cpu_locks.sh@97 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_tgt -m 0x1 --disable-cpumask-locks 00:05:29.486 11:16:10 event.cpu_locks.locking_app_on_unlocked_coremask -- event/cpu_locks.sh@99 -- # waitforlisten 61093 /var/tmp/spdk.sock 00:05:29.486 11:16:10 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@831 -- # '[' -z 61093 ']' 00:05:29.486 11:16:10 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:29.486 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:29.486 11:16:10 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@836 -- # local max_retries=100 00:05:29.486 11:16:10 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:29.486 11:16:10 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@840 -- # xtrace_disable 00:05:29.486 11:16:10 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@10 -- # set +x 00:05:29.486 [2024-10-07 11:16:11.060593] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:05:29.486 [2024-10-07 11:16:11.060698] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid61093 ] 00:05:29.745 [2024-10-07 11:16:11.197288] app.c: 914:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:05:29.745 [2024-10-07 11:16:11.197380] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:29.745 [2024-10-07 11:16:11.363555] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:05:30.680 11:16:12 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:05:30.680 11:16:12 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@864 -- # return 0 00:05:30.680 11:16:12 event.cpu_locks.locking_app_on_unlocked_coremask -- event/cpu_locks.sh@102 -- # spdk_tgt_pid2=61123 00:05:30.680 11:16:12 event.cpu_locks.locking_app_on_unlocked_coremask -- event/cpu_locks.sh@103 -- # waitforlisten 61123 /var/tmp/spdk2.sock 00:05:30.680 11:16:12 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@831 -- # '[' -z 61123 ']' 00:05:30.681 11:16:12 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:30.681 11:16:12 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@836 -- # local max_retries=100 00:05:30.681 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:30.681 11:16:12 event.cpu_locks.locking_app_on_unlocked_coremask -- event/cpu_locks.sh@101 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_tgt -m 0x1 -r /var/tmp/spdk2.sock 00:05:30.681 11:16:12 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:30.681 11:16:12 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@840 -- # xtrace_disable 00:05:30.681 11:16:12 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@10 -- # set +x 00:05:30.681 [2024-10-07 11:16:12.167934] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:05:30.681 [2024-10-07 11:16:12.168034] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid61123 ] 00:05:30.681 [2024-10-07 11:16:12.311456] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:30.939 [2024-10-07 11:16:12.627527] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:05:31.926 11:16:13 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:05:31.926 11:16:13 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@864 -- # return 0 00:05:31.926 11:16:13 event.cpu_locks.locking_app_on_unlocked_coremask -- event/cpu_locks.sh@105 -- # locks_exist 61123 00:05:31.926 11:16:13 event.cpu_locks.locking_app_on_unlocked_coremask -- event/cpu_locks.sh@22 -- # lslocks -p 61123 00:05:31.926 11:16:13 event.cpu_locks.locking_app_on_unlocked_coremask -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:05:32.861 11:16:14 event.cpu_locks.locking_app_on_unlocked_coremask -- event/cpu_locks.sh@107 -- # killprocess 61093 00:05:32.861 11:16:14 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@950 -- # '[' -z 61093 ']' 00:05:32.861 11:16:14 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@954 -- # kill -0 61093 00:05:32.861 11:16:14 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@955 -- # uname 00:05:32.861 11:16:14 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:05:32.861 11:16:14 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 61093 00:05:32.861 11:16:14 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:05:32.861 killing process with pid 61093 00:05:32.861 11:16:14 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:05:32.861 11:16:14 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@968 -- # echo 'killing process with pid 61093' 00:05:32.861 11:16:14 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@969 -- # kill 61093 00:05:32.861 11:16:14 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@974 -- # wait 61093 00:05:34.236 11:16:15 event.cpu_locks.locking_app_on_unlocked_coremask -- event/cpu_locks.sh@108 -- # killprocess 61123 00:05:34.236 11:16:15 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@950 -- # '[' -z 61123 ']' 00:05:34.236 11:16:15 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@954 -- # kill -0 61123 00:05:34.236 11:16:15 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@955 -- # uname 00:05:34.236 11:16:15 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:05:34.236 11:16:15 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 61123 00:05:34.236 11:16:15 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:05:34.236 killing process with pid 61123 00:05:34.236 11:16:15 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:05:34.236 11:16:15 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@968 -- # echo 'killing process with pid 61123' 00:05:34.236 11:16:15 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@969 -- # kill 61123 00:05:34.236 11:16:15 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@974 -- # wait 61123 00:05:34.803 00:05:34.803 real 0m5.247s 00:05:34.803 user 0m5.662s 00:05:34.803 sys 0m1.532s 00:05:34.803 11:16:16 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@1126 -- # xtrace_disable 00:05:34.803 11:16:16 event.cpu_locks.locking_app_on_unlocked_coremask -- common/autotest_common.sh@10 -- # set +x 00:05:34.803 ************************************ 00:05:34.804 END TEST locking_app_on_unlocked_coremask 00:05:34.804 ************************************ 00:05:34.804 11:16:16 event.cpu_locks -- event/cpu_locks.sh@170 -- # run_test locking_app_on_locked_coremask locking_app_on_locked_coremask 00:05:34.804 11:16:16 event.cpu_locks -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:05:34.804 11:16:16 event.cpu_locks -- common/autotest_common.sh@1107 -- # xtrace_disable 00:05:34.804 11:16:16 event.cpu_locks -- common/autotest_common.sh@10 -- # set +x 00:05:34.804 ************************************ 00:05:34.804 START TEST locking_app_on_locked_coremask 00:05:34.804 ************************************ 00:05:34.804 11:16:16 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@1125 -- # locking_app_on_locked_coremask 00:05:34.804 11:16:16 event.cpu_locks.locking_app_on_locked_coremask -- event/cpu_locks.sh@115 -- # spdk_tgt_pid=61217 00:05:34.804 11:16:16 event.cpu_locks.locking_app_on_locked_coremask -- event/cpu_locks.sh@116 -- # waitforlisten 61217 /var/tmp/spdk.sock 00:05:34.804 11:16:16 event.cpu_locks.locking_app_on_locked_coremask -- event/cpu_locks.sh@114 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_tgt -m 0x1 00:05:34.804 11:16:16 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@831 -- # '[' -z 61217 ']' 00:05:34.804 11:16:16 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:34.804 11:16:16 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@836 -- # local max_retries=100 00:05:34.804 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:34.804 11:16:16 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:34.804 11:16:16 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@840 -- # xtrace_disable 00:05:34.804 11:16:16 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@10 -- # set +x 00:05:34.804 [2024-10-07 11:16:16.352147] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:05:34.804 [2024-10-07 11:16:16.352272] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid61217 ] 00:05:34.804 [2024-10-07 11:16:16.491803] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:35.062 [2024-10-07 11:16:16.629334] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:05:35.998 11:16:17 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:05:35.998 11:16:17 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@864 -- # return 0 00:05:35.998 11:16:17 event.cpu_locks.locking_app_on_locked_coremask -- event/cpu_locks.sh@119 -- # spdk_tgt_pid2=61245 00:05:35.998 11:16:17 event.cpu_locks.locking_app_on_locked_coremask -- event/cpu_locks.sh@118 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_tgt -m 0x1 -r /var/tmp/spdk2.sock 00:05:35.998 11:16:17 event.cpu_locks.locking_app_on_locked_coremask -- event/cpu_locks.sh@120 -- # NOT waitforlisten 61245 /var/tmp/spdk2.sock 00:05:35.998 11:16:17 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@650 -- # local es=0 00:05:35.998 11:16:17 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@652 -- # valid_exec_arg waitforlisten 61245 /var/tmp/spdk2.sock 00:05:35.998 11:16:17 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@638 -- # local arg=waitforlisten 00:05:35.998 11:16:17 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:35.998 11:16:17 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@642 -- # type -t waitforlisten 00:05:35.998 11:16:17 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:35.998 11:16:17 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@653 -- # waitforlisten 61245 /var/tmp/spdk2.sock 00:05:35.998 11:16:17 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@831 -- # '[' -z 61245 ']' 00:05:35.998 11:16:17 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:35.998 11:16:17 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@836 -- # local max_retries=100 00:05:35.998 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:35.998 11:16:17 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:35.998 11:16:17 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@840 -- # xtrace_disable 00:05:35.998 11:16:17 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@10 -- # set +x 00:05:35.998 [2024-10-07 11:16:17.491842] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:05:35.998 [2024-10-07 11:16:17.491951] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid61245 ] 00:05:35.998 [2024-10-07 11:16:17.639306] app.c: 779:claim_cpu_cores: *ERROR*: Cannot create lock on core 0, probably process 61217 has claimed it. 00:05:35.998 [2024-10-07 11:16:17.639392] app.c: 910:spdk_app_start: *ERROR*: Unable to acquire lock on assigned core mask - exiting. 00:05:36.565 ERROR: process (pid: 61245) is no longer running 00:05:36.565 /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh: line 846: kill: (61245) - No such process 00:05:36.565 11:16:18 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:05:36.565 11:16:18 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@864 -- # return 1 00:05:36.565 11:16:18 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@653 -- # es=1 00:05:36.565 11:16:18 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:05:36.565 11:16:18 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:05:36.565 11:16:18 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:05:36.565 11:16:18 event.cpu_locks.locking_app_on_locked_coremask -- event/cpu_locks.sh@122 -- # locks_exist 61217 00:05:36.565 11:16:18 event.cpu_locks.locking_app_on_locked_coremask -- event/cpu_locks.sh@22 -- # lslocks -p 61217 00:05:36.565 11:16:18 event.cpu_locks.locking_app_on_locked_coremask -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:05:37.135 11:16:18 event.cpu_locks.locking_app_on_locked_coremask -- event/cpu_locks.sh@124 -- # killprocess 61217 00:05:37.135 11:16:18 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@950 -- # '[' -z 61217 ']' 00:05:37.135 11:16:18 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@954 -- # kill -0 61217 00:05:37.135 11:16:18 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@955 -- # uname 00:05:37.135 11:16:18 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:05:37.135 11:16:18 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 61217 00:05:37.135 11:16:18 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:05:37.135 killing process with pid 61217 00:05:37.135 11:16:18 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:05:37.135 11:16:18 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@968 -- # echo 'killing process with pid 61217' 00:05:37.135 11:16:18 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@969 -- # kill 61217 00:05:37.135 11:16:18 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@974 -- # wait 61217 00:05:37.702 00:05:37.702 real 0m3.059s 00:05:37.702 user 0m3.496s 00:05:37.702 sys 0m0.800s 00:05:37.702 ************************************ 00:05:37.702 END TEST locking_app_on_locked_coremask 00:05:37.702 ************************************ 00:05:37.702 11:16:19 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@1126 -- # xtrace_disable 00:05:37.702 11:16:19 event.cpu_locks.locking_app_on_locked_coremask -- common/autotest_common.sh@10 -- # set +x 00:05:37.702 11:16:19 event.cpu_locks -- event/cpu_locks.sh@171 -- # run_test locking_overlapped_coremask locking_overlapped_coremask 00:05:37.702 11:16:19 event.cpu_locks -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:05:37.702 11:16:19 event.cpu_locks -- common/autotest_common.sh@1107 -- # xtrace_disable 00:05:37.702 11:16:19 event.cpu_locks -- common/autotest_common.sh@10 -- # set +x 00:05:37.702 ************************************ 00:05:37.702 START TEST locking_overlapped_coremask 00:05:37.702 ************************************ 00:05:37.702 11:16:19 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@1125 -- # locking_overlapped_coremask 00:05:37.702 11:16:19 event.cpu_locks.locking_overlapped_coremask -- event/cpu_locks.sh@132 -- # spdk_tgt_pid=61302 00:05:37.702 11:16:19 event.cpu_locks.locking_overlapped_coremask -- event/cpu_locks.sh@131 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_tgt -m 0x7 00:05:37.702 11:16:19 event.cpu_locks.locking_overlapped_coremask -- event/cpu_locks.sh@133 -- # waitforlisten 61302 /var/tmp/spdk.sock 00:05:37.702 11:16:19 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@831 -- # '[' -z 61302 ']' 00:05:37.702 11:16:19 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:37.702 11:16:19 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@836 -- # local max_retries=100 00:05:37.702 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:37.702 11:16:19 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:37.702 11:16:19 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@840 -- # xtrace_disable 00:05:37.702 11:16:19 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@10 -- # set +x 00:05:37.961 [2024-10-07 11:16:19.457098] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:05:37.961 [2024-10-07 11:16:19.457225] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid61302 ] 00:05:37.961 [2024-10-07 11:16:19.592356] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 3 00:05:38.219 [2024-10-07 11:16:19.746049] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:05:38.219 [2024-10-07 11:16:19.746177] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:05:38.219 [2024-10-07 11:16:19.746182] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:05:39.153 11:16:20 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:05:39.153 11:16:20 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@864 -- # return 0 00:05:39.153 11:16:20 event.cpu_locks.locking_overlapped_coremask -- event/cpu_locks.sh@136 -- # spdk_tgt_pid2=61333 00:05:39.153 11:16:20 event.cpu_locks.locking_overlapped_coremask -- event/cpu_locks.sh@135 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_tgt -m 0x1c -r /var/tmp/spdk2.sock 00:05:39.153 11:16:20 event.cpu_locks.locking_overlapped_coremask -- event/cpu_locks.sh@137 -- # NOT waitforlisten 61333 /var/tmp/spdk2.sock 00:05:39.153 11:16:20 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@650 -- # local es=0 00:05:39.153 11:16:20 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@652 -- # valid_exec_arg waitforlisten 61333 /var/tmp/spdk2.sock 00:05:39.153 11:16:20 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@638 -- # local arg=waitforlisten 00:05:39.153 11:16:20 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:39.153 11:16:20 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@642 -- # type -t waitforlisten 00:05:39.153 11:16:20 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:39.153 11:16:20 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@653 -- # waitforlisten 61333 /var/tmp/spdk2.sock 00:05:39.153 11:16:20 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@831 -- # '[' -z 61333 ']' 00:05:39.153 11:16:20 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:39.153 11:16:20 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@836 -- # local max_retries=100 00:05:39.153 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:39.153 11:16:20 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:39.153 11:16:20 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@840 -- # xtrace_disable 00:05:39.153 11:16:20 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@10 -- # set +x 00:05:39.153 [2024-10-07 11:16:20.635831] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:05:39.153 [2024-10-07 11:16:20.636002] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1c --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid61333 ] 00:05:39.153 [2024-10-07 11:16:20.787542] app.c: 779:claim_cpu_cores: *ERROR*: Cannot create lock on core 2, probably process 61302 has claimed it. 00:05:39.153 [2024-10-07 11:16:20.787619] app.c: 910:spdk_app_start: *ERROR*: Unable to acquire lock on assigned core mask - exiting. 00:05:39.719 ERROR: process (pid: 61333) is no longer running 00:05:39.719 /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh: line 846: kill: (61333) - No such process 00:05:39.719 11:16:21 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:05:39.719 11:16:21 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@864 -- # return 1 00:05:39.719 11:16:21 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@653 -- # es=1 00:05:39.719 11:16:21 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:05:39.719 11:16:21 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:05:39.719 11:16:21 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:05:39.719 11:16:21 event.cpu_locks.locking_overlapped_coremask -- event/cpu_locks.sh@139 -- # check_remaining_locks 00:05:39.719 11:16:21 event.cpu_locks.locking_overlapped_coremask -- event/cpu_locks.sh@36 -- # locks=(/var/tmp/spdk_cpu_lock_*) 00:05:39.719 11:16:21 event.cpu_locks.locking_overlapped_coremask -- event/cpu_locks.sh@37 -- # locks_expected=(/var/tmp/spdk_cpu_lock_{000..002}) 00:05:39.719 11:16:21 event.cpu_locks.locking_overlapped_coremask -- event/cpu_locks.sh@38 -- # [[ /var/tmp/spdk_cpu_lock_000 /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 == \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\0\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\1\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\2 ]] 00:05:39.719 11:16:21 event.cpu_locks.locking_overlapped_coremask -- event/cpu_locks.sh@141 -- # killprocess 61302 00:05:39.719 11:16:21 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@950 -- # '[' -z 61302 ']' 00:05:39.719 11:16:21 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@954 -- # kill -0 61302 00:05:39.719 11:16:21 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@955 -- # uname 00:05:39.719 11:16:21 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:05:39.719 11:16:21 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 61302 00:05:39.978 killing process with pid 61302 00:05:39.978 11:16:21 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:05:39.978 11:16:21 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:05:39.978 11:16:21 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@968 -- # echo 'killing process with pid 61302' 00:05:39.978 11:16:21 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@969 -- # kill 61302 00:05:39.978 11:16:21 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@974 -- # wait 61302 00:05:40.606 ************************************ 00:05:40.606 END TEST locking_overlapped_coremask 00:05:40.606 ************************************ 00:05:40.606 00:05:40.606 real 0m2.676s 00:05:40.606 user 0m7.382s 00:05:40.606 sys 0m0.617s 00:05:40.606 11:16:22 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@1126 -- # xtrace_disable 00:05:40.606 11:16:22 event.cpu_locks.locking_overlapped_coremask -- common/autotest_common.sh@10 -- # set +x 00:05:40.606 11:16:22 event.cpu_locks -- event/cpu_locks.sh@172 -- # run_test locking_overlapped_coremask_via_rpc locking_overlapped_coremask_via_rpc 00:05:40.606 11:16:22 event.cpu_locks -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:05:40.606 11:16:22 event.cpu_locks -- common/autotest_common.sh@1107 -- # xtrace_disable 00:05:40.606 11:16:22 event.cpu_locks -- common/autotest_common.sh@10 -- # set +x 00:05:40.606 ************************************ 00:05:40.606 START TEST locking_overlapped_coremask_via_rpc 00:05:40.606 ************************************ 00:05:40.606 11:16:22 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@1125 -- # locking_overlapped_coremask_via_rpc 00:05:40.606 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:40.606 11:16:22 event.cpu_locks.locking_overlapped_coremask_via_rpc -- event/cpu_locks.sh@148 -- # spdk_tgt_pid=61384 00:05:40.606 11:16:22 event.cpu_locks.locking_overlapped_coremask_via_rpc -- event/cpu_locks.sh@149 -- # waitforlisten 61384 /var/tmp/spdk.sock 00:05:40.606 11:16:22 event.cpu_locks.locking_overlapped_coremask_via_rpc -- event/cpu_locks.sh@147 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_tgt -m 0x7 --disable-cpumask-locks 00:05:40.606 11:16:22 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@831 -- # '[' -z 61384 ']' 00:05:40.606 11:16:22 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:40.606 11:16:22 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@836 -- # local max_retries=100 00:05:40.606 11:16:22 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:40.606 11:16:22 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@840 -- # xtrace_disable 00:05:40.606 11:16:22 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@10 -- # set +x 00:05:40.607 [2024-10-07 11:16:22.189382] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:05:40.607 [2024-10-07 11:16:22.189507] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid61384 ] 00:05:40.878 [2024-10-07 11:16:22.325758] app.c: 914:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:05:40.878 [2024-10-07 11:16:22.325898] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 3 00:05:40.878 [2024-10-07 11:16:22.504252] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:05:40.878 [2024-10-07 11:16:22.504396] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:05:40.878 [2024-10-07 11:16:22.504379] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:05:41.812 11:16:23 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:05:41.812 11:16:23 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@864 -- # return 0 00:05:41.812 11:16:23 event.cpu_locks.locking_overlapped_coremask_via_rpc -- event/cpu_locks.sh@152 -- # spdk_tgt_pid2=61414 00:05:41.812 11:16:23 event.cpu_locks.locking_overlapped_coremask_via_rpc -- event/cpu_locks.sh@151 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_tgt -m 0x1c -r /var/tmp/spdk2.sock --disable-cpumask-locks 00:05:41.812 11:16:23 event.cpu_locks.locking_overlapped_coremask_via_rpc -- event/cpu_locks.sh@153 -- # waitforlisten 61414 /var/tmp/spdk2.sock 00:05:41.812 11:16:23 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@831 -- # '[' -z 61414 ']' 00:05:41.812 11:16:23 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:41.812 11:16:23 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@836 -- # local max_retries=100 00:05:41.812 11:16:23 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:41.812 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:41.812 11:16:23 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@840 -- # xtrace_disable 00:05:41.812 11:16:23 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@10 -- # set +x 00:05:41.813 [2024-10-07 11:16:23.310045] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:05:41.813 [2024-10-07 11:16:23.310437] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1c --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid61414 ] 00:05:41.813 [2024-10-07 11:16:23.453998] app.c: 914:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:05:41.813 [2024-10-07 11:16:23.454049] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 3 00:05:42.070 [2024-10-07 11:16:23.713683] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 3 00:05:42.070 [2024-10-07 11:16:23.717553] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 4 00:05:42.070 [2024-10-07 11:16:23.717557] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:05:43.004 11:16:24 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:05:43.004 11:16:24 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@864 -- # return 0 00:05:43.004 11:16:24 event.cpu_locks.locking_overlapped_coremask_via_rpc -- event/cpu_locks.sh@155 -- # rpc_cmd framework_enable_cpumask_locks 00:05:43.004 11:16:24 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:43.004 11:16:24 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@10 -- # set +x 00:05:43.005 11:16:24 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:43.005 11:16:24 event.cpu_locks.locking_overlapped_coremask_via_rpc -- event/cpu_locks.sh@156 -- # NOT rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:05:43.005 11:16:24 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@650 -- # local es=0 00:05:43.005 11:16:24 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:05:43.005 11:16:24 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:05:43.005 11:16:24 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:43.005 11:16:24 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:05:43.005 11:16:24 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:43.005 11:16:24 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:05:43.005 11:16:24 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:43.005 11:16:24 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@10 -- # set +x 00:05:43.005 [2024-10-07 11:16:24.372685] app.c: 779:claim_cpu_cores: *ERROR*: Cannot create lock on core 2, probably process 61384 has claimed it. 00:05:43.005 2024/10/07 11:16:24 error on JSON-RPC call, method: framework_enable_cpumask_locks, params: map[], err: error received for framework_enable_cpumask_locks method, err: Code=-32603 Msg=Failed to claim CPU core: 2 00:05:43.005 request: 00:05:43.005 { 00:05:43.005 "method": "framework_enable_cpumask_locks", 00:05:43.005 "params": {} 00:05:43.005 } 00:05:43.005 Got JSON-RPC error response 00:05:43.005 GoRPCClient: error on JSON-RPC call 00:05:43.005 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:43.005 11:16:24 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:05:43.005 11:16:24 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@653 -- # es=1 00:05:43.005 11:16:24 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:05:43.005 11:16:24 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:05:43.005 11:16:24 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:05:43.005 11:16:24 event.cpu_locks.locking_overlapped_coremask_via_rpc -- event/cpu_locks.sh@158 -- # waitforlisten 61384 /var/tmp/spdk.sock 00:05:43.005 11:16:24 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@831 -- # '[' -z 61384 ']' 00:05:43.005 11:16:24 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:43.005 11:16:24 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@836 -- # local max_retries=100 00:05:43.005 11:16:24 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:43.005 11:16:24 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@840 -- # xtrace_disable 00:05:43.005 11:16:24 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@10 -- # set +x 00:05:43.005 11:16:24 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:05:43.005 11:16:24 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@864 -- # return 0 00:05:43.005 11:16:24 event.cpu_locks.locking_overlapped_coremask_via_rpc -- event/cpu_locks.sh@159 -- # waitforlisten 61414 /var/tmp/spdk2.sock 00:05:43.005 11:16:24 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@831 -- # '[' -z 61414 ']' 00:05:43.005 11:16:24 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:43.005 11:16:24 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@836 -- # local max_retries=100 00:05:43.005 11:16:24 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:43.005 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:43.005 11:16:24 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@840 -- # xtrace_disable 00:05:43.005 11:16:24 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@10 -- # set +x 00:05:43.262 11:16:24 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:05:43.262 11:16:24 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@864 -- # return 0 00:05:43.262 11:16:24 event.cpu_locks.locking_overlapped_coremask_via_rpc -- event/cpu_locks.sh@161 -- # check_remaining_locks 00:05:43.262 11:16:24 event.cpu_locks.locking_overlapped_coremask_via_rpc -- event/cpu_locks.sh@36 -- # locks=(/var/tmp/spdk_cpu_lock_*) 00:05:43.262 11:16:24 event.cpu_locks.locking_overlapped_coremask_via_rpc -- event/cpu_locks.sh@37 -- # locks_expected=(/var/tmp/spdk_cpu_lock_{000..002}) 00:05:43.262 11:16:24 event.cpu_locks.locking_overlapped_coremask_via_rpc -- event/cpu_locks.sh@38 -- # [[ /var/tmp/spdk_cpu_lock_000 /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 == \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\0\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\1\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\2 ]] 00:05:43.262 00:05:43.262 real 0m2.828s 00:05:43.262 user 0m1.533s 00:05:43.262 sys 0m0.226s 00:05:43.262 ************************************ 00:05:43.262 END TEST locking_overlapped_coremask_via_rpc 00:05:43.262 ************************************ 00:05:43.262 11:16:24 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@1126 -- # xtrace_disable 00:05:43.262 11:16:24 event.cpu_locks.locking_overlapped_coremask_via_rpc -- common/autotest_common.sh@10 -- # set +x 00:05:43.519 11:16:24 event.cpu_locks -- event/cpu_locks.sh@174 -- # cleanup 00:05:43.519 11:16:24 event.cpu_locks -- event/cpu_locks.sh@15 -- # [[ -z 61384 ]] 00:05:43.519 11:16:24 event.cpu_locks -- event/cpu_locks.sh@15 -- # killprocess 61384 00:05:43.519 11:16:24 event.cpu_locks -- common/autotest_common.sh@950 -- # '[' -z 61384 ']' 00:05:43.519 11:16:24 event.cpu_locks -- common/autotest_common.sh@954 -- # kill -0 61384 00:05:43.519 11:16:24 event.cpu_locks -- common/autotest_common.sh@955 -- # uname 00:05:43.519 11:16:24 event.cpu_locks -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:05:43.519 11:16:24 event.cpu_locks -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 61384 00:05:43.519 killing process with pid 61384 00:05:43.519 11:16:25 event.cpu_locks -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:05:43.519 11:16:25 event.cpu_locks -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:05:43.519 11:16:25 event.cpu_locks -- common/autotest_common.sh@968 -- # echo 'killing process with pid 61384' 00:05:43.519 11:16:25 event.cpu_locks -- common/autotest_common.sh@969 -- # kill 61384 00:05:43.519 11:16:25 event.cpu_locks -- common/autotest_common.sh@974 -- # wait 61384 00:05:44.088 11:16:25 event.cpu_locks -- event/cpu_locks.sh@16 -- # [[ -z 61414 ]] 00:05:44.088 11:16:25 event.cpu_locks -- event/cpu_locks.sh@16 -- # killprocess 61414 00:05:44.088 11:16:25 event.cpu_locks -- common/autotest_common.sh@950 -- # '[' -z 61414 ']' 00:05:44.088 11:16:25 event.cpu_locks -- common/autotest_common.sh@954 -- # kill -0 61414 00:05:44.088 11:16:25 event.cpu_locks -- common/autotest_common.sh@955 -- # uname 00:05:44.088 11:16:25 event.cpu_locks -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:05:44.088 11:16:25 event.cpu_locks -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 61414 00:05:44.088 killing process with pid 61414 00:05:44.088 11:16:25 event.cpu_locks -- common/autotest_common.sh@956 -- # process_name=reactor_2 00:05:44.088 11:16:25 event.cpu_locks -- common/autotest_common.sh@960 -- # '[' reactor_2 = sudo ']' 00:05:44.088 11:16:25 event.cpu_locks -- common/autotest_common.sh@968 -- # echo 'killing process with pid 61414' 00:05:44.088 11:16:25 event.cpu_locks -- common/autotest_common.sh@969 -- # kill 61414 00:05:44.088 11:16:25 event.cpu_locks -- common/autotest_common.sh@974 -- # wait 61414 00:05:44.655 11:16:26 event.cpu_locks -- event/cpu_locks.sh@18 -- # rm -f 00:05:44.655 11:16:26 event.cpu_locks -- event/cpu_locks.sh@1 -- # cleanup 00:05:44.655 11:16:26 event.cpu_locks -- event/cpu_locks.sh@15 -- # [[ -z 61384 ]] 00:05:44.655 11:16:26 event.cpu_locks -- event/cpu_locks.sh@15 -- # killprocess 61384 00:05:44.655 11:16:26 event.cpu_locks -- common/autotest_common.sh@950 -- # '[' -z 61384 ']' 00:05:44.655 11:16:26 event.cpu_locks -- common/autotest_common.sh@954 -- # kill -0 61384 00:05:44.655 /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh: line 954: kill: (61384) - No such process 00:05:44.655 Process with pid 61384 is not found 00:05:44.655 Process with pid 61414 is not found 00:05:44.655 11:16:26 event.cpu_locks -- common/autotest_common.sh@977 -- # echo 'Process with pid 61384 is not found' 00:05:44.655 11:16:26 event.cpu_locks -- event/cpu_locks.sh@16 -- # [[ -z 61414 ]] 00:05:44.655 11:16:26 event.cpu_locks -- event/cpu_locks.sh@16 -- # killprocess 61414 00:05:44.655 11:16:26 event.cpu_locks -- common/autotest_common.sh@950 -- # '[' -z 61414 ']' 00:05:44.655 11:16:26 event.cpu_locks -- common/autotest_common.sh@954 -- # kill -0 61414 00:05:44.655 /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh: line 954: kill: (61414) - No such process 00:05:44.655 11:16:26 event.cpu_locks -- common/autotest_common.sh@977 -- # echo 'Process with pid 61414 is not found' 00:05:44.655 11:16:26 event.cpu_locks -- event/cpu_locks.sh@18 -- # rm -f 00:05:44.655 00:05:44.655 real 0m24.106s 00:05:44.655 user 0m41.190s 00:05:44.655 sys 0m6.936s 00:05:44.655 11:16:26 event.cpu_locks -- common/autotest_common.sh@1126 -- # xtrace_disable 00:05:44.655 11:16:26 event.cpu_locks -- common/autotest_common.sh@10 -- # set +x 00:05:44.655 ************************************ 00:05:44.655 END TEST cpu_locks 00:05:44.655 ************************************ 00:05:44.655 ************************************ 00:05:44.655 END TEST event 00:05:44.655 ************************************ 00:05:44.655 00:05:44.655 real 0m55.026s 00:05:44.655 user 1m45.592s 00:05:44.655 sys 0m11.376s 00:05:44.655 11:16:26 event -- common/autotest_common.sh@1126 -- # xtrace_disable 00:05:44.655 11:16:26 event -- common/autotest_common.sh@10 -- # set +x 00:05:44.655 11:16:26 -- spdk/autotest.sh@169 -- # run_test thread /home/vagrant/spdk_repo/spdk/test/thread/thread.sh 00:05:44.655 11:16:26 -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:05:44.655 11:16:26 -- common/autotest_common.sh@1107 -- # xtrace_disable 00:05:44.655 11:16:26 -- common/autotest_common.sh@10 -- # set +x 00:05:44.655 ************************************ 00:05:44.655 START TEST thread 00:05:44.655 ************************************ 00:05:44.655 11:16:26 thread -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/thread/thread.sh 00:05:44.655 * Looking for test storage... 00:05:44.655 * Found test storage at /home/vagrant/spdk_repo/spdk/test/thread 00:05:44.655 11:16:26 thread -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:05:44.655 11:16:26 thread -- common/autotest_common.sh@1681 -- # lcov --version 00:05:44.655 11:16:26 thread -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:05:44.915 11:16:26 thread -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:05:44.915 11:16:26 thread -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:05:44.915 11:16:26 thread -- scripts/common.sh@333 -- # local ver1 ver1_l 00:05:44.915 11:16:26 thread -- scripts/common.sh@334 -- # local ver2 ver2_l 00:05:44.915 11:16:26 thread -- scripts/common.sh@336 -- # IFS=.-: 00:05:44.915 11:16:26 thread -- scripts/common.sh@336 -- # read -ra ver1 00:05:44.915 11:16:26 thread -- scripts/common.sh@337 -- # IFS=.-: 00:05:44.915 11:16:26 thread -- scripts/common.sh@337 -- # read -ra ver2 00:05:44.915 11:16:26 thread -- scripts/common.sh@338 -- # local 'op=<' 00:05:44.915 11:16:26 thread -- scripts/common.sh@340 -- # ver1_l=2 00:05:44.915 11:16:26 thread -- scripts/common.sh@341 -- # ver2_l=1 00:05:44.915 11:16:26 thread -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:05:44.915 11:16:26 thread -- scripts/common.sh@344 -- # case "$op" in 00:05:44.915 11:16:26 thread -- scripts/common.sh@345 -- # : 1 00:05:44.915 11:16:26 thread -- scripts/common.sh@364 -- # (( v = 0 )) 00:05:44.915 11:16:26 thread -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:44.915 11:16:26 thread -- scripts/common.sh@365 -- # decimal 1 00:05:44.915 11:16:26 thread -- scripts/common.sh@353 -- # local d=1 00:05:44.915 11:16:26 thread -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:44.915 11:16:26 thread -- scripts/common.sh@355 -- # echo 1 00:05:44.915 11:16:26 thread -- scripts/common.sh@365 -- # ver1[v]=1 00:05:44.915 11:16:26 thread -- scripts/common.sh@366 -- # decimal 2 00:05:44.915 11:16:26 thread -- scripts/common.sh@353 -- # local d=2 00:05:44.915 11:16:26 thread -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:44.915 11:16:26 thread -- scripts/common.sh@355 -- # echo 2 00:05:44.915 11:16:26 thread -- scripts/common.sh@366 -- # ver2[v]=2 00:05:44.915 11:16:26 thread -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:05:44.915 11:16:26 thread -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:05:44.915 11:16:26 thread -- scripts/common.sh@368 -- # return 0 00:05:44.915 11:16:26 thread -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:44.915 11:16:26 thread -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:05:44.915 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:44.915 --rc genhtml_branch_coverage=1 00:05:44.915 --rc genhtml_function_coverage=1 00:05:44.915 --rc genhtml_legend=1 00:05:44.915 --rc geninfo_all_blocks=1 00:05:44.915 --rc geninfo_unexecuted_blocks=1 00:05:44.915 00:05:44.915 ' 00:05:44.915 11:16:26 thread -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:05:44.915 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:44.915 --rc genhtml_branch_coverage=1 00:05:44.915 --rc genhtml_function_coverage=1 00:05:44.915 --rc genhtml_legend=1 00:05:44.915 --rc geninfo_all_blocks=1 00:05:44.915 --rc geninfo_unexecuted_blocks=1 00:05:44.915 00:05:44.915 ' 00:05:44.915 11:16:26 thread -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:05:44.915 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:44.915 --rc genhtml_branch_coverage=1 00:05:44.915 --rc genhtml_function_coverage=1 00:05:44.915 --rc genhtml_legend=1 00:05:44.915 --rc geninfo_all_blocks=1 00:05:44.915 --rc geninfo_unexecuted_blocks=1 00:05:44.915 00:05:44.915 ' 00:05:44.915 11:16:26 thread -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:05:44.915 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:44.915 --rc genhtml_branch_coverage=1 00:05:44.915 --rc genhtml_function_coverage=1 00:05:44.915 --rc genhtml_legend=1 00:05:44.915 --rc geninfo_all_blocks=1 00:05:44.915 --rc geninfo_unexecuted_blocks=1 00:05:44.915 00:05:44.915 ' 00:05:44.915 11:16:26 thread -- thread/thread.sh@11 -- # run_test thread_poller_perf /home/vagrant/spdk_repo/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 1 -t 1 00:05:44.915 11:16:26 thread -- common/autotest_common.sh@1101 -- # '[' 8 -le 1 ']' 00:05:44.915 11:16:26 thread -- common/autotest_common.sh@1107 -- # xtrace_disable 00:05:44.915 11:16:26 thread -- common/autotest_common.sh@10 -- # set +x 00:05:44.915 ************************************ 00:05:44.915 START TEST thread_poller_perf 00:05:44.915 ************************************ 00:05:44.915 11:16:26 thread.thread_poller_perf -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 1 -t 1 00:05:44.915 [2024-10-07 11:16:26.447544] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:05:44.915 [2024-10-07 11:16:26.447838] [ DPDK EAL parameters: poller_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid61574 ] 00:05:44.915 [2024-10-07 11:16:26.587427] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:45.173 [2024-10-07 11:16:26.737177] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:05:45.173 Running 1000 pollers for 1 seconds with 1 microseconds period. 00:05:46.547 [2024-10-07T11:16:28.258Z] ====================================== 00:05:46.547 [2024-10-07T11:16:28.258Z] busy:2212806866 (cyc) 00:05:46.547 [2024-10-07T11:16:28.258Z] total_run_count: 316000 00:05:46.547 [2024-10-07T11:16:28.258Z] tsc_hz: 2200000000 (cyc) 00:05:46.547 [2024-10-07T11:16:28.258Z] ====================================== 00:05:46.547 [2024-10-07T11:16:28.258Z] poller_cost: 7002 (cyc), 3182 (nsec) 00:05:46.547 00:05:46.547 ************************************ 00:05:46.547 END TEST thread_poller_perf 00:05:46.547 ************************************ 00:05:46.547 real 0m1.453s 00:05:46.547 user 0m1.273s 00:05:46.547 sys 0m0.071s 00:05:46.547 11:16:27 thread.thread_poller_perf -- common/autotest_common.sh@1126 -- # xtrace_disable 00:05:46.547 11:16:27 thread.thread_poller_perf -- common/autotest_common.sh@10 -- # set +x 00:05:46.547 11:16:27 thread -- thread/thread.sh@12 -- # run_test thread_poller_perf /home/vagrant/spdk_repo/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 0 -t 1 00:05:46.547 11:16:27 thread -- common/autotest_common.sh@1101 -- # '[' 8 -le 1 ']' 00:05:46.547 11:16:27 thread -- common/autotest_common.sh@1107 -- # xtrace_disable 00:05:46.547 11:16:27 thread -- common/autotest_common.sh@10 -- # set +x 00:05:46.547 ************************************ 00:05:46.547 START TEST thread_poller_perf 00:05:46.547 ************************************ 00:05:46.547 11:16:27 thread.thread_poller_perf -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 0 -t 1 00:05:46.547 [2024-10-07 11:16:27.954375] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:05:46.547 [2024-10-07 11:16:27.954817] [ DPDK EAL parameters: poller_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid61610 ] 00:05:46.547 [2024-10-07 11:16:28.095189] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:46.806 Running 1000 pollers for 1 seconds with 0 microseconds period. 00:05:46.806 [2024-10-07 11:16:28.263347] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:05:47.742 [2024-10-07T11:16:29.453Z] ====================================== 00:05:47.742 [2024-10-07T11:16:29.453Z] busy:2202875482 (cyc) 00:05:47.742 [2024-10-07T11:16:29.453Z] total_run_count: 3578000 00:05:47.742 [2024-10-07T11:16:29.453Z] tsc_hz: 2200000000 (cyc) 00:05:47.742 [2024-10-07T11:16:29.453Z] ====================================== 00:05:47.742 [2024-10-07T11:16:29.453Z] poller_cost: 615 (cyc), 279 (nsec) 00:05:47.742 ************************************ 00:05:47.742 END TEST thread_poller_perf 00:05:47.742 ************************************ 00:05:47.742 00:05:47.742 real 0m1.419s 00:05:47.742 user 0m1.234s 00:05:47.742 sys 0m0.074s 00:05:47.742 11:16:29 thread.thread_poller_perf -- common/autotest_common.sh@1126 -- # xtrace_disable 00:05:47.742 11:16:29 thread.thread_poller_perf -- common/autotest_common.sh@10 -- # set +x 00:05:47.742 11:16:29 thread -- thread/thread.sh@17 -- # [[ y != \y ]] 00:05:47.742 ************************************ 00:05:47.742 END TEST thread 00:05:47.742 ************************************ 00:05:47.742 00:05:47.742 real 0m3.172s 00:05:47.742 user 0m2.655s 00:05:47.742 sys 0m0.291s 00:05:47.742 11:16:29 thread -- common/autotest_common.sh@1126 -- # xtrace_disable 00:05:47.742 11:16:29 thread -- common/autotest_common.sh@10 -- # set +x 00:05:47.742 11:16:29 -- spdk/autotest.sh@171 -- # [[ 0 -eq 1 ]] 00:05:47.742 11:16:29 -- spdk/autotest.sh@176 -- # run_test app_cmdline /home/vagrant/spdk_repo/spdk/test/app/cmdline.sh 00:05:47.742 11:16:29 -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:05:47.742 11:16:29 -- common/autotest_common.sh@1107 -- # xtrace_disable 00:05:47.742 11:16:29 -- common/autotest_common.sh@10 -- # set +x 00:05:47.742 ************************************ 00:05:47.742 START TEST app_cmdline 00:05:47.742 ************************************ 00:05:47.742 11:16:29 app_cmdline -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/app/cmdline.sh 00:05:48.001 * Looking for test storage... 00:05:48.001 * Found test storage at /home/vagrant/spdk_repo/spdk/test/app 00:05:48.001 11:16:29 app_cmdline -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:05:48.001 11:16:29 app_cmdline -- common/autotest_common.sh@1681 -- # lcov --version 00:05:48.001 11:16:29 app_cmdline -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:05:48.001 11:16:29 app_cmdline -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:05:48.001 11:16:29 app_cmdline -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:05:48.001 11:16:29 app_cmdline -- scripts/common.sh@333 -- # local ver1 ver1_l 00:05:48.001 11:16:29 app_cmdline -- scripts/common.sh@334 -- # local ver2 ver2_l 00:05:48.001 11:16:29 app_cmdline -- scripts/common.sh@336 -- # IFS=.-: 00:05:48.001 11:16:29 app_cmdline -- scripts/common.sh@336 -- # read -ra ver1 00:05:48.001 11:16:29 app_cmdline -- scripts/common.sh@337 -- # IFS=.-: 00:05:48.001 11:16:29 app_cmdline -- scripts/common.sh@337 -- # read -ra ver2 00:05:48.001 11:16:29 app_cmdline -- scripts/common.sh@338 -- # local 'op=<' 00:05:48.001 11:16:29 app_cmdline -- scripts/common.sh@340 -- # ver1_l=2 00:05:48.001 11:16:29 app_cmdline -- scripts/common.sh@341 -- # ver2_l=1 00:05:48.001 11:16:29 app_cmdline -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:05:48.001 11:16:29 app_cmdline -- scripts/common.sh@344 -- # case "$op" in 00:05:48.001 11:16:29 app_cmdline -- scripts/common.sh@345 -- # : 1 00:05:48.001 11:16:29 app_cmdline -- scripts/common.sh@364 -- # (( v = 0 )) 00:05:48.001 11:16:29 app_cmdline -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:48.001 11:16:29 app_cmdline -- scripts/common.sh@365 -- # decimal 1 00:05:48.001 11:16:29 app_cmdline -- scripts/common.sh@353 -- # local d=1 00:05:48.001 11:16:29 app_cmdline -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:48.001 11:16:29 app_cmdline -- scripts/common.sh@355 -- # echo 1 00:05:48.001 11:16:29 app_cmdline -- scripts/common.sh@365 -- # ver1[v]=1 00:05:48.001 11:16:29 app_cmdline -- scripts/common.sh@366 -- # decimal 2 00:05:48.001 11:16:29 app_cmdline -- scripts/common.sh@353 -- # local d=2 00:05:48.001 11:16:29 app_cmdline -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:48.001 11:16:29 app_cmdline -- scripts/common.sh@355 -- # echo 2 00:05:48.001 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:48.001 11:16:29 app_cmdline -- scripts/common.sh@366 -- # ver2[v]=2 00:05:48.001 11:16:29 app_cmdline -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:05:48.001 11:16:29 app_cmdline -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:05:48.001 11:16:29 app_cmdline -- scripts/common.sh@368 -- # return 0 00:05:48.001 11:16:29 app_cmdline -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:48.001 11:16:29 app_cmdline -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:05:48.001 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:48.001 --rc genhtml_branch_coverage=1 00:05:48.001 --rc genhtml_function_coverage=1 00:05:48.001 --rc genhtml_legend=1 00:05:48.001 --rc geninfo_all_blocks=1 00:05:48.001 --rc geninfo_unexecuted_blocks=1 00:05:48.001 00:05:48.001 ' 00:05:48.001 11:16:29 app_cmdline -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:05:48.001 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:48.001 --rc genhtml_branch_coverage=1 00:05:48.001 --rc genhtml_function_coverage=1 00:05:48.001 --rc genhtml_legend=1 00:05:48.001 --rc geninfo_all_blocks=1 00:05:48.001 --rc geninfo_unexecuted_blocks=1 00:05:48.001 00:05:48.001 ' 00:05:48.001 11:16:29 app_cmdline -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:05:48.001 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:48.001 --rc genhtml_branch_coverage=1 00:05:48.001 --rc genhtml_function_coverage=1 00:05:48.001 --rc genhtml_legend=1 00:05:48.001 --rc geninfo_all_blocks=1 00:05:48.001 --rc geninfo_unexecuted_blocks=1 00:05:48.001 00:05:48.001 ' 00:05:48.001 11:16:29 app_cmdline -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:05:48.001 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:48.001 --rc genhtml_branch_coverage=1 00:05:48.001 --rc genhtml_function_coverage=1 00:05:48.001 --rc genhtml_legend=1 00:05:48.001 --rc geninfo_all_blocks=1 00:05:48.001 --rc geninfo_unexecuted_blocks=1 00:05:48.001 00:05:48.001 ' 00:05:48.001 11:16:29 app_cmdline -- app/cmdline.sh@14 -- # trap 'killprocess $spdk_tgt_pid' EXIT 00:05:48.001 11:16:29 app_cmdline -- app/cmdline.sh@17 -- # spdk_tgt_pid=61698 00:05:48.001 11:16:29 app_cmdline -- app/cmdline.sh@18 -- # waitforlisten 61698 00:05:48.001 11:16:29 app_cmdline -- common/autotest_common.sh@831 -- # '[' -z 61698 ']' 00:05:48.001 11:16:29 app_cmdline -- app/cmdline.sh@16 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_tgt --rpcs-allowed spdk_get_version,rpc_get_methods 00:05:48.001 11:16:29 app_cmdline -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:48.001 11:16:29 app_cmdline -- common/autotest_common.sh@836 -- # local max_retries=100 00:05:48.001 11:16:29 app_cmdline -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:48.001 11:16:29 app_cmdline -- common/autotest_common.sh@840 -- # xtrace_disable 00:05:48.001 11:16:29 app_cmdline -- common/autotest_common.sh@10 -- # set +x 00:05:48.001 [2024-10-07 11:16:29.689554] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:05:48.001 [2024-10-07 11:16:29.689862] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid61698 ] 00:05:48.261 [2024-10-07 11:16:29.825330] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:48.261 [2024-10-07 11:16:29.957542] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:05:49.199 11:16:30 app_cmdline -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:05:49.199 11:16:30 app_cmdline -- common/autotest_common.sh@864 -- # return 0 00:05:49.199 11:16:30 app_cmdline -- app/cmdline.sh@20 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py spdk_get_version 00:05:49.459 { 00:05:49.459 "fields": { 00:05:49.459 "commit": "d16db39ee", 00:05:49.459 "major": 25, 00:05:49.459 "minor": 1, 00:05:49.459 "patch": 0, 00:05:49.459 "suffix": "-pre" 00:05:49.459 }, 00:05:49.459 "version": "SPDK v25.01-pre git sha1 d16db39ee" 00:05:49.459 } 00:05:49.459 11:16:31 app_cmdline -- app/cmdline.sh@22 -- # expected_methods=() 00:05:49.459 11:16:31 app_cmdline -- app/cmdline.sh@23 -- # expected_methods+=("rpc_get_methods") 00:05:49.459 11:16:31 app_cmdline -- app/cmdline.sh@24 -- # expected_methods+=("spdk_get_version") 00:05:49.459 11:16:31 app_cmdline -- app/cmdline.sh@26 -- # methods=($(rpc_cmd rpc_get_methods | jq -r ".[]" | sort)) 00:05:49.717 11:16:31 app_cmdline -- app/cmdline.sh@26 -- # rpc_cmd rpc_get_methods 00:05:49.717 11:16:31 app_cmdline -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:49.717 11:16:31 app_cmdline -- app/cmdline.sh@26 -- # sort 00:05:49.717 11:16:31 app_cmdline -- common/autotest_common.sh@10 -- # set +x 00:05:49.717 11:16:31 app_cmdline -- app/cmdline.sh@26 -- # jq -r '.[]' 00:05:49.717 11:16:31 app_cmdline -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:49.717 11:16:31 app_cmdline -- app/cmdline.sh@27 -- # (( 2 == 2 )) 00:05:49.718 11:16:31 app_cmdline -- app/cmdline.sh@28 -- # [[ rpc_get_methods spdk_get_version == \r\p\c\_\g\e\t\_\m\e\t\h\o\d\s\ \s\p\d\k\_\g\e\t\_\v\e\r\s\i\o\n ]] 00:05:49.718 11:16:31 app_cmdline -- app/cmdline.sh@30 -- # NOT /home/vagrant/spdk_repo/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:05:49.718 11:16:31 app_cmdline -- common/autotest_common.sh@650 -- # local es=0 00:05:49.718 11:16:31 app_cmdline -- common/autotest_common.sh@652 -- # valid_exec_arg /home/vagrant/spdk_repo/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:05:49.718 11:16:31 app_cmdline -- common/autotest_common.sh@638 -- # local arg=/home/vagrant/spdk_repo/spdk/scripts/rpc.py 00:05:49.718 11:16:31 app_cmdline -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:49.718 11:16:31 app_cmdline -- common/autotest_common.sh@642 -- # type -t /home/vagrant/spdk_repo/spdk/scripts/rpc.py 00:05:49.718 11:16:31 app_cmdline -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:49.718 11:16:31 app_cmdline -- common/autotest_common.sh@644 -- # type -P /home/vagrant/spdk_repo/spdk/scripts/rpc.py 00:05:49.718 11:16:31 app_cmdline -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:49.718 11:16:31 app_cmdline -- common/autotest_common.sh@644 -- # arg=/home/vagrant/spdk_repo/spdk/scripts/rpc.py 00:05:49.718 11:16:31 app_cmdline -- common/autotest_common.sh@644 -- # [[ -x /home/vagrant/spdk_repo/spdk/scripts/rpc.py ]] 00:05:49.718 11:16:31 app_cmdline -- common/autotest_common.sh@653 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:05:49.976 2024/10/07 11:16:31 error on JSON-RPC call, method: env_dpdk_get_mem_stats, params: map[], err: error received for env_dpdk_get_mem_stats method, err: Code=-32601 Msg=Method not found 00:05:49.976 request: 00:05:49.976 { 00:05:49.976 "method": "env_dpdk_get_mem_stats", 00:05:49.976 "params": {} 00:05:49.976 } 00:05:49.976 Got JSON-RPC error response 00:05:49.976 GoRPCClient: error on JSON-RPC call 00:05:49.976 11:16:31 app_cmdline -- common/autotest_common.sh@653 -- # es=1 00:05:49.976 11:16:31 app_cmdline -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:05:49.976 11:16:31 app_cmdline -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:05:49.976 11:16:31 app_cmdline -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:05:49.976 11:16:31 app_cmdline -- app/cmdline.sh@1 -- # killprocess 61698 00:05:49.976 11:16:31 app_cmdline -- common/autotest_common.sh@950 -- # '[' -z 61698 ']' 00:05:49.976 11:16:31 app_cmdline -- common/autotest_common.sh@954 -- # kill -0 61698 00:05:49.976 11:16:31 app_cmdline -- common/autotest_common.sh@955 -- # uname 00:05:49.976 11:16:31 app_cmdline -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:05:49.976 11:16:31 app_cmdline -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 61698 00:05:49.976 11:16:31 app_cmdline -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:05:49.976 killing process with pid 61698 00:05:49.976 11:16:31 app_cmdline -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:05:49.976 11:16:31 app_cmdline -- common/autotest_common.sh@968 -- # echo 'killing process with pid 61698' 00:05:49.976 11:16:31 app_cmdline -- common/autotest_common.sh@969 -- # kill 61698 00:05:49.977 11:16:31 app_cmdline -- common/autotest_common.sh@974 -- # wait 61698 00:05:50.544 00:05:50.544 real 0m2.636s 00:05:50.544 user 0m3.403s 00:05:50.544 sys 0m0.613s 00:05:50.544 11:16:32 app_cmdline -- common/autotest_common.sh@1126 -- # xtrace_disable 00:05:50.544 ************************************ 00:05:50.544 END TEST app_cmdline 00:05:50.544 ************************************ 00:05:50.544 11:16:32 app_cmdline -- common/autotest_common.sh@10 -- # set +x 00:05:50.544 11:16:32 -- spdk/autotest.sh@177 -- # run_test version /home/vagrant/spdk_repo/spdk/test/app/version.sh 00:05:50.544 11:16:32 -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:05:50.544 11:16:32 -- common/autotest_common.sh@1107 -- # xtrace_disable 00:05:50.544 11:16:32 -- common/autotest_common.sh@10 -- # set +x 00:05:50.544 ************************************ 00:05:50.544 START TEST version 00:05:50.544 ************************************ 00:05:50.544 11:16:32 version -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/app/version.sh 00:05:50.544 * Looking for test storage... 00:05:50.544 * Found test storage at /home/vagrant/spdk_repo/spdk/test/app 00:05:50.544 11:16:32 version -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:05:50.544 11:16:32 version -- common/autotest_common.sh@1681 -- # lcov --version 00:05:50.544 11:16:32 version -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:05:50.803 11:16:32 version -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:05:50.803 11:16:32 version -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:05:50.803 11:16:32 version -- scripts/common.sh@333 -- # local ver1 ver1_l 00:05:50.803 11:16:32 version -- scripts/common.sh@334 -- # local ver2 ver2_l 00:05:50.803 11:16:32 version -- scripts/common.sh@336 -- # IFS=.-: 00:05:50.803 11:16:32 version -- scripts/common.sh@336 -- # read -ra ver1 00:05:50.803 11:16:32 version -- scripts/common.sh@337 -- # IFS=.-: 00:05:50.803 11:16:32 version -- scripts/common.sh@337 -- # read -ra ver2 00:05:50.803 11:16:32 version -- scripts/common.sh@338 -- # local 'op=<' 00:05:50.803 11:16:32 version -- scripts/common.sh@340 -- # ver1_l=2 00:05:50.803 11:16:32 version -- scripts/common.sh@341 -- # ver2_l=1 00:05:50.803 11:16:32 version -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:05:50.803 11:16:32 version -- scripts/common.sh@344 -- # case "$op" in 00:05:50.803 11:16:32 version -- scripts/common.sh@345 -- # : 1 00:05:50.803 11:16:32 version -- scripts/common.sh@364 -- # (( v = 0 )) 00:05:50.803 11:16:32 version -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:50.803 11:16:32 version -- scripts/common.sh@365 -- # decimal 1 00:05:50.803 11:16:32 version -- scripts/common.sh@353 -- # local d=1 00:05:50.803 11:16:32 version -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:50.803 11:16:32 version -- scripts/common.sh@355 -- # echo 1 00:05:50.803 11:16:32 version -- scripts/common.sh@365 -- # ver1[v]=1 00:05:50.803 11:16:32 version -- scripts/common.sh@366 -- # decimal 2 00:05:50.803 11:16:32 version -- scripts/common.sh@353 -- # local d=2 00:05:50.803 11:16:32 version -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:50.803 11:16:32 version -- scripts/common.sh@355 -- # echo 2 00:05:50.803 11:16:32 version -- scripts/common.sh@366 -- # ver2[v]=2 00:05:50.803 11:16:32 version -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:05:50.803 11:16:32 version -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:05:50.803 11:16:32 version -- scripts/common.sh@368 -- # return 0 00:05:50.803 11:16:32 version -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:50.803 11:16:32 version -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:05:50.803 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:50.803 --rc genhtml_branch_coverage=1 00:05:50.803 --rc genhtml_function_coverage=1 00:05:50.803 --rc genhtml_legend=1 00:05:50.803 --rc geninfo_all_blocks=1 00:05:50.803 --rc geninfo_unexecuted_blocks=1 00:05:50.803 00:05:50.803 ' 00:05:50.803 11:16:32 version -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:05:50.803 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:50.803 --rc genhtml_branch_coverage=1 00:05:50.803 --rc genhtml_function_coverage=1 00:05:50.803 --rc genhtml_legend=1 00:05:50.803 --rc geninfo_all_blocks=1 00:05:50.803 --rc geninfo_unexecuted_blocks=1 00:05:50.803 00:05:50.803 ' 00:05:50.803 11:16:32 version -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:05:50.803 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:50.803 --rc genhtml_branch_coverage=1 00:05:50.803 --rc genhtml_function_coverage=1 00:05:50.803 --rc genhtml_legend=1 00:05:50.803 --rc geninfo_all_blocks=1 00:05:50.803 --rc geninfo_unexecuted_blocks=1 00:05:50.803 00:05:50.803 ' 00:05:50.803 11:16:32 version -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:05:50.803 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:50.803 --rc genhtml_branch_coverage=1 00:05:50.803 --rc genhtml_function_coverage=1 00:05:50.803 --rc genhtml_legend=1 00:05:50.803 --rc geninfo_all_blocks=1 00:05:50.803 --rc geninfo_unexecuted_blocks=1 00:05:50.803 00:05:50.803 ' 00:05:50.803 11:16:32 version -- app/version.sh@17 -- # get_header_version major 00:05:50.803 11:16:32 version -- app/version.sh@14 -- # cut -f2 00:05:50.803 11:16:32 version -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_MAJOR[[:space:]]+' /home/vagrant/spdk_repo/spdk/include/spdk/version.h 00:05:50.803 11:16:32 version -- app/version.sh@14 -- # tr -d '"' 00:05:50.803 11:16:32 version -- app/version.sh@17 -- # major=25 00:05:50.803 11:16:32 version -- app/version.sh@18 -- # get_header_version minor 00:05:50.803 11:16:32 version -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_MINOR[[:space:]]+' /home/vagrant/spdk_repo/spdk/include/spdk/version.h 00:05:50.803 11:16:32 version -- app/version.sh@14 -- # cut -f2 00:05:50.803 11:16:32 version -- app/version.sh@14 -- # tr -d '"' 00:05:50.803 11:16:32 version -- app/version.sh@18 -- # minor=1 00:05:50.803 11:16:32 version -- app/version.sh@19 -- # get_header_version patch 00:05:50.803 11:16:32 version -- app/version.sh@14 -- # cut -f2 00:05:50.803 11:16:32 version -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_PATCH[[:space:]]+' /home/vagrant/spdk_repo/spdk/include/spdk/version.h 00:05:50.803 11:16:32 version -- app/version.sh@14 -- # tr -d '"' 00:05:50.803 11:16:32 version -- app/version.sh@19 -- # patch=0 00:05:50.803 11:16:32 version -- app/version.sh@20 -- # get_header_version suffix 00:05:50.803 11:16:32 version -- app/version.sh@14 -- # cut -f2 00:05:50.803 11:16:32 version -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_SUFFIX[[:space:]]+' /home/vagrant/spdk_repo/spdk/include/spdk/version.h 00:05:50.803 11:16:32 version -- app/version.sh@14 -- # tr -d '"' 00:05:50.803 11:16:32 version -- app/version.sh@20 -- # suffix=-pre 00:05:50.803 11:16:32 version -- app/version.sh@22 -- # version=25.1 00:05:50.803 11:16:32 version -- app/version.sh@25 -- # (( patch != 0 )) 00:05:50.803 11:16:32 version -- app/version.sh@28 -- # version=25.1rc0 00:05:50.803 11:16:32 version -- app/version.sh@30 -- # PYTHONPATH=:/home/vagrant/spdk_repo/spdk/python:/home/vagrant/spdk_repo/spdk/test/rpc_plugins:/home/vagrant/spdk_repo/spdk/python:/home/vagrant/spdk_repo/spdk/test/rpc_plugins:/home/vagrant/spdk_repo/spdk/python 00:05:50.804 11:16:32 version -- app/version.sh@30 -- # python3 -c 'import spdk; print(spdk.__version__)' 00:05:50.804 11:16:32 version -- app/version.sh@30 -- # py_version=25.1rc0 00:05:50.804 11:16:32 version -- app/version.sh@31 -- # [[ 25.1rc0 == \2\5\.\1\r\c\0 ]] 00:05:50.804 00:05:50.804 real 0m0.270s 00:05:50.804 user 0m0.173s 00:05:50.804 sys 0m0.138s 00:05:50.804 11:16:32 version -- common/autotest_common.sh@1126 -- # xtrace_disable 00:05:50.804 11:16:32 version -- common/autotest_common.sh@10 -- # set +x 00:05:50.804 ************************************ 00:05:50.804 END TEST version 00:05:50.804 ************************************ 00:05:50.804 11:16:32 -- spdk/autotest.sh@179 -- # '[' 0 -eq 1 ']' 00:05:50.804 11:16:32 -- spdk/autotest.sh@188 -- # [[ 0 -eq 1 ]] 00:05:50.804 11:16:32 -- spdk/autotest.sh@194 -- # uname -s 00:05:50.804 11:16:32 -- spdk/autotest.sh@194 -- # [[ Linux == Linux ]] 00:05:50.804 11:16:32 -- spdk/autotest.sh@195 -- # [[ 0 -eq 1 ]] 00:05:50.804 11:16:32 -- spdk/autotest.sh@195 -- # [[ 0 -eq 1 ]] 00:05:50.804 11:16:32 -- spdk/autotest.sh@207 -- # '[' 0 -eq 1 ']' 00:05:50.804 11:16:32 -- spdk/autotest.sh@252 -- # '[' 0 -eq 1 ']' 00:05:50.804 11:16:32 -- spdk/autotest.sh@256 -- # timing_exit lib 00:05:50.804 11:16:32 -- common/autotest_common.sh@730 -- # xtrace_disable 00:05:50.804 11:16:32 -- common/autotest_common.sh@10 -- # set +x 00:05:50.804 11:16:32 -- spdk/autotest.sh@258 -- # '[' 0 -eq 1 ']' 00:05:50.804 11:16:32 -- spdk/autotest.sh@263 -- # '[' 0 -eq 1 ']' 00:05:50.804 11:16:32 -- spdk/autotest.sh@272 -- # '[' 1 -eq 1 ']' 00:05:50.804 11:16:32 -- spdk/autotest.sh@273 -- # export NET_TYPE 00:05:50.804 11:16:32 -- spdk/autotest.sh@276 -- # '[' tcp = rdma ']' 00:05:50.804 11:16:32 -- spdk/autotest.sh@279 -- # '[' tcp = tcp ']' 00:05:50.804 11:16:32 -- spdk/autotest.sh@280 -- # run_test nvmf_tcp /home/vagrant/spdk_repo/spdk/test/nvmf/nvmf.sh --transport=tcp 00:05:50.804 11:16:32 -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:05:50.804 11:16:32 -- common/autotest_common.sh@1107 -- # xtrace_disable 00:05:50.804 11:16:32 -- common/autotest_common.sh@10 -- # set +x 00:05:50.804 ************************************ 00:05:50.804 START TEST nvmf_tcp 00:05:50.804 ************************************ 00:05:50.804 11:16:32 nvmf_tcp -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/nvmf/nvmf.sh --transport=tcp 00:05:51.063 * Looking for test storage... 00:05:51.063 * Found test storage at /home/vagrant/spdk_repo/spdk/test/nvmf 00:05:51.063 11:16:32 nvmf_tcp -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:05:51.063 11:16:32 nvmf_tcp -- common/autotest_common.sh@1681 -- # lcov --version 00:05:51.063 11:16:32 nvmf_tcp -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:05:51.063 11:16:32 nvmf_tcp -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:05:51.063 11:16:32 nvmf_tcp -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:05:51.063 11:16:32 nvmf_tcp -- scripts/common.sh@333 -- # local ver1 ver1_l 00:05:51.063 11:16:32 nvmf_tcp -- scripts/common.sh@334 -- # local ver2 ver2_l 00:05:51.063 11:16:32 nvmf_tcp -- scripts/common.sh@336 -- # IFS=.-: 00:05:51.063 11:16:32 nvmf_tcp -- scripts/common.sh@336 -- # read -ra ver1 00:05:51.063 11:16:32 nvmf_tcp -- scripts/common.sh@337 -- # IFS=.-: 00:05:51.063 11:16:32 nvmf_tcp -- scripts/common.sh@337 -- # read -ra ver2 00:05:51.063 11:16:32 nvmf_tcp -- scripts/common.sh@338 -- # local 'op=<' 00:05:51.063 11:16:32 nvmf_tcp -- scripts/common.sh@340 -- # ver1_l=2 00:05:51.063 11:16:32 nvmf_tcp -- scripts/common.sh@341 -- # ver2_l=1 00:05:51.063 11:16:32 nvmf_tcp -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:05:51.063 11:16:32 nvmf_tcp -- scripts/common.sh@344 -- # case "$op" in 00:05:51.063 11:16:32 nvmf_tcp -- scripts/common.sh@345 -- # : 1 00:05:51.063 11:16:32 nvmf_tcp -- scripts/common.sh@364 -- # (( v = 0 )) 00:05:51.063 11:16:32 nvmf_tcp -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:51.063 11:16:32 nvmf_tcp -- scripts/common.sh@365 -- # decimal 1 00:05:51.063 11:16:32 nvmf_tcp -- scripts/common.sh@353 -- # local d=1 00:05:51.063 11:16:32 nvmf_tcp -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:51.063 11:16:32 nvmf_tcp -- scripts/common.sh@355 -- # echo 1 00:05:51.063 11:16:32 nvmf_tcp -- scripts/common.sh@365 -- # ver1[v]=1 00:05:51.063 11:16:32 nvmf_tcp -- scripts/common.sh@366 -- # decimal 2 00:05:51.063 11:16:32 nvmf_tcp -- scripts/common.sh@353 -- # local d=2 00:05:51.063 11:16:32 nvmf_tcp -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:51.063 11:16:32 nvmf_tcp -- scripts/common.sh@355 -- # echo 2 00:05:51.063 11:16:32 nvmf_tcp -- scripts/common.sh@366 -- # ver2[v]=2 00:05:51.063 11:16:32 nvmf_tcp -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:05:51.063 11:16:32 nvmf_tcp -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:05:51.063 11:16:32 nvmf_tcp -- scripts/common.sh@368 -- # return 0 00:05:51.063 11:16:32 nvmf_tcp -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:51.063 11:16:32 nvmf_tcp -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:05:51.063 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:51.063 --rc genhtml_branch_coverage=1 00:05:51.063 --rc genhtml_function_coverage=1 00:05:51.063 --rc genhtml_legend=1 00:05:51.063 --rc geninfo_all_blocks=1 00:05:51.063 --rc geninfo_unexecuted_blocks=1 00:05:51.063 00:05:51.063 ' 00:05:51.063 11:16:32 nvmf_tcp -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:05:51.063 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:51.063 --rc genhtml_branch_coverage=1 00:05:51.063 --rc genhtml_function_coverage=1 00:05:51.063 --rc genhtml_legend=1 00:05:51.063 --rc geninfo_all_blocks=1 00:05:51.063 --rc geninfo_unexecuted_blocks=1 00:05:51.063 00:05:51.063 ' 00:05:51.063 11:16:32 nvmf_tcp -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:05:51.063 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:51.063 --rc genhtml_branch_coverage=1 00:05:51.063 --rc genhtml_function_coverage=1 00:05:51.063 --rc genhtml_legend=1 00:05:51.063 --rc geninfo_all_blocks=1 00:05:51.063 --rc geninfo_unexecuted_blocks=1 00:05:51.063 00:05:51.063 ' 00:05:51.063 11:16:32 nvmf_tcp -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:05:51.063 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:51.063 --rc genhtml_branch_coverage=1 00:05:51.063 --rc genhtml_function_coverage=1 00:05:51.063 --rc genhtml_legend=1 00:05:51.063 --rc geninfo_all_blocks=1 00:05:51.063 --rc geninfo_unexecuted_blocks=1 00:05:51.063 00:05:51.063 ' 00:05:51.063 11:16:32 nvmf_tcp -- nvmf/nvmf.sh@10 -- # uname -s 00:05:51.063 11:16:32 nvmf_tcp -- nvmf/nvmf.sh@10 -- # '[' '!' Linux = Linux ']' 00:05:51.063 11:16:32 nvmf_tcp -- nvmf/nvmf.sh@14 -- # run_test nvmf_target_core /home/vagrant/spdk_repo/spdk/test/nvmf/nvmf_target_core.sh --transport=tcp 00:05:51.063 11:16:32 nvmf_tcp -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:05:51.063 11:16:32 nvmf_tcp -- common/autotest_common.sh@1107 -- # xtrace_disable 00:05:51.063 11:16:32 nvmf_tcp -- common/autotest_common.sh@10 -- # set +x 00:05:51.063 ************************************ 00:05:51.063 START TEST nvmf_target_core 00:05:51.063 ************************************ 00:05:51.063 11:16:32 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/nvmf/nvmf_target_core.sh --transport=tcp 00:05:51.322 * Looking for test storage... 00:05:51.322 * Found test storage at /home/vagrant/spdk_repo/spdk/test/nvmf 00:05:51.322 11:16:32 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:05:51.322 11:16:32 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:05:51.322 11:16:32 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1681 -- # lcov --version 00:05:51.322 11:16:32 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:05:51.322 11:16:32 nvmf_tcp.nvmf_target_core -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:05:51.322 11:16:32 nvmf_tcp.nvmf_target_core -- scripts/common.sh@333 -- # local ver1 ver1_l 00:05:51.322 11:16:32 nvmf_tcp.nvmf_target_core -- scripts/common.sh@334 -- # local ver2 ver2_l 00:05:51.322 11:16:32 nvmf_tcp.nvmf_target_core -- scripts/common.sh@336 -- # IFS=.-: 00:05:51.322 11:16:32 nvmf_tcp.nvmf_target_core -- scripts/common.sh@336 -- # read -ra ver1 00:05:51.322 11:16:32 nvmf_tcp.nvmf_target_core -- scripts/common.sh@337 -- # IFS=.-: 00:05:51.322 11:16:32 nvmf_tcp.nvmf_target_core -- scripts/common.sh@337 -- # read -ra ver2 00:05:51.322 11:16:32 nvmf_tcp.nvmf_target_core -- scripts/common.sh@338 -- # local 'op=<' 00:05:51.322 11:16:32 nvmf_tcp.nvmf_target_core -- scripts/common.sh@340 -- # ver1_l=2 00:05:51.322 11:16:32 nvmf_tcp.nvmf_target_core -- scripts/common.sh@341 -- # ver2_l=1 00:05:51.322 11:16:32 nvmf_tcp.nvmf_target_core -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:05:51.322 11:16:32 nvmf_tcp.nvmf_target_core -- scripts/common.sh@344 -- # case "$op" in 00:05:51.322 11:16:32 nvmf_tcp.nvmf_target_core -- scripts/common.sh@345 -- # : 1 00:05:51.322 11:16:32 nvmf_tcp.nvmf_target_core -- scripts/common.sh@364 -- # (( v = 0 )) 00:05:51.322 11:16:32 nvmf_tcp.nvmf_target_core -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:51.322 11:16:32 nvmf_tcp.nvmf_target_core -- scripts/common.sh@365 -- # decimal 1 00:05:51.322 11:16:32 nvmf_tcp.nvmf_target_core -- scripts/common.sh@353 -- # local d=1 00:05:51.322 11:16:32 nvmf_tcp.nvmf_target_core -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:51.322 11:16:32 nvmf_tcp.nvmf_target_core -- scripts/common.sh@355 -- # echo 1 00:05:51.322 11:16:32 nvmf_tcp.nvmf_target_core -- scripts/common.sh@365 -- # ver1[v]=1 00:05:51.322 11:16:32 nvmf_tcp.nvmf_target_core -- scripts/common.sh@366 -- # decimal 2 00:05:51.322 11:16:32 nvmf_tcp.nvmf_target_core -- scripts/common.sh@353 -- # local d=2 00:05:51.323 11:16:32 nvmf_tcp.nvmf_target_core -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:51.323 11:16:32 nvmf_tcp.nvmf_target_core -- scripts/common.sh@355 -- # echo 2 00:05:51.323 11:16:32 nvmf_tcp.nvmf_target_core -- scripts/common.sh@366 -- # ver2[v]=2 00:05:51.323 11:16:32 nvmf_tcp.nvmf_target_core -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:05:51.323 11:16:32 nvmf_tcp.nvmf_target_core -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:05:51.323 11:16:32 nvmf_tcp.nvmf_target_core -- scripts/common.sh@368 -- # return 0 00:05:51.323 11:16:32 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:51.323 11:16:32 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:05:51.323 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:51.323 --rc genhtml_branch_coverage=1 00:05:51.323 --rc genhtml_function_coverage=1 00:05:51.323 --rc genhtml_legend=1 00:05:51.323 --rc geninfo_all_blocks=1 00:05:51.323 --rc geninfo_unexecuted_blocks=1 00:05:51.323 00:05:51.323 ' 00:05:51.323 11:16:32 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:05:51.323 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:51.323 --rc genhtml_branch_coverage=1 00:05:51.323 --rc genhtml_function_coverage=1 00:05:51.323 --rc genhtml_legend=1 00:05:51.323 --rc geninfo_all_blocks=1 00:05:51.323 --rc geninfo_unexecuted_blocks=1 00:05:51.323 00:05:51.323 ' 00:05:51.323 11:16:32 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:05:51.323 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:51.323 --rc genhtml_branch_coverage=1 00:05:51.323 --rc genhtml_function_coverage=1 00:05:51.323 --rc genhtml_legend=1 00:05:51.323 --rc geninfo_all_blocks=1 00:05:51.323 --rc geninfo_unexecuted_blocks=1 00:05:51.323 00:05:51.323 ' 00:05:51.323 11:16:32 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:05:51.323 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:51.323 --rc genhtml_branch_coverage=1 00:05:51.323 --rc genhtml_function_coverage=1 00:05:51.323 --rc genhtml_legend=1 00:05:51.323 --rc geninfo_all_blocks=1 00:05:51.323 --rc geninfo_unexecuted_blocks=1 00:05:51.323 00:05:51.323 ' 00:05:51.323 11:16:32 nvmf_tcp.nvmf_target_core -- nvmf/nvmf_target_core.sh@10 -- # uname -s 00:05:51.323 11:16:32 nvmf_tcp.nvmf_target_core -- nvmf/nvmf_target_core.sh@10 -- # '[' '!' Linux = Linux ']' 00:05:51.323 11:16:32 nvmf_tcp.nvmf_target_core -- nvmf/nvmf_target_core.sh@14 -- # source /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh 00:05:51.323 11:16:32 nvmf_tcp.nvmf_target_core -- nvmf/common.sh@7 -- # uname -s 00:05:51.323 11:16:32 nvmf_tcp.nvmf_target_core -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:05:51.323 11:16:32 nvmf_tcp.nvmf_target_core -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:05:51.323 11:16:32 nvmf_tcp.nvmf_target_core -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:05:51.323 11:16:32 nvmf_tcp.nvmf_target_core -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:05:51.323 11:16:32 nvmf_tcp.nvmf_target_core -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:05:51.323 11:16:32 nvmf_tcp.nvmf_target_core -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:05:51.323 11:16:32 nvmf_tcp.nvmf_target_core -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:05:51.323 11:16:32 nvmf_tcp.nvmf_target_core -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:05:51.323 11:16:32 nvmf_tcp.nvmf_target_core -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:05:51.323 11:16:32 nvmf_tcp.nvmf_target_core -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:05:51.323 11:16:32 nvmf_tcp.nvmf_target_core -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:05:51.323 11:16:32 nvmf_tcp.nvmf_target_core -- nvmf/common.sh@18 -- # NVME_HOSTID=3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:05:51.323 11:16:32 nvmf_tcp.nvmf_target_core -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:05:51.323 11:16:32 nvmf_tcp.nvmf_target_core -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:05:51.323 11:16:32 nvmf_tcp.nvmf_target_core -- nvmf/common.sh@21 -- # NET_TYPE=virt 00:05:51.323 11:16:32 nvmf_tcp.nvmf_target_core -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:05:51.323 11:16:32 nvmf_tcp.nvmf_target_core -- nvmf/common.sh@49 -- # source /home/vagrant/spdk_repo/spdk/scripts/common.sh 00:05:51.323 11:16:32 nvmf_tcp.nvmf_target_core -- scripts/common.sh@15 -- # shopt -s extglob 00:05:51.323 11:16:32 nvmf_tcp.nvmf_target_core -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:05:51.323 11:16:32 nvmf_tcp.nvmf_target_core -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:05:51.323 11:16:32 nvmf_tcp.nvmf_target_core -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:05:51.323 11:16:32 nvmf_tcp.nvmf_target_core -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:51.323 11:16:32 nvmf_tcp.nvmf_target_core -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:51.323 11:16:32 nvmf_tcp.nvmf_target_core -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:51.323 11:16:32 nvmf_tcp.nvmf_target_core -- paths/export.sh@5 -- # export PATH 00:05:51.323 11:16:32 nvmf_tcp.nvmf_target_core -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:51.323 11:16:32 nvmf_tcp.nvmf_target_core -- nvmf/common.sh@51 -- # : 0 00:05:51.323 11:16:32 nvmf_tcp.nvmf_target_core -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:05:51.323 11:16:32 nvmf_tcp.nvmf_target_core -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:05:51.323 11:16:32 nvmf_tcp.nvmf_target_core -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:05:51.323 11:16:32 nvmf_tcp.nvmf_target_core -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:05:51.323 11:16:32 nvmf_tcp.nvmf_target_core -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:05:51.323 11:16:32 nvmf_tcp.nvmf_target_core -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:05:51.323 /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:05:51.323 11:16:32 nvmf_tcp.nvmf_target_core -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:05:51.323 11:16:32 nvmf_tcp.nvmf_target_core -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:05:51.323 11:16:32 nvmf_tcp.nvmf_target_core -- nvmf/common.sh@55 -- # have_pci_nics=0 00:05:51.323 11:16:32 nvmf_tcp.nvmf_target_core -- nvmf/nvmf_target_core.sh@16 -- # trap 'exit 1' SIGINT SIGTERM EXIT 00:05:51.323 11:16:32 nvmf_tcp.nvmf_target_core -- nvmf/nvmf_target_core.sh@18 -- # TEST_ARGS=("$@") 00:05:51.323 11:16:32 nvmf_tcp.nvmf_target_core -- nvmf/nvmf_target_core.sh@20 -- # [[ 0 -eq 0 ]] 00:05:51.323 11:16:32 nvmf_tcp.nvmf_target_core -- nvmf/nvmf_target_core.sh@21 -- # run_test nvmf_abort /home/vagrant/spdk_repo/spdk/test/nvmf/target/abort.sh --transport=tcp 00:05:51.323 11:16:32 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:05:51.323 11:16:32 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1107 -- # xtrace_disable 00:05:51.323 11:16:32 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@10 -- # set +x 00:05:51.323 ************************************ 00:05:51.323 START TEST nvmf_abort 00:05:51.323 ************************************ 00:05:51.323 11:16:32 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/nvmf/target/abort.sh --transport=tcp 00:05:51.583 * Looking for test storage... 00:05:51.583 * Found test storage at /home/vagrant/spdk_repo/spdk/test/nvmf/target 00:05:51.583 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:05:51.583 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@1681 -- # lcov --version 00:05:51.583 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:05:51.583 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:05:51.584 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:05:51.584 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- scripts/common.sh@333 -- # local ver1 ver1_l 00:05:51.584 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- scripts/common.sh@334 -- # local ver2 ver2_l 00:05:51.584 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- scripts/common.sh@336 -- # IFS=.-: 00:05:51.584 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- scripts/common.sh@336 -- # read -ra ver1 00:05:51.584 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- scripts/common.sh@337 -- # IFS=.-: 00:05:51.584 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- scripts/common.sh@337 -- # read -ra ver2 00:05:51.584 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- scripts/common.sh@338 -- # local 'op=<' 00:05:51.584 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- scripts/common.sh@340 -- # ver1_l=2 00:05:51.584 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- scripts/common.sh@341 -- # ver2_l=1 00:05:51.584 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:05:51.584 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- scripts/common.sh@344 -- # case "$op" in 00:05:51.584 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- scripts/common.sh@345 -- # : 1 00:05:51.584 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- scripts/common.sh@364 -- # (( v = 0 )) 00:05:51.584 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:51.584 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- scripts/common.sh@365 -- # decimal 1 00:05:51.584 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- scripts/common.sh@353 -- # local d=1 00:05:51.584 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:51.584 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- scripts/common.sh@355 -- # echo 1 00:05:51.584 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- scripts/common.sh@365 -- # ver1[v]=1 00:05:51.584 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- scripts/common.sh@366 -- # decimal 2 00:05:51.584 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- scripts/common.sh@353 -- # local d=2 00:05:51.584 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:51.584 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- scripts/common.sh@355 -- # echo 2 00:05:51.584 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- scripts/common.sh@366 -- # ver2[v]=2 00:05:51.584 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:05:51.584 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:05:51.584 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- scripts/common.sh@368 -- # return 0 00:05:51.584 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:51.584 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:05:51.584 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:51.584 --rc genhtml_branch_coverage=1 00:05:51.584 --rc genhtml_function_coverage=1 00:05:51.584 --rc genhtml_legend=1 00:05:51.584 --rc geninfo_all_blocks=1 00:05:51.584 --rc geninfo_unexecuted_blocks=1 00:05:51.584 00:05:51.584 ' 00:05:51.584 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:05:51.584 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:51.584 --rc genhtml_branch_coverage=1 00:05:51.584 --rc genhtml_function_coverage=1 00:05:51.584 --rc genhtml_legend=1 00:05:51.584 --rc geninfo_all_blocks=1 00:05:51.584 --rc geninfo_unexecuted_blocks=1 00:05:51.584 00:05:51.584 ' 00:05:51.584 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:05:51.584 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:51.584 --rc genhtml_branch_coverage=1 00:05:51.584 --rc genhtml_function_coverage=1 00:05:51.584 --rc genhtml_legend=1 00:05:51.584 --rc geninfo_all_blocks=1 00:05:51.584 --rc geninfo_unexecuted_blocks=1 00:05:51.584 00:05:51.584 ' 00:05:51.584 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:05:51.584 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:51.584 --rc genhtml_branch_coverage=1 00:05:51.584 --rc genhtml_function_coverage=1 00:05:51.584 --rc genhtml_legend=1 00:05:51.584 --rc geninfo_all_blocks=1 00:05:51.584 --rc geninfo_unexecuted_blocks=1 00:05:51.584 00:05:51.584 ' 00:05:51.584 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- target/abort.sh@9 -- # source /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh 00:05:51.584 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@7 -- # uname -s 00:05:51.584 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:05:51.584 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:05:51.584 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:05:51.584 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:05:51.584 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:05:51.584 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:05:51.584 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:05:51.584 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:05:51.584 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:05:51.584 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:05:51.584 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:05:51.584 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@18 -- # NVME_HOSTID=3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:05:51.584 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:05:51.584 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:05:51.584 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@21 -- # NET_TYPE=virt 00:05:51.584 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:05:51.584 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@49 -- # source /home/vagrant/spdk_repo/spdk/scripts/common.sh 00:05:51.584 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- scripts/common.sh@15 -- # shopt -s extglob 00:05:51.584 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:05:51.584 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:05:51.584 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:05:51.584 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:51.584 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:51.584 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:51.584 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- paths/export.sh@5 -- # export PATH 00:05:51.584 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:51.584 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@51 -- # : 0 00:05:51.584 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:05:51.584 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:05:51.584 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:05:51.584 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:05:51.584 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:05:51.584 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:05:51.584 /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:05:51.584 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:05:51.584 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:05:51.584 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@55 -- # have_pci_nics=0 00:05:51.584 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- target/abort.sh@11 -- # MALLOC_BDEV_SIZE=64 00:05:51.584 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- target/abort.sh@12 -- # MALLOC_BLOCK_SIZE=4096 00:05:51.584 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- target/abort.sh@14 -- # nvmftestinit 00:05:51.584 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:05:51.584 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:05:51.584 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@474 -- # prepare_net_devs 00:05:51.584 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@436 -- # local -g is_hw=no 00:05:51.584 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@438 -- # remove_spdk_ns 00:05:51.584 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:05:51.584 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:05:51.584 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:05:51.584 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@440 -- # [[ virt != virt ]] 00:05:51.584 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@442 -- # [[ no == yes ]] 00:05:51.584 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@449 -- # [[ virt == phy ]] 00:05:51.585 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@452 -- # [[ virt == phy-fallback ]] 00:05:51.585 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@457 -- # [[ tcp == tcp ]] 00:05:51.585 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@458 -- # nvmf_veth_init 00:05:51.585 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@145 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:05:51.585 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@146 -- # NVMF_SECOND_INITIATOR_IP=10.0.0.2 00:05:51.585 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@147 -- # NVMF_FIRST_TARGET_IP=10.0.0.3 00:05:51.585 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@148 -- # NVMF_SECOND_TARGET_IP=10.0.0.4 00:05:51.585 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@149 -- # NVMF_INITIATOR_IP=10.0.0.1 00:05:51.585 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@150 -- # NVMF_BRIDGE=nvmf_br 00:05:51.585 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@151 -- # NVMF_INITIATOR_INTERFACE=nvmf_init_if 00:05:51.585 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@152 -- # NVMF_INITIATOR_INTERFACE2=nvmf_init_if2 00:05:51.585 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@153 -- # NVMF_INITIATOR_BRIDGE=nvmf_init_br 00:05:51.585 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@154 -- # NVMF_INITIATOR_BRIDGE2=nvmf_init_br2 00:05:51.585 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@155 -- # NVMF_TARGET_NAMESPACE=nvmf_tgt_ns_spdk 00:05:51.585 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@156 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:05:51.585 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@157 -- # NVMF_TARGET_INTERFACE=nvmf_tgt_if 00:05:51.585 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@158 -- # NVMF_TARGET_INTERFACE2=nvmf_tgt_if2 00:05:51.585 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@159 -- # NVMF_TARGET_BRIDGE=nvmf_tgt_br 00:05:51.585 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@160 -- # NVMF_TARGET_BRIDGE2=nvmf_tgt_br2 00:05:51.585 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@162 -- # ip link set nvmf_init_br nomaster 00:05:51.585 Cannot find device "nvmf_init_br" 00:05:51.585 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@162 -- # true 00:05:51.585 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@163 -- # ip link set nvmf_init_br2 nomaster 00:05:51.585 Cannot find device "nvmf_init_br2" 00:05:51.585 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@163 -- # true 00:05:51.585 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@164 -- # ip link set nvmf_tgt_br nomaster 00:05:51.585 Cannot find device "nvmf_tgt_br" 00:05:51.585 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@164 -- # true 00:05:51.585 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@165 -- # ip link set nvmf_tgt_br2 nomaster 00:05:51.585 Cannot find device "nvmf_tgt_br2" 00:05:51.585 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@165 -- # true 00:05:51.585 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@166 -- # ip link set nvmf_init_br down 00:05:51.585 Cannot find device "nvmf_init_br" 00:05:51.585 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@166 -- # true 00:05:51.585 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@167 -- # ip link set nvmf_init_br2 down 00:05:51.585 Cannot find device "nvmf_init_br2" 00:05:51.585 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@167 -- # true 00:05:51.585 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@168 -- # ip link set nvmf_tgt_br down 00:05:51.585 Cannot find device "nvmf_tgt_br" 00:05:51.585 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@168 -- # true 00:05:51.585 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@169 -- # ip link set nvmf_tgt_br2 down 00:05:51.585 Cannot find device "nvmf_tgt_br2" 00:05:51.585 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@169 -- # true 00:05:51.585 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@170 -- # ip link delete nvmf_br type bridge 00:05:51.844 Cannot find device "nvmf_br" 00:05:51.844 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@170 -- # true 00:05:51.844 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@171 -- # ip link delete nvmf_init_if 00:05:51.844 Cannot find device "nvmf_init_if" 00:05:51.844 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@171 -- # true 00:05:51.844 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@172 -- # ip link delete nvmf_init_if2 00:05:51.844 Cannot find device "nvmf_init_if2" 00:05:51.844 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@172 -- # true 00:05:51.844 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@173 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:05:51.844 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:05:51.844 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@173 -- # true 00:05:51.844 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@174 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:05:51.844 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:05:51.844 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@174 -- # true 00:05:51.844 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@177 -- # ip netns add nvmf_tgt_ns_spdk 00:05:51.844 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@180 -- # ip link add nvmf_init_if type veth peer name nvmf_init_br 00:05:51.844 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@181 -- # ip link add nvmf_init_if2 type veth peer name nvmf_init_br2 00:05:51.844 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@182 -- # ip link add nvmf_tgt_if type veth peer name nvmf_tgt_br 00:05:51.844 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@183 -- # ip link add nvmf_tgt_if2 type veth peer name nvmf_tgt_br2 00:05:51.844 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@186 -- # ip link set nvmf_tgt_if netns nvmf_tgt_ns_spdk 00:05:51.844 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@187 -- # ip link set nvmf_tgt_if2 netns nvmf_tgt_ns_spdk 00:05:51.844 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@190 -- # ip addr add 10.0.0.1/24 dev nvmf_init_if 00:05:51.844 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@191 -- # ip addr add 10.0.0.2/24 dev nvmf_init_if2 00:05:51.844 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@192 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.3/24 dev nvmf_tgt_if 00:05:51.844 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@193 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.4/24 dev nvmf_tgt_if2 00:05:51.844 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@196 -- # ip link set nvmf_init_if up 00:05:51.844 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@197 -- # ip link set nvmf_init_if2 up 00:05:51.844 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@198 -- # ip link set nvmf_init_br up 00:05:51.844 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@199 -- # ip link set nvmf_init_br2 up 00:05:51.844 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@200 -- # ip link set nvmf_tgt_br up 00:05:51.844 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@201 -- # ip link set nvmf_tgt_br2 up 00:05:51.844 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@202 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if up 00:05:51.844 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@203 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if2 up 00:05:51.845 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@204 -- # ip netns exec nvmf_tgt_ns_spdk ip link set lo up 00:05:51.845 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@207 -- # ip link add nvmf_br type bridge 00:05:52.103 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@208 -- # ip link set nvmf_br up 00:05:52.103 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@211 -- # ip link set nvmf_init_br master nvmf_br 00:05:52.103 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@212 -- # ip link set nvmf_init_br2 master nvmf_br 00:05:52.103 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@213 -- # ip link set nvmf_tgt_br master nvmf_br 00:05:52.103 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@214 -- # ip link set nvmf_tgt_br2 master nvmf_br 00:05:52.103 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@217 -- # ipts -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT 00:05:52.103 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT' 00:05:52.103 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@218 -- # ipts -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT 00:05:52.103 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT' 00:05:52.103 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@219 -- # ipts -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT 00:05:52.103 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@788 -- # iptables -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT -m comment --comment 'SPDK_NVMF:-A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT' 00:05:52.103 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@222 -- # ping -c 1 10.0.0.3 00:05:52.103 PING 10.0.0.3 (10.0.0.3) 56(84) bytes of data. 00:05:52.103 64 bytes from 10.0.0.3: icmp_seq=1 ttl=64 time=0.105 ms 00:05:52.103 00:05:52.103 --- 10.0.0.3 ping statistics --- 00:05:52.103 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:05:52.103 rtt min/avg/max/mdev = 0.105/0.105/0.105/0.000 ms 00:05:52.103 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@223 -- # ping -c 1 10.0.0.4 00:05:52.103 PING 10.0.0.4 (10.0.0.4) 56(84) bytes of data. 00:05:52.103 64 bytes from 10.0.0.4: icmp_seq=1 ttl=64 time=0.090 ms 00:05:52.103 00:05:52.103 --- 10.0.0.4 ping statistics --- 00:05:52.103 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:05:52.104 rtt min/avg/max/mdev = 0.090/0.090/0.090/0.000 ms 00:05:52.104 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@224 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.1 00:05:52.104 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:05:52.104 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.034 ms 00:05:52.104 00:05:52.104 --- 10.0.0.1 ping statistics --- 00:05:52.104 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:05:52.104 rtt min/avg/max/mdev = 0.034/0.034/0.034/0.000 ms 00:05:52.104 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@225 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.2 00:05:52.104 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:05:52.104 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.102 ms 00:05:52.104 00:05:52.104 --- 10.0.0.2 ping statistics --- 00:05:52.104 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:05:52.104 rtt min/avg/max/mdev = 0.102/0.102/0.102/0.000 ms 00:05:52.104 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@227 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:05:52.104 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@459 -- # return 0 00:05:52.104 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:05:52.104 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:05:52.104 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:05:52.104 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:05:52.104 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:05:52.104 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:05:52.104 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:05:52.104 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- target/abort.sh@15 -- # nvmfappstart -m 0xE 00:05:52.104 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:05:52.104 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@724 -- # xtrace_disable 00:05:52.104 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@10 -- # set +x 00:05:52.104 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@507 -- # nvmfpid=62143 00:05:52.104 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@506 -- # ip netns exec nvmf_tgt_ns_spdk /home/vagrant/spdk_repo/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:05:52.104 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@508 -- # waitforlisten 62143 00:05:52.104 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@831 -- # '[' -z 62143 ']' 00:05:52.104 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:52.104 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@836 -- # local max_retries=100 00:05:52.104 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:52.104 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:52.104 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@840 -- # xtrace_disable 00:05:52.104 11:16:33 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@10 -- # set +x 00:05:52.104 [2024-10-07 11:16:33.777029] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:05:52.104 [2024-10-07 11:16:33.777169] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:05:52.362 [2024-10-07 11:16:33.921752] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 3 00:05:52.362 [2024-10-07 11:16:34.052629] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:05:52.362 [2024-10-07 11:16:34.052702] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:05:52.362 [2024-10-07 11:16:34.052728] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:05:52.362 [2024-10-07 11:16:34.052739] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:05:52.362 [2024-10-07 11:16:34.052748] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:05:52.362 [2024-10-07 11:16:34.053340] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:05:52.362 [2024-10-07 11:16:34.053509] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:05:52.362 [2024-10-07 11:16:34.053488] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 3 00:05:52.621 11:16:34 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:05:52.621 11:16:34 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@864 -- # return 0 00:05:52.621 11:16:34 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:05:52.621 11:16:34 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@730 -- # xtrace_disable 00:05:52.621 11:16:34 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@10 -- # set +x 00:05:52.621 11:16:34 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:05:52.621 11:16:34 nvmf_tcp.nvmf_target_core.nvmf_abort -- target/abort.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -a 256 00:05:52.621 11:16:34 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:52.621 11:16:34 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@10 -- # set +x 00:05:52.621 [2024-10-07 11:16:34.232221] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:05:52.621 11:16:34 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:52.621 11:16:34 nvmf_tcp.nvmf_target_core.nvmf_abort -- target/abort.sh@20 -- # rpc_cmd bdev_malloc_create 64 4096 -b Malloc0 00:05:52.621 11:16:34 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:52.621 11:16:34 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@10 -- # set +x 00:05:52.621 Malloc0 00:05:52.621 11:16:34 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:52.621 11:16:34 nvmf_tcp.nvmf_target_core.nvmf_abort -- target/abort.sh@21 -- # rpc_cmd bdev_delay_create -b Malloc0 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:05:52.621 11:16:34 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:52.621 11:16:34 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@10 -- # set +x 00:05:52.621 Delay0 00:05:52.621 11:16:34 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:52.621 11:16:34 nvmf_tcp.nvmf_target_core.nvmf_abort -- target/abort.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:05:52.621 11:16:34 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:52.621 11:16:34 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@10 -- # set +x 00:05:52.621 11:16:34 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:52.621 11:16:34 nvmf_tcp.nvmf_target_core.nvmf_abort -- target/abort.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 Delay0 00:05:52.621 11:16:34 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:52.621 11:16:34 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@10 -- # set +x 00:05:52.621 11:16:34 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:52.621 11:16:34 nvmf_tcp.nvmf_target_core.nvmf_abort -- target/abort.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.3 -s 4420 00:05:52.621 11:16:34 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:52.621 11:16:34 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@10 -- # set +x 00:05:52.621 [2024-10-07 11:16:34.318110] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:05:52.621 11:16:34 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:52.621 11:16:34 nvmf_tcp.nvmf_target_core.nvmf_abort -- target/abort.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.3 -s 4420 00:05:52.621 11:16:34 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:52.621 11:16:34 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@10 -- # set +x 00:05:52.621 11:16:34 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:52.621 11:16:34 nvmf_tcp.nvmf_target_core.nvmf_abort -- target/abort.sh@30 -- # /home/vagrant/spdk_repo/spdk/build/examples/abort -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.3 trsvcid:4420' -c 0x1 -t 1 -l warning -q 128 00:05:52.880 [2024-10-07 11:16:34.501168] nvme_fabric.c: 295:nvme_fabric_discover_probe: *WARNING*: Skipping unsupported current discovery service or discovery service referral 00:05:55.409 Initializing NVMe Controllers 00:05:55.410 Attached to NVMe over Fabrics controller at 10.0.0.3:4420: nqn.2016-06.io.spdk:cnode0 00:05:55.410 controller IO queue size 128 less than required 00:05:55.410 Consider using lower queue depth or small IO size because IO requests may be queued at the NVMe driver. 00:05:55.410 Associating TCP (addr:10.0.0.3 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 0 00:05:55.410 Initialization complete. Launching workers. 00:05:55.410 NS: TCP (addr:10.0.0.3 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 I/O completed: 127, failed: 26519 00:05:55.410 CTRLR: TCP (addr:10.0.0.3 subnqn:nqn.2016-06.io.spdk:cnode0) abort submitted 26584, failed to submit 62 00:05:55.410 success 26523, unsuccessful 61, failed 0 00:05:55.410 11:16:36 nvmf_tcp.nvmf_target_core.nvmf_abort -- target/abort.sh@34 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:05:55.410 11:16:36 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:55.410 11:16:36 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@10 -- # set +x 00:05:55.410 11:16:36 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:55.410 11:16:36 nvmf_tcp.nvmf_target_core.nvmf_abort -- target/abort.sh@36 -- # trap - SIGINT SIGTERM EXIT 00:05:55.410 11:16:36 nvmf_tcp.nvmf_target_core.nvmf_abort -- target/abort.sh@38 -- # nvmftestfini 00:05:55.410 11:16:36 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@514 -- # nvmfcleanup 00:05:55.410 11:16:36 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@121 -- # sync 00:05:55.410 11:16:36 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:05:55.410 11:16:36 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@124 -- # set +e 00:05:55.410 11:16:36 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@125 -- # for i in {1..20} 00:05:55.410 11:16:36 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:05:55.410 rmmod nvme_tcp 00:05:55.410 rmmod nvme_fabrics 00:05:55.410 rmmod nvme_keyring 00:05:55.410 11:16:36 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:05:55.410 11:16:36 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@128 -- # set -e 00:05:55.410 11:16:36 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@129 -- # return 0 00:05:55.410 11:16:36 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@515 -- # '[' -n 62143 ']' 00:05:55.410 11:16:36 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@516 -- # killprocess 62143 00:05:55.410 11:16:36 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@950 -- # '[' -z 62143 ']' 00:05:55.410 11:16:36 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@954 -- # kill -0 62143 00:05:55.410 11:16:36 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@955 -- # uname 00:05:55.410 11:16:36 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:05:55.410 11:16:36 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 62143 00:05:55.410 11:16:36 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@956 -- # process_name=reactor_1 00:05:55.410 11:16:36 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@960 -- # '[' reactor_1 = sudo ']' 00:05:55.410 11:16:36 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@968 -- # echo 'killing process with pid 62143' 00:05:55.410 killing process with pid 62143 00:05:55.410 11:16:36 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@969 -- # kill 62143 00:05:55.410 11:16:36 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@974 -- # wait 62143 00:05:55.410 11:16:36 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:05:55.410 11:16:36 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:05:55.410 11:16:36 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:05:55.410 11:16:36 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@297 -- # iptr 00:05:55.410 11:16:36 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@789 -- # iptables-save 00:05:55.410 11:16:36 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:05:55.410 11:16:36 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@789 -- # iptables-restore 00:05:55.410 11:16:36 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@298 -- # [[ nvmf_tgt_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:05:55.410 11:16:36 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@299 -- # nvmf_veth_fini 00:05:55.410 11:16:36 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@233 -- # ip link set nvmf_init_br nomaster 00:05:55.410 11:16:36 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@234 -- # ip link set nvmf_init_br2 nomaster 00:05:55.410 11:16:36 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@235 -- # ip link set nvmf_tgt_br nomaster 00:05:55.410 11:16:36 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@236 -- # ip link set nvmf_tgt_br2 nomaster 00:05:55.410 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@237 -- # ip link set nvmf_init_br down 00:05:55.410 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@238 -- # ip link set nvmf_init_br2 down 00:05:55.410 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@239 -- # ip link set nvmf_tgt_br down 00:05:55.410 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@240 -- # ip link set nvmf_tgt_br2 down 00:05:55.410 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@241 -- # ip link delete nvmf_br type bridge 00:05:55.410 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@242 -- # ip link delete nvmf_init_if 00:05:55.410 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@243 -- # ip link delete nvmf_init_if2 00:05:55.668 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@244 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:05:55.668 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@245 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:05:55.668 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@246 -- # remove_spdk_ns 00:05:55.668 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:05:55.668 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:05:55.668 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:05:55.668 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_abort -- nvmf/common.sh@300 -- # return 0 00:05:55.668 00:05:55.668 real 0m4.232s 00:05:55.668 user 0m10.637s 00:05:55.668 sys 0m1.167s 00:05:55.668 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@1126 -- # xtrace_disable 00:05:55.668 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_abort -- common/autotest_common.sh@10 -- # set +x 00:05:55.668 ************************************ 00:05:55.668 END TEST nvmf_abort 00:05:55.668 ************************************ 00:05:55.668 11:16:37 nvmf_tcp.nvmf_target_core -- nvmf/nvmf_target_core.sh@22 -- # run_test nvmf_ns_hotplug_stress /home/vagrant/spdk_repo/spdk/test/nvmf/target/ns_hotplug_stress.sh --transport=tcp 00:05:55.668 11:16:37 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:05:55.668 11:16:37 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1107 -- # xtrace_disable 00:05:55.668 11:16:37 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@10 -- # set +x 00:05:55.668 ************************************ 00:05:55.668 START TEST nvmf_ns_hotplug_stress 00:05:55.668 ************************************ 00:05:55.668 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/nvmf/target/ns_hotplug_stress.sh --transport=tcp 00:05:55.668 * Looking for test storage... 00:05:55.668 * Found test storage at /home/vagrant/spdk_repo/spdk/test/nvmf/target 00:05:55.668 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:05:55.668 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:05:55.668 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- common/autotest_common.sh@1681 -- # lcov --version 00:05:55.927 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:05:55.927 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:05:55.927 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- scripts/common.sh@333 -- # local ver1 ver1_l 00:05:55.927 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- scripts/common.sh@334 -- # local ver2 ver2_l 00:05:55.927 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- scripts/common.sh@336 -- # IFS=.-: 00:05:55.927 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- scripts/common.sh@336 -- # read -ra ver1 00:05:55.927 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- scripts/common.sh@337 -- # IFS=.-: 00:05:55.927 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- scripts/common.sh@337 -- # read -ra ver2 00:05:55.927 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- scripts/common.sh@338 -- # local 'op=<' 00:05:55.927 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- scripts/common.sh@340 -- # ver1_l=2 00:05:55.927 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- scripts/common.sh@341 -- # ver2_l=1 00:05:55.927 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:05:55.927 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- scripts/common.sh@344 -- # case "$op" in 00:05:55.927 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- scripts/common.sh@345 -- # : 1 00:05:55.927 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- scripts/common.sh@364 -- # (( v = 0 )) 00:05:55.927 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:55.927 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- scripts/common.sh@365 -- # decimal 1 00:05:55.927 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- scripts/common.sh@353 -- # local d=1 00:05:55.927 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:55.927 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- scripts/common.sh@355 -- # echo 1 00:05:55.927 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- scripts/common.sh@365 -- # ver1[v]=1 00:05:55.927 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- scripts/common.sh@366 -- # decimal 2 00:05:55.927 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- scripts/common.sh@353 -- # local d=2 00:05:55.927 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:55.927 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- scripts/common.sh@355 -- # echo 2 00:05:55.927 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- scripts/common.sh@366 -- # ver2[v]=2 00:05:55.927 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:05:55.927 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:05:55.927 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- scripts/common.sh@368 -- # return 0 00:05:55.927 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:55.927 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:05:55.927 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:55.927 --rc genhtml_branch_coverage=1 00:05:55.927 --rc genhtml_function_coverage=1 00:05:55.927 --rc genhtml_legend=1 00:05:55.927 --rc geninfo_all_blocks=1 00:05:55.927 --rc geninfo_unexecuted_blocks=1 00:05:55.927 00:05:55.927 ' 00:05:55.927 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:05:55.927 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:55.927 --rc genhtml_branch_coverage=1 00:05:55.927 --rc genhtml_function_coverage=1 00:05:55.927 --rc genhtml_legend=1 00:05:55.927 --rc geninfo_all_blocks=1 00:05:55.927 --rc geninfo_unexecuted_blocks=1 00:05:55.927 00:05:55.927 ' 00:05:55.927 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:05:55.927 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:55.927 --rc genhtml_branch_coverage=1 00:05:55.927 --rc genhtml_function_coverage=1 00:05:55.927 --rc genhtml_legend=1 00:05:55.927 --rc geninfo_all_blocks=1 00:05:55.927 --rc geninfo_unexecuted_blocks=1 00:05:55.927 00:05:55.927 ' 00:05:55.927 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:05:55.927 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:55.927 --rc genhtml_branch_coverage=1 00:05:55.927 --rc genhtml_function_coverage=1 00:05:55.927 --rc genhtml_legend=1 00:05:55.927 --rc geninfo_all_blocks=1 00:05:55.927 --rc geninfo_unexecuted_blocks=1 00:05:55.927 00:05:55.927 ' 00:05:55.927 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@9 -- # source /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh 00:05:55.928 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@7 -- # uname -s 00:05:55.928 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:05:55.928 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:05:55.928 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:05:55.928 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:05:55.928 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:05:55.928 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:05:55.928 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:05:55.928 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:05:55.928 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:05:55.928 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:05:55.928 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:05:55.928 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@18 -- # NVME_HOSTID=3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:05:55.928 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:05:55.928 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:05:55.928 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@21 -- # NET_TYPE=virt 00:05:55.928 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:05:55.928 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@49 -- # source /home/vagrant/spdk_repo/spdk/scripts/common.sh 00:05:55.928 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- scripts/common.sh@15 -- # shopt -s extglob 00:05:55.928 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:05:55.928 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:05:55.928 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:05:55.928 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:55.928 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:55.928 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:55.928 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- paths/export.sh@5 -- # export PATH 00:05:55.928 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:55.928 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@51 -- # : 0 00:05:55.928 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:05:55.928 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:05:55.928 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:05:55.928 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:05:55.928 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:05:55.928 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:05:55.928 /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:05:55.928 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:05:55.928 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:05:55.928 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@55 -- # have_pci_nics=0 00:05:55.928 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@11 -- # rpc_py=/home/vagrant/spdk_repo/spdk/scripts/rpc.py 00:05:55.928 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@22 -- # nvmftestinit 00:05:55.928 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:05:55.928 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:05:55.928 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@474 -- # prepare_net_devs 00:05:55.928 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@436 -- # local -g is_hw=no 00:05:55.928 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@438 -- # remove_spdk_ns 00:05:55.928 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:05:55.928 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:05:55.928 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:05:55.928 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@440 -- # [[ virt != virt ]] 00:05:55.928 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@442 -- # [[ no == yes ]] 00:05:55.928 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@449 -- # [[ virt == phy ]] 00:05:55.928 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@452 -- # [[ virt == phy-fallback ]] 00:05:55.928 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@457 -- # [[ tcp == tcp ]] 00:05:55.928 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@458 -- # nvmf_veth_init 00:05:55.928 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@145 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:05:55.928 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@146 -- # NVMF_SECOND_INITIATOR_IP=10.0.0.2 00:05:55.928 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@147 -- # NVMF_FIRST_TARGET_IP=10.0.0.3 00:05:55.928 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@148 -- # NVMF_SECOND_TARGET_IP=10.0.0.4 00:05:55.928 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@149 -- # NVMF_INITIATOR_IP=10.0.0.1 00:05:55.928 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@150 -- # NVMF_BRIDGE=nvmf_br 00:05:55.928 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@151 -- # NVMF_INITIATOR_INTERFACE=nvmf_init_if 00:05:55.928 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@152 -- # NVMF_INITIATOR_INTERFACE2=nvmf_init_if2 00:05:55.928 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@153 -- # NVMF_INITIATOR_BRIDGE=nvmf_init_br 00:05:55.928 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@154 -- # NVMF_INITIATOR_BRIDGE2=nvmf_init_br2 00:05:55.928 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@155 -- # NVMF_TARGET_NAMESPACE=nvmf_tgt_ns_spdk 00:05:55.928 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@156 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:05:55.928 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@157 -- # NVMF_TARGET_INTERFACE=nvmf_tgt_if 00:05:55.928 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@158 -- # NVMF_TARGET_INTERFACE2=nvmf_tgt_if2 00:05:55.928 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@159 -- # NVMF_TARGET_BRIDGE=nvmf_tgt_br 00:05:55.928 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@160 -- # NVMF_TARGET_BRIDGE2=nvmf_tgt_br2 00:05:55.928 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@162 -- # ip link set nvmf_init_br nomaster 00:05:55.928 Cannot find device "nvmf_init_br" 00:05:55.928 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@162 -- # true 00:05:55.928 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@163 -- # ip link set nvmf_init_br2 nomaster 00:05:55.928 Cannot find device "nvmf_init_br2" 00:05:55.928 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@163 -- # true 00:05:55.928 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@164 -- # ip link set nvmf_tgt_br nomaster 00:05:55.928 Cannot find device "nvmf_tgt_br" 00:05:55.928 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@164 -- # true 00:05:55.929 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@165 -- # ip link set nvmf_tgt_br2 nomaster 00:05:55.929 Cannot find device "nvmf_tgt_br2" 00:05:55.929 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@165 -- # true 00:05:55.929 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@166 -- # ip link set nvmf_init_br down 00:05:55.929 Cannot find device "nvmf_init_br" 00:05:55.929 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@166 -- # true 00:05:55.929 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@167 -- # ip link set nvmf_init_br2 down 00:05:55.929 Cannot find device "nvmf_init_br2" 00:05:55.929 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@167 -- # true 00:05:55.929 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@168 -- # ip link set nvmf_tgt_br down 00:05:55.929 Cannot find device "nvmf_tgt_br" 00:05:55.929 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@168 -- # true 00:05:55.929 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@169 -- # ip link set nvmf_tgt_br2 down 00:05:55.929 Cannot find device "nvmf_tgt_br2" 00:05:55.929 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@169 -- # true 00:05:55.929 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@170 -- # ip link delete nvmf_br type bridge 00:05:55.929 Cannot find device "nvmf_br" 00:05:55.929 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@170 -- # true 00:05:55.929 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@171 -- # ip link delete nvmf_init_if 00:05:55.929 Cannot find device "nvmf_init_if" 00:05:55.929 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@171 -- # true 00:05:55.929 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@172 -- # ip link delete nvmf_init_if2 00:05:55.929 Cannot find device "nvmf_init_if2" 00:05:55.929 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@172 -- # true 00:05:55.929 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@173 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:05:55.929 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:05:55.929 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@173 -- # true 00:05:55.929 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@174 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:05:55.929 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:05:55.929 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@174 -- # true 00:05:55.929 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@177 -- # ip netns add nvmf_tgt_ns_spdk 00:05:55.929 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@180 -- # ip link add nvmf_init_if type veth peer name nvmf_init_br 00:05:55.929 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@181 -- # ip link add nvmf_init_if2 type veth peer name nvmf_init_br2 00:05:55.929 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@182 -- # ip link add nvmf_tgt_if type veth peer name nvmf_tgt_br 00:05:55.929 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@183 -- # ip link add nvmf_tgt_if2 type veth peer name nvmf_tgt_br2 00:05:56.187 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@186 -- # ip link set nvmf_tgt_if netns nvmf_tgt_ns_spdk 00:05:56.187 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@187 -- # ip link set nvmf_tgt_if2 netns nvmf_tgt_ns_spdk 00:05:56.187 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@190 -- # ip addr add 10.0.0.1/24 dev nvmf_init_if 00:05:56.187 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@191 -- # ip addr add 10.0.0.2/24 dev nvmf_init_if2 00:05:56.187 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@192 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.3/24 dev nvmf_tgt_if 00:05:56.187 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@193 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.4/24 dev nvmf_tgt_if2 00:05:56.187 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@196 -- # ip link set nvmf_init_if up 00:05:56.187 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@197 -- # ip link set nvmf_init_if2 up 00:05:56.187 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@198 -- # ip link set nvmf_init_br up 00:05:56.187 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@199 -- # ip link set nvmf_init_br2 up 00:05:56.187 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@200 -- # ip link set nvmf_tgt_br up 00:05:56.187 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@201 -- # ip link set nvmf_tgt_br2 up 00:05:56.187 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@202 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if up 00:05:56.187 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@203 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if2 up 00:05:56.187 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@204 -- # ip netns exec nvmf_tgt_ns_spdk ip link set lo up 00:05:56.187 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@207 -- # ip link add nvmf_br type bridge 00:05:56.187 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@208 -- # ip link set nvmf_br up 00:05:56.187 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@211 -- # ip link set nvmf_init_br master nvmf_br 00:05:56.187 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@212 -- # ip link set nvmf_init_br2 master nvmf_br 00:05:56.188 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@213 -- # ip link set nvmf_tgt_br master nvmf_br 00:05:56.188 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@214 -- # ip link set nvmf_tgt_br2 master nvmf_br 00:05:56.188 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@217 -- # ipts -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT 00:05:56.188 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT' 00:05:56.188 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@218 -- # ipts -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT 00:05:56.188 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT' 00:05:56.188 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@219 -- # ipts -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT 00:05:56.188 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@788 -- # iptables -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT -m comment --comment 'SPDK_NVMF:-A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT' 00:05:56.188 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@222 -- # ping -c 1 10.0.0.3 00:05:56.188 PING 10.0.0.3 (10.0.0.3) 56(84) bytes of data. 00:05:56.188 64 bytes from 10.0.0.3: icmp_seq=1 ttl=64 time=0.118 ms 00:05:56.188 00:05:56.188 --- 10.0.0.3 ping statistics --- 00:05:56.188 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:05:56.188 rtt min/avg/max/mdev = 0.118/0.118/0.118/0.000 ms 00:05:56.188 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@223 -- # ping -c 1 10.0.0.4 00:05:56.188 PING 10.0.0.4 (10.0.0.4) 56(84) bytes of data. 00:05:56.188 64 bytes from 10.0.0.4: icmp_seq=1 ttl=64 time=0.113 ms 00:05:56.188 00:05:56.188 --- 10.0.0.4 ping statistics --- 00:05:56.188 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:05:56.188 rtt min/avg/max/mdev = 0.113/0.113/0.113/0.000 ms 00:05:56.188 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@224 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.1 00:05:56.188 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:05:56.188 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.037 ms 00:05:56.188 00:05:56.188 --- 10.0.0.1 ping statistics --- 00:05:56.188 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:05:56.188 rtt min/avg/max/mdev = 0.037/0.037/0.037/0.000 ms 00:05:56.188 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@225 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.2 00:05:56.446 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:05:56.446 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.059 ms 00:05:56.446 00:05:56.446 --- 10.0.0.2 ping statistics --- 00:05:56.446 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:05:56.446 rtt min/avg/max/mdev = 0.059/0.059/0.059/0.000 ms 00:05:56.446 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@227 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:05:56.446 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@459 -- # return 0 00:05:56.446 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:05:56.446 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:05:56.446 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:05:56.446 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:05:56.446 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:05:56.446 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:05:56.446 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:05:56.446 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@23 -- # nvmfappstart -m 0xE 00:05:56.446 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:05:56.446 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- common/autotest_common.sh@724 -- # xtrace_disable 00:05:56.446 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- common/autotest_common.sh@10 -- # set +x 00:05:56.446 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@507 -- # nvmfpid=62423 00:05:56.446 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@506 -- # ip netns exec nvmf_tgt_ns_spdk /home/vagrant/spdk_repo/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:05:56.446 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@508 -- # waitforlisten 62423 00:05:56.446 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- common/autotest_common.sh@831 -- # '[' -z 62423 ']' 00:05:56.446 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:56.446 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- common/autotest_common.sh@836 -- # local max_retries=100 00:05:56.446 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:56.446 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:56.446 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- common/autotest_common.sh@840 -- # xtrace_disable 00:05:56.446 11:16:37 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- common/autotest_common.sh@10 -- # set +x 00:05:56.446 [2024-10-07 11:16:37.993753] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:05:56.446 [2024-10-07 11:16:37.993859] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:05:56.446 [2024-10-07 11:16:38.133749] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 3 00:05:56.705 [2024-10-07 11:16:38.281911] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:05:56.705 [2024-10-07 11:16:38.282212] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:05:56.705 [2024-10-07 11:16:38.282376] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:05:56.705 [2024-10-07 11:16:38.282574] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:05:56.705 [2024-10-07 11:16:38.282675] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:05:56.705 [2024-10-07 11:16:38.283363] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:05:56.705 [2024-10-07 11:16:38.283671] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 3 00:05:56.705 [2024-10-07 11:16:38.283793] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:05:57.637 11:16:39 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:05:57.637 11:16:39 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- common/autotest_common.sh@864 -- # return 0 00:05:57.637 11:16:39 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:05:57.637 11:16:39 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- common/autotest_common.sh@730 -- # xtrace_disable 00:05:57.637 11:16:39 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- common/autotest_common.sh@10 -- # set +x 00:05:57.637 11:16:39 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:05:57.637 11:16:39 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@25 -- # null_size=1000 00:05:57.637 11:16:39 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@27 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:05:57.895 [2024-10-07 11:16:39.355125] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:05:57.895 11:16:39 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@29 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:05:58.154 11:16:39 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@30 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4420 00:05:58.412 [2024-10-07 11:16:39.969786] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:05:58.412 11:16:39 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.3 -s 4420 00:05:58.671 11:16:40 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@32 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_malloc_create 32 512 -b Malloc0 00:05:58.930 Malloc0 00:05:58.930 11:16:40 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@33 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_delay_create -b Malloc0 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:05:59.189 Delay0 00:05:59.189 11:16:40 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@34 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:05:59.756 11:16:41 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@35 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_null_create NULL1 1000 512 00:06:00.015 NULL1 00:06:00.015 11:16:41 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@36 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 NULL1 00:06:00.273 11:16:41 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@42 -- # PERF_PID=62555 00:06:00.274 11:16:41 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@44 -- # kill -0 62555 00:06:00.274 11:16:41 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@40 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_nvme_perf -c 0x1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.3 trsvcid:4420' -t 30 -q 128 -w randread -o 512 -Q 1000 00:06:00.274 11:16:41 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@45 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:06:01.650 Read completed with error (sct=0, sc=11) 00:06:01.650 11:16:43 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@46 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:06:01.650 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:06:01.650 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:06:01.650 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:06:01.650 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:06:01.650 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:06:01.910 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:06:01.910 11:16:43 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@49 -- # null_size=1001 00:06:01.910 11:16:43 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@50 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_null_resize NULL1 1001 00:06:02.169 true 00:06:02.169 11:16:43 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@44 -- # kill -0 62555 00:06:02.169 11:16:43 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@45 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:06:03.104 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:06:03.104 11:16:44 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@46 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:06:03.104 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:06:03.104 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:06:03.104 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:06:03.104 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:06:03.104 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:06:03.104 11:16:44 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@49 -- # null_size=1002 00:06:03.104 11:16:44 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@50 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_null_resize NULL1 1002 00:06:03.362 true 00:06:03.362 11:16:45 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@44 -- # kill -0 62555 00:06:03.362 11:16:45 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@45 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:06:04.297 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:06:04.297 11:16:45 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@46 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:06:04.297 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:06:04.297 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:06:04.297 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:06:04.297 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:06:04.555 11:16:46 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@49 -- # null_size=1003 00:06:04.555 11:16:46 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@50 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_null_resize NULL1 1003 00:06:04.842 true 00:06:04.842 11:16:46 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@44 -- # kill -0 62555 00:06:04.842 11:16:46 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@45 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:06:05.137 11:16:46 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@46 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:06:05.395 11:16:46 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@49 -- # null_size=1004 00:06:05.395 11:16:46 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@50 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_null_resize NULL1 1004 00:06:05.653 true 00:06:05.653 11:16:47 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@44 -- # kill -0 62555 00:06:05.653 11:16:47 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@45 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:06:06.586 11:16:48 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@46 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:06:06.842 11:16:48 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@49 -- # null_size=1005 00:06:06.842 11:16:48 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@50 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_null_resize NULL1 1005 00:06:07.099 true 00:06:07.099 11:16:48 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@44 -- # kill -0 62555 00:06:07.099 11:16:48 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@45 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:06:07.357 11:16:49 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@46 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:06:07.923 11:16:49 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@49 -- # null_size=1006 00:06:07.923 11:16:49 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@50 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_null_resize NULL1 1006 00:06:08.181 true 00:06:08.181 11:16:49 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@44 -- # kill -0 62555 00:06:08.181 11:16:49 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@45 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:06:08.438 11:16:49 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@46 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:06:08.696 11:16:50 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@49 -- # null_size=1007 00:06:08.696 11:16:50 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@50 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_null_resize NULL1 1007 00:06:08.953 true 00:06:08.953 11:16:50 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@44 -- # kill -0 62555 00:06:08.953 11:16:50 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@45 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:06:09.519 11:16:50 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@46 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:06:09.777 11:16:51 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@49 -- # null_size=1008 00:06:09.777 11:16:51 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@50 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_null_resize NULL1 1008 00:06:10.034 true 00:06:10.034 11:16:51 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@44 -- # kill -0 62555 00:06:10.034 11:16:51 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@45 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:06:11.416 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:06:11.416 11:16:53 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@46 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:06:11.416 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:06:11.416 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:06:11.674 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:06:11.674 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:06:11.674 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:06:11.674 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:06:11.674 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:06:11.935 11:16:53 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@49 -- # null_size=1009 00:06:11.935 11:16:53 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@50 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_null_resize NULL1 1009 00:06:12.193 true 00:06:12.193 11:16:53 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@44 -- # kill -0 62555 00:06:12.193 11:16:53 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@45 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:06:12.759 11:16:54 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@46 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:06:12.759 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:06:13.017 11:16:54 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@49 -- # null_size=1010 00:06:13.017 11:16:54 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@50 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_null_resize NULL1 1010 00:06:13.583 true 00:06:13.583 11:16:55 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@44 -- # kill -0 62555 00:06:13.583 11:16:55 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@45 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:06:13.841 11:16:55 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@46 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:06:14.099 11:16:55 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@49 -- # null_size=1011 00:06:14.099 11:16:55 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@50 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_null_resize NULL1 1011 00:06:14.358 true 00:06:14.358 11:16:55 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@44 -- # kill -0 62555 00:06:14.358 11:16:55 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@45 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:06:14.616 11:16:56 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@46 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:06:14.874 11:16:56 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@49 -- # null_size=1012 00:06:14.874 11:16:56 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@50 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_null_resize NULL1 1012 00:06:15.131 true 00:06:15.131 11:16:56 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@44 -- # kill -0 62555 00:06:15.131 11:16:56 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@45 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:06:15.389 11:16:57 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@46 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:06:15.648 11:16:57 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@49 -- # null_size=1013 00:06:15.648 11:16:57 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@50 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_null_resize NULL1 1013 00:06:15.906 true 00:06:15.906 11:16:57 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@44 -- # kill -0 62555 00:06:15.906 11:16:57 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@45 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:06:16.845 11:16:58 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@46 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:06:17.104 11:16:58 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@49 -- # null_size=1014 00:06:17.104 11:16:58 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@50 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_null_resize NULL1 1014 00:06:17.362 true 00:06:17.362 11:16:58 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@44 -- # kill -0 62555 00:06:17.362 11:16:58 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@45 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:06:17.620 11:16:59 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@46 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:06:18.186 11:16:59 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@49 -- # null_size=1015 00:06:18.186 11:16:59 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@50 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_null_resize NULL1 1015 00:06:18.444 true 00:06:18.444 11:16:59 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@44 -- # kill -0 62555 00:06:18.444 11:16:59 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@45 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:06:18.701 11:17:00 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@46 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:06:18.959 11:17:00 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@49 -- # null_size=1016 00:06:18.959 11:17:00 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@50 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_null_resize NULL1 1016 00:06:19.217 true 00:06:19.217 11:17:00 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@44 -- # kill -0 62555 00:06:19.217 11:17:00 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@45 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:06:19.782 11:17:01 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@46 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:06:20.042 11:17:01 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@49 -- # null_size=1017 00:06:20.043 11:17:01 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@50 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_null_resize NULL1 1017 00:06:20.300 true 00:06:20.300 11:17:01 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@44 -- # kill -0 62555 00:06:20.300 11:17:01 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@45 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:06:20.558 11:17:02 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@46 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:06:21.124 11:17:02 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@49 -- # null_size=1018 00:06:21.124 11:17:02 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@50 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_null_resize NULL1 1018 00:06:21.382 true 00:06:21.382 11:17:02 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@44 -- # kill -0 62555 00:06:21.382 11:17:02 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@45 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:06:21.640 11:17:03 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@46 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:06:22.205 11:17:03 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@49 -- # null_size=1019 00:06:22.205 11:17:03 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@50 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_null_resize NULL1 1019 00:06:22.462 true 00:06:22.462 11:17:04 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@44 -- # kill -0 62555 00:06:22.462 11:17:04 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@45 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:06:22.719 11:17:04 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@46 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:06:22.977 11:17:04 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@49 -- # null_size=1020 00:06:22.977 11:17:04 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@50 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_null_resize NULL1 1020 00:06:23.565 true 00:06:23.565 11:17:05 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@44 -- # kill -0 62555 00:06:23.565 11:17:05 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@45 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:06:23.823 11:17:05 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@46 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:06:24.081 11:17:05 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@49 -- # null_size=1021 00:06:24.081 11:17:05 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@50 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_null_resize NULL1 1021 00:06:24.338 true 00:06:24.339 11:17:05 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@44 -- # kill -0 62555 00:06:24.339 11:17:05 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@45 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:06:24.596 11:17:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@46 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:06:25.163 11:17:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@49 -- # null_size=1022 00:06:25.163 11:17:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@50 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_null_resize NULL1 1022 00:06:25.163 true 00:06:25.163 11:17:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@44 -- # kill -0 62555 00:06:25.163 11:17:06 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@45 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:06:25.728 11:17:07 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@46 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:06:25.986 11:17:07 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@49 -- # null_size=1023 00:06:25.986 11:17:07 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@50 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_null_resize NULL1 1023 00:06:26.243 true 00:06:26.243 11:17:07 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@44 -- # kill -0 62555 00:06:26.243 11:17:07 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@45 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:06:26.530 11:17:08 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@46 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:06:27.093 11:17:08 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@49 -- # null_size=1024 00:06:27.093 11:17:08 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@50 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_null_resize NULL1 1024 00:06:27.093 true 00:06:27.350 11:17:08 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@44 -- # kill -0 62555 00:06:27.351 11:17:08 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@45 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:06:27.608 11:17:09 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@46 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:06:27.866 11:17:09 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@49 -- # null_size=1025 00:06:27.866 11:17:09 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@50 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_null_resize NULL1 1025 00:06:28.123 true 00:06:28.123 11:17:09 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@44 -- # kill -0 62555 00:06:28.123 11:17:09 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@45 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:06:28.381 11:17:10 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@46 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:06:28.641 11:17:10 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@49 -- # null_size=1026 00:06:28.641 11:17:10 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@50 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_null_resize NULL1 1026 00:06:28.898 true 00:06:29.156 11:17:10 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@44 -- # kill -0 62555 00:06:29.156 11:17:10 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@45 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:06:29.780 11:17:11 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@46 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:06:30.348 11:17:11 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@49 -- # null_size=1027 00:06:30.348 11:17:11 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@50 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_null_resize NULL1 1027 00:06:30.348 Initializing NVMe Controllers 00:06:30.348 Attached to NVMe over Fabrics controller at 10.0.0.3:4420: nqn.2016-06.io.spdk:cnode1 00:06:30.348 Controller IO queue size 128, less than required. 00:06:30.348 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:06:30.348 Controller IO queue size 128, less than required. 00:06:30.348 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:06:30.348 Associating TCP (addr:10.0.0.3 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:06:30.348 Associating TCP (addr:10.0.0.3 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:06:30.348 Initialization complete. Launching workers. 00:06:30.348 ======================================================== 00:06:30.348 Latency(us) 00:06:30.348 Device Information : IOPS MiB/s Average min max 00:06:30.348 TCP (addr:10.0.0.3 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 915.67 0.45 45413.79 2878.67 1026708.41 00:06:30.348 TCP (addr:10.0.0.3 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 6283.78 3.07 20369.62 3314.70 647449.44 00:06:30.348 ======================================================== 00:06:30.348 Total : 7199.44 3.52 23554.89 2878.67 1026708.41 00:06:30.348 00:06:30.607 true 00:06:30.607 11:17:12 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@44 -- # kill -0 62555 00:06:30.607 /home/vagrant/spdk_repo/spdk/test/nvmf/target/ns_hotplug_stress.sh: line 44: kill: (62555) - No such process 00:06:30.607 11:17:12 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@53 -- # wait 62555 00:06:30.607 11:17:12 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@54 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:06:30.864 11:17:12 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@55 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:06:31.122 11:17:12 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@58 -- # nthreads=8 00:06:31.122 11:17:12 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@58 -- # pids=() 00:06:31.122 11:17:12 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@59 -- # (( i = 0 )) 00:06:31.122 11:17:12 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:06:31.122 11:17:12 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@60 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_null_create null0 100 4096 00:06:31.687 null0 00:06:31.687 11:17:13 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:06:31.687 11:17:13 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:06:31.687 11:17:13 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@60 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_null_create null1 100 4096 00:06:31.945 null1 00:06:31.945 11:17:13 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:06:31.945 11:17:13 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:06:31.945 11:17:13 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@60 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_null_create null2 100 4096 00:06:32.203 null2 00:06:32.460 11:17:13 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:06:32.461 11:17:13 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:06:32.461 11:17:13 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@60 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_null_create null3 100 4096 00:06:32.719 null3 00:06:32.719 11:17:14 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:06:32.719 11:17:14 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:06:32.719 11:17:14 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@60 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_null_create null4 100 4096 00:06:32.978 null4 00:06:32.978 11:17:14 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:06:32.978 11:17:14 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:06:32.978 11:17:14 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@60 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_null_create null5 100 4096 00:06:33.557 null5 00:06:33.557 11:17:15 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:06:33.557 11:17:15 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:06:33.557 11:17:15 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@60 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_null_create null6 100 4096 00:06:33.815 null6 00:06:33.815 11:17:15 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:06:33.815 11:17:15 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:06:33.815 11:17:15 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@60 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_null_create null7 100 4096 00:06:34.381 null7 00:06:34.381 11:17:15 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:06:34.381 11:17:15 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:06:34.381 11:17:15 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@62 -- # (( i = 0 )) 00:06:34.381 11:17:15 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:06:34.381 11:17:15 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:06:34.381 11:17:15 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@63 -- # add_remove 1 null0 00:06:34.381 11:17:15 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:06:34.381 11:17:15 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:06:34.381 11:17:15 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@14 -- # local nsid=1 bdev=null0 00:06:34.381 11:17:15 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:06:34.381 11:17:15 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:06:34.381 11:17:15 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:06:34.381 11:17:15 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:06:34.381 11:17:15 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@63 -- # add_remove 2 null1 00:06:34.381 11:17:15 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@14 -- # local nsid=2 bdev=null1 00:06:34.381 11:17:15 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:06:34.381 11:17:15 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:06:34.381 11:17:15 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:06:34.381 11:17:15 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:06:34.381 11:17:15 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:06:34.381 11:17:15 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:06:34.381 11:17:15 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@63 -- # add_remove 3 null2 00:06:34.381 11:17:15 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:06:34.381 11:17:15 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:06:34.381 11:17:15 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@14 -- # local nsid=3 bdev=null2 00:06:34.381 11:17:15 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:06:34.381 11:17:15 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:06:34.381 11:17:15 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:06:34.381 11:17:15 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:06:34.381 11:17:15 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@63 -- # add_remove 4 null3 00:06:34.381 11:17:15 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@14 -- # local nsid=4 bdev=null3 00:06:34.381 11:17:15 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:06:34.381 11:17:15 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:06:34.381 11:17:15 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:06:34.381 11:17:15 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:06:34.381 11:17:15 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:06:34.381 11:17:15 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@63 -- # add_remove 5 null4 00:06:34.381 11:17:15 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:06:34.381 11:17:15 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:06:34.381 11:17:15 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@14 -- # local nsid=5 bdev=null4 00:06:34.381 11:17:15 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:06:34.381 11:17:15 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:06:34.381 11:17:15 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:06:34.381 11:17:15 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:06:34.381 11:17:15 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:06:34.381 11:17:15 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:06:34.381 11:17:15 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:06:34.381 11:17:15 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@63 -- # add_remove 6 null5 00:06:34.381 11:17:15 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@14 -- # local nsid=6 bdev=null5 00:06:34.381 11:17:15 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@63 -- # add_remove 7 null6 00:06:34.381 11:17:15 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:06:34.381 11:17:15 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:06:34.381 11:17:15 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@14 -- # local nsid=7 bdev=null6 00:06:34.381 11:17:15 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:06:34.381 11:17:15 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:06:34.381 11:17:15 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:06:34.381 11:17:15 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:06:34.381 11:17:15 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:06:34.381 11:17:15 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:06:34.381 11:17:15 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:06:34.381 11:17:15 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:06:34.381 11:17:15 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@63 -- # add_remove 8 null7 00:06:34.381 11:17:15 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@14 -- # local nsid=8 bdev=null7 00:06:34.381 11:17:15 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:06:34.381 11:17:15 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:06:34.381 11:17:15 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:06:34.381 11:17:15 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:06:34.381 11:17:15 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:06:34.381 11:17:15 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@66 -- # wait 63567 63568 63570 63572 63574 63576 63578 63581 00:06:34.946 11:17:16 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:06:34.946 11:17:16 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:06:34.946 11:17:16 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:06:34.946 11:17:16 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:06:34.946 11:17:16 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:06:34.946 11:17:16 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:06:34.946 11:17:16 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:06:34.946 11:17:16 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:06:35.204 11:17:16 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:06:35.204 11:17:16 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:06:35.204 11:17:16 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:06:35.204 11:17:16 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:06:35.204 11:17:16 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:06:35.204 11:17:16 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:06:35.204 11:17:16 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:06:35.204 11:17:16 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:06:35.204 11:17:16 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:06:35.204 11:17:16 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:06:35.204 11:17:16 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:06:35.204 11:17:16 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:06:35.204 11:17:16 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:06:35.204 11:17:16 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:06:35.205 11:17:16 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:06:35.463 11:17:16 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:06:35.463 11:17:16 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:06:35.463 11:17:16 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:06:35.463 11:17:17 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:06:35.463 11:17:17 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:06:35.463 11:17:17 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:06:35.463 11:17:17 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:06:35.463 11:17:17 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:06:35.463 11:17:17 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:06:35.463 11:17:17 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:06:35.721 11:17:17 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:06:35.721 11:17:17 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:06:35.721 11:17:17 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:06:35.721 11:17:17 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:06:35.721 11:17:17 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:06:35.979 11:17:17 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:06:35.979 11:17:17 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:06:35.979 11:17:17 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:06:35.979 11:17:17 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:06:35.979 11:17:17 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:06:35.979 11:17:17 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:06:35.979 11:17:17 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:06:35.979 11:17:17 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:06:35.979 11:17:17 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:06:35.979 11:17:17 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:06:35.979 11:17:17 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:06:36.237 11:17:17 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:06:36.237 11:17:17 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:06:36.237 11:17:17 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:06:36.237 11:17:17 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:06:36.237 11:17:17 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:06:36.237 11:17:17 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:06:36.237 11:17:17 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:06:36.237 11:17:17 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:06:36.237 11:17:17 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:06:36.237 11:17:17 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:06:36.237 11:17:17 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:06:36.237 11:17:17 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:06:36.237 11:17:17 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:06:36.237 11:17:17 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:06:36.237 11:17:17 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:06:36.237 11:17:17 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:06:36.237 11:17:17 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:06:36.495 11:17:18 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:06:36.495 11:17:18 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:06:36.495 11:17:18 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:06:36.495 11:17:18 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:06:36.495 11:17:18 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:06:36.495 11:17:18 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:06:36.753 11:17:18 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:06:36.753 11:17:18 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:06:36.753 11:17:18 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:06:36.753 11:17:18 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:06:36.753 11:17:18 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:06:36.753 11:17:18 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:06:36.753 11:17:18 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:06:36.753 11:17:18 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:06:36.753 11:17:18 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:06:37.012 11:17:18 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:06:37.012 11:17:18 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:06:37.012 11:17:18 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:06:37.012 11:17:18 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:06:37.012 11:17:18 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:06:37.012 11:17:18 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:06:37.012 11:17:18 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:06:37.012 11:17:18 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:06:37.012 11:17:18 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:06:37.012 11:17:18 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:06:37.012 11:17:18 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:06:37.012 11:17:18 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:06:37.012 11:17:18 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:06:37.012 11:17:18 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:06:37.012 11:17:18 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:06:37.012 11:17:18 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:06:37.271 11:17:18 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:06:37.271 11:17:18 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:06:37.271 11:17:18 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:06:37.271 11:17:18 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:06:37.271 11:17:18 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:06:37.271 11:17:18 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:06:37.271 11:17:18 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:06:37.271 11:17:18 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:06:37.271 11:17:18 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:06:37.530 11:17:19 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:06:37.530 11:17:19 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:06:37.530 11:17:19 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:06:37.530 11:17:19 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:06:37.530 11:17:19 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:06:37.530 11:17:19 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:06:37.530 11:17:19 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:06:37.530 11:17:19 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:06:37.788 11:17:19 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:06:37.788 11:17:19 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:06:37.788 11:17:19 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:06:37.788 11:17:19 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:06:37.788 11:17:19 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:06:37.788 11:17:19 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:06:37.788 11:17:19 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:06:38.046 11:17:19 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:06:38.046 11:17:19 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:06:38.046 11:17:19 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:06:38.046 11:17:19 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:06:38.046 11:17:19 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:06:38.046 11:17:19 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:06:38.046 11:17:19 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:06:38.046 11:17:19 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:06:38.046 11:17:19 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:06:38.046 11:17:19 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:06:38.046 11:17:19 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:06:38.046 11:17:19 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:06:38.046 11:17:19 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:06:38.046 11:17:19 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:06:38.046 11:17:19 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:06:38.046 11:17:19 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:06:38.303 11:17:19 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:06:38.303 11:17:19 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:06:38.303 11:17:19 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:06:38.304 11:17:19 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:06:38.304 11:17:19 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:06:38.304 11:17:19 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:06:38.304 11:17:19 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:06:38.304 11:17:19 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:06:38.560 11:17:20 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:06:38.560 11:17:20 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:06:38.560 11:17:20 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:06:38.560 11:17:20 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:06:38.560 11:17:20 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:06:38.560 11:17:20 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:06:38.560 11:17:20 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:06:38.560 11:17:20 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:06:38.560 11:17:20 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:06:38.560 11:17:20 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:06:38.560 11:17:20 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:06:38.818 11:17:20 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:06:38.818 11:17:20 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:06:38.818 11:17:20 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:06:38.818 11:17:20 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:06:38.818 11:17:20 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:06:38.818 11:17:20 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:06:38.818 11:17:20 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:06:38.818 11:17:20 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:06:38.818 11:17:20 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:06:38.818 11:17:20 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:06:38.818 11:17:20 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:06:39.076 11:17:20 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:06:39.076 11:17:20 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:06:39.076 11:17:20 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:06:39.076 11:17:20 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:06:39.076 11:17:20 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:06:39.076 11:17:20 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:06:39.076 11:17:20 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:06:39.076 11:17:20 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:06:39.076 11:17:20 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:06:39.076 11:17:20 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:06:39.334 11:17:20 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:06:39.334 11:17:20 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:06:39.334 11:17:20 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:06:39.334 11:17:20 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:06:39.334 11:17:20 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:06:39.334 11:17:20 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:06:39.334 11:17:20 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:06:39.334 11:17:20 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:06:39.334 11:17:20 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:06:39.334 11:17:20 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:06:39.334 11:17:21 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:06:39.334 11:17:21 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:06:39.334 11:17:21 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:06:39.591 11:17:21 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:06:39.591 11:17:21 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:06:39.591 11:17:21 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:06:39.591 11:17:21 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:06:39.591 11:17:21 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:06:39.591 11:17:21 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:06:39.591 11:17:21 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:06:39.591 11:17:21 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:06:39.848 11:17:21 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:06:39.849 11:17:21 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:06:39.849 11:17:21 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:06:39.849 11:17:21 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:06:39.849 11:17:21 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:06:39.849 11:17:21 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:06:39.849 11:17:21 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:06:39.849 11:17:21 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:06:40.106 11:17:21 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:06:40.106 11:17:21 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:06:40.106 11:17:21 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:06:40.106 11:17:21 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:06:40.106 11:17:21 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:06:40.106 11:17:21 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:06:40.106 11:17:21 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:06:40.106 11:17:21 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:06:40.106 11:17:21 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:06:40.106 11:17:21 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:06:40.364 11:17:21 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:06:40.364 11:17:21 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:06:40.364 11:17:21 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:06:40.364 11:17:21 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:06:40.364 11:17:21 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:06:40.364 11:17:21 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:06:40.364 11:17:21 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:06:40.364 11:17:22 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:06:40.364 11:17:22 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:06:40.364 11:17:22 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:06:40.364 11:17:22 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:06:40.622 11:17:22 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:06:40.622 11:17:22 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:06:40.622 11:17:22 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:06:40.622 11:17:22 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:06:40.622 11:17:22 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:06:40.622 11:17:22 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:06:40.622 11:17:22 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:06:40.622 11:17:22 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:06:40.880 11:17:22 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:06:40.880 11:17:22 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:06:40.880 11:17:22 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:06:40.880 11:17:22 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:06:40.880 11:17:22 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:06:40.880 11:17:22 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:06:41.138 11:17:22 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:06:41.138 11:17:22 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:06:41.138 11:17:22 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:06:41.138 11:17:22 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:06:41.138 11:17:22 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:06:41.138 11:17:22 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:06:41.138 11:17:22 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:06:41.138 11:17:22 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:06:41.138 11:17:22 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:06:41.138 11:17:22 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:06:41.138 11:17:22 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:06:41.400 11:17:22 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:06:41.400 11:17:22 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:06:41.400 11:17:22 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:06:41.400 11:17:22 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:06:41.400 11:17:23 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:06:41.400 11:17:23 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:06:41.400 11:17:23 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:06:41.400 11:17:23 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:06:41.400 11:17:23 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:06:41.400 11:17:23 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:06:41.657 11:17:23 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:06:41.657 11:17:23 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:06:41.657 11:17:23 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:06:41.657 11:17:23 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:06:41.657 11:17:23 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:06:41.657 11:17:23 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:06:41.914 11:17:23 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:06:41.914 11:17:23 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:06:41.914 11:17:23 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:06:41.914 11:17:23 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:06:41.914 11:17:23 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:06:41.914 11:17:23 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:06:41.914 11:17:23 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:06:41.914 11:17:23 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:06:41.914 11:17:23 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:06:41.914 11:17:23 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:06:41.914 11:17:23 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:06:41.914 11:17:23 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:06:41.914 11:17:23 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:06:42.172 11:17:23 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:06:42.172 11:17:23 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:06:42.172 11:17:23 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:06:42.172 11:17:23 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:06:42.172 11:17:23 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:06:42.172 11:17:23 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:06:42.172 11:17:23 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:06:42.429 11:17:23 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:06:42.430 11:17:23 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:06:42.430 11:17:23 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:06:42.430 11:17:23 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:06:42.430 11:17:24 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:06:42.430 11:17:24 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:06:42.430 11:17:24 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:06:42.430 11:17:24 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:06:42.430 11:17:24 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:06:42.430 11:17:24 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@17 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:06:42.687 11:17:24 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:06:42.687 11:17:24 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:06:42.687 11:17:24 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:06:42.687 11:17:24 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:06:42.687 11:17:24 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:06:42.687 11:17:24 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:06:42.687 11:17:24 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:06:42.687 11:17:24 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:06:42.687 11:17:24 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:06:42.946 11:17:24 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@18 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:06:43.204 11:17:24 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:06:43.204 11:17:24 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:06:43.204 11:17:24 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:06:43.204 11:17:24 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:06:43.204 11:17:24 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@68 -- # trap - SIGINT SIGTERM EXIT 00:06:43.204 11:17:24 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- target/ns_hotplug_stress.sh@70 -- # nvmftestfini 00:06:43.204 11:17:24 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@514 -- # nvmfcleanup 00:06:43.204 11:17:24 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@121 -- # sync 00:06:43.204 11:17:24 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:06:43.204 11:17:24 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@124 -- # set +e 00:06:43.204 11:17:24 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@125 -- # for i in {1..20} 00:06:43.204 11:17:24 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:06:43.204 rmmod nvme_tcp 00:06:43.204 rmmod nvme_fabrics 00:06:43.461 rmmod nvme_keyring 00:06:43.461 11:17:24 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:06:43.461 11:17:24 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@128 -- # set -e 00:06:43.462 11:17:24 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@129 -- # return 0 00:06:43.462 11:17:24 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@515 -- # '[' -n 62423 ']' 00:06:43.462 11:17:24 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@516 -- # killprocess 62423 00:06:43.462 11:17:24 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- common/autotest_common.sh@950 -- # '[' -z 62423 ']' 00:06:43.462 11:17:24 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- common/autotest_common.sh@954 -- # kill -0 62423 00:06:43.462 11:17:24 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- common/autotest_common.sh@955 -- # uname 00:06:43.462 11:17:24 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:06:43.462 11:17:24 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 62423 00:06:43.462 killing process with pid 62423 00:06:43.462 11:17:24 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- common/autotest_common.sh@956 -- # process_name=reactor_1 00:06:43.462 11:17:24 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- common/autotest_common.sh@960 -- # '[' reactor_1 = sudo ']' 00:06:43.462 11:17:24 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- common/autotest_common.sh@968 -- # echo 'killing process with pid 62423' 00:06:43.462 11:17:24 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- common/autotest_common.sh@969 -- # kill 62423 00:06:43.462 11:17:24 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- common/autotest_common.sh@974 -- # wait 62423 00:06:43.720 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:06:43.720 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:06:43.720 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:06:43.720 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@297 -- # iptr 00:06:43.720 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@789 -- # iptables-save 00:06:43.720 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@789 -- # iptables-restore 00:06:43.720 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:06:43.720 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@298 -- # [[ nvmf_tgt_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:06:43.720 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@299 -- # nvmf_veth_fini 00:06:43.720 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@233 -- # ip link set nvmf_init_br nomaster 00:06:43.720 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@234 -- # ip link set nvmf_init_br2 nomaster 00:06:43.720 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@235 -- # ip link set nvmf_tgt_br nomaster 00:06:43.720 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@236 -- # ip link set nvmf_tgt_br2 nomaster 00:06:43.720 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@237 -- # ip link set nvmf_init_br down 00:06:43.720 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@238 -- # ip link set nvmf_init_br2 down 00:06:43.720 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@239 -- # ip link set nvmf_tgt_br down 00:06:43.720 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@240 -- # ip link set nvmf_tgt_br2 down 00:06:43.720 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@241 -- # ip link delete nvmf_br type bridge 00:06:43.720 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@242 -- # ip link delete nvmf_init_if 00:06:43.720 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@243 -- # ip link delete nvmf_init_if2 00:06:43.978 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@244 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:06:43.978 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@245 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:06:43.978 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@246 -- # remove_spdk_ns 00:06:43.978 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:06:43.978 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:06:43.978 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:06:43.978 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- nvmf/common.sh@300 -- # return 0 00:06:43.978 00:06:43.978 real 0m48.260s 00:06:43.978 user 4m4.546s 00:06:43.978 sys 0m14.811s 00:06:43.978 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- common/autotest_common.sh@1126 -- # xtrace_disable 00:06:43.978 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_ns_hotplug_stress -- common/autotest_common.sh@10 -- # set +x 00:06:43.978 ************************************ 00:06:43.978 END TEST nvmf_ns_hotplug_stress 00:06:43.978 ************************************ 00:06:43.978 11:17:25 nvmf_tcp.nvmf_target_core -- nvmf/nvmf_target_core.sh@23 -- # run_test nvmf_delete_subsystem /home/vagrant/spdk_repo/spdk/test/nvmf/target/delete_subsystem.sh --transport=tcp 00:06:43.978 11:17:25 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:06:43.978 11:17:25 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1107 -- # xtrace_disable 00:06:43.978 11:17:25 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@10 -- # set +x 00:06:43.978 ************************************ 00:06:43.978 START TEST nvmf_delete_subsystem 00:06:43.978 ************************************ 00:06:43.978 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/nvmf/target/delete_subsystem.sh --transport=tcp 00:06:43.978 * Looking for test storage... 00:06:43.978 * Found test storage at /home/vagrant/spdk_repo/spdk/test/nvmf/target 00:06:43.978 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:06:43.978 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@1681 -- # lcov --version 00:06:43.978 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:06:44.236 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:06:44.236 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:06:44.236 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- scripts/common.sh@333 -- # local ver1 ver1_l 00:06:44.236 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- scripts/common.sh@334 -- # local ver2 ver2_l 00:06:44.236 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- scripts/common.sh@336 -- # IFS=.-: 00:06:44.236 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- scripts/common.sh@336 -- # read -ra ver1 00:06:44.236 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- scripts/common.sh@337 -- # IFS=.-: 00:06:44.236 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- scripts/common.sh@337 -- # read -ra ver2 00:06:44.236 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- scripts/common.sh@338 -- # local 'op=<' 00:06:44.236 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- scripts/common.sh@340 -- # ver1_l=2 00:06:44.236 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- scripts/common.sh@341 -- # ver2_l=1 00:06:44.236 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:06:44.236 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- scripts/common.sh@344 -- # case "$op" in 00:06:44.236 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- scripts/common.sh@345 -- # : 1 00:06:44.236 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- scripts/common.sh@364 -- # (( v = 0 )) 00:06:44.236 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:44.236 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- scripts/common.sh@365 -- # decimal 1 00:06:44.236 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- scripts/common.sh@353 -- # local d=1 00:06:44.237 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:44.237 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- scripts/common.sh@355 -- # echo 1 00:06:44.237 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- scripts/common.sh@365 -- # ver1[v]=1 00:06:44.237 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- scripts/common.sh@366 -- # decimal 2 00:06:44.237 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- scripts/common.sh@353 -- # local d=2 00:06:44.237 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:44.237 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- scripts/common.sh@355 -- # echo 2 00:06:44.237 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- scripts/common.sh@366 -- # ver2[v]=2 00:06:44.237 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:06:44.237 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:06:44.237 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- scripts/common.sh@368 -- # return 0 00:06:44.237 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:44.237 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:06:44.237 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:44.237 --rc genhtml_branch_coverage=1 00:06:44.237 --rc genhtml_function_coverage=1 00:06:44.237 --rc genhtml_legend=1 00:06:44.237 --rc geninfo_all_blocks=1 00:06:44.237 --rc geninfo_unexecuted_blocks=1 00:06:44.237 00:06:44.237 ' 00:06:44.237 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:06:44.237 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:44.237 --rc genhtml_branch_coverage=1 00:06:44.237 --rc genhtml_function_coverage=1 00:06:44.237 --rc genhtml_legend=1 00:06:44.237 --rc geninfo_all_blocks=1 00:06:44.237 --rc geninfo_unexecuted_blocks=1 00:06:44.237 00:06:44.237 ' 00:06:44.237 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:06:44.237 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:44.237 --rc genhtml_branch_coverage=1 00:06:44.237 --rc genhtml_function_coverage=1 00:06:44.237 --rc genhtml_legend=1 00:06:44.237 --rc geninfo_all_blocks=1 00:06:44.237 --rc geninfo_unexecuted_blocks=1 00:06:44.237 00:06:44.237 ' 00:06:44.237 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:06:44.237 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:44.237 --rc genhtml_branch_coverage=1 00:06:44.237 --rc genhtml_function_coverage=1 00:06:44.237 --rc genhtml_legend=1 00:06:44.237 --rc geninfo_all_blocks=1 00:06:44.237 --rc geninfo_unexecuted_blocks=1 00:06:44.237 00:06:44.237 ' 00:06:44.237 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@10 -- # source /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh 00:06:44.237 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@7 -- # uname -s 00:06:44.237 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:06:44.237 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:06:44.237 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:06:44.237 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:06:44.237 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:06:44.237 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:06:44.237 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:06:44.237 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:06:44.237 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:06:44.237 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:06:44.237 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:06:44.237 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@18 -- # NVME_HOSTID=3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:06:44.237 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:06:44.237 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:06:44.237 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@21 -- # NET_TYPE=virt 00:06:44.237 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:06:44.237 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@49 -- # source /home/vagrant/spdk_repo/spdk/scripts/common.sh 00:06:44.237 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- scripts/common.sh@15 -- # shopt -s extglob 00:06:44.237 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:44.237 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:44.237 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:44.237 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:44.237 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:44.237 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:44.237 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- paths/export.sh@5 -- # export PATH 00:06:44.237 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:44.237 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@51 -- # : 0 00:06:44.237 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:06:44.237 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:06:44.237 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:06:44.237 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:06:44.237 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:06:44.237 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:06:44.237 /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:06:44.237 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:06:44.237 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:06:44.237 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@55 -- # have_pci_nics=0 00:06:44.237 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@12 -- # nvmftestinit 00:06:44.237 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:06:44.237 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:06:44.237 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@474 -- # prepare_net_devs 00:06:44.237 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@436 -- # local -g is_hw=no 00:06:44.237 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@438 -- # remove_spdk_ns 00:06:44.237 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:06:44.237 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:06:44.237 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:06:44.237 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@440 -- # [[ virt != virt ]] 00:06:44.237 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@442 -- # [[ no == yes ]] 00:06:44.237 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@449 -- # [[ virt == phy ]] 00:06:44.237 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@452 -- # [[ virt == phy-fallback ]] 00:06:44.237 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@457 -- # [[ tcp == tcp ]] 00:06:44.237 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@458 -- # nvmf_veth_init 00:06:44.237 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@145 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:06:44.237 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@146 -- # NVMF_SECOND_INITIATOR_IP=10.0.0.2 00:06:44.237 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@147 -- # NVMF_FIRST_TARGET_IP=10.0.0.3 00:06:44.237 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@148 -- # NVMF_SECOND_TARGET_IP=10.0.0.4 00:06:44.237 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@149 -- # NVMF_INITIATOR_IP=10.0.0.1 00:06:44.237 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@150 -- # NVMF_BRIDGE=nvmf_br 00:06:44.237 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@151 -- # NVMF_INITIATOR_INTERFACE=nvmf_init_if 00:06:44.237 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@152 -- # NVMF_INITIATOR_INTERFACE2=nvmf_init_if2 00:06:44.237 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@153 -- # NVMF_INITIATOR_BRIDGE=nvmf_init_br 00:06:44.237 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@154 -- # NVMF_INITIATOR_BRIDGE2=nvmf_init_br2 00:06:44.237 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@155 -- # NVMF_TARGET_NAMESPACE=nvmf_tgt_ns_spdk 00:06:44.238 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@156 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:06:44.238 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@157 -- # NVMF_TARGET_INTERFACE=nvmf_tgt_if 00:06:44.238 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@158 -- # NVMF_TARGET_INTERFACE2=nvmf_tgt_if2 00:06:44.238 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@159 -- # NVMF_TARGET_BRIDGE=nvmf_tgt_br 00:06:44.238 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@160 -- # NVMF_TARGET_BRIDGE2=nvmf_tgt_br2 00:06:44.238 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@162 -- # ip link set nvmf_init_br nomaster 00:06:44.238 Cannot find device "nvmf_init_br" 00:06:44.238 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@162 -- # true 00:06:44.238 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@163 -- # ip link set nvmf_init_br2 nomaster 00:06:44.238 Cannot find device "nvmf_init_br2" 00:06:44.238 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@163 -- # true 00:06:44.238 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@164 -- # ip link set nvmf_tgt_br nomaster 00:06:44.238 Cannot find device "nvmf_tgt_br" 00:06:44.238 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@164 -- # true 00:06:44.238 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@165 -- # ip link set nvmf_tgt_br2 nomaster 00:06:44.238 Cannot find device "nvmf_tgt_br2" 00:06:44.238 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@165 -- # true 00:06:44.238 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@166 -- # ip link set nvmf_init_br down 00:06:44.238 Cannot find device "nvmf_init_br" 00:06:44.238 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@166 -- # true 00:06:44.238 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@167 -- # ip link set nvmf_init_br2 down 00:06:44.238 Cannot find device "nvmf_init_br2" 00:06:44.238 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@167 -- # true 00:06:44.238 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@168 -- # ip link set nvmf_tgt_br down 00:06:44.238 Cannot find device "nvmf_tgt_br" 00:06:44.238 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@168 -- # true 00:06:44.238 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@169 -- # ip link set nvmf_tgt_br2 down 00:06:44.238 Cannot find device "nvmf_tgt_br2" 00:06:44.238 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@169 -- # true 00:06:44.238 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@170 -- # ip link delete nvmf_br type bridge 00:06:44.238 Cannot find device "nvmf_br" 00:06:44.238 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@170 -- # true 00:06:44.238 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@171 -- # ip link delete nvmf_init_if 00:06:44.238 Cannot find device "nvmf_init_if" 00:06:44.238 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@171 -- # true 00:06:44.238 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@172 -- # ip link delete nvmf_init_if2 00:06:44.496 Cannot find device "nvmf_init_if2" 00:06:44.496 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@172 -- # true 00:06:44.496 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@173 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:06:44.496 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:06:44.496 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@173 -- # true 00:06:44.496 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@174 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:06:44.496 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:06:44.496 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@174 -- # true 00:06:44.496 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@177 -- # ip netns add nvmf_tgt_ns_spdk 00:06:44.496 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@180 -- # ip link add nvmf_init_if type veth peer name nvmf_init_br 00:06:44.496 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@181 -- # ip link add nvmf_init_if2 type veth peer name nvmf_init_br2 00:06:44.496 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@182 -- # ip link add nvmf_tgt_if type veth peer name nvmf_tgt_br 00:06:44.496 11:17:25 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@183 -- # ip link add nvmf_tgt_if2 type veth peer name nvmf_tgt_br2 00:06:44.496 11:17:26 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@186 -- # ip link set nvmf_tgt_if netns nvmf_tgt_ns_spdk 00:06:44.496 11:17:26 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@187 -- # ip link set nvmf_tgt_if2 netns nvmf_tgt_ns_spdk 00:06:44.496 11:17:26 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@190 -- # ip addr add 10.0.0.1/24 dev nvmf_init_if 00:06:44.496 11:17:26 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@191 -- # ip addr add 10.0.0.2/24 dev nvmf_init_if2 00:06:44.496 11:17:26 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@192 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.3/24 dev nvmf_tgt_if 00:06:44.496 11:17:26 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@193 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.4/24 dev nvmf_tgt_if2 00:06:44.496 11:17:26 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@196 -- # ip link set nvmf_init_if up 00:06:44.496 11:17:26 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@197 -- # ip link set nvmf_init_if2 up 00:06:44.496 11:17:26 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@198 -- # ip link set nvmf_init_br up 00:06:44.496 11:17:26 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@199 -- # ip link set nvmf_init_br2 up 00:06:44.496 11:17:26 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@200 -- # ip link set nvmf_tgt_br up 00:06:44.496 11:17:26 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@201 -- # ip link set nvmf_tgt_br2 up 00:06:44.496 11:17:26 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@202 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if up 00:06:44.496 11:17:26 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@203 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if2 up 00:06:44.496 11:17:26 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@204 -- # ip netns exec nvmf_tgt_ns_spdk ip link set lo up 00:06:44.496 11:17:26 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@207 -- # ip link add nvmf_br type bridge 00:06:44.496 11:17:26 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@208 -- # ip link set nvmf_br up 00:06:44.496 11:17:26 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@211 -- # ip link set nvmf_init_br master nvmf_br 00:06:44.496 11:17:26 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@212 -- # ip link set nvmf_init_br2 master nvmf_br 00:06:44.496 11:17:26 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@213 -- # ip link set nvmf_tgt_br master nvmf_br 00:06:44.496 11:17:26 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@214 -- # ip link set nvmf_tgt_br2 master nvmf_br 00:06:44.496 11:17:26 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@217 -- # ipts -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT 00:06:44.496 11:17:26 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT' 00:06:44.496 11:17:26 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@218 -- # ipts -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT 00:06:44.496 11:17:26 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT' 00:06:44.754 11:17:26 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@219 -- # ipts -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT 00:06:44.754 11:17:26 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@788 -- # iptables -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT -m comment --comment 'SPDK_NVMF:-A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT' 00:06:44.754 11:17:26 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@222 -- # ping -c 1 10.0.0.3 00:06:44.754 PING 10.0.0.3 (10.0.0.3) 56(84) bytes of data. 00:06:44.754 64 bytes from 10.0.0.3: icmp_seq=1 ttl=64 time=0.086 ms 00:06:44.754 00:06:44.754 --- 10.0.0.3 ping statistics --- 00:06:44.754 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:06:44.754 rtt min/avg/max/mdev = 0.086/0.086/0.086/0.000 ms 00:06:44.754 11:17:26 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@223 -- # ping -c 1 10.0.0.4 00:06:44.754 PING 10.0.0.4 (10.0.0.4) 56(84) bytes of data. 00:06:44.754 64 bytes from 10.0.0.4: icmp_seq=1 ttl=64 time=0.064 ms 00:06:44.754 00:06:44.754 --- 10.0.0.4 ping statistics --- 00:06:44.754 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:06:44.754 rtt min/avg/max/mdev = 0.064/0.064/0.064/0.000 ms 00:06:44.754 11:17:26 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@224 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.1 00:06:44.754 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:06:44.754 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.041 ms 00:06:44.754 00:06:44.754 --- 10.0.0.1 ping statistics --- 00:06:44.754 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:06:44.754 rtt min/avg/max/mdev = 0.041/0.041/0.041/0.000 ms 00:06:44.754 11:17:26 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@225 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.2 00:06:44.754 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:06:44.754 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.109 ms 00:06:44.754 00:06:44.754 --- 10.0.0.2 ping statistics --- 00:06:44.754 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:06:44.754 rtt min/avg/max/mdev = 0.109/0.109/0.109/0.000 ms 00:06:44.754 11:17:26 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@227 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:06:44.754 11:17:26 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@459 -- # return 0 00:06:44.754 11:17:26 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:06:44.754 11:17:26 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:06:44.754 11:17:26 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:06:44.754 11:17:26 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:06:44.754 11:17:26 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:06:44.754 11:17:26 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:06:44.754 11:17:26 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:06:44.754 11:17:26 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@13 -- # nvmfappstart -m 0x3 00:06:44.754 11:17:26 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:06:44.754 11:17:26 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@724 -- # xtrace_disable 00:06:44.754 11:17:26 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@10 -- # set +x 00:06:44.754 11:17:26 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@507 -- # nvmfpid=65002 00:06:44.754 11:17:26 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@508 -- # waitforlisten 65002 00:06:44.754 11:17:26 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@506 -- # ip netns exec nvmf_tgt_ns_spdk /home/vagrant/spdk_repo/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x3 00:06:44.754 11:17:26 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@831 -- # '[' -z 65002 ']' 00:06:44.754 11:17:26 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:44.755 11:17:26 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@836 -- # local max_retries=100 00:06:44.755 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:44.755 11:17:26 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:44.755 11:17:26 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@840 -- # xtrace_disable 00:06:44.755 11:17:26 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@10 -- # set +x 00:06:44.755 [2024-10-07 11:17:26.321576] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:06:44.755 [2024-10-07 11:17:26.321709] [ DPDK EAL parameters: nvmf -c 0x3 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:06:44.755 [2024-10-07 11:17:26.456465] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 2 00:06:45.012 [2024-10-07 11:17:26.608991] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:06:45.012 [2024-10-07 11:17:26.609075] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:06:45.012 [2024-10-07 11:17:26.609089] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:06:45.012 [2024-10-07 11:17:26.609098] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:06:45.012 [2024-10-07 11:17:26.609106] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:06:45.012 [2024-10-07 11:17:26.609737] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:06:45.012 [2024-10-07 11:17:26.609746] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:06:45.946 11:17:27 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:06:45.946 11:17:27 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@864 -- # return 0 00:06:45.946 11:17:27 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:06:45.946 11:17:27 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@730 -- # xtrace_disable 00:06:45.946 11:17:27 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@10 -- # set +x 00:06:45.946 11:17:27 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:06:45.946 11:17:27 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:06:45.946 11:17:27 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:45.946 11:17:27 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@10 -- # set +x 00:06:45.946 [2024-10-07 11:17:27.434883] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:06:45.946 11:17:27 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:45.946 11:17:27 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:06:45.946 11:17:27 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:45.946 11:17:27 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@10 -- # set +x 00:06:45.946 11:17:27 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:45.946 11:17:27 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4420 00:06:45.946 11:17:27 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:45.946 11:17:27 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@10 -- # set +x 00:06:45.946 [2024-10-07 11:17:27.455294] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:06:45.946 11:17:27 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:45.946 11:17:27 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:06:45.946 11:17:27 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:45.946 11:17:27 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@10 -- # set +x 00:06:45.946 NULL1 00:06:45.946 11:17:27 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:45.946 11:17:27 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@23 -- # rpc_cmd bdev_delay_create -b NULL1 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:06:45.946 11:17:27 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:45.946 11:17:27 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@10 -- # set +x 00:06:45.946 Delay0 00:06:45.946 11:17:27 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:45.946 11:17:27 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:06:45.946 11:17:27 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:45.946 11:17:27 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@10 -- # set +x 00:06:45.946 11:17:27 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:45.946 11:17:27 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@28 -- # perf_pid=65053 00:06:45.946 11:17:27 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@26 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_nvme_perf -c 0xC -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.3 trsvcid:4420' -t 5 -q 128 -w randrw -M 70 -o 512 -P 4 00:06:45.946 11:17:27 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@30 -- # sleep 2 00:06:46.204 [2024-10-07 11:17:27.656663] subsystem.c:1641:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on TCP/10.0.0.3/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:06:48.110 11:17:29 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@32 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:06:48.110 11:17:29 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:48.110 11:17:29 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@10 -- # set +x 00:06:48.110 Read completed with error (sct=0, sc=8) 00:06:48.110 Read completed with error (sct=0, sc=8) 00:06:48.110 Read completed with error (sct=0, sc=8) 00:06:48.110 Write completed with error (sct=0, sc=8) 00:06:48.110 starting I/O failed: -6 00:06:48.110 Read completed with error (sct=0, sc=8) 00:06:48.110 Read completed with error (sct=0, sc=8) 00:06:48.110 Read completed with error (sct=0, sc=8) 00:06:48.110 Write completed with error (sct=0, sc=8) 00:06:48.110 starting I/O failed: -6 00:06:48.110 Write completed with error (sct=0, sc=8) 00:06:48.110 Read completed with error (sct=0, sc=8) 00:06:48.110 Read completed with error (sct=0, sc=8) 00:06:48.110 Read completed with error (sct=0, sc=8) 00:06:48.110 starting I/O failed: -6 00:06:48.110 Read completed with error (sct=0, sc=8) 00:06:48.110 Write completed with error (sct=0, sc=8) 00:06:48.110 Read completed with error (sct=0, sc=8) 00:06:48.110 Write completed with error (sct=0, sc=8) 00:06:48.110 starting I/O failed: -6 00:06:48.110 Read completed with error (sct=0, sc=8) 00:06:48.110 Read completed with error (sct=0, sc=8) 00:06:48.110 Write completed with error (sct=0, sc=8) 00:06:48.110 Read completed with error (sct=0, sc=8) 00:06:48.110 starting I/O failed: -6 00:06:48.110 Read completed with error (sct=0, sc=8) 00:06:48.110 Read completed with error (sct=0, sc=8) 00:06:48.110 Read completed with error (sct=0, sc=8) 00:06:48.110 Read completed with error (sct=0, sc=8) 00:06:48.110 starting I/O failed: -6 00:06:48.110 Read completed with error (sct=0, sc=8) 00:06:48.110 Read completed with error (sct=0, sc=8) 00:06:48.110 Read completed with error (sct=0, sc=8) 00:06:48.110 Read completed with error (sct=0, sc=8) 00:06:48.110 starting I/O failed: -6 00:06:48.110 Write completed with error (sct=0, sc=8) 00:06:48.110 Read completed with error (sct=0, sc=8) 00:06:48.110 Read completed with error (sct=0, sc=8) 00:06:48.110 Read completed with error (sct=0, sc=8) 00:06:48.110 starting I/O failed: -6 00:06:48.110 Read completed with error (sct=0, sc=8) 00:06:48.110 Read completed with error (sct=0, sc=8) 00:06:48.110 Read completed with error (sct=0, sc=8) 00:06:48.110 Read completed with error (sct=0, sc=8) 00:06:48.110 starting I/O failed: -6 00:06:48.110 Write completed with error (sct=0, sc=8) 00:06:48.110 Read completed with error (sct=0, sc=8) 00:06:48.110 Write completed with error (sct=0, sc=8) 00:06:48.110 Read completed with error (sct=0, sc=8) 00:06:48.110 starting I/O failed: -6 00:06:48.110 Write completed with error (sct=0, sc=8) 00:06:48.110 Read completed with error (sct=0, sc=8) 00:06:48.110 Write completed with error (sct=0, sc=8) 00:06:48.110 Read completed with error (sct=0, sc=8) 00:06:48.110 starting I/O failed: -6 00:06:48.110 [2024-10-07 11:17:29.699434] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc2ad00 is same with the state(6) to be set 00:06:48.110 Read completed with error (sct=0, sc=8) 00:06:48.110 Read completed with error (sct=0, sc=8) 00:06:48.110 Read completed with error (sct=0, sc=8) 00:06:48.110 Read completed with error (sct=0, sc=8) 00:06:48.110 Read completed with error (sct=0, sc=8) 00:06:48.110 Read completed with error (sct=0, sc=8) 00:06:48.110 Read completed with error (sct=0, sc=8) 00:06:48.110 Read completed with error (sct=0, sc=8) 00:06:48.110 Read completed with error (sct=0, sc=8) 00:06:48.110 Read completed with error (sct=0, sc=8) 00:06:48.110 Read completed with error (sct=0, sc=8) 00:06:48.110 Write completed with error (sct=0, sc=8) 00:06:48.110 Write completed with error (sct=0, sc=8) 00:06:48.110 Read completed with error (sct=0, sc=8) 00:06:48.110 Write completed with error (sct=0, sc=8) 00:06:48.110 Read completed with error (sct=0, sc=8) 00:06:48.110 Read completed with error (sct=0, sc=8) 00:06:48.110 Write completed with error (sct=0, sc=8) 00:06:48.110 Read completed with error (sct=0, sc=8) 00:06:48.111 Read completed with error (sct=0, sc=8) 00:06:48.111 Read completed with error (sct=0, sc=8) 00:06:48.111 Write completed with error (sct=0, sc=8) 00:06:48.111 Read completed with error (sct=0, sc=8) 00:06:48.111 Write completed with error (sct=0, sc=8) 00:06:48.111 Read completed with error (sct=0, sc=8) 00:06:48.111 Write completed with error (sct=0, sc=8) 00:06:48.111 Read completed with error (sct=0, sc=8) 00:06:48.111 Read completed with error (sct=0, sc=8) 00:06:48.111 Read completed with error (sct=0, sc=8) 00:06:48.111 Read completed with error (sct=0, sc=8) 00:06:48.111 Read completed with error (sct=0, sc=8) 00:06:48.111 Read completed with error (sct=0, sc=8) 00:06:48.111 Read completed with error (sct=0, sc=8) 00:06:48.111 Read completed with error (sct=0, sc=8) 00:06:48.111 Write completed with error (sct=0, sc=8) 00:06:48.111 Write completed with error (sct=0, sc=8) 00:06:48.111 Read completed with error (sct=0, sc=8) 00:06:48.111 Read completed with error (sct=0, sc=8) 00:06:48.111 Read completed with error (sct=0, sc=8) 00:06:48.111 Write completed with error (sct=0, sc=8) 00:06:48.111 Read completed with error (sct=0, sc=8) 00:06:48.111 Write completed with error (sct=0, sc=8) 00:06:48.111 Read completed with error (sct=0, sc=8) 00:06:48.111 Read completed with error (sct=0, sc=8) 00:06:48.111 Read completed with error (sct=0, sc=8) 00:06:48.111 Read completed with error (sct=0, sc=8) 00:06:48.111 Read completed with error (sct=0, sc=8) 00:06:48.111 Read completed with error (sct=0, sc=8) 00:06:48.111 Read completed with error (sct=0, sc=8) 00:06:48.111 Read completed with error (sct=0, sc=8) 00:06:48.111 Read completed with error (sct=0, sc=8) 00:06:48.111 Read completed with error (sct=0, sc=8) 00:06:48.111 Write completed with error (sct=0, sc=8) 00:06:48.111 Read completed with error (sct=0, sc=8) 00:06:48.111 Read completed with error (sct=0, sc=8) 00:06:48.111 Read completed with error (sct=0, sc=8) 00:06:48.111 Read completed with error (sct=0, sc=8) 00:06:48.111 Write completed with error (sct=0, sc=8) 00:06:48.111 starting I/O failed: -6 00:06:48.111 Read completed with error (sct=0, sc=8) 00:06:48.111 Read completed with error (sct=0, sc=8) 00:06:48.111 Read completed with error (sct=0, sc=8) 00:06:48.111 Read completed with error (sct=0, sc=8) 00:06:48.111 starting I/O failed: -6 00:06:48.111 Write completed with error (sct=0, sc=8) 00:06:48.111 Read completed with error (sct=0, sc=8) 00:06:48.111 Write completed with error (sct=0, sc=8) 00:06:48.111 Read completed with error (sct=0, sc=8) 00:06:48.111 starting I/O failed: -6 00:06:48.111 Read completed with error (sct=0, sc=8) 00:06:48.111 Read completed with error (sct=0, sc=8) 00:06:48.111 Write completed with error (sct=0, sc=8) 00:06:48.111 Read completed with error (sct=0, sc=8) 00:06:48.111 starting I/O failed: -6 00:06:48.111 Read completed with error (sct=0, sc=8) 00:06:48.111 Read completed with error (sct=0, sc=8) 00:06:48.111 Read completed with error (sct=0, sc=8) 00:06:48.111 Write completed with error (sct=0, sc=8) 00:06:48.111 starting I/O failed: -6 00:06:48.111 Read completed with error (sct=0, sc=8) 00:06:48.111 Write completed with error (sct=0, sc=8) 00:06:48.111 Read completed with error (sct=0, sc=8) 00:06:48.111 Write completed with error (sct=0, sc=8) 00:06:48.111 starting I/O failed: -6 00:06:48.111 Write completed with error (sct=0, sc=8) 00:06:48.111 Read completed with error (sct=0, sc=8) 00:06:48.111 Read completed with error (sct=0, sc=8) 00:06:48.111 Read completed with error (sct=0, sc=8) 00:06:48.111 starting I/O failed: -6 00:06:48.111 Write completed with error (sct=0, sc=8) 00:06:48.111 Read completed with error (sct=0, sc=8) 00:06:48.111 Read completed with error (sct=0, sc=8) 00:06:48.111 Read completed with error (sct=0, sc=8) 00:06:48.111 starting I/O failed: -6 00:06:48.111 Read completed with error (sct=0, sc=8) 00:06:48.111 Read completed with error (sct=0, sc=8) 00:06:48.111 Write completed with error (sct=0, sc=8) 00:06:48.111 Read completed with error (sct=0, sc=8) 00:06:48.111 starting I/O failed: -6 00:06:48.111 Read completed with error (sct=0, sc=8) 00:06:48.111 Read completed with error (sct=0, sc=8) 00:06:48.111 Read completed with error (sct=0, sc=8) 00:06:48.111 Read completed with error (sct=0, sc=8) 00:06:48.111 starting I/O failed: -6 00:06:48.111 Read completed with error (sct=0, sc=8) 00:06:48.111 Read completed with error (sct=0, sc=8) 00:06:48.111 Write completed with error (sct=0, sc=8) 00:06:48.111 [2024-10-07 11:17:29.701869] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7f06fc00d310 is same with the state(6) to be set 00:06:48.111 Write completed with error (sct=0, sc=8) 00:06:48.111 Read completed with error (sct=0, sc=8) 00:06:48.111 Read completed with error (sct=0, sc=8) 00:06:48.111 Read completed with error (sct=0, sc=8) 00:06:48.111 Write completed with error (sct=0, sc=8) 00:06:48.111 Read completed with error (sct=0, sc=8) 00:06:48.111 Read completed with error (sct=0, sc=8) 00:06:48.111 Read completed with error (sct=0, sc=8) 00:06:48.111 Write completed with error (sct=0, sc=8) 00:06:48.111 Write completed with error (sct=0, sc=8) 00:06:48.111 Write completed with error (sct=0, sc=8) 00:06:48.111 Write completed with error (sct=0, sc=8) 00:06:48.111 Read completed with error (sct=0, sc=8) 00:06:48.111 Read completed with error (sct=0, sc=8) 00:06:48.111 Write completed with error (sct=0, sc=8) 00:06:48.111 Read completed with error (sct=0, sc=8) 00:06:48.111 Read completed with error (sct=0, sc=8) 00:06:48.111 Read completed with error (sct=0, sc=8) 00:06:48.111 Write completed with error (sct=0, sc=8) 00:06:48.111 Read completed with error (sct=0, sc=8) 00:06:48.111 Read completed with error (sct=0, sc=8) 00:06:48.111 Read completed with error (sct=0, sc=8) 00:06:48.111 Write completed with error (sct=0, sc=8) 00:06:48.111 Read completed with error (sct=0, sc=8) 00:06:48.111 Read completed with error (sct=0, sc=8) 00:06:48.111 Read completed with error (sct=0, sc=8) 00:06:48.111 Write completed with error (sct=0, sc=8) 00:06:48.111 Write completed with error (sct=0, sc=8) 00:06:48.111 Read completed with error (sct=0, sc=8) 00:06:48.111 Read completed with error (sct=0, sc=8) 00:06:48.111 Read completed with error (sct=0, sc=8) 00:06:48.111 Read completed with error (sct=0, sc=8) 00:06:48.111 Read completed with error (sct=0, sc=8) 00:06:48.111 Read completed with error (sct=0, sc=8) 00:06:48.111 Write completed with error (sct=0, sc=8) 00:06:48.111 Read completed with error (sct=0, sc=8) 00:06:48.111 Read completed with error (sct=0, sc=8) 00:06:48.111 Read completed with error (sct=0, sc=8) 00:06:48.111 Read completed with error (sct=0, sc=8) 00:06:48.111 Read completed with error (sct=0, sc=8) 00:06:48.111 Write completed with error (sct=0, sc=8) 00:06:48.111 Read completed with error (sct=0, sc=8) 00:06:48.111 Read completed with error (sct=0, sc=8) 00:06:48.111 Read completed with error (sct=0, sc=8) 00:06:48.111 Read completed with error (sct=0, sc=8) 00:06:48.111 Read completed with error (sct=0, sc=8) 00:06:48.111 Read completed with error (sct=0, sc=8) 00:06:48.111 Read completed with error (sct=0, sc=8) 00:06:48.111 Read completed with error (sct=0, sc=8) 00:06:48.111 Read completed with error (sct=0, sc=8) 00:06:48.111 Read completed with error (sct=0, sc=8) 00:06:48.111 Read completed with error (sct=0, sc=8) 00:06:48.111 Read completed with error (sct=0, sc=8) 00:06:49.046 [2024-10-07 11:17:30.675593] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc26fb0 is same with the state(6) to be set 00:06:49.046 Read completed with error (sct=0, sc=8) 00:06:49.046 Read completed with error (sct=0, sc=8) 00:06:49.046 Read completed with error (sct=0, sc=8) 00:06:49.046 Write completed with error (sct=0, sc=8) 00:06:49.046 Write completed with error (sct=0, sc=8) 00:06:49.046 Write completed with error (sct=0, sc=8) 00:06:49.046 Read completed with error (sct=0, sc=8) 00:06:49.046 Write completed with error (sct=0, sc=8) 00:06:49.046 Write completed with error (sct=0, sc=8) 00:06:49.046 Write completed with error (sct=0, sc=8) 00:06:49.046 Read completed with error (sct=0, sc=8) 00:06:49.046 Read completed with error (sct=0, sc=8) 00:06:49.046 Read completed with error (sct=0, sc=8) 00:06:49.046 Read completed with error (sct=0, sc=8) 00:06:49.046 Read completed with error (sct=0, sc=8) 00:06:49.046 Read completed with error (sct=0, sc=8) 00:06:49.046 Read completed with error (sct=0, sc=8) 00:06:49.046 Write completed with error (sct=0, sc=8) 00:06:49.046 Write completed with error (sct=0, sc=8) 00:06:49.046 Read completed with error (sct=0, sc=8) 00:06:49.046 Read completed with error (sct=0, sc=8) 00:06:49.046 Write completed with error (sct=0, sc=8) 00:06:49.046 Read completed with error (sct=0, sc=8) 00:06:49.046 Read completed with error (sct=0, sc=8) 00:06:49.046 Read completed with error (sct=0, sc=8) 00:06:49.046 Read completed with error (sct=0, sc=8) 00:06:49.046 [2024-10-07 11:17:30.696745] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7f06fc00cfe0 is same with the state(6) to be set 00:06:49.046 Write completed with error (sct=0, sc=8) 00:06:49.046 Read completed with error (sct=0, sc=8) 00:06:49.046 Read completed with error (sct=0, sc=8) 00:06:49.046 Read completed with error (sct=0, sc=8) 00:06:49.046 Write completed with error (sct=0, sc=8) 00:06:49.046 Write completed with error (sct=0, sc=8) 00:06:49.046 Read completed with error (sct=0, sc=8) 00:06:49.046 Write completed with error (sct=0, sc=8) 00:06:49.046 Read completed with error (sct=0, sc=8) 00:06:49.046 Write completed with error (sct=0, sc=8) 00:06:49.046 Write completed with error (sct=0, sc=8) 00:06:49.046 Read completed with error (sct=0, sc=8) 00:06:49.046 Read completed with error (sct=0, sc=8) 00:06:49.046 Read completed with error (sct=0, sc=8) 00:06:49.046 Read completed with error (sct=0, sc=8) 00:06:49.046 Read completed with error (sct=0, sc=8) 00:06:49.046 Read completed with error (sct=0, sc=8) 00:06:49.046 Write completed with error (sct=0, sc=8) 00:06:49.046 Read completed with error (sct=0, sc=8) 00:06:49.046 Read completed with error (sct=0, sc=8) 00:06:49.046 Write completed with error (sct=0, sc=8) 00:06:49.046 Read completed with error (sct=0, sc=8) 00:06:49.046 Read completed with error (sct=0, sc=8) 00:06:49.046 Read completed with error (sct=0, sc=8) 00:06:49.046 Read completed with error (sct=0, sc=8) 00:06:49.046 Read completed with error (sct=0, sc=8) 00:06:49.046 Read completed with error (sct=0, sc=8) 00:06:49.046 Write completed with error (sct=0, sc=8) 00:06:49.046 Write completed with error (sct=0, sc=8) 00:06:49.046 Read completed with error (sct=0, sc=8) 00:06:49.046 [2024-10-07 11:17:30.700325] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7f06fc00d640 is same with the state(6) to be set 00:06:49.046 Read completed with error (sct=0, sc=8) 00:06:49.046 Write completed with error (sct=0, sc=8) 00:06:49.046 Read completed with error (sct=0, sc=8) 00:06:49.046 Write completed with error (sct=0, sc=8) 00:06:49.046 Read completed with error (sct=0, sc=8) 00:06:49.046 Write completed with error (sct=0, sc=8) 00:06:49.046 Write completed with error (sct=0, sc=8) 00:06:49.046 Read completed with error (sct=0, sc=8) 00:06:49.046 Read completed with error (sct=0, sc=8) 00:06:49.046 Read completed with error (sct=0, sc=8) 00:06:49.046 Read completed with error (sct=0, sc=8) 00:06:49.046 Read completed with error (sct=0, sc=8) 00:06:49.046 Read completed with error (sct=0, sc=8) 00:06:49.046 Read completed with error (sct=0, sc=8) 00:06:49.046 Read completed with error (sct=0, sc=8) 00:06:49.046 Write completed with error (sct=0, sc=8) 00:06:49.046 Read completed with error (sct=0, sc=8) 00:06:49.046 Read completed with error (sct=0, sc=8) 00:06:49.046 Read completed with error (sct=0, sc=8) 00:06:49.046 Read completed with error (sct=0, sc=8) 00:06:49.046 Read completed with error (sct=0, sc=8) 00:06:49.046 Write completed with error (sct=0, sc=8) 00:06:49.046 Read completed with error (sct=0, sc=8) 00:06:49.046 [2024-10-07 11:17:30.701781] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc2ab20 is same with the state(6) to be set 00:06:49.046 Write completed with error (sct=0, sc=8) 00:06:49.046 Read completed with error (sct=0, sc=8) 00:06:49.046 Read completed with error (sct=0, sc=8) 00:06:49.046 Read completed with error (sct=0, sc=8) 00:06:49.046 Read completed with error (sct=0, sc=8) 00:06:49.046 Write completed with error (sct=0, sc=8) 00:06:49.046 Write completed with error (sct=0, sc=8) 00:06:49.046 Write completed with error (sct=0, sc=8) 00:06:49.046 Read completed with error (sct=0, sc=8) 00:06:49.046 Write completed with error (sct=0, sc=8) 00:06:49.046 Read completed with error (sct=0, sc=8) 00:06:49.046 Read completed with error (sct=0, sc=8) 00:06:49.046 Read completed with error (sct=0, sc=8) 00:06:49.046 Read completed with error (sct=0, sc=8) 00:06:49.046 Read completed with error (sct=0, sc=8) 00:06:49.046 Read completed with error (sct=0, sc=8) 00:06:49.046 Write completed with error (sct=0, sc=8) 00:06:49.046 Write completed with error (sct=0, sc=8) 00:06:49.046 Read completed with error (sct=0, sc=8) 00:06:49.046 Read completed with error (sct=0, sc=8) 00:06:49.046 Read completed with error (sct=0, sc=8) 00:06:49.046 Read completed with error (sct=0, sc=8) 00:06:49.046 [2024-10-07 11:17:30.702022] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xc6abe0 is same with the state(6) to be set 00:06:49.046 Initializing NVMe Controllers 00:06:49.046 Attached to NVMe over Fabrics controller at 10.0.0.3:4420: nqn.2016-06.io.spdk:cnode1 00:06:49.046 Controller IO queue size 128, less than required. 00:06:49.046 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:06:49.047 Associating TCP (addr:10.0.0.3 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 2 00:06:49.047 Associating TCP (addr:10.0.0.3 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 3 00:06:49.047 Initialization complete. Launching workers. 00:06:49.047 ======================================================== 00:06:49.047 Latency(us) 00:06:49.047 Device Information : IOPS MiB/s Average min max 00:06:49.047 TCP (addr:10.0.0.3 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 2: 166.29 0.08 904008.85 460.35 1017504.30 00:06:49.047 TCP (addr:10.0.0.3 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 3: 162.33 0.08 959514.37 1189.23 2001319.19 00:06:49.047 ======================================================== 00:06:49.047 Total : 328.63 0.16 931427.24 460.35 2001319.19 00:06:49.047 00:06:49.047 [2024-10-07 11:17:30.703549] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc26fb0 (9): Bad file descriptor 00:06:49.047 /home/vagrant/spdk_repo/spdk/build/bin/spdk_nvme_perf: errors occurred 00:06:49.047 11:17:30 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:49.047 11:17:30 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@34 -- # delay=0 00:06:49.047 11:17:30 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@35 -- # kill -0 65053 00:06:49.047 11:17:30 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@36 -- # sleep 0.5 00:06:49.612 11:17:31 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@38 -- # (( delay++ > 30 )) 00:06:49.612 11:17:31 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@35 -- # kill -0 65053 00:06:49.612 /home/vagrant/spdk_repo/spdk/test/nvmf/target/delete_subsystem.sh: line 35: kill: (65053) - No such process 00:06:49.612 11:17:31 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@45 -- # NOT wait 65053 00:06:49.612 11:17:31 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@650 -- # local es=0 00:06:49.612 11:17:31 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@652 -- # valid_exec_arg wait 65053 00:06:49.612 11:17:31 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@638 -- # local arg=wait 00:06:49.612 11:17:31 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:49.612 11:17:31 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@642 -- # type -t wait 00:06:49.612 11:17:31 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:49.612 11:17:31 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@653 -- # wait 65053 00:06:49.612 11:17:31 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@653 -- # es=1 00:06:49.612 11:17:31 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:49.612 11:17:31 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:06:49.612 11:17:31 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:49.612 11:17:31 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@48 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:06:49.612 11:17:31 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:49.612 11:17:31 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@10 -- # set +x 00:06:49.612 11:17:31 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:49.613 11:17:31 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@49 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4420 00:06:49.613 11:17:31 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:49.613 11:17:31 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@10 -- # set +x 00:06:49.613 [2024-10-07 11:17:31.234298] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:06:49.613 11:17:31 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:49.613 11:17:31 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@50 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:06:49.613 11:17:31 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:49.613 11:17:31 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@10 -- # set +x 00:06:49.613 11:17:31 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:49.613 11:17:31 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@54 -- # perf_pid=65104 00:06:49.613 11:17:31 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@56 -- # delay=0 00:06:49.613 11:17:31 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@57 -- # kill -0 65104 00:06:49.613 11:17:31 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:06:49.613 11:17:31 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@52 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_nvme_perf -c 0xC -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.3 trsvcid:4420' -t 3 -q 128 -w randrw -M 70 -o 512 -P 4 00:06:49.871 [2024-10-07 11:17:31.417944] subsystem.c:1641:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on TCP/10.0.0.3/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:06:50.129 11:17:31 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:06:50.129 11:17:31 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@57 -- # kill -0 65104 00:06:50.129 11:17:31 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:06:50.703 11:17:32 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:06:50.703 11:17:32 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@57 -- # kill -0 65104 00:06:50.703 11:17:32 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:06:51.270 11:17:32 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:06:51.270 11:17:32 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@57 -- # kill -0 65104 00:06:51.270 11:17:32 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:06:51.837 11:17:33 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:06:51.837 11:17:33 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@57 -- # kill -0 65104 00:06:51.837 11:17:33 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:06:52.095 11:17:33 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:06:52.095 11:17:33 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@57 -- # kill -0 65104 00:06:52.095 11:17:33 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:06:52.661 11:17:34 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:06:52.661 11:17:34 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@57 -- # kill -0 65104 00:06:52.661 11:17:34 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:06:52.918 Initializing NVMe Controllers 00:06:52.918 Attached to NVMe over Fabrics controller at 10.0.0.3:4420: nqn.2016-06.io.spdk:cnode1 00:06:52.918 Controller IO queue size 128, less than required. 00:06:52.918 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:06:52.918 Associating TCP (addr:10.0.0.3 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 2 00:06:52.918 Associating TCP (addr:10.0.0.3 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 3 00:06:52.918 Initialization complete. Launching workers. 00:06:52.918 ======================================================== 00:06:52.918 Latency(us) 00:06:52.918 Device Information : IOPS MiB/s Average min max 00:06:52.918 TCP (addr:10.0.0.3 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 2: 128.00 0.06 1004482.98 1000239.22 1015378.81 00:06:52.918 TCP (addr:10.0.0.3 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 3: 128.00 0.06 1009065.86 1000478.36 1044015.28 00:06:52.919 ======================================================== 00:06:52.919 Total : 256.00 0.12 1006774.42 1000239.22 1044015.28 00:06:52.919 00:06:53.202 11:17:34 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:06:53.202 11:17:34 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@57 -- # kill -0 65104 00:06:53.202 /home/vagrant/spdk_repo/spdk/test/nvmf/target/delete_subsystem.sh: line 57: kill: (65104) - No such process 00:06:53.202 11:17:34 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@67 -- # wait 65104 00:06:53.202 11:17:34 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@69 -- # trap - SIGINT SIGTERM EXIT 00:06:53.202 11:17:34 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- target/delete_subsystem.sh@71 -- # nvmftestfini 00:06:53.202 11:17:34 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@514 -- # nvmfcleanup 00:06:53.202 11:17:34 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@121 -- # sync 00:06:53.202 11:17:34 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:06:53.202 11:17:34 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@124 -- # set +e 00:06:53.202 11:17:34 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@125 -- # for i in {1..20} 00:06:53.202 11:17:34 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:06:53.202 rmmod nvme_tcp 00:06:53.202 rmmod nvme_fabrics 00:06:53.202 rmmod nvme_keyring 00:06:53.202 11:17:34 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:06:53.202 11:17:34 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@128 -- # set -e 00:06:53.202 11:17:34 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@129 -- # return 0 00:06:53.202 11:17:34 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@515 -- # '[' -n 65002 ']' 00:06:53.202 11:17:34 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@516 -- # killprocess 65002 00:06:53.202 11:17:34 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@950 -- # '[' -z 65002 ']' 00:06:53.202 11:17:34 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@954 -- # kill -0 65002 00:06:53.202 11:17:34 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@955 -- # uname 00:06:53.202 11:17:34 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:06:53.202 11:17:34 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 65002 00:06:53.486 11:17:34 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:06:53.486 11:17:34 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:06:53.486 11:17:34 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@968 -- # echo 'killing process with pid 65002' 00:06:53.486 killing process with pid 65002 00:06:53.486 11:17:34 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@969 -- # kill 65002 00:06:53.486 11:17:34 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@974 -- # wait 65002 00:06:53.744 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:06:53.744 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:06:53.744 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:06:53.744 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@297 -- # iptr 00:06:53.744 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@789 -- # iptables-save 00:06:53.744 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:06:53.744 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@789 -- # iptables-restore 00:06:53.744 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@298 -- # [[ nvmf_tgt_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:06:53.744 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@299 -- # nvmf_veth_fini 00:06:53.744 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@233 -- # ip link set nvmf_init_br nomaster 00:06:53.744 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@234 -- # ip link set nvmf_init_br2 nomaster 00:06:53.744 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@235 -- # ip link set nvmf_tgt_br nomaster 00:06:53.744 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@236 -- # ip link set nvmf_tgt_br2 nomaster 00:06:53.744 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@237 -- # ip link set nvmf_init_br down 00:06:53.744 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@238 -- # ip link set nvmf_init_br2 down 00:06:53.744 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@239 -- # ip link set nvmf_tgt_br down 00:06:53.744 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@240 -- # ip link set nvmf_tgt_br2 down 00:06:53.744 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@241 -- # ip link delete nvmf_br type bridge 00:06:53.744 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@242 -- # ip link delete nvmf_init_if 00:06:53.744 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@243 -- # ip link delete nvmf_init_if2 00:06:53.744 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@244 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:06:53.744 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@245 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:06:54.002 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@246 -- # remove_spdk_ns 00:06:54.002 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:06:54.002 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:06:54.002 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:06:54.002 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- nvmf/common.sh@300 -- # return 0 00:06:54.002 00:06:54.002 real 0m9.956s 00:06:54.002 user 0m29.481s 00:06:54.002 sys 0m1.559s 00:06:54.002 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@1126 -- # xtrace_disable 00:06:54.002 ************************************ 00:06:54.002 END TEST nvmf_delete_subsystem 00:06:54.002 ************************************ 00:06:54.002 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_delete_subsystem -- common/autotest_common.sh@10 -- # set +x 00:06:54.002 11:17:35 nvmf_tcp.nvmf_target_core -- nvmf/nvmf_target_core.sh@26 -- # run_test nvmf_host_management /home/vagrant/spdk_repo/spdk/test/nvmf/target/host_management.sh --transport=tcp 00:06:54.002 11:17:35 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:06:54.002 11:17:35 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1107 -- # xtrace_disable 00:06:54.002 11:17:35 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@10 -- # set +x 00:06:54.002 ************************************ 00:06:54.002 START TEST nvmf_host_management 00:06:54.002 ************************************ 00:06:54.002 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/nvmf/target/host_management.sh --transport=tcp 00:06:54.002 * Looking for test storage... 00:06:54.002 * Found test storage at /home/vagrant/spdk_repo/spdk/test/nvmf/target 00:06:54.002 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:06:54.002 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@1681 -- # lcov --version 00:06:54.002 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:06:54.261 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:06:54.261 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:06:54.261 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- scripts/common.sh@333 -- # local ver1 ver1_l 00:06:54.261 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- scripts/common.sh@334 -- # local ver2 ver2_l 00:06:54.262 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- scripts/common.sh@336 -- # IFS=.-: 00:06:54.262 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- scripts/common.sh@336 -- # read -ra ver1 00:06:54.262 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- scripts/common.sh@337 -- # IFS=.-: 00:06:54.262 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- scripts/common.sh@337 -- # read -ra ver2 00:06:54.262 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- scripts/common.sh@338 -- # local 'op=<' 00:06:54.262 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- scripts/common.sh@340 -- # ver1_l=2 00:06:54.262 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- scripts/common.sh@341 -- # ver2_l=1 00:06:54.262 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:06:54.262 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- scripts/common.sh@344 -- # case "$op" in 00:06:54.262 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- scripts/common.sh@345 -- # : 1 00:06:54.262 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- scripts/common.sh@364 -- # (( v = 0 )) 00:06:54.262 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:54.262 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- scripts/common.sh@365 -- # decimal 1 00:06:54.262 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- scripts/common.sh@353 -- # local d=1 00:06:54.262 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:54.262 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- scripts/common.sh@355 -- # echo 1 00:06:54.262 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- scripts/common.sh@365 -- # ver1[v]=1 00:06:54.262 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- scripts/common.sh@366 -- # decimal 2 00:06:54.262 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- scripts/common.sh@353 -- # local d=2 00:06:54.262 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:54.262 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- scripts/common.sh@355 -- # echo 2 00:06:54.262 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- scripts/common.sh@366 -- # ver2[v]=2 00:06:54.262 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:06:54.262 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:06:54.262 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- scripts/common.sh@368 -- # return 0 00:06:54.262 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:54.262 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:06:54.262 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:54.262 --rc genhtml_branch_coverage=1 00:06:54.262 --rc genhtml_function_coverage=1 00:06:54.262 --rc genhtml_legend=1 00:06:54.262 --rc geninfo_all_blocks=1 00:06:54.262 --rc geninfo_unexecuted_blocks=1 00:06:54.262 00:06:54.262 ' 00:06:54.262 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:06:54.262 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:54.262 --rc genhtml_branch_coverage=1 00:06:54.262 --rc genhtml_function_coverage=1 00:06:54.262 --rc genhtml_legend=1 00:06:54.262 --rc geninfo_all_blocks=1 00:06:54.262 --rc geninfo_unexecuted_blocks=1 00:06:54.262 00:06:54.262 ' 00:06:54.262 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:06:54.262 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:54.262 --rc genhtml_branch_coverage=1 00:06:54.262 --rc genhtml_function_coverage=1 00:06:54.262 --rc genhtml_legend=1 00:06:54.262 --rc geninfo_all_blocks=1 00:06:54.262 --rc geninfo_unexecuted_blocks=1 00:06:54.262 00:06:54.262 ' 00:06:54.262 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:06:54.262 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:54.262 --rc genhtml_branch_coverage=1 00:06:54.262 --rc genhtml_function_coverage=1 00:06:54.262 --rc genhtml_legend=1 00:06:54.262 --rc geninfo_all_blocks=1 00:06:54.262 --rc geninfo_unexecuted_blocks=1 00:06:54.262 00:06:54.262 ' 00:06:54.262 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@9 -- # source /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh 00:06:54.262 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@7 -- # uname -s 00:06:54.262 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:06:54.262 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:06:54.262 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:06:54.262 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:06:54.262 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:06:54.262 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:06:54.262 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:06:54.262 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:06:54.262 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:06:54.262 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:06:54.262 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:06:54.262 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@18 -- # NVME_HOSTID=3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:06:54.262 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:06:54.262 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:06:54.262 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@21 -- # NET_TYPE=virt 00:06:54.262 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:06:54.262 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@49 -- # source /home/vagrant/spdk_repo/spdk/scripts/common.sh 00:06:54.262 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- scripts/common.sh@15 -- # shopt -s extglob 00:06:54.262 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:54.262 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:54.262 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:54.262 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:54.262 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:54.262 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:54.262 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- paths/export.sh@5 -- # export PATH 00:06:54.262 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:54.262 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@51 -- # : 0 00:06:54.262 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:06:54.262 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:06:54.262 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:06:54.262 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:06:54.262 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:06:54.262 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:06:54.262 /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:06:54.262 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:06:54.262 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:06:54.262 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@55 -- # have_pci_nics=0 00:06:54.262 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@11 -- # MALLOC_BDEV_SIZE=64 00:06:54.262 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:06:54.262 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@105 -- # nvmftestinit 00:06:54.262 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:06:54.262 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:06:54.262 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@474 -- # prepare_net_devs 00:06:54.262 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@436 -- # local -g is_hw=no 00:06:54.262 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@438 -- # remove_spdk_ns 00:06:54.262 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:06:54.262 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:06:54.262 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:06:54.262 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@440 -- # [[ virt != virt ]] 00:06:54.263 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@442 -- # [[ no == yes ]] 00:06:54.263 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@449 -- # [[ virt == phy ]] 00:06:54.263 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@452 -- # [[ virt == phy-fallback ]] 00:06:54.263 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@457 -- # [[ tcp == tcp ]] 00:06:54.263 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@458 -- # nvmf_veth_init 00:06:54.263 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@145 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:06:54.263 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@146 -- # NVMF_SECOND_INITIATOR_IP=10.0.0.2 00:06:54.263 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@147 -- # NVMF_FIRST_TARGET_IP=10.0.0.3 00:06:54.263 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@148 -- # NVMF_SECOND_TARGET_IP=10.0.0.4 00:06:54.263 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@149 -- # NVMF_INITIATOR_IP=10.0.0.1 00:06:54.263 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@150 -- # NVMF_BRIDGE=nvmf_br 00:06:54.263 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@151 -- # NVMF_INITIATOR_INTERFACE=nvmf_init_if 00:06:54.263 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@152 -- # NVMF_INITIATOR_INTERFACE2=nvmf_init_if2 00:06:54.263 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@153 -- # NVMF_INITIATOR_BRIDGE=nvmf_init_br 00:06:54.263 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@154 -- # NVMF_INITIATOR_BRIDGE2=nvmf_init_br2 00:06:54.263 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@155 -- # NVMF_TARGET_NAMESPACE=nvmf_tgt_ns_spdk 00:06:54.263 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@156 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:06:54.263 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@157 -- # NVMF_TARGET_INTERFACE=nvmf_tgt_if 00:06:54.263 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@158 -- # NVMF_TARGET_INTERFACE2=nvmf_tgt_if2 00:06:54.263 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@159 -- # NVMF_TARGET_BRIDGE=nvmf_tgt_br 00:06:54.263 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@160 -- # NVMF_TARGET_BRIDGE2=nvmf_tgt_br2 00:06:54.263 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@162 -- # ip link set nvmf_init_br nomaster 00:06:54.263 Cannot find device "nvmf_init_br" 00:06:54.263 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@162 -- # true 00:06:54.263 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@163 -- # ip link set nvmf_init_br2 nomaster 00:06:54.263 Cannot find device "nvmf_init_br2" 00:06:54.263 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@163 -- # true 00:06:54.263 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@164 -- # ip link set nvmf_tgt_br nomaster 00:06:54.263 Cannot find device "nvmf_tgt_br" 00:06:54.263 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@164 -- # true 00:06:54.263 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@165 -- # ip link set nvmf_tgt_br2 nomaster 00:06:54.263 Cannot find device "nvmf_tgt_br2" 00:06:54.263 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@165 -- # true 00:06:54.263 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@166 -- # ip link set nvmf_init_br down 00:06:54.263 Cannot find device "nvmf_init_br" 00:06:54.263 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@166 -- # true 00:06:54.263 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@167 -- # ip link set nvmf_init_br2 down 00:06:54.263 Cannot find device "nvmf_init_br2" 00:06:54.263 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@167 -- # true 00:06:54.263 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@168 -- # ip link set nvmf_tgt_br down 00:06:54.263 Cannot find device "nvmf_tgt_br" 00:06:54.263 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@168 -- # true 00:06:54.263 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@169 -- # ip link set nvmf_tgt_br2 down 00:06:54.263 Cannot find device "nvmf_tgt_br2" 00:06:54.263 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@169 -- # true 00:06:54.263 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@170 -- # ip link delete nvmf_br type bridge 00:06:54.263 Cannot find device "nvmf_br" 00:06:54.263 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@170 -- # true 00:06:54.263 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@171 -- # ip link delete nvmf_init_if 00:06:54.263 Cannot find device "nvmf_init_if" 00:06:54.263 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@171 -- # true 00:06:54.263 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@172 -- # ip link delete nvmf_init_if2 00:06:54.263 Cannot find device "nvmf_init_if2" 00:06:54.263 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@172 -- # true 00:06:54.263 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@173 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:06:54.521 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:06:54.521 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@173 -- # true 00:06:54.521 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@174 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:06:54.521 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:06:54.521 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@174 -- # true 00:06:54.521 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@177 -- # ip netns add nvmf_tgt_ns_spdk 00:06:54.521 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@180 -- # ip link add nvmf_init_if type veth peer name nvmf_init_br 00:06:54.521 11:17:35 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@181 -- # ip link add nvmf_init_if2 type veth peer name nvmf_init_br2 00:06:54.521 11:17:36 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@182 -- # ip link add nvmf_tgt_if type veth peer name nvmf_tgt_br 00:06:54.521 11:17:36 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@183 -- # ip link add nvmf_tgt_if2 type veth peer name nvmf_tgt_br2 00:06:54.521 11:17:36 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@186 -- # ip link set nvmf_tgt_if netns nvmf_tgt_ns_spdk 00:06:54.521 11:17:36 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@187 -- # ip link set nvmf_tgt_if2 netns nvmf_tgt_ns_spdk 00:06:54.521 11:17:36 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@190 -- # ip addr add 10.0.0.1/24 dev nvmf_init_if 00:06:54.521 11:17:36 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@191 -- # ip addr add 10.0.0.2/24 dev nvmf_init_if2 00:06:54.521 11:17:36 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@192 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.3/24 dev nvmf_tgt_if 00:06:54.521 11:17:36 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@193 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.4/24 dev nvmf_tgt_if2 00:06:54.521 11:17:36 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@196 -- # ip link set nvmf_init_if up 00:06:54.521 11:17:36 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@197 -- # ip link set nvmf_init_if2 up 00:06:54.521 11:17:36 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@198 -- # ip link set nvmf_init_br up 00:06:54.521 11:17:36 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@199 -- # ip link set nvmf_init_br2 up 00:06:54.521 11:17:36 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@200 -- # ip link set nvmf_tgt_br up 00:06:54.521 11:17:36 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@201 -- # ip link set nvmf_tgt_br2 up 00:06:54.521 11:17:36 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@202 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if up 00:06:54.521 11:17:36 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@203 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if2 up 00:06:54.521 11:17:36 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@204 -- # ip netns exec nvmf_tgt_ns_spdk ip link set lo up 00:06:54.521 11:17:36 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@207 -- # ip link add nvmf_br type bridge 00:06:54.521 11:17:36 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@208 -- # ip link set nvmf_br up 00:06:54.521 11:17:36 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@211 -- # ip link set nvmf_init_br master nvmf_br 00:06:54.521 11:17:36 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@212 -- # ip link set nvmf_init_br2 master nvmf_br 00:06:54.521 11:17:36 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@213 -- # ip link set nvmf_tgt_br master nvmf_br 00:06:54.521 11:17:36 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@214 -- # ip link set nvmf_tgt_br2 master nvmf_br 00:06:54.521 11:17:36 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@217 -- # ipts -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT 00:06:54.521 11:17:36 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT' 00:06:54.521 11:17:36 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@218 -- # ipts -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT 00:06:54.521 11:17:36 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT' 00:06:54.521 11:17:36 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@219 -- # ipts -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT 00:06:54.521 11:17:36 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@788 -- # iptables -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT -m comment --comment 'SPDK_NVMF:-A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT' 00:06:54.521 11:17:36 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@222 -- # ping -c 1 10.0.0.3 00:06:54.780 PING 10.0.0.3 (10.0.0.3) 56(84) bytes of data. 00:06:54.780 64 bytes from 10.0.0.3: icmp_seq=1 ttl=64 time=0.078 ms 00:06:54.780 00:06:54.780 --- 10.0.0.3 ping statistics --- 00:06:54.780 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:06:54.780 rtt min/avg/max/mdev = 0.078/0.078/0.078/0.000 ms 00:06:54.780 11:17:36 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@223 -- # ping -c 1 10.0.0.4 00:06:54.780 PING 10.0.0.4 (10.0.0.4) 56(84) bytes of data. 00:06:54.780 64 bytes from 10.0.0.4: icmp_seq=1 ttl=64 time=0.060 ms 00:06:54.780 00:06:54.780 --- 10.0.0.4 ping statistics --- 00:06:54.780 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:06:54.780 rtt min/avg/max/mdev = 0.060/0.060/0.060/0.000 ms 00:06:54.780 11:17:36 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@224 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.1 00:06:54.780 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:06:54.780 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.041 ms 00:06:54.780 00:06:54.780 --- 10.0.0.1 ping statistics --- 00:06:54.780 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:06:54.780 rtt min/avg/max/mdev = 0.041/0.041/0.041/0.000 ms 00:06:54.780 11:17:36 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@225 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.2 00:06:54.780 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:06:54.780 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.088 ms 00:06:54.780 00:06:54.780 --- 10.0.0.2 ping statistics --- 00:06:54.780 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:06:54.780 rtt min/avg/max/mdev = 0.088/0.088/0.088/0.000 ms 00:06:54.780 11:17:36 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@227 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:06:54.780 11:17:36 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@459 -- # return 0 00:06:54.780 11:17:36 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:06:54.780 11:17:36 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:06:54.780 11:17:36 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:06:54.780 11:17:36 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:06:54.780 11:17:36 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:06:54.780 11:17:36 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:06:54.780 11:17:36 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:06:54.780 11:17:36 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@107 -- # nvmf_host_management 00:06:54.780 11:17:36 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@69 -- # starttarget 00:06:54.780 11:17:36 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@16 -- # nvmfappstart -m 0x1E 00:06:54.780 11:17:36 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:06:54.780 11:17:36 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@724 -- # xtrace_disable 00:06:54.780 11:17:36 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@10 -- # set +x 00:06:54.780 11:17:36 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@507 -- # nvmfpid=65396 00:06:54.780 11:17:36 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@506 -- # ip netns exec nvmf_tgt_ns_spdk /home/vagrant/spdk_repo/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:06:54.780 11:17:36 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@508 -- # waitforlisten 65396 00:06:54.780 11:17:36 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@831 -- # '[' -z 65396 ']' 00:06:54.780 11:17:36 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:54.780 11:17:36 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@836 -- # local max_retries=100 00:06:54.780 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:54.780 11:17:36 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:54.780 11:17:36 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@840 -- # xtrace_disable 00:06:54.780 11:17:36 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@10 -- # set +x 00:06:54.780 [2024-10-07 11:17:36.349883] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:06:54.780 [2024-10-07 11:17:36.349981] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:06:54.780 [2024-10-07 11:17:36.487481] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:55.038 [2024-10-07 11:17:36.611107] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:06:55.038 [2024-10-07 11:17:36.611184] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:06:55.039 [2024-10-07 11:17:36.611197] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:06:55.039 [2024-10-07 11:17:36.611205] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:06:55.039 [2024-10-07 11:17:36.611213] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:06:55.039 [2024-10-07 11:17:36.612783] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:06:55.039 [2024-10-07 11:17:36.612870] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 3 00:06:55.039 [2024-10-07 11:17:36.612990] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 4 00:06:55.039 [2024-10-07 11:17:36.613043] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:06:55.972 11:17:37 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:06:55.972 11:17:37 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@864 -- # return 0 00:06:55.972 11:17:37 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:06:55.972 11:17:37 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@730 -- # xtrace_disable 00:06:55.972 11:17:37 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@10 -- # set +x 00:06:55.972 11:17:37 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:06:55.972 11:17:37 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:06:55.972 11:17:37 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:55.972 11:17:37 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@10 -- # set +x 00:06:55.972 [2024-10-07 11:17:37.419087] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:06:55.972 11:17:37 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:55.972 11:17:37 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@20 -- # timing_enter create_subsystem 00:06:55.972 11:17:37 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@724 -- # xtrace_disable 00:06:55.972 11:17:37 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@10 -- # set +x 00:06:55.972 11:17:37 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@22 -- # rm -rf /home/vagrant/spdk_repo/spdk/test/nvmf/target/rpcs.txt 00:06:55.972 11:17:37 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@23 -- # cat 00:06:55.972 11:17:37 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@30 -- # rpc_cmd 00:06:55.972 11:17:37 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:55.972 11:17:37 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@10 -- # set +x 00:06:55.972 Malloc0 00:06:55.972 [2024-10-07 11:17:37.486402] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:06:55.972 11:17:37 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:55.972 11:17:37 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@31 -- # timing_exit create_subsystems 00:06:55.972 11:17:37 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@730 -- # xtrace_disable 00:06:55.972 11:17:37 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@10 -- # set +x 00:06:55.972 11:17:37 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@73 -- # perfpid=65468 00:06:55.972 11:17:37 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@74 -- # waitforlisten 65468 /var/tmp/bdevperf.sock 00:06:55.972 11:17:37 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@831 -- # '[' -z 65468 ']' 00:06:55.972 11:17:37 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:06:55.972 11:17:37 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@72 -- # /home/vagrant/spdk_repo/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:06:55.972 11:17:37 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@836 -- # local max_retries=100 00:06:55.972 11:17:37 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@72 -- # gen_nvmf_target_json 0 00:06:55.972 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:06:55.972 11:17:37 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:06:55.972 11:17:37 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@558 -- # config=() 00:06:55.972 11:17:37 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@840 -- # xtrace_disable 00:06:55.972 11:17:37 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@10 -- # set +x 00:06:55.972 11:17:37 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@558 -- # local subsystem config 00:06:55.972 11:17:37 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@560 -- # for subsystem in "${@:-1}" 00:06:55.972 11:17:37 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@580 -- # config+=("$(cat <<-EOF 00:06:55.972 { 00:06:55.972 "params": { 00:06:55.972 "name": "Nvme$subsystem", 00:06:55.972 "trtype": "$TEST_TRANSPORT", 00:06:55.972 "traddr": "$NVMF_FIRST_TARGET_IP", 00:06:55.972 "adrfam": "ipv4", 00:06:55.972 "trsvcid": "$NVMF_PORT", 00:06:55.972 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:06:55.972 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:06:55.972 "hdgst": ${hdgst:-false}, 00:06:55.972 "ddgst": ${ddgst:-false} 00:06:55.972 }, 00:06:55.972 "method": "bdev_nvme_attach_controller" 00:06:55.972 } 00:06:55.972 EOF 00:06:55.972 )") 00:06:55.972 11:17:37 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@580 -- # cat 00:06:55.972 11:17:37 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@582 -- # jq . 00:06:55.972 11:17:37 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@583 -- # IFS=, 00:06:55.972 11:17:37 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@584 -- # printf '%s\n' '{ 00:06:55.972 "params": { 00:06:55.973 "name": "Nvme0", 00:06:55.973 "trtype": "tcp", 00:06:55.973 "traddr": "10.0.0.3", 00:06:55.973 "adrfam": "ipv4", 00:06:55.973 "trsvcid": "4420", 00:06:55.973 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:06:55.973 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:06:55.973 "hdgst": false, 00:06:55.973 "ddgst": false 00:06:55.973 }, 00:06:55.973 "method": "bdev_nvme_attach_controller" 00:06:55.973 }' 00:06:55.973 [2024-10-07 11:17:37.599174] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:06:55.973 [2024-10-07 11:17:37.599288] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid65468 ] 00:06:56.231 [2024-10-07 11:17:37.734821] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:56.231 [2024-10-07 11:17:37.911366] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:06:56.488 Running I/O for 10 seconds... 00:06:57.055 11:17:38 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:06:57.055 11:17:38 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@864 -- # return 0 00:06:57.055 11:17:38 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@75 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:06:57.055 11:17:38 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:57.055 11:17:38 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@10 -- # set +x 00:06:57.055 11:17:38 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:57.055 11:17:38 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@78 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill -9 $perfpid || true; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:06:57.055 11:17:38 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@80 -- # waitforio /var/tmp/bdevperf.sock Nvme0n1 00:06:57.055 11:17:38 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@45 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:06:57.055 11:17:38 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@49 -- # '[' -z Nvme0n1 ']' 00:06:57.055 11:17:38 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@52 -- # local ret=1 00:06:57.055 11:17:38 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@53 -- # local i 00:06:57.055 11:17:38 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@54 -- # (( i = 10 )) 00:06:57.055 11:17:38 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@54 -- # (( i != 0 )) 00:06:57.055 11:17:38 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@55 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme0n1 00:06:57.055 11:17:38 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@55 -- # jq -r '.bdevs[0].num_read_ops' 00:06:57.055 11:17:38 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:57.055 11:17:38 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@10 -- # set +x 00:06:57.055 11:17:38 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:57.315 11:17:38 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@55 -- # read_io_count=835 00:06:57.315 11:17:38 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@58 -- # '[' 835 -ge 100 ']' 00:06:57.315 11:17:38 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@59 -- # ret=0 00:06:57.315 11:17:38 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@60 -- # break 00:06:57.315 11:17:38 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@64 -- # return 0 00:06:57.315 11:17:38 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@84 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host0 00:06:57.315 11:17:38 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:57.315 11:17:38 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@10 -- # set +x 00:06:57.315 [2024-10-07 11:17:38.808600] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a0bf60 is same with the state(6) to be set 00:06:57.315 [2024-10-07 11:17:38.808662] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a0bf60 is same with the state(6) to be set 00:06:57.315 [2024-10-07 11:17:38.808675] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a0bf60 is same with the state(6) to be set 00:06:57.316 [2024-10-07 11:17:38.808684] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a0bf60 is same with the state(6) to be set 00:06:57.316 [2024-10-07 11:17:38.808693] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a0bf60 is same with the state(6) to be set 00:06:57.316 [2024-10-07 11:17:38.808701] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a0bf60 is same with the state(6) to be set 00:06:57.316 [2024-10-07 11:17:38.808710] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a0bf60 is same with the state(6) to be set 00:06:57.316 [2024-10-07 11:17:38.808719] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a0bf60 is same with the state(6) to be set 00:06:57.316 [2024-10-07 11:17:38.808727] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a0bf60 is same with the state(6) to be set 00:06:57.316 [2024-10-07 11:17:38.808736] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a0bf60 is same with the state(6) to be set 00:06:57.316 [2024-10-07 11:17:38.808744] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a0bf60 is same with the state(6) to be set 00:06:57.316 [2024-10-07 11:17:38.808753] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a0bf60 is same with the state(6) to be set 00:06:57.316 [2024-10-07 11:17:38.808761] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a0bf60 is same with the state(6) to be set 00:06:57.316 [2024-10-07 11:17:38.808769] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a0bf60 is same with the state(6) to be set 00:06:57.316 [2024-10-07 11:17:38.808777] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a0bf60 is same with the state(6) to be set 00:06:57.316 [2024-10-07 11:17:38.808785] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a0bf60 is same with the state(6) to be set 00:06:57.316 [2024-10-07 11:17:38.808793] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a0bf60 is same with the state(6) to be set 00:06:57.316 [2024-10-07 11:17:38.808801] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a0bf60 is same with the state(6) to be set 00:06:57.316 [2024-10-07 11:17:38.808809] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a0bf60 is same with the state(6) to be set 00:06:57.316 [2024-10-07 11:17:38.808817] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a0bf60 is same with the state(6) to be set 00:06:57.316 [2024-10-07 11:17:38.808825] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a0bf60 is same with the state(6) to be set 00:06:57.316 [2024-10-07 11:17:38.808833] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a0bf60 is same with the state(6) to be set 00:06:57.316 [2024-10-07 11:17:38.808841] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a0bf60 is same with the state(6) to be set 00:06:57.316 [2024-10-07 11:17:38.808851] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a0bf60 is same with the state(6) to be set 00:06:57.316 [2024-10-07 11:17:38.808860] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a0bf60 is same with the state(6) to be set 00:06:57.316 [2024-10-07 11:17:38.808868] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a0bf60 is same with the state(6) to be set 00:06:57.316 [2024-10-07 11:17:38.808876] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a0bf60 is same with the state(6) to be set 00:06:57.316 [2024-10-07 11:17:38.808884] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a0bf60 is same with the state(6) to be set 00:06:57.316 [2024-10-07 11:17:38.808892] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a0bf60 is same with the state(6) to be set 00:06:57.316 [2024-10-07 11:17:38.808901] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a0bf60 is same with the state(6) to be set 00:06:57.316 [2024-10-07 11:17:38.808909] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a0bf60 is same with the state(6) to be set 00:06:57.316 [2024-10-07 11:17:38.808926] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a0bf60 is same with the state(6) to be set 00:06:57.316 [2024-10-07 11:17:38.808935] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a0bf60 is same with the state(6) to be set 00:06:57.316 [2024-10-07 11:17:38.808944] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a0bf60 is same with the state(6) to be set 00:06:57.316 [2024-10-07 11:17:38.808952] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a0bf60 is same with the state(6) to be set 00:06:57.316 [2024-10-07 11:17:38.808961] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a0bf60 is same with the state(6) to be set 00:06:57.316 [2024-10-07 11:17:38.808970] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a0bf60 is same with the state(6) to be set 00:06:57.316 [2024-10-07 11:17:38.808979] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a0bf60 is same with the state(6) to be set 00:06:57.316 [2024-10-07 11:17:38.808987] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a0bf60 is same with the state(6) to be set 00:06:57.316 [2024-10-07 11:17:38.808995] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a0bf60 is same with the state(6) to be set 00:06:57.316 [2024-10-07 11:17:38.809003] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a0bf60 is same with the state(6) to be set 00:06:57.316 [2024-10-07 11:17:38.809011] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a0bf60 is same with the state(6) to be set 00:06:57.316 [2024-10-07 11:17:38.809019] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a0bf60 is same with the state(6) to be set 00:06:57.316 [2024-10-07 11:17:38.809027] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a0bf60 is same with the state(6) to be set 00:06:57.316 [2024-10-07 11:17:38.809035] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a0bf60 is same with the state(6) to be set 00:06:57.316 [2024-10-07 11:17:38.809043] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a0bf60 is same with the state(6) to be set 00:06:57.316 [2024-10-07 11:17:38.809051] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a0bf60 is same with the state(6) to be set 00:06:57.316 [2024-10-07 11:17:38.809059] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a0bf60 is same with the state(6) to be set 00:06:57.316 [2024-10-07 11:17:38.809068] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a0bf60 is same with the state(6) to be set 00:06:57.316 [2024-10-07 11:17:38.809083] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a0bf60 is same with the state(6) to be set 00:06:57.316 [2024-10-07 11:17:38.809091] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a0bf60 is same with the state(6) to be set 00:06:57.316 [2024-10-07 11:17:38.809099] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a0bf60 is same with the state(6) to be set 00:06:57.316 [2024-10-07 11:17:38.809107] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a0bf60 is same with the state(6) to be set 00:06:57.316 [2024-10-07 11:17:38.809115] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a0bf60 is same with the state(6) to be set 00:06:57.316 [2024-10-07 11:17:38.809123] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a0bf60 is same with the state(6) to be set 00:06:57.316 [2024-10-07 11:17:38.809131] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a0bf60 is same with the state(6) to be set 00:06:57.316 [2024-10-07 11:17:38.809139] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a0bf60 is same with the state(6) to be set 00:06:57.316 [2024-10-07 11:17:38.809147] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a0bf60 is same with the state(6) to be set 00:06:57.316 [2024-10-07 11:17:38.809155] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a0bf60 is same with the state(6) to be set 00:06:57.316 [2024-10-07 11:17:38.809162] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a0bf60 is same with the state(6) to be set 00:06:57.316 [2024-10-07 11:17:38.809170] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a0bf60 is same with the state(6) to be set 00:06:57.316 [2024-10-07 11:17:38.809178] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a0bf60 is same with the state(6) to be set 00:06:57.316 [2024-10-07 11:17:38.809186] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a0bf60 is same with the state(6) to be set 00:06:57.316 [2024-10-07 11:17:38.811672] nvme_tcp.c:1252:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:06:57.316 11:17:38 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:57.316 11:17:38 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@85 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host0 00:06:57.316 11:17:38 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:57.316 11:17:38 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@10 -- # set +x 00:06:57.316 [2024-10-07 11:17:38.817480] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:06:57.316 [2024-10-07 11:17:38.817635] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:06:57.316 [2024-10-07 11:17:38.817726] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:06:57.316 [2024-10-07 11:17:38.817814] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:06:57.316 [2024-10-07 11:17:38.817872] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:06:57.316 [2024-10-07 11:17:38.817936] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:06:57.316 [2024-10-07 11:17:38.818015] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:06:57.316 [2024-10-07 11:17:38.818093] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:06:57.316 [2024-10-07 11:17:38.818160] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c3730 is same with the state(6) to be set 00:06:57.316 11:17:38 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:57.316 11:17:38 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@87 -- # sleep 1 00:06:57.316 [2024-10-07 11:17:38.827436] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11c3730 (9): Bad file descriptor 00:06:57.316 [2024-10-07 11:17:38.837527] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:114688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:06:57.316 [2024-10-07 11:17:38.837779] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:06:57.316 [2024-10-07 11:17:38.837827] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:114816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:06:57.316 [2024-10-07 11:17:38.837840] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:06:57.316 [2024-10-07 11:17:38.837853] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:114944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:06:57.316 [2024-10-07 11:17:38.837863] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:06:57.316 [2024-10-07 11:17:38.837876] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:115072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:06:57.316 [2024-10-07 11:17:38.837886] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:06:57.316 [2024-10-07 11:17:38.837899] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:115200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:06:57.316 [2024-10-07 11:17:38.837908] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:06:57.316 [2024-10-07 11:17:38.837923] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:115328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:06:57.317 [2024-10-07 11:17:38.837933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:06:57.317 [2024-10-07 11:17:38.837945] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:115456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:06:57.317 [2024-10-07 11:17:38.837956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:06:57.317 [2024-10-07 11:17:38.837968] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:115584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:06:57.317 [2024-10-07 11:17:38.837988] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:06:57.317 [2024-10-07 11:17:38.838000] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:115712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:06:57.317 [2024-10-07 11:17:38.838009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:06:57.317 [2024-10-07 11:17:38.838021] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:115840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:06:57.317 [2024-10-07 11:17:38.838030] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:06:57.317 [2024-10-07 11:17:38.838041] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:115968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:06:57.317 [2024-10-07 11:17:38.838050] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:06:57.317 [2024-10-07 11:17:38.838062] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:116096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:06:57.317 [2024-10-07 11:17:38.838071] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:06:57.317 [2024-10-07 11:17:38.838083] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:116224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:06:57.317 [2024-10-07 11:17:38.838092] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:06:57.317 [2024-10-07 11:17:38.838104] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:116352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:06:57.317 [2024-10-07 11:17:38.838113] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:06:57.317 [2024-10-07 11:17:38.838124] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:116480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:06:57.317 [2024-10-07 11:17:38.838133] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:06:57.317 [2024-10-07 11:17:38.838145] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:116608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:06:57.317 [2024-10-07 11:17:38.838154] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:06:57.317 [2024-10-07 11:17:38.838166] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:116736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:06:57.317 [2024-10-07 11:17:38.838176] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:06:57.317 [2024-10-07 11:17:38.838189] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:116864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:06:57.317 [2024-10-07 11:17:38.838199] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:06:57.317 [2024-10-07 11:17:38.838211] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:116992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:06:57.317 [2024-10-07 11:17:38.838220] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:06:57.317 [2024-10-07 11:17:38.838233] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:117120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:06:57.317 [2024-10-07 11:17:38.838242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:06:57.317 [2024-10-07 11:17:38.838254] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:117248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:06:57.317 [2024-10-07 11:17:38.838264] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:06:57.317 [2024-10-07 11:17:38.838276] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:117376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:06:57.317 [2024-10-07 11:17:38.838285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:06:57.317 [2024-10-07 11:17:38.838297] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:117504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:06:57.317 [2024-10-07 11:17:38.838306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:06:57.317 [2024-10-07 11:17:38.838318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:117632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:06:57.317 [2024-10-07 11:17:38.838327] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:06:57.317 [2024-10-07 11:17:38.838338] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:117760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:06:57.317 [2024-10-07 11:17:38.838347] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:06:57.317 [2024-10-07 11:17:38.838359] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:117888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:06:57.317 [2024-10-07 11:17:38.838368] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:06:57.317 [2024-10-07 11:17:38.838379] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:118016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:06:57.317 [2024-10-07 11:17:38.838388] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:06:57.317 [2024-10-07 11:17:38.838400] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:118144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:06:57.317 [2024-10-07 11:17:38.838409] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:06:57.317 [2024-10-07 11:17:38.838438] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:118272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:06:57.317 [2024-10-07 11:17:38.838449] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:06:57.317 [2024-10-07 11:17:38.838461] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:118400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:06:57.317 [2024-10-07 11:17:38.838470] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:06:57.317 [2024-10-07 11:17:38.838482] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:118528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:06:57.317 [2024-10-07 11:17:38.838491] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:06:57.317 [2024-10-07 11:17:38.838503] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:118656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:06:57.317 [2024-10-07 11:17:38.838513] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:06:57.317 [2024-10-07 11:17:38.838525] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:118784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:06:57.317 [2024-10-07 11:17:38.838543] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:06:57.317 [2024-10-07 11:17:38.838556] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:118912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:06:57.317 [2024-10-07 11:17:38.838565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:06:57.317 [2024-10-07 11:17:38.838578] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:119040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:06:57.317 [2024-10-07 11:17:38.838587] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:06:57.317 [2024-10-07 11:17:38.838600] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:119168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:06:57.317 [2024-10-07 11:17:38.838609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:06:57.317 [2024-10-07 11:17:38.838621] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:119296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:06:57.317 [2024-10-07 11:17:38.838630] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:06:57.317 [2024-10-07 11:17:38.838642] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:119424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:06:57.317 [2024-10-07 11:17:38.838651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:06:57.317 [2024-10-07 11:17:38.838663] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:119552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:06:57.317 [2024-10-07 11:17:38.838673] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:06:57.317 [2024-10-07 11:17:38.838684] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:119680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:06:57.317 [2024-10-07 11:17:38.838694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:06:57.317 [2024-10-07 11:17:38.838706] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:119808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:06:57.317 [2024-10-07 11:17:38.838715] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:06:57.318 [2024-10-07 11:17:38.838727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:119936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:06:57.318 [2024-10-07 11:17:38.838736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:06:57.318 [2024-10-07 11:17:38.838748] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:120064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:06:57.318 [2024-10-07 11:17:38.838757] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:06:57.318 [2024-10-07 11:17:38.838769] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:120192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:06:57.318 [2024-10-07 11:17:38.838778] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:06:57.318 [2024-10-07 11:17:38.838789] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:120320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:06:57.318 [2024-10-07 11:17:38.838798] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:06:57.318 [2024-10-07 11:17:38.838810] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:120448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:06:57.318 [2024-10-07 11:17:38.838819] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:06:57.318 [2024-10-07 11:17:38.838830] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:120576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:06:57.318 [2024-10-07 11:17:38.838854] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:06:57.318 [2024-10-07 11:17:38.838866] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:120704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:06:57.318 [2024-10-07 11:17:38.838875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:06:57.318 [2024-10-07 11:17:38.838888] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:120832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:06:57.318 [2024-10-07 11:17:38.838897] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:06:57.318 [2024-10-07 11:17:38.838909] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:120960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:06:57.318 [2024-10-07 11:17:38.838918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:06:57.318 [2024-10-07 11:17:38.838930] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:121088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:06:57.318 [2024-10-07 11:17:38.838941] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:06:57.318 [2024-10-07 11:17:38.838954] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:121216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:06:57.318 [2024-10-07 11:17:38.838964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:06:57.318 [2024-10-07 11:17:38.838976] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:121344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:06:57.318 [2024-10-07 11:17:38.838986] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:06:57.318 [2024-10-07 11:17:38.838997] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:121472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:06:57.318 [2024-10-07 11:17:38.839006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:06:57.318 [2024-10-07 11:17:38.839018] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:121600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:06:57.318 [2024-10-07 11:17:38.839027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:06:57.318 [2024-10-07 11:17:38.839039] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:121728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:06:57.318 [2024-10-07 11:17:38.839049] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:06:57.318 [2024-10-07 11:17:38.839060] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:121856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:06:57.318 [2024-10-07 11:17:38.839069] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:06:57.318 [2024-10-07 11:17:38.839080] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:121984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:06:57.318 [2024-10-07 11:17:38.839089] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:06:57.318 [2024-10-07 11:17:38.839102] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:122112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:06:57.318 [2024-10-07 11:17:38.839111] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:06:57.318 [2024-10-07 11:17:38.839124] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:122240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:06:57.318 [2024-10-07 11:17:38.839134] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:06:57.318 [2024-10-07 11:17:38.839146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:122368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:06:57.318 [2024-10-07 11:17:38.839155] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:06:57.318 [2024-10-07 11:17:38.839167] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:122496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:06:57.318 [2024-10-07 11:17:38.839177] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:06:57.318 [2024-10-07 11:17:38.839189] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:122624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:06:57.318 [2024-10-07 11:17:38.839204] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:06:57.318 [2024-10-07 11:17:38.839217] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:122752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:06:57.318 [2024-10-07 11:17:38.839227] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:06:57.318 [2024-10-07 11:17:38.839239] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11c34f0 is same with the state(6) to be set 00:06:57.318 task offset: 114688 on job bdev=Nvme0n1 fails 00:06:57.318 00:06:57.318 Latency(us) 00:06:57.318 [2024-10-07T11:17:39.029Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:06:57.318 Job: Nvme0n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:06:57.318 Job: Nvme0n1 ended in about 0.71 seconds with error 00:06:57.318 Verification LBA range: start 0x0 length 0x400 00:06:57.318 Nvme0n1 : 0.71 1265.30 79.08 90.38 0.00 46101.97 11260.28 49092.42 00:06:57.318 [2024-10-07T11:17:39.029Z] =================================================================================================================== 00:06:57.318 [2024-10-07T11:17:39.029Z] Total : 1265.30 79.08 90.38 0.00 46101.97 11260.28 49092.42 00:06:57.318 [2024-10-07 11:17:38.843301] app.c:1062:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:06:57.318 [2024-10-07 11:17:38.843339] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:06:57.318 [2024-10-07 11:17:38.849712] bdev_nvme.c:2183:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:06:58.255 11:17:39 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@91 -- # kill -9 65468 00:06:58.255 /home/vagrant/spdk_repo/spdk/test/nvmf/target/host_management.sh: line 91: kill: (65468) - No such process 00:06:58.255 11:17:39 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@91 -- # true 00:06:58.255 11:17:39 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@97 -- # rm -f /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 /var/tmp/spdk_cpu_lock_003 /var/tmp/spdk_cpu_lock_004 00:06:58.255 11:17:39 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@100 -- # /home/vagrant/spdk_repo/spdk/build/examples/bdevperf --json /dev/fd/62 -q 64 -o 65536 -w verify -t 1 00:06:58.255 11:17:39 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@100 -- # gen_nvmf_target_json 0 00:06:58.255 11:17:39 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@558 -- # config=() 00:06:58.255 11:17:39 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@558 -- # local subsystem config 00:06:58.255 11:17:39 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@560 -- # for subsystem in "${@:-1}" 00:06:58.255 11:17:39 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@580 -- # config+=("$(cat <<-EOF 00:06:58.255 { 00:06:58.255 "params": { 00:06:58.255 "name": "Nvme$subsystem", 00:06:58.255 "trtype": "$TEST_TRANSPORT", 00:06:58.255 "traddr": "$NVMF_FIRST_TARGET_IP", 00:06:58.255 "adrfam": "ipv4", 00:06:58.255 "trsvcid": "$NVMF_PORT", 00:06:58.255 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:06:58.255 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:06:58.255 "hdgst": ${hdgst:-false}, 00:06:58.255 "ddgst": ${ddgst:-false} 00:06:58.255 }, 00:06:58.255 "method": "bdev_nvme_attach_controller" 00:06:58.255 } 00:06:58.255 EOF 00:06:58.255 )") 00:06:58.255 11:17:39 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@580 -- # cat 00:06:58.255 11:17:39 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@582 -- # jq . 00:06:58.255 11:17:39 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@583 -- # IFS=, 00:06:58.255 11:17:39 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@584 -- # printf '%s\n' '{ 00:06:58.255 "params": { 00:06:58.255 "name": "Nvme0", 00:06:58.255 "trtype": "tcp", 00:06:58.255 "traddr": "10.0.0.3", 00:06:58.255 "adrfam": "ipv4", 00:06:58.255 "trsvcid": "4420", 00:06:58.255 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:06:58.255 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:06:58.255 "hdgst": false, 00:06:58.255 "ddgst": false 00:06:58.255 }, 00:06:58.255 "method": "bdev_nvme_attach_controller" 00:06:58.255 }' 00:06:58.255 [2024-10-07 11:17:39.901368] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:06:58.255 [2024-10-07 11:17:39.901542] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid65518 ] 00:06:58.513 [2024-10-07 11:17:40.045078] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:58.513 [2024-10-07 11:17:40.200957] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:06:58.788 Running I/O for 1 seconds... 00:06:59.994 1376.00 IOPS, 86.00 MiB/s 00:06:59.994 Latency(us) 00:06:59.994 [2024-10-07T11:17:41.705Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:06:59.994 Job: Nvme0n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:06:59.994 Verification LBA range: start 0x0 length 0x400 00:06:59.994 Nvme0n1 : 1.04 1412.99 88.31 0.00 0.00 44412.08 6851.49 40274.85 00:06:59.994 [2024-10-07T11:17:41.705Z] =================================================================================================================== 00:06:59.994 [2024-10-07T11:17:41.705Z] Total : 1412.99 88.31 0.00 0.00 44412.08 6851.49 40274.85 00:07:00.252 11:17:41 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@102 -- # stoptarget 00:07:00.252 11:17:41 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@36 -- # rm -f ./local-job0-0-verify.state 00:07:00.252 11:17:41 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@37 -- # rm -rf /home/vagrant/spdk_repo/spdk/test/nvmf/target/bdevperf.conf 00:07:00.252 11:17:41 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@38 -- # rm -rf /home/vagrant/spdk_repo/spdk/test/nvmf/target/rpcs.txt 00:07:00.252 11:17:41 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@40 -- # nvmftestfini 00:07:00.252 11:17:41 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@514 -- # nvmfcleanup 00:07:00.252 11:17:41 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@121 -- # sync 00:07:00.252 11:17:41 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:07:00.252 11:17:41 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@124 -- # set +e 00:07:00.252 11:17:41 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@125 -- # for i in {1..20} 00:07:00.252 11:17:41 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:07:00.252 rmmod nvme_tcp 00:07:00.252 rmmod nvme_fabrics 00:07:00.252 rmmod nvme_keyring 00:07:00.253 11:17:41 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:07:00.253 11:17:41 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@128 -- # set -e 00:07:00.253 11:17:41 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@129 -- # return 0 00:07:00.253 11:17:41 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@515 -- # '[' -n 65396 ']' 00:07:00.253 11:17:41 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@516 -- # killprocess 65396 00:07:00.253 11:17:41 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@950 -- # '[' -z 65396 ']' 00:07:00.253 11:17:41 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@954 -- # kill -0 65396 00:07:00.253 11:17:41 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@955 -- # uname 00:07:00.253 11:17:41 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:07:00.253 11:17:41 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 65396 00:07:00.511 11:17:41 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@956 -- # process_name=reactor_1 00:07:00.511 11:17:41 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@960 -- # '[' reactor_1 = sudo ']' 00:07:00.511 killing process with pid 65396 00:07:00.511 11:17:41 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@968 -- # echo 'killing process with pid 65396' 00:07:00.512 11:17:41 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@969 -- # kill 65396 00:07:00.512 11:17:41 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@974 -- # wait 65396 00:07:00.512 [2024-10-07 11:17:42.211864] app.c: 719:unclaim_cpu_cores: *ERROR*: Failed to unlink lock fd for core 1, errno: 2 00:07:00.770 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:07:00.770 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:07:00.770 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:07:00.770 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@297 -- # iptr 00:07:00.770 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@789 -- # iptables-save 00:07:00.770 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@789 -- # iptables-restore 00:07:00.770 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:07:00.770 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@298 -- # [[ nvmf_tgt_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:07:00.770 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@299 -- # nvmf_veth_fini 00:07:00.770 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@233 -- # ip link set nvmf_init_br nomaster 00:07:00.770 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@234 -- # ip link set nvmf_init_br2 nomaster 00:07:00.770 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@235 -- # ip link set nvmf_tgt_br nomaster 00:07:00.770 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@236 -- # ip link set nvmf_tgt_br2 nomaster 00:07:00.770 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@237 -- # ip link set nvmf_init_br down 00:07:00.770 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@238 -- # ip link set nvmf_init_br2 down 00:07:00.770 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@239 -- # ip link set nvmf_tgt_br down 00:07:00.770 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@240 -- # ip link set nvmf_tgt_br2 down 00:07:00.770 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@241 -- # ip link delete nvmf_br type bridge 00:07:00.770 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@242 -- # ip link delete nvmf_init_if 00:07:00.770 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@243 -- # ip link delete nvmf_init_if2 00:07:00.770 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@244 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:07:00.770 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@245 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:07:00.770 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@246 -- # remove_spdk_ns 00:07:00.770 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:00.770 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:07:00.770 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:01.029 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_host_management -- nvmf/common.sh@300 -- # return 0 00:07:01.029 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_host_management -- target/host_management.sh@109 -- # trap - SIGINT SIGTERM EXIT 00:07:01.029 00:07:01.029 real 0m6.936s 00:07:01.029 user 0m25.840s 00:07:01.029 sys 0m1.831s 00:07:01.029 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@1126 -- # xtrace_disable 00:07:01.029 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_host_management -- common/autotest_common.sh@10 -- # set +x 00:07:01.029 ************************************ 00:07:01.029 END TEST nvmf_host_management 00:07:01.029 ************************************ 00:07:01.029 11:17:42 nvmf_tcp.nvmf_target_core -- nvmf/nvmf_target_core.sh@27 -- # run_test nvmf_lvol /home/vagrant/spdk_repo/spdk/test/nvmf/target/nvmf_lvol.sh --transport=tcp 00:07:01.029 11:17:42 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:07:01.029 11:17:42 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1107 -- # xtrace_disable 00:07:01.029 11:17:42 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@10 -- # set +x 00:07:01.029 ************************************ 00:07:01.029 START TEST nvmf_lvol 00:07:01.029 ************************************ 00:07:01.029 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/nvmf/target/nvmf_lvol.sh --transport=tcp 00:07:01.029 * Looking for test storage... 00:07:01.029 * Found test storage at /home/vagrant/spdk_repo/spdk/test/nvmf/target 00:07:01.029 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:07:01.029 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@1681 -- # lcov --version 00:07:01.029 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:07:01.029 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:07:01.029 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:07:01.029 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- scripts/common.sh@333 -- # local ver1 ver1_l 00:07:01.029 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- scripts/common.sh@334 -- # local ver2 ver2_l 00:07:01.029 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- scripts/common.sh@336 -- # IFS=.-: 00:07:01.029 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- scripts/common.sh@336 -- # read -ra ver1 00:07:01.029 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- scripts/common.sh@337 -- # IFS=.-: 00:07:01.029 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- scripts/common.sh@337 -- # read -ra ver2 00:07:01.029 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- scripts/common.sh@338 -- # local 'op=<' 00:07:01.029 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- scripts/common.sh@340 -- # ver1_l=2 00:07:01.029 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- scripts/common.sh@341 -- # ver2_l=1 00:07:01.029 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:07:01.029 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- scripts/common.sh@344 -- # case "$op" in 00:07:01.029 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- scripts/common.sh@345 -- # : 1 00:07:01.029 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- scripts/common.sh@364 -- # (( v = 0 )) 00:07:01.029 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:01.029 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- scripts/common.sh@365 -- # decimal 1 00:07:01.029 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- scripts/common.sh@353 -- # local d=1 00:07:01.029 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:01.029 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- scripts/common.sh@355 -- # echo 1 00:07:01.029 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- scripts/common.sh@365 -- # ver1[v]=1 00:07:01.029 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- scripts/common.sh@366 -- # decimal 2 00:07:01.029 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- scripts/common.sh@353 -- # local d=2 00:07:01.029 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:01.029 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- scripts/common.sh@355 -- # echo 2 00:07:01.029 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- scripts/common.sh@366 -- # ver2[v]=2 00:07:01.029 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:07:01.289 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:07:01.289 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- scripts/common.sh@368 -- # return 0 00:07:01.289 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:01.289 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:07:01.289 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:01.289 --rc genhtml_branch_coverage=1 00:07:01.289 --rc genhtml_function_coverage=1 00:07:01.289 --rc genhtml_legend=1 00:07:01.289 --rc geninfo_all_blocks=1 00:07:01.289 --rc geninfo_unexecuted_blocks=1 00:07:01.289 00:07:01.289 ' 00:07:01.289 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:07:01.289 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:01.289 --rc genhtml_branch_coverage=1 00:07:01.289 --rc genhtml_function_coverage=1 00:07:01.289 --rc genhtml_legend=1 00:07:01.289 --rc geninfo_all_blocks=1 00:07:01.289 --rc geninfo_unexecuted_blocks=1 00:07:01.289 00:07:01.289 ' 00:07:01.289 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:07:01.289 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:01.289 --rc genhtml_branch_coverage=1 00:07:01.289 --rc genhtml_function_coverage=1 00:07:01.289 --rc genhtml_legend=1 00:07:01.289 --rc geninfo_all_blocks=1 00:07:01.289 --rc geninfo_unexecuted_blocks=1 00:07:01.289 00:07:01.289 ' 00:07:01.289 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:07:01.289 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:01.289 --rc genhtml_branch_coverage=1 00:07:01.289 --rc genhtml_function_coverage=1 00:07:01.289 --rc genhtml_legend=1 00:07:01.289 --rc geninfo_all_blocks=1 00:07:01.289 --rc geninfo_unexecuted_blocks=1 00:07:01.289 00:07:01.289 ' 00:07:01.289 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@9 -- # source /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh 00:07:01.289 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@7 -- # uname -s 00:07:01.289 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:01.289 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:01.289 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:01.289 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:01.289 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:01.289 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:01.289 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:01.289 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:01.289 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:01.289 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:01.289 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:07:01.289 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@18 -- # NVME_HOSTID=3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:07:01.289 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:01.289 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:01.289 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@21 -- # NET_TYPE=virt 00:07:01.289 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:07:01.289 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@49 -- # source /home/vagrant/spdk_repo/spdk/scripts/common.sh 00:07:01.289 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- scripts/common.sh@15 -- # shopt -s extglob 00:07:01.289 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:01.289 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:01.289 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:01.289 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:01.289 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:01.289 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:01.289 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- paths/export.sh@5 -- # export PATH 00:07:01.289 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:01.289 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@51 -- # : 0 00:07:01.289 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:07:01.289 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:07:01.289 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:07:01.289 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:01.289 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:01.289 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:07:01.289 /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:07:01.289 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:07:01.289 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:07:01.289 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@55 -- # have_pci_nics=0 00:07:01.289 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@11 -- # MALLOC_BDEV_SIZE=64 00:07:01.289 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:07:01.289 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@13 -- # LVOL_BDEV_INIT_SIZE=20 00:07:01.289 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@14 -- # LVOL_BDEV_FINAL_SIZE=30 00:07:01.289 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@16 -- # rpc_py=/home/vagrant/spdk_repo/spdk/scripts/rpc.py 00:07:01.289 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@18 -- # nvmftestinit 00:07:01.289 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:07:01.289 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:07:01.289 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@474 -- # prepare_net_devs 00:07:01.289 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@436 -- # local -g is_hw=no 00:07:01.289 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@438 -- # remove_spdk_ns 00:07:01.289 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:01.289 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:07:01.289 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:01.289 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@440 -- # [[ virt != virt ]] 00:07:01.289 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@442 -- # [[ no == yes ]] 00:07:01.289 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@449 -- # [[ virt == phy ]] 00:07:01.289 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@452 -- # [[ virt == phy-fallback ]] 00:07:01.289 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@457 -- # [[ tcp == tcp ]] 00:07:01.289 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@458 -- # nvmf_veth_init 00:07:01.289 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@145 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:07:01.289 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@146 -- # NVMF_SECOND_INITIATOR_IP=10.0.0.2 00:07:01.289 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@147 -- # NVMF_FIRST_TARGET_IP=10.0.0.3 00:07:01.289 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@148 -- # NVMF_SECOND_TARGET_IP=10.0.0.4 00:07:01.289 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@149 -- # NVMF_INITIATOR_IP=10.0.0.1 00:07:01.289 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@150 -- # NVMF_BRIDGE=nvmf_br 00:07:01.289 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@151 -- # NVMF_INITIATOR_INTERFACE=nvmf_init_if 00:07:01.289 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@152 -- # NVMF_INITIATOR_INTERFACE2=nvmf_init_if2 00:07:01.290 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@153 -- # NVMF_INITIATOR_BRIDGE=nvmf_init_br 00:07:01.290 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@154 -- # NVMF_INITIATOR_BRIDGE2=nvmf_init_br2 00:07:01.290 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@155 -- # NVMF_TARGET_NAMESPACE=nvmf_tgt_ns_spdk 00:07:01.290 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@156 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:07:01.290 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@157 -- # NVMF_TARGET_INTERFACE=nvmf_tgt_if 00:07:01.290 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@158 -- # NVMF_TARGET_INTERFACE2=nvmf_tgt_if2 00:07:01.290 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@159 -- # NVMF_TARGET_BRIDGE=nvmf_tgt_br 00:07:01.290 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@160 -- # NVMF_TARGET_BRIDGE2=nvmf_tgt_br2 00:07:01.290 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@162 -- # ip link set nvmf_init_br nomaster 00:07:01.290 Cannot find device "nvmf_init_br" 00:07:01.290 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@162 -- # true 00:07:01.290 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@163 -- # ip link set nvmf_init_br2 nomaster 00:07:01.290 Cannot find device "nvmf_init_br2" 00:07:01.290 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@163 -- # true 00:07:01.290 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@164 -- # ip link set nvmf_tgt_br nomaster 00:07:01.290 Cannot find device "nvmf_tgt_br" 00:07:01.290 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@164 -- # true 00:07:01.290 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@165 -- # ip link set nvmf_tgt_br2 nomaster 00:07:01.290 Cannot find device "nvmf_tgt_br2" 00:07:01.290 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@165 -- # true 00:07:01.290 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@166 -- # ip link set nvmf_init_br down 00:07:01.290 Cannot find device "nvmf_init_br" 00:07:01.290 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@166 -- # true 00:07:01.290 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@167 -- # ip link set nvmf_init_br2 down 00:07:01.290 Cannot find device "nvmf_init_br2" 00:07:01.290 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@167 -- # true 00:07:01.290 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@168 -- # ip link set nvmf_tgt_br down 00:07:01.290 Cannot find device "nvmf_tgt_br" 00:07:01.290 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@168 -- # true 00:07:01.290 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@169 -- # ip link set nvmf_tgt_br2 down 00:07:01.290 Cannot find device "nvmf_tgt_br2" 00:07:01.290 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@169 -- # true 00:07:01.290 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@170 -- # ip link delete nvmf_br type bridge 00:07:01.290 Cannot find device "nvmf_br" 00:07:01.290 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@170 -- # true 00:07:01.290 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@171 -- # ip link delete nvmf_init_if 00:07:01.290 Cannot find device "nvmf_init_if" 00:07:01.290 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@171 -- # true 00:07:01.290 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@172 -- # ip link delete nvmf_init_if2 00:07:01.290 Cannot find device "nvmf_init_if2" 00:07:01.290 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@172 -- # true 00:07:01.290 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@173 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:07:01.290 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:07:01.290 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@173 -- # true 00:07:01.290 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@174 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:07:01.290 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:07:01.290 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@174 -- # true 00:07:01.290 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@177 -- # ip netns add nvmf_tgt_ns_spdk 00:07:01.290 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@180 -- # ip link add nvmf_init_if type veth peer name nvmf_init_br 00:07:01.290 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@181 -- # ip link add nvmf_init_if2 type veth peer name nvmf_init_br2 00:07:01.290 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@182 -- # ip link add nvmf_tgt_if type veth peer name nvmf_tgt_br 00:07:01.290 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@183 -- # ip link add nvmf_tgt_if2 type veth peer name nvmf_tgt_br2 00:07:01.290 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@186 -- # ip link set nvmf_tgt_if netns nvmf_tgt_ns_spdk 00:07:01.290 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@187 -- # ip link set nvmf_tgt_if2 netns nvmf_tgt_ns_spdk 00:07:01.564 11:17:42 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@190 -- # ip addr add 10.0.0.1/24 dev nvmf_init_if 00:07:01.564 11:17:43 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@191 -- # ip addr add 10.0.0.2/24 dev nvmf_init_if2 00:07:01.564 11:17:43 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@192 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.3/24 dev nvmf_tgt_if 00:07:01.564 11:17:43 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@193 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.4/24 dev nvmf_tgt_if2 00:07:01.564 11:17:43 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@196 -- # ip link set nvmf_init_if up 00:07:01.564 11:17:43 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@197 -- # ip link set nvmf_init_if2 up 00:07:01.564 11:17:43 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@198 -- # ip link set nvmf_init_br up 00:07:01.564 11:17:43 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@199 -- # ip link set nvmf_init_br2 up 00:07:01.564 11:17:43 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@200 -- # ip link set nvmf_tgt_br up 00:07:01.564 11:17:43 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@201 -- # ip link set nvmf_tgt_br2 up 00:07:01.564 11:17:43 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@202 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if up 00:07:01.564 11:17:43 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@203 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if2 up 00:07:01.564 11:17:43 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@204 -- # ip netns exec nvmf_tgt_ns_spdk ip link set lo up 00:07:01.564 11:17:43 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@207 -- # ip link add nvmf_br type bridge 00:07:01.564 11:17:43 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@208 -- # ip link set nvmf_br up 00:07:01.564 11:17:43 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@211 -- # ip link set nvmf_init_br master nvmf_br 00:07:01.564 11:17:43 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@212 -- # ip link set nvmf_init_br2 master nvmf_br 00:07:01.564 11:17:43 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@213 -- # ip link set nvmf_tgt_br master nvmf_br 00:07:01.564 11:17:43 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@214 -- # ip link set nvmf_tgt_br2 master nvmf_br 00:07:01.564 11:17:43 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@217 -- # ipts -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT 00:07:01.564 11:17:43 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT' 00:07:01.564 11:17:43 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@218 -- # ipts -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT 00:07:01.564 11:17:43 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT' 00:07:01.564 11:17:43 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@219 -- # ipts -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT 00:07:01.564 11:17:43 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@788 -- # iptables -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT -m comment --comment 'SPDK_NVMF:-A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT' 00:07:01.564 11:17:43 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@222 -- # ping -c 1 10.0.0.3 00:07:01.564 PING 10.0.0.3 (10.0.0.3) 56(84) bytes of data. 00:07:01.564 64 bytes from 10.0.0.3: icmp_seq=1 ttl=64 time=0.105 ms 00:07:01.564 00:07:01.564 --- 10.0.0.3 ping statistics --- 00:07:01.564 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:01.564 rtt min/avg/max/mdev = 0.105/0.105/0.105/0.000 ms 00:07:01.564 11:17:43 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@223 -- # ping -c 1 10.0.0.4 00:07:01.564 PING 10.0.0.4 (10.0.0.4) 56(84) bytes of data. 00:07:01.564 64 bytes from 10.0.0.4: icmp_seq=1 ttl=64 time=0.048 ms 00:07:01.564 00:07:01.564 --- 10.0.0.4 ping statistics --- 00:07:01.564 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:01.564 rtt min/avg/max/mdev = 0.048/0.048/0.048/0.000 ms 00:07:01.564 11:17:43 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@224 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.1 00:07:01.564 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:07:01.564 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.029 ms 00:07:01.564 00:07:01.564 --- 10.0.0.1 ping statistics --- 00:07:01.564 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:01.564 rtt min/avg/max/mdev = 0.029/0.029/0.029/0.000 ms 00:07:01.564 11:17:43 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@225 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.2 00:07:01.564 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:07:01.564 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.092 ms 00:07:01.564 00:07:01.564 --- 10.0.0.2 ping statistics --- 00:07:01.564 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:01.564 rtt min/avg/max/mdev = 0.092/0.092/0.092/0.000 ms 00:07:01.564 11:17:43 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@227 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:07:01.564 11:17:43 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@459 -- # return 0 00:07:01.564 11:17:43 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:07:01.564 11:17:43 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:07:01.564 11:17:43 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:07:01.564 11:17:43 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:07:01.564 11:17:43 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:07:01.564 11:17:43 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:07:01.564 11:17:43 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:07:01.564 11:17:43 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@19 -- # nvmfappstart -m 0x7 00:07:01.564 11:17:43 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:07:01.564 11:17:43 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@724 -- # xtrace_disable 00:07:01.564 11:17:43 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@10 -- # set +x 00:07:01.564 11:17:43 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@507 -- # nvmfpid=65790 00:07:01.564 11:17:43 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@506 -- # ip netns exec nvmf_tgt_ns_spdk /home/vagrant/spdk_repo/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x7 00:07:01.564 11:17:43 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@508 -- # waitforlisten 65790 00:07:01.564 11:17:43 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@831 -- # '[' -z 65790 ']' 00:07:01.564 11:17:43 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:01.564 11:17:43 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@836 -- # local max_retries=100 00:07:01.564 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:01.564 11:17:43 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:01.564 11:17:43 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@840 -- # xtrace_disable 00:07:01.564 11:17:43 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@10 -- # set +x 00:07:01.834 [2024-10-07 11:17:43.296329] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:07:01.834 [2024-10-07 11:17:43.297173] [ DPDK EAL parameters: nvmf -c 0x7 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:07:01.834 [2024-10-07 11:17:43.438644] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 3 00:07:02.092 [2024-10-07 11:17:43.604487] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:07:02.093 [2024-10-07 11:17:43.604593] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:07:02.093 [2024-10-07 11:17:43.604609] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:07:02.093 [2024-10-07 11:17:43.604622] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:07:02.093 [2024-10-07 11:17:43.604633] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:07:02.093 [2024-10-07 11:17:43.605353] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:07:02.093 [2024-10-07 11:17:43.605470] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:07:02.093 [2024-10-07 11:17:43.605482] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:07:03.027 11:17:44 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:07:03.027 11:17:44 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@864 -- # return 0 00:07:03.027 11:17:44 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:07:03.027 11:17:44 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@730 -- # xtrace_disable 00:07:03.027 11:17:44 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@10 -- # set +x 00:07:03.027 11:17:44 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:07:03.027 11:17:44 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@21 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:07:03.027 [2024-10-07 11:17:44.692776] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:07:03.027 11:17:44 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@24 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:07:03.593 11:17:45 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@24 -- # base_bdevs='Malloc0 ' 00:07:03.593 11:17:45 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@25 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:07:03.850 11:17:45 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@25 -- # base_bdevs+=Malloc1 00:07:03.850 11:17:45 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@26 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_raid_create -n raid0 -z 64 -r 0 -b 'Malloc0 Malloc1' 00:07:04.108 11:17:45 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@29 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_lvol_create_lvstore raid0 lvs 00:07:04.367 11:17:46 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@29 -- # lvs=19dc1591-3b81-4662-9e6b-b5cee4ca8cfb 00:07:04.367 11:17:46 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@32 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_lvol_create -u 19dc1591-3b81-4662-9e6b-b5cee4ca8cfb lvol 20 00:07:04.932 11:17:46 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@32 -- # lvol=f77f94e5-6c7a-4b0f-8771-2c5f55d6c361 00:07:04.932 11:17:46 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@35 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:07:05.190 11:17:46 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@36 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 f77f94e5-6c7a-4b0f-8771-2c5f55d6c361 00:07:05.448 11:17:47 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@37 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.3 -s 4420 00:07:05.706 [2024-10-07 11:17:47.364469] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:07:05.706 11:17:47 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@38 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.3 -s 4420 00:07:06.271 11:17:47 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@42 -- # perf_pid=65944 00:07:06.271 11:17:47 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@41 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_nvme_perf -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.3 trsvcid:4420' -o 4096 -q 128 -s 512 -w randwrite -t 10 -c 0x18 00:07:06.271 11:17:47 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@44 -- # sleep 1 00:07:07.204 11:17:48 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@47 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_lvol_snapshot f77f94e5-6c7a-4b0f-8771-2c5f55d6c361 MY_SNAPSHOT 00:07:07.771 11:17:49 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@47 -- # snapshot=e7b23384-b701-4851-a649-174678f2e912 00:07:07.771 11:17:49 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@48 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_lvol_resize f77f94e5-6c7a-4b0f-8771-2c5f55d6c361 30 00:07:08.029 11:17:49 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@49 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_lvol_clone e7b23384-b701-4851-a649-174678f2e912 MY_CLONE 00:07:08.287 11:17:49 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@49 -- # clone=1569f0ff-5359-4c33-acfb-eb292eed69c7 00:07:08.287 11:17:49 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@50 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_lvol_inflate 1569f0ff-5359-4c33-acfb-eb292eed69c7 00:07:09.660 11:17:50 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@53 -- # wait 65944 00:07:17.770 Initializing NVMe Controllers 00:07:17.770 Attached to NVMe over Fabrics controller at 10.0.0.3:4420: nqn.2016-06.io.spdk:cnode0 00:07:17.770 Controller IO queue size 128, less than required. 00:07:17.770 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:07:17.770 Associating TCP (addr:10.0.0.3 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 3 00:07:17.770 Associating TCP (addr:10.0.0.3 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 4 00:07:17.770 Initialization complete. Launching workers. 00:07:17.770 ======================================================== 00:07:17.770 Latency(us) 00:07:17.770 Device Information : IOPS MiB/s Average min max 00:07:17.770 TCP (addr:10.0.0.3 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 from core 3: 6534.70 25.53 19597.35 1954.52 93736.50 00:07:17.770 TCP (addr:10.0.0.3 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 from core 4: 6795.50 26.54 18835.78 3580.71 89557.74 00:07:17.770 ======================================================== 00:07:17.770 Total : 13330.20 52.07 19209.11 1954.52 93736.50 00:07:17.770 00:07:17.770 11:17:58 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@56 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:07:17.770 11:17:58 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@57 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_lvol_delete f77f94e5-6c7a-4b0f-8771-2c5f55d6c361 00:07:17.770 11:17:58 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@58 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u 19dc1591-3b81-4662-9e6b-b5cee4ca8cfb 00:07:17.770 11:17:58 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@60 -- # rm -f 00:07:17.770 11:17:58 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@62 -- # trap - SIGINT SIGTERM EXIT 00:07:17.770 11:17:58 nvmf_tcp.nvmf_target_core.nvmf_lvol -- target/nvmf_lvol.sh@64 -- # nvmftestfini 00:07:17.770 11:17:58 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@514 -- # nvmfcleanup 00:07:17.770 11:17:58 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@121 -- # sync 00:07:17.770 11:17:59 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:07:17.770 11:17:59 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@124 -- # set +e 00:07:17.770 11:17:59 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@125 -- # for i in {1..20} 00:07:17.770 11:17:59 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:07:17.770 rmmod nvme_tcp 00:07:17.770 rmmod nvme_fabrics 00:07:17.770 rmmod nvme_keyring 00:07:17.770 11:17:59 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:07:17.770 11:17:59 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@128 -- # set -e 00:07:17.770 11:17:59 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@129 -- # return 0 00:07:17.770 11:17:59 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@515 -- # '[' -n 65790 ']' 00:07:17.770 11:17:59 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@516 -- # killprocess 65790 00:07:17.770 11:17:59 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@950 -- # '[' -z 65790 ']' 00:07:17.770 11:17:59 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@954 -- # kill -0 65790 00:07:17.770 11:17:59 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@955 -- # uname 00:07:17.770 11:17:59 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:07:17.770 11:17:59 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 65790 00:07:17.770 11:17:59 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:07:17.770 killing process with pid 65790 00:07:17.770 11:17:59 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:07:17.770 11:17:59 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@968 -- # echo 'killing process with pid 65790' 00:07:17.770 11:17:59 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@969 -- # kill 65790 00:07:17.770 11:17:59 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@974 -- # wait 65790 00:07:18.029 11:17:59 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:07:18.029 11:17:59 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:07:18.029 11:17:59 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:07:18.029 11:17:59 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@297 -- # iptr 00:07:18.029 11:17:59 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@789 -- # iptables-save 00:07:18.029 11:17:59 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:07:18.029 11:17:59 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@789 -- # iptables-restore 00:07:18.029 11:17:59 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@298 -- # [[ nvmf_tgt_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:07:18.029 11:17:59 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@299 -- # nvmf_veth_fini 00:07:18.029 11:17:59 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@233 -- # ip link set nvmf_init_br nomaster 00:07:18.029 11:17:59 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@234 -- # ip link set nvmf_init_br2 nomaster 00:07:18.029 11:17:59 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@235 -- # ip link set nvmf_tgt_br nomaster 00:07:18.029 11:17:59 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@236 -- # ip link set nvmf_tgt_br2 nomaster 00:07:18.029 11:17:59 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@237 -- # ip link set nvmf_init_br down 00:07:18.029 11:17:59 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@238 -- # ip link set nvmf_init_br2 down 00:07:18.029 11:17:59 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@239 -- # ip link set nvmf_tgt_br down 00:07:18.029 11:17:59 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@240 -- # ip link set nvmf_tgt_br2 down 00:07:18.029 11:17:59 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@241 -- # ip link delete nvmf_br type bridge 00:07:18.029 11:17:59 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@242 -- # ip link delete nvmf_init_if 00:07:18.029 11:17:59 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@243 -- # ip link delete nvmf_init_if2 00:07:18.029 11:17:59 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@244 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:07:18.344 11:17:59 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@245 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:07:18.344 11:17:59 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@246 -- # remove_spdk_ns 00:07:18.344 11:17:59 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:18.344 11:17:59 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:07:18.344 11:17:59 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:18.344 11:17:59 nvmf_tcp.nvmf_target_core.nvmf_lvol -- nvmf/common.sh@300 -- # return 0 00:07:18.344 00:07:18.344 real 0m17.253s 00:07:18.344 user 1m10.200s 00:07:18.344 sys 0m3.852s 00:07:18.344 11:17:59 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@1126 -- # xtrace_disable 00:07:18.344 11:17:59 nvmf_tcp.nvmf_target_core.nvmf_lvol -- common/autotest_common.sh@10 -- # set +x 00:07:18.344 ************************************ 00:07:18.344 END TEST nvmf_lvol 00:07:18.344 ************************************ 00:07:18.344 11:17:59 nvmf_tcp.nvmf_target_core -- nvmf/nvmf_target_core.sh@28 -- # run_test nvmf_lvs_grow /home/vagrant/spdk_repo/spdk/test/nvmf/target/nvmf_lvs_grow.sh --transport=tcp 00:07:18.344 11:17:59 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:07:18.344 11:17:59 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1107 -- # xtrace_disable 00:07:18.344 11:17:59 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@10 -- # set +x 00:07:18.344 ************************************ 00:07:18.344 START TEST nvmf_lvs_grow 00:07:18.344 ************************************ 00:07:18.344 11:17:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/nvmf/target/nvmf_lvs_grow.sh --transport=tcp 00:07:18.344 * Looking for test storage... 00:07:18.344 * Found test storage at /home/vagrant/spdk_repo/spdk/test/nvmf/target 00:07:18.344 11:17:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:07:18.344 11:17:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:07:18.344 11:17:59 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@1681 -- # lcov --version 00:07:18.344 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:07:18.344 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:07:18.344 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- scripts/common.sh@333 -- # local ver1 ver1_l 00:07:18.344 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- scripts/common.sh@334 -- # local ver2 ver2_l 00:07:18.344 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- scripts/common.sh@336 -- # IFS=.-: 00:07:18.344 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- scripts/common.sh@336 -- # read -ra ver1 00:07:18.344 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- scripts/common.sh@337 -- # IFS=.-: 00:07:18.344 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- scripts/common.sh@337 -- # read -ra ver2 00:07:18.344 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- scripts/common.sh@338 -- # local 'op=<' 00:07:18.344 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- scripts/common.sh@340 -- # ver1_l=2 00:07:18.344 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- scripts/common.sh@341 -- # ver2_l=1 00:07:18.344 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:07:18.344 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- scripts/common.sh@344 -- # case "$op" in 00:07:18.344 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- scripts/common.sh@345 -- # : 1 00:07:18.344 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- scripts/common.sh@364 -- # (( v = 0 )) 00:07:18.344 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:18.344 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- scripts/common.sh@365 -- # decimal 1 00:07:18.344 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- scripts/common.sh@353 -- # local d=1 00:07:18.344 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:18.344 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- scripts/common.sh@355 -- # echo 1 00:07:18.345 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- scripts/common.sh@365 -- # ver1[v]=1 00:07:18.345 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- scripts/common.sh@366 -- # decimal 2 00:07:18.345 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- scripts/common.sh@353 -- # local d=2 00:07:18.345 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:18.345 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- scripts/common.sh@355 -- # echo 2 00:07:18.345 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- scripts/common.sh@366 -- # ver2[v]=2 00:07:18.345 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:07:18.345 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:07:18.345 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- scripts/common.sh@368 -- # return 0 00:07:18.345 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:18.345 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:07:18.345 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:18.345 --rc genhtml_branch_coverage=1 00:07:18.345 --rc genhtml_function_coverage=1 00:07:18.345 --rc genhtml_legend=1 00:07:18.345 --rc geninfo_all_blocks=1 00:07:18.345 --rc geninfo_unexecuted_blocks=1 00:07:18.345 00:07:18.345 ' 00:07:18.345 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:07:18.345 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:18.345 --rc genhtml_branch_coverage=1 00:07:18.345 --rc genhtml_function_coverage=1 00:07:18.345 --rc genhtml_legend=1 00:07:18.345 --rc geninfo_all_blocks=1 00:07:18.345 --rc geninfo_unexecuted_blocks=1 00:07:18.345 00:07:18.345 ' 00:07:18.345 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:07:18.345 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:18.345 --rc genhtml_branch_coverage=1 00:07:18.345 --rc genhtml_function_coverage=1 00:07:18.345 --rc genhtml_legend=1 00:07:18.345 --rc geninfo_all_blocks=1 00:07:18.345 --rc geninfo_unexecuted_blocks=1 00:07:18.345 00:07:18.345 ' 00:07:18.345 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:07:18.345 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:18.345 --rc genhtml_branch_coverage=1 00:07:18.345 --rc genhtml_function_coverage=1 00:07:18.345 --rc genhtml_legend=1 00:07:18.345 --rc geninfo_all_blocks=1 00:07:18.345 --rc geninfo_unexecuted_blocks=1 00:07:18.345 00:07:18.345 ' 00:07:18.345 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- target/nvmf_lvs_grow.sh@9 -- # source /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh 00:07:18.345 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@7 -- # uname -s 00:07:18.345 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:18.345 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:18.605 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:18.605 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:18.605 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:18.605 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:18.605 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:18.605 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:18.605 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:18.605 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:18.605 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:07:18.605 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@18 -- # NVME_HOSTID=3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:07:18.605 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:18.605 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:18.605 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@21 -- # NET_TYPE=virt 00:07:18.605 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:07:18.605 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@49 -- # source /home/vagrant/spdk_repo/spdk/scripts/common.sh 00:07:18.605 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- scripts/common.sh@15 -- # shopt -s extglob 00:07:18.605 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:18.605 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:18.605 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:18.605 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:18.605 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:18.605 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:18.605 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- paths/export.sh@5 -- # export PATH 00:07:18.605 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:18.605 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@51 -- # : 0 00:07:18.605 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:07:18.605 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:07:18.605 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:07:18.605 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:18.605 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:18.605 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:07:18.605 /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:07:18.605 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:07:18.605 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:07:18.605 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@55 -- # have_pci_nics=0 00:07:18.605 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- target/nvmf_lvs_grow.sh@11 -- # rpc_py=/home/vagrant/spdk_repo/spdk/scripts/rpc.py 00:07:18.605 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- target/nvmf_lvs_grow.sh@12 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:07:18.605 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- target/nvmf_lvs_grow.sh@98 -- # nvmftestinit 00:07:18.605 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:07:18.605 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:07:18.605 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@474 -- # prepare_net_devs 00:07:18.605 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@436 -- # local -g is_hw=no 00:07:18.605 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@438 -- # remove_spdk_ns 00:07:18.605 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:18.605 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:07:18.605 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:18.605 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@440 -- # [[ virt != virt ]] 00:07:18.605 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@442 -- # [[ no == yes ]] 00:07:18.605 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@449 -- # [[ virt == phy ]] 00:07:18.605 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@452 -- # [[ virt == phy-fallback ]] 00:07:18.605 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@457 -- # [[ tcp == tcp ]] 00:07:18.605 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@458 -- # nvmf_veth_init 00:07:18.605 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@145 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:07:18.605 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@146 -- # NVMF_SECOND_INITIATOR_IP=10.0.0.2 00:07:18.605 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@147 -- # NVMF_FIRST_TARGET_IP=10.0.0.3 00:07:18.605 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@148 -- # NVMF_SECOND_TARGET_IP=10.0.0.4 00:07:18.605 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@149 -- # NVMF_INITIATOR_IP=10.0.0.1 00:07:18.605 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@150 -- # NVMF_BRIDGE=nvmf_br 00:07:18.605 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@151 -- # NVMF_INITIATOR_INTERFACE=nvmf_init_if 00:07:18.605 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@152 -- # NVMF_INITIATOR_INTERFACE2=nvmf_init_if2 00:07:18.605 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@153 -- # NVMF_INITIATOR_BRIDGE=nvmf_init_br 00:07:18.605 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@154 -- # NVMF_INITIATOR_BRIDGE2=nvmf_init_br2 00:07:18.605 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@155 -- # NVMF_TARGET_NAMESPACE=nvmf_tgt_ns_spdk 00:07:18.605 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@156 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:07:18.605 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@157 -- # NVMF_TARGET_INTERFACE=nvmf_tgt_if 00:07:18.605 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@158 -- # NVMF_TARGET_INTERFACE2=nvmf_tgt_if2 00:07:18.605 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@159 -- # NVMF_TARGET_BRIDGE=nvmf_tgt_br 00:07:18.605 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@160 -- # NVMF_TARGET_BRIDGE2=nvmf_tgt_br2 00:07:18.605 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@162 -- # ip link set nvmf_init_br nomaster 00:07:18.605 Cannot find device "nvmf_init_br" 00:07:18.605 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@162 -- # true 00:07:18.605 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@163 -- # ip link set nvmf_init_br2 nomaster 00:07:18.605 Cannot find device "nvmf_init_br2" 00:07:18.605 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@163 -- # true 00:07:18.605 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@164 -- # ip link set nvmf_tgt_br nomaster 00:07:18.605 Cannot find device "nvmf_tgt_br" 00:07:18.605 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@164 -- # true 00:07:18.606 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@165 -- # ip link set nvmf_tgt_br2 nomaster 00:07:18.606 Cannot find device "nvmf_tgt_br2" 00:07:18.606 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@165 -- # true 00:07:18.606 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@166 -- # ip link set nvmf_init_br down 00:07:18.606 Cannot find device "nvmf_init_br" 00:07:18.606 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@166 -- # true 00:07:18.606 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@167 -- # ip link set nvmf_init_br2 down 00:07:18.606 Cannot find device "nvmf_init_br2" 00:07:18.606 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@167 -- # true 00:07:18.606 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@168 -- # ip link set nvmf_tgt_br down 00:07:18.606 Cannot find device "nvmf_tgt_br" 00:07:18.606 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@168 -- # true 00:07:18.606 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@169 -- # ip link set nvmf_tgt_br2 down 00:07:18.606 Cannot find device "nvmf_tgt_br2" 00:07:18.606 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@169 -- # true 00:07:18.606 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@170 -- # ip link delete nvmf_br type bridge 00:07:18.606 Cannot find device "nvmf_br" 00:07:18.606 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@170 -- # true 00:07:18.606 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@171 -- # ip link delete nvmf_init_if 00:07:18.606 Cannot find device "nvmf_init_if" 00:07:18.606 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@171 -- # true 00:07:18.606 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@172 -- # ip link delete nvmf_init_if2 00:07:18.606 Cannot find device "nvmf_init_if2" 00:07:18.606 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@172 -- # true 00:07:18.606 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@173 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:07:18.606 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:07:18.606 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@173 -- # true 00:07:18.606 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@174 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:07:18.606 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:07:18.606 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@174 -- # true 00:07:18.606 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@177 -- # ip netns add nvmf_tgt_ns_spdk 00:07:18.606 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@180 -- # ip link add nvmf_init_if type veth peer name nvmf_init_br 00:07:18.606 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@181 -- # ip link add nvmf_init_if2 type veth peer name nvmf_init_br2 00:07:18.606 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@182 -- # ip link add nvmf_tgt_if type veth peer name nvmf_tgt_br 00:07:18.606 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@183 -- # ip link add nvmf_tgt_if2 type veth peer name nvmf_tgt_br2 00:07:18.606 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@186 -- # ip link set nvmf_tgt_if netns nvmf_tgt_ns_spdk 00:07:18.865 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@187 -- # ip link set nvmf_tgt_if2 netns nvmf_tgt_ns_spdk 00:07:18.865 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@190 -- # ip addr add 10.0.0.1/24 dev nvmf_init_if 00:07:18.865 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@191 -- # ip addr add 10.0.0.2/24 dev nvmf_init_if2 00:07:18.865 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@192 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.3/24 dev nvmf_tgt_if 00:07:18.865 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@193 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.4/24 dev nvmf_tgt_if2 00:07:18.865 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@196 -- # ip link set nvmf_init_if up 00:07:18.865 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@197 -- # ip link set nvmf_init_if2 up 00:07:18.865 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@198 -- # ip link set nvmf_init_br up 00:07:18.865 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@199 -- # ip link set nvmf_init_br2 up 00:07:18.865 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@200 -- # ip link set nvmf_tgt_br up 00:07:18.865 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@201 -- # ip link set nvmf_tgt_br2 up 00:07:18.865 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@202 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if up 00:07:18.865 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@203 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if2 up 00:07:18.865 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@204 -- # ip netns exec nvmf_tgt_ns_spdk ip link set lo up 00:07:18.865 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@207 -- # ip link add nvmf_br type bridge 00:07:18.865 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@208 -- # ip link set nvmf_br up 00:07:18.865 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@211 -- # ip link set nvmf_init_br master nvmf_br 00:07:18.865 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@212 -- # ip link set nvmf_init_br2 master nvmf_br 00:07:18.865 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@213 -- # ip link set nvmf_tgt_br master nvmf_br 00:07:18.865 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@214 -- # ip link set nvmf_tgt_br2 master nvmf_br 00:07:18.865 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@217 -- # ipts -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT 00:07:18.865 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT' 00:07:18.865 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@218 -- # ipts -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT 00:07:18.865 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT' 00:07:18.865 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@219 -- # ipts -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT 00:07:18.865 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@788 -- # iptables -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT -m comment --comment 'SPDK_NVMF:-A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT' 00:07:18.865 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@222 -- # ping -c 1 10.0.0.3 00:07:18.865 PING 10.0.0.3 (10.0.0.3) 56(84) bytes of data. 00:07:18.865 64 bytes from 10.0.0.3: icmp_seq=1 ttl=64 time=0.088 ms 00:07:18.865 00:07:18.865 --- 10.0.0.3 ping statistics --- 00:07:18.865 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:18.865 rtt min/avg/max/mdev = 0.088/0.088/0.088/0.000 ms 00:07:18.865 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@223 -- # ping -c 1 10.0.0.4 00:07:18.865 PING 10.0.0.4 (10.0.0.4) 56(84) bytes of data. 00:07:18.865 64 bytes from 10.0.0.4: icmp_seq=1 ttl=64 time=0.090 ms 00:07:18.865 00:07:18.865 --- 10.0.0.4 ping statistics --- 00:07:18.865 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:18.865 rtt min/avg/max/mdev = 0.090/0.090/0.090/0.000 ms 00:07:18.865 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@224 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.1 00:07:18.865 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:07:18.865 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.032 ms 00:07:18.865 00:07:18.865 --- 10.0.0.1 ping statistics --- 00:07:18.865 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:18.865 rtt min/avg/max/mdev = 0.032/0.032/0.032/0.000 ms 00:07:18.865 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@225 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.2 00:07:18.865 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:07:18.865 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.078 ms 00:07:18.865 00:07:18.865 --- 10.0.0.2 ping statistics --- 00:07:18.865 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:18.865 rtt min/avg/max/mdev = 0.078/0.078/0.078/0.000 ms 00:07:18.865 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@227 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:07:18.865 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@459 -- # return 0 00:07:18.866 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:07:18.866 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:07:18.866 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:07:18.866 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:07:18.866 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:07:18.866 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:07:18.866 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:07:18.866 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- target/nvmf_lvs_grow.sh@99 -- # nvmfappstart -m 0x1 00:07:18.866 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:07:18.866 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@724 -- # xtrace_disable 00:07:18.866 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@10 -- # set +x 00:07:18.866 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@507 -- # nvmfpid=66365 00:07:18.866 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@506 -- # ip netns exec nvmf_tgt_ns_spdk /home/vagrant/spdk_repo/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:07:18.866 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@508 -- # waitforlisten 66365 00:07:18.866 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@831 -- # '[' -z 66365 ']' 00:07:18.866 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:18.866 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@836 -- # local max_retries=100 00:07:18.866 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:18.866 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:18.866 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@840 -- # xtrace_disable 00:07:18.866 11:18:00 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@10 -- # set +x 00:07:19.124 [2024-10-07 11:18:00.618162] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:07:19.124 [2024-10-07 11:18:00.618272] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:07:19.124 [2024-10-07 11:18:00.759847] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:19.413 [2024-10-07 11:18:00.921114] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:07:19.413 [2024-10-07 11:18:00.921192] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:07:19.413 [2024-10-07 11:18:00.921207] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:07:19.413 [2024-10-07 11:18:00.921219] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:07:19.413 [2024-10-07 11:18:00.921228] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:07:19.413 [2024-10-07 11:18:00.921855] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:07:19.979 11:18:01 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:07:19.979 11:18:01 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@864 -- # return 0 00:07:19.979 11:18:01 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:07:19.979 11:18:01 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@730 -- # xtrace_disable 00:07:19.979 11:18:01 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@10 -- # set +x 00:07:20.237 11:18:01 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:07:20.237 11:18:01 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- target/nvmf_lvs_grow.sh@100 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:07:20.495 [2024-10-07 11:18:02.013525] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:07:20.495 11:18:02 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- target/nvmf_lvs_grow.sh@102 -- # run_test lvs_grow_clean lvs_grow 00:07:20.495 11:18:02 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@1101 -- # '[' 2 -le 1 ']' 00:07:20.495 11:18:02 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@1107 -- # xtrace_disable 00:07:20.495 11:18:02 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@10 -- # set +x 00:07:20.495 ************************************ 00:07:20.495 START TEST lvs_grow_clean 00:07:20.495 ************************************ 00:07:20.495 11:18:02 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@1125 -- # lvs_grow 00:07:20.495 11:18:02 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@15 -- # local aio_bdev lvs lvol 00:07:20.495 11:18:02 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@16 -- # local data_clusters free_clusters 00:07:20.495 11:18:02 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@17 -- # local bdevperf_pid run_test_pid 00:07:20.495 11:18:02 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@18 -- # local aio_init_size_mb=200 00:07:20.495 11:18:02 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@19 -- # local aio_final_size_mb=400 00:07:20.495 11:18:02 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@20 -- # local lvol_bdev_size_mb=150 00:07:20.495 11:18:02 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@23 -- # rm -f /home/vagrant/spdk_repo/spdk/test/nvmf/target/aio_bdev 00:07:20.495 11:18:02 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@24 -- # truncate -s 200M /home/vagrant/spdk_repo/spdk/test/nvmf/target/aio_bdev 00:07:20.495 11:18:02 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@25 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_aio_create /home/vagrant/spdk_repo/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:07:20.752 11:18:02 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@25 -- # aio_bdev=aio_bdev 00:07:20.752 11:18:02 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@28 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_lvol_create_lvstore --cluster-sz 4194304 --md-pages-per-cluster-ratio 300 aio_bdev lvs 00:07:21.319 11:18:02 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@28 -- # lvs=76749968-f4c6-4b98-99d4-609c82a06855 00:07:21.319 11:18:02 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@29 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 76749968-f4c6-4b98-99d4-609c82a06855 00:07:21.319 11:18:02 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@29 -- # jq -r '.[0].total_data_clusters' 00:07:21.578 11:18:03 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@29 -- # data_clusters=49 00:07:21.578 11:18:03 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@30 -- # (( data_clusters == 49 )) 00:07:21.578 11:18:03 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@33 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_lvol_create -u 76749968-f4c6-4b98-99d4-609c82a06855 lvol 150 00:07:21.872 11:18:03 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@33 -- # lvol=d047940f-a255-4bb5-9ca2-b6b25cbcc738 00:07:21.872 11:18:03 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@36 -- # truncate -s 400M /home/vagrant/spdk_repo/spdk/test/nvmf/target/aio_bdev 00:07:21.872 11:18:03 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@37 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_aio_rescan aio_bdev 00:07:22.133 [2024-10-07 11:18:03.694521] bdev_aio.c:1044:bdev_aio_rescan: *NOTICE*: AIO device is resized: bdev name /home/vagrant/spdk_repo/spdk/test/nvmf/target/aio_bdev, old block count 51200, new block count 102400 00:07:22.133 [2024-10-07 11:18:03.694633] vbdev_lvol.c: 165:vbdev_lvs_base_bdev_event_cb: *NOTICE*: Unsupported bdev event: type 1 00:07:22.133 true 00:07:22.133 11:18:03 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@38 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 76749968-f4c6-4b98-99d4-609c82a06855 00:07:22.133 11:18:03 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@38 -- # jq -r '.[0].total_data_clusters' 00:07:22.391 11:18:04 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@38 -- # (( data_clusters == 49 )) 00:07:22.391 11:18:04 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@41 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:07:22.651 11:18:04 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@42 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 d047940f-a255-4bb5-9ca2-b6b25cbcc738 00:07:23.218 11:18:04 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@43 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.3 -s 4420 00:07:23.475 [2024-10-07 11:18:04.939308] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:07:23.475 11:18:04 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@44 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.3 -s 4420 00:07:23.732 11:18:05 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@47 -- # /home/vagrant/spdk_repo/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock -m 0x2 -o 4096 -q 128 -w randwrite -t 10 -S 1 -z 00:07:23.732 11:18:05 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@48 -- # bdevperf_pid=66543 00:07:23.732 11:18:05 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@49 -- # trap 'killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:07:23.732 11:18:05 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@50 -- # waitforlisten 66543 /var/tmp/bdevperf.sock 00:07:23.732 11:18:05 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@831 -- # '[' -z 66543 ']' 00:07:23.732 11:18:05 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:07:23.732 11:18:05 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@836 -- # local max_retries=100 00:07:23.732 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:07:23.732 11:18:05 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:07:23.733 11:18:05 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@840 -- # xtrace_disable 00:07:23.733 11:18:05 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@10 -- # set +x 00:07:23.733 [2024-10-07 11:18:05.324945] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:07:23.733 [2024-10-07 11:18:05.325051] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid66543 ] 00:07:23.989 [2024-10-07 11:18:05.455463] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:23.989 [2024-10-07 11:18:05.611907] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:07:24.964 11:18:06 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:07:24.964 11:18:06 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@864 -- # return 0 00:07:24.964 11:18:06 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@52 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme0 -t tcp -a 10.0.0.3 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 00:07:25.225 Nvme0n1 00:07:25.226 11:18:06 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@53 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_get_bdevs -b Nvme0n1 -t 3000 00:07:25.484 [ 00:07:25.484 { 00:07:25.484 "aliases": [ 00:07:25.484 "d047940f-a255-4bb5-9ca2-b6b25cbcc738" 00:07:25.484 ], 00:07:25.484 "assigned_rate_limits": { 00:07:25.484 "r_mbytes_per_sec": 0, 00:07:25.484 "rw_ios_per_sec": 0, 00:07:25.484 "rw_mbytes_per_sec": 0, 00:07:25.484 "w_mbytes_per_sec": 0 00:07:25.484 }, 00:07:25.484 "block_size": 4096, 00:07:25.484 "claimed": false, 00:07:25.484 "driver_specific": { 00:07:25.484 "mp_policy": "active_passive", 00:07:25.484 "nvme": [ 00:07:25.484 { 00:07:25.484 "ctrlr_data": { 00:07:25.484 "ana_reporting": false, 00:07:25.484 "cntlid": 1, 00:07:25.484 "firmware_revision": "25.01", 00:07:25.484 "model_number": "SPDK bdev Controller", 00:07:25.484 "multi_ctrlr": true, 00:07:25.484 "oacs": { 00:07:25.484 "firmware": 0, 00:07:25.484 "format": 0, 00:07:25.484 "ns_manage": 0, 00:07:25.484 "security": 0 00:07:25.484 }, 00:07:25.484 "serial_number": "SPDK0", 00:07:25.484 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:07:25.484 "vendor_id": "0x8086" 00:07:25.484 }, 00:07:25.484 "ns_data": { 00:07:25.484 "can_share": true, 00:07:25.484 "id": 1 00:07:25.484 }, 00:07:25.484 "trid": { 00:07:25.484 "adrfam": "IPv4", 00:07:25.484 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:07:25.484 "traddr": "10.0.0.3", 00:07:25.484 "trsvcid": "4420", 00:07:25.484 "trtype": "TCP" 00:07:25.484 }, 00:07:25.484 "vs": { 00:07:25.484 "nvme_version": "1.3" 00:07:25.484 } 00:07:25.484 } 00:07:25.484 ] 00:07:25.484 }, 00:07:25.484 "memory_domains": [ 00:07:25.484 { 00:07:25.484 "dma_device_id": "system", 00:07:25.484 "dma_device_type": 1 00:07:25.484 } 00:07:25.484 ], 00:07:25.484 "name": "Nvme0n1", 00:07:25.484 "num_blocks": 38912, 00:07:25.484 "numa_id": -1, 00:07:25.484 "product_name": "NVMe disk", 00:07:25.484 "supported_io_types": { 00:07:25.484 "abort": true, 00:07:25.484 "compare": true, 00:07:25.484 "compare_and_write": true, 00:07:25.484 "copy": true, 00:07:25.484 "flush": true, 00:07:25.484 "get_zone_info": false, 00:07:25.484 "nvme_admin": true, 00:07:25.484 "nvme_io": true, 00:07:25.484 "nvme_io_md": false, 00:07:25.484 "nvme_iov_md": false, 00:07:25.484 "read": true, 00:07:25.484 "reset": true, 00:07:25.484 "seek_data": false, 00:07:25.484 "seek_hole": false, 00:07:25.484 "unmap": true, 00:07:25.484 "write": true, 00:07:25.484 "write_zeroes": true, 00:07:25.484 "zcopy": false, 00:07:25.484 "zone_append": false, 00:07:25.484 "zone_management": false 00:07:25.484 }, 00:07:25.484 "uuid": "d047940f-a255-4bb5-9ca2-b6b25cbcc738", 00:07:25.484 "zoned": false 00:07:25.484 } 00:07:25.484 ] 00:07:25.484 11:18:07 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@56 -- # run_test_pid=66595 00:07:25.484 11:18:07 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@55 -- # /home/vagrant/spdk_repo/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:07:25.484 11:18:07 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@57 -- # sleep 2 00:07:25.743 Running I/O for 10 seconds... 00:07:26.679 Latency(us) 00:07:26.679 [2024-10-07T11:18:08.390Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:07:26.679 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:07:26.679 Nvme0n1 : 1.00 7070.00 27.62 0.00 0.00 0.00 0.00 0.00 00:07:26.679 [2024-10-07T11:18:08.390Z] =================================================================================================================== 00:07:26.679 [2024-10-07T11:18:08.390Z] Total : 7070.00 27.62 0.00 0.00 0.00 0.00 0.00 00:07:26.679 00:07:27.609 11:18:09 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@60 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_lvol_grow_lvstore -u 76749968-f4c6-4b98-99d4-609c82a06855 00:07:27.610 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:07:27.610 Nvme0n1 : 2.00 6848.00 26.75 0.00 0.00 0.00 0.00 0.00 00:07:27.610 [2024-10-07T11:18:09.321Z] =================================================================================================================== 00:07:27.610 [2024-10-07T11:18:09.321Z] Total : 6848.00 26.75 0.00 0.00 0.00 0.00 0.00 00:07:27.610 00:07:27.867 true 00:07:27.867 11:18:09 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@61 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 76749968-f4c6-4b98-99d4-609c82a06855 00:07:27.867 11:18:09 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@61 -- # jq -r '.[0].total_data_clusters' 00:07:28.433 11:18:09 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@61 -- # data_clusters=99 00:07:28.433 11:18:09 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@62 -- # (( data_clusters == 99 )) 00:07:28.433 11:18:09 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@65 -- # wait 66595 00:07:28.691 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:07:28.691 Nvme0n1 : 3.00 6809.33 26.60 0.00 0.00 0.00 0.00 0.00 00:07:28.691 [2024-10-07T11:18:10.402Z] =================================================================================================================== 00:07:28.691 [2024-10-07T11:18:10.402Z] Total : 6809.33 26.60 0.00 0.00 0.00 0.00 0.00 00:07:28.691 00:07:29.625 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:07:29.625 Nvme0n1 : 4.00 6877.25 26.86 0.00 0.00 0.00 0.00 0.00 00:07:29.625 [2024-10-07T11:18:11.336Z] =================================================================================================================== 00:07:29.625 [2024-10-07T11:18:11.336Z] Total : 6877.25 26.86 0.00 0.00 0.00 0.00 0.00 00:07:29.625 00:07:30.633 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:07:30.634 Nvme0n1 : 5.00 6836.00 26.70 0.00 0.00 0.00 0.00 0.00 00:07:30.634 [2024-10-07T11:18:12.345Z] =================================================================================================================== 00:07:30.634 [2024-10-07T11:18:12.345Z] Total : 6836.00 26.70 0.00 0.00 0.00 0.00 0.00 00:07:30.634 00:07:31.566 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:07:31.566 Nvme0n1 : 6.00 6877.33 26.86 0.00 0.00 0.00 0.00 0.00 00:07:31.566 [2024-10-07T11:18:13.277Z] =================================================================================================================== 00:07:31.566 [2024-10-07T11:18:13.277Z] Total : 6877.33 26.86 0.00 0.00 0.00 0.00 0.00 00:07:31.566 00:07:32.940 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:07:32.940 Nvme0n1 : 7.00 6805.29 26.58 0.00 0.00 0.00 0.00 0.00 00:07:32.940 [2024-10-07T11:18:14.651Z] =================================================================================================================== 00:07:32.940 [2024-10-07T11:18:14.651Z] Total : 6805.29 26.58 0.00 0.00 0.00 0.00 0.00 00:07:32.940 00:07:33.874 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:07:33.874 Nvme0n1 : 8.00 6742.25 26.34 0.00 0.00 0.00 0.00 0.00 00:07:33.874 [2024-10-07T11:18:15.585Z] =================================================================================================================== 00:07:33.874 [2024-10-07T11:18:15.585Z] Total : 6742.25 26.34 0.00 0.00 0.00 0.00 0.00 00:07:33.874 00:07:34.810 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:07:34.810 Nvme0n1 : 9.00 6778.78 26.48 0.00 0.00 0.00 0.00 0.00 00:07:34.810 [2024-10-07T11:18:16.521Z] =================================================================================================================== 00:07:34.810 [2024-10-07T11:18:16.521Z] Total : 6778.78 26.48 0.00 0.00 0.00 0.00 0.00 00:07:34.810 00:07:35.744 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:07:35.744 Nvme0n1 : 10.00 6820.90 26.64 0.00 0.00 0.00 0.00 0.00 00:07:35.744 [2024-10-07T11:18:17.455Z] =================================================================================================================== 00:07:35.744 [2024-10-07T11:18:17.455Z] Total : 6820.90 26.64 0.00 0.00 0.00 0.00 0.00 00:07:35.744 00:07:35.744 00:07:35.744 Latency(us) 00:07:35.744 [2024-10-07T11:18:17.455Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:07:35.744 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:07:35.744 Nvme0n1 : 10.02 6821.58 26.65 0.00 0.00 18757.76 5898.24 110577.11 00:07:35.744 [2024-10-07T11:18:17.455Z] =================================================================================================================== 00:07:35.744 [2024-10-07T11:18:17.455Z] Total : 6821.58 26.65 0.00 0.00 18757.76 5898.24 110577.11 00:07:35.744 { 00:07:35.744 "results": [ 00:07:35.744 { 00:07:35.744 "job": "Nvme0n1", 00:07:35.744 "core_mask": "0x2", 00:07:35.744 "workload": "randwrite", 00:07:35.744 "status": "finished", 00:07:35.744 "queue_depth": 128, 00:07:35.744 "io_size": 4096, 00:07:35.744 "runtime": 10.017762, 00:07:35.744 "iops": 6821.583503381295, 00:07:35.744 "mibps": 26.646810560083182, 00:07:35.744 "io_failed": 0, 00:07:35.744 "io_timeout": 0, 00:07:35.744 "avg_latency_us": 18757.762738939506, 00:07:35.744 "min_latency_us": 5898.24, 00:07:35.744 "max_latency_us": 110577.10545454545 00:07:35.744 } 00:07:35.744 ], 00:07:35.744 "core_count": 1 00:07:35.744 } 00:07:35.744 11:18:17 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@66 -- # killprocess 66543 00:07:35.744 11:18:17 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@950 -- # '[' -z 66543 ']' 00:07:35.744 11:18:17 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@954 -- # kill -0 66543 00:07:35.744 11:18:17 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@955 -- # uname 00:07:35.744 11:18:17 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:07:35.744 11:18:17 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 66543 00:07:35.744 11:18:17 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@956 -- # process_name=reactor_1 00:07:35.744 killing process with pid 66543 00:07:35.744 11:18:17 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@960 -- # '[' reactor_1 = sudo ']' 00:07:35.744 11:18:17 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@968 -- # echo 'killing process with pid 66543' 00:07:35.744 Received shutdown signal, test time was about 10.000000 seconds 00:07:35.744 00:07:35.744 Latency(us) 00:07:35.744 [2024-10-07T11:18:17.455Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:07:35.744 [2024-10-07T11:18:17.455Z] =================================================================================================================== 00:07:35.744 [2024-10-07T11:18:17.455Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:07:35.744 11:18:17 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@969 -- # kill 66543 00:07:35.744 11:18:17 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@974 -- # wait 66543 00:07:36.002 11:18:17 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@68 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_listener discovery -t tcp -a 10.0.0.3 -s 4420 00:07:36.259 11:18:17 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@69 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:07:36.832 11:18:18 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@70 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 76749968-f4c6-4b98-99d4-609c82a06855 00:07:36.832 11:18:18 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@70 -- # jq -r '.[0].free_clusters' 00:07:37.095 11:18:18 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@70 -- # free_clusters=61 00:07:37.095 11:18:18 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@72 -- # [[ '' == \d\i\r\t\y ]] 00:07:37.095 11:18:18 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@84 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:07:37.353 [2024-10-07 11:18:18.910232] vbdev_lvol.c: 150:vbdev_lvs_hotremove_cb: *NOTICE*: bdev aio_bdev being removed: closing lvstore lvs 00:07:37.353 11:18:18 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@85 -- # NOT /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 76749968-f4c6-4b98-99d4-609c82a06855 00:07:37.353 11:18:18 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@650 -- # local es=0 00:07:37.353 11:18:18 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@652 -- # valid_exec_arg /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 76749968-f4c6-4b98-99d4-609c82a06855 00:07:37.353 11:18:18 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@638 -- # local arg=/home/vagrant/spdk_repo/spdk/scripts/rpc.py 00:07:37.353 11:18:18 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:07:37.353 11:18:18 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@642 -- # type -t /home/vagrant/spdk_repo/spdk/scripts/rpc.py 00:07:37.353 11:18:18 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:07:37.353 11:18:18 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@644 -- # type -P /home/vagrant/spdk_repo/spdk/scripts/rpc.py 00:07:37.354 11:18:18 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:07:37.354 11:18:18 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@644 -- # arg=/home/vagrant/spdk_repo/spdk/scripts/rpc.py 00:07:37.354 11:18:18 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@644 -- # [[ -x /home/vagrant/spdk_repo/spdk/scripts/rpc.py ]] 00:07:37.354 11:18:18 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@653 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 76749968-f4c6-4b98-99d4-609c82a06855 00:07:37.611 2024/10/07 11:18:19 error on JSON-RPC call, method: bdev_lvol_get_lvstores, params: map[uuid:76749968-f4c6-4b98-99d4-609c82a06855], err: error received for bdev_lvol_get_lvstores method, err: Code=-19 Msg=No such device 00:07:37.611 request: 00:07:37.611 { 00:07:37.611 "method": "bdev_lvol_get_lvstores", 00:07:37.611 "params": { 00:07:37.612 "uuid": "76749968-f4c6-4b98-99d4-609c82a06855" 00:07:37.612 } 00:07:37.612 } 00:07:37.612 Got JSON-RPC error response 00:07:37.612 GoRPCClient: error on JSON-RPC call 00:07:37.612 11:18:19 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@653 -- # es=1 00:07:37.612 11:18:19 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:07:37.612 11:18:19 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:07:37.612 11:18:19 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:07:37.612 11:18:19 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@86 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_aio_create /home/vagrant/spdk_repo/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:07:38.176 aio_bdev 00:07:38.176 11:18:19 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@87 -- # waitforbdev d047940f-a255-4bb5-9ca2-b6b25cbcc738 00:07:38.176 11:18:19 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@899 -- # local bdev_name=d047940f-a255-4bb5-9ca2-b6b25cbcc738 00:07:38.176 11:18:19 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@900 -- # local bdev_timeout= 00:07:38.176 11:18:19 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@901 -- # local i 00:07:38.176 11:18:19 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@902 -- # [[ -z '' ]] 00:07:38.176 11:18:19 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@902 -- # bdev_timeout=2000 00:07:38.176 11:18:19 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@904 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_wait_for_examine 00:07:38.434 11:18:19 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@906 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_get_bdevs -b d047940f-a255-4bb5-9ca2-b6b25cbcc738 -t 2000 00:07:38.692 [ 00:07:38.692 { 00:07:38.692 "aliases": [ 00:07:38.692 "lvs/lvol" 00:07:38.692 ], 00:07:38.692 "assigned_rate_limits": { 00:07:38.692 "r_mbytes_per_sec": 0, 00:07:38.692 "rw_ios_per_sec": 0, 00:07:38.692 "rw_mbytes_per_sec": 0, 00:07:38.692 "w_mbytes_per_sec": 0 00:07:38.692 }, 00:07:38.692 "block_size": 4096, 00:07:38.692 "claimed": false, 00:07:38.692 "driver_specific": { 00:07:38.692 "lvol": { 00:07:38.692 "base_bdev": "aio_bdev", 00:07:38.692 "clone": false, 00:07:38.692 "esnap_clone": false, 00:07:38.692 "lvol_store_uuid": "76749968-f4c6-4b98-99d4-609c82a06855", 00:07:38.692 "num_allocated_clusters": 38, 00:07:38.692 "snapshot": false, 00:07:38.692 "thin_provision": false 00:07:38.692 } 00:07:38.692 }, 00:07:38.692 "name": "d047940f-a255-4bb5-9ca2-b6b25cbcc738", 00:07:38.692 "num_blocks": 38912, 00:07:38.692 "product_name": "Logical Volume", 00:07:38.692 "supported_io_types": { 00:07:38.692 "abort": false, 00:07:38.692 "compare": false, 00:07:38.692 "compare_and_write": false, 00:07:38.692 "copy": false, 00:07:38.692 "flush": false, 00:07:38.692 "get_zone_info": false, 00:07:38.692 "nvme_admin": false, 00:07:38.692 "nvme_io": false, 00:07:38.692 "nvme_io_md": false, 00:07:38.692 "nvme_iov_md": false, 00:07:38.692 "read": true, 00:07:38.692 "reset": true, 00:07:38.692 "seek_data": true, 00:07:38.692 "seek_hole": true, 00:07:38.692 "unmap": true, 00:07:38.692 "write": true, 00:07:38.692 "write_zeroes": true, 00:07:38.692 "zcopy": false, 00:07:38.692 "zone_append": false, 00:07:38.692 "zone_management": false 00:07:38.692 }, 00:07:38.692 "uuid": "d047940f-a255-4bb5-9ca2-b6b25cbcc738", 00:07:38.692 "zoned": false 00:07:38.692 } 00:07:38.692 ] 00:07:38.692 11:18:20 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@907 -- # return 0 00:07:38.692 11:18:20 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@88 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 76749968-f4c6-4b98-99d4-609c82a06855 00:07:38.692 11:18:20 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@88 -- # jq -r '.[0].free_clusters' 00:07:38.950 11:18:20 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@88 -- # (( free_clusters == 61 )) 00:07:38.950 11:18:20 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@89 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 76749968-f4c6-4b98-99d4-609c82a06855 00:07:38.950 11:18:20 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@89 -- # jq -r '.[0].total_data_clusters' 00:07:39.209 11:18:20 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@89 -- # (( data_clusters == 99 )) 00:07:39.209 11:18:20 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@92 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_lvol_delete d047940f-a255-4bb5-9ca2-b6b25cbcc738 00:07:39.467 11:18:21 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@93 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u 76749968-f4c6-4b98-99d4-609c82a06855 00:07:39.725 11:18:21 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@94 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:07:39.983 11:18:21 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- target/nvmf_lvs_grow.sh@95 -- # rm -f /home/vagrant/spdk_repo/spdk/test/nvmf/target/aio_bdev 00:07:40.549 ************************************ 00:07:40.549 END TEST lvs_grow_clean 00:07:40.549 ************************************ 00:07:40.549 00:07:40.549 real 0m20.087s 00:07:40.549 user 0m19.469s 00:07:40.549 sys 0m2.627s 00:07:40.549 11:18:22 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@1126 -- # xtrace_disable 00:07:40.549 11:18:22 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_clean -- common/autotest_common.sh@10 -- # set +x 00:07:40.549 11:18:22 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- target/nvmf_lvs_grow.sh@103 -- # run_test lvs_grow_dirty lvs_grow dirty 00:07:40.549 11:18:22 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:07:40.549 11:18:22 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@1107 -- # xtrace_disable 00:07:40.549 11:18:22 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@10 -- # set +x 00:07:40.549 ************************************ 00:07:40.549 START TEST lvs_grow_dirty 00:07:40.549 ************************************ 00:07:40.549 11:18:22 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@1125 -- # lvs_grow dirty 00:07:40.549 11:18:22 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@15 -- # local aio_bdev lvs lvol 00:07:40.549 11:18:22 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@16 -- # local data_clusters free_clusters 00:07:40.549 11:18:22 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@17 -- # local bdevperf_pid run_test_pid 00:07:40.549 11:18:22 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@18 -- # local aio_init_size_mb=200 00:07:40.549 11:18:22 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@19 -- # local aio_final_size_mb=400 00:07:40.549 11:18:22 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@20 -- # local lvol_bdev_size_mb=150 00:07:40.549 11:18:22 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@23 -- # rm -f /home/vagrant/spdk_repo/spdk/test/nvmf/target/aio_bdev 00:07:40.549 11:18:22 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@24 -- # truncate -s 200M /home/vagrant/spdk_repo/spdk/test/nvmf/target/aio_bdev 00:07:40.549 11:18:22 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@25 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_aio_create /home/vagrant/spdk_repo/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:07:41.145 11:18:22 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@25 -- # aio_bdev=aio_bdev 00:07:41.145 11:18:22 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@28 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_lvol_create_lvstore --cluster-sz 4194304 --md-pages-per-cluster-ratio 300 aio_bdev lvs 00:07:41.403 11:18:22 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@28 -- # lvs=c6f3f844-c84d-4fda-afb1-d8770405c335 00:07:41.403 11:18:22 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@29 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u c6f3f844-c84d-4fda-afb1-d8770405c335 00:07:41.403 11:18:22 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@29 -- # jq -r '.[0].total_data_clusters' 00:07:41.661 11:18:23 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@29 -- # data_clusters=49 00:07:41.661 11:18:23 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@30 -- # (( data_clusters == 49 )) 00:07:41.661 11:18:23 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@33 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_lvol_create -u c6f3f844-c84d-4fda-afb1-d8770405c335 lvol 150 00:07:41.919 11:18:23 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@33 -- # lvol=78ac5ab9-e177-4018-9340-e8b9ff22ba7b 00:07:41.919 11:18:23 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@36 -- # truncate -s 400M /home/vagrant/spdk_repo/spdk/test/nvmf/target/aio_bdev 00:07:41.919 11:18:23 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@37 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_aio_rescan aio_bdev 00:07:42.177 [2024-10-07 11:18:23.678347] bdev_aio.c:1044:bdev_aio_rescan: *NOTICE*: AIO device is resized: bdev name /home/vagrant/spdk_repo/spdk/test/nvmf/target/aio_bdev, old block count 51200, new block count 102400 00:07:42.177 [2024-10-07 11:18:23.678499] vbdev_lvol.c: 165:vbdev_lvs_base_bdev_event_cb: *NOTICE*: Unsupported bdev event: type 1 00:07:42.177 true 00:07:42.177 11:18:23 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@38 -- # jq -r '.[0].total_data_clusters' 00:07:42.177 11:18:23 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@38 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u c6f3f844-c84d-4fda-afb1-d8770405c335 00:07:42.435 11:18:24 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@38 -- # (( data_clusters == 49 )) 00:07:42.435 11:18:24 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@41 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:07:42.693 11:18:24 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@42 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 78ac5ab9-e177-4018-9340-e8b9ff22ba7b 00:07:43.259 11:18:24 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@43 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.3 -s 4420 00:07:43.517 [2024-10-07 11:18:24.995140] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:07:43.517 11:18:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@44 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.3 -s 4420 00:07:43.777 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:07:43.777 11:18:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@48 -- # bdevperf_pid=67012 00:07:43.777 11:18:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@47 -- # /home/vagrant/spdk_repo/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock -m 0x2 -o 4096 -q 128 -w randwrite -t 10 -S 1 -z 00:07:43.777 11:18:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@49 -- # trap 'killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:07:43.777 11:18:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@50 -- # waitforlisten 67012 /var/tmp/bdevperf.sock 00:07:43.777 11:18:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@831 -- # '[' -z 67012 ']' 00:07:43.777 11:18:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:07:43.777 11:18:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@836 -- # local max_retries=100 00:07:43.777 11:18:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:07:43.777 11:18:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@840 -- # xtrace_disable 00:07:43.777 11:18:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@10 -- # set +x 00:07:43.777 [2024-10-07 11:18:25.422658] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:07:43.777 [2024-10-07 11:18:25.422769] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid67012 ] 00:07:44.035 [2024-10-07 11:18:25.555623] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:44.035 [2024-10-07 11:18:25.680078] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:07:44.293 11:18:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:07:44.293 11:18:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@864 -- # return 0 00:07:44.293 11:18:25 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@52 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme0 -t tcp -a 10.0.0.3 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 00:07:44.552 Nvme0n1 00:07:44.552 11:18:26 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@53 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_get_bdevs -b Nvme0n1 -t 3000 00:07:44.810 [ 00:07:44.810 { 00:07:44.810 "aliases": [ 00:07:44.810 "78ac5ab9-e177-4018-9340-e8b9ff22ba7b" 00:07:44.810 ], 00:07:44.810 "assigned_rate_limits": { 00:07:44.810 "r_mbytes_per_sec": 0, 00:07:44.810 "rw_ios_per_sec": 0, 00:07:44.810 "rw_mbytes_per_sec": 0, 00:07:44.810 "w_mbytes_per_sec": 0 00:07:44.810 }, 00:07:44.810 "block_size": 4096, 00:07:44.810 "claimed": false, 00:07:44.810 "driver_specific": { 00:07:44.810 "mp_policy": "active_passive", 00:07:44.810 "nvme": [ 00:07:44.810 { 00:07:44.810 "ctrlr_data": { 00:07:44.810 "ana_reporting": false, 00:07:44.810 "cntlid": 1, 00:07:44.810 "firmware_revision": "25.01", 00:07:44.810 "model_number": "SPDK bdev Controller", 00:07:44.810 "multi_ctrlr": true, 00:07:44.810 "oacs": { 00:07:44.810 "firmware": 0, 00:07:44.810 "format": 0, 00:07:44.810 "ns_manage": 0, 00:07:44.810 "security": 0 00:07:44.810 }, 00:07:44.810 "serial_number": "SPDK0", 00:07:44.810 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:07:44.810 "vendor_id": "0x8086" 00:07:44.810 }, 00:07:44.810 "ns_data": { 00:07:44.810 "can_share": true, 00:07:44.810 "id": 1 00:07:44.810 }, 00:07:44.810 "trid": { 00:07:44.810 "adrfam": "IPv4", 00:07:44.810 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:07:44.810 "traddr": "10.0.0.3", 00:07:44.810 "trsvcid": "4420", 00:07:44.810 "trtype": "TCP" 00:07:44.810 }, 00:07:44.810 "vs": { 00:07:44.810 "nvme_version": "1.3" 00:07:44.810 } 00:07:44.810 } 00:07:44.810 ] 00:07:44.810 }, 00:07:44.810 "memory_domains": [ 00:07:44.810 { 00:07:44.810 "dma_device_id": "system", 00:07:44.810 "dma_device_type": 1 00:07:44.810 } 00:07:44.810 ], 00:07:44.810 "name": "Nvme0n1", 00:07:44.810 "num_blocks": 38912, 00:07:44.810 "numa_id": -1, 00:07:44.810 "product_name": "NVMe disk", 00:07:44.810 "supported_io_types": { 00:07:44.810 "abort": true, 00:07:44.810 "compare": true, 00:07:44.810 "compare_and_write": true, 00:07:44.810 "copy": true, 00:07:44.810 "flush": true, 00:07:44.810 "get_zone_info": false, 00:07:44.810 "nvme_admin": true, 00:07:44.810 "nvme_io": true, 00:07:44.810 "nvme_io_md": false, 00:07:44.810 "nvme_iov_md": false, 00:07:44.810 "read": true, 00:07:44.810 "reset": true, 00:07:44.810 "seek_data": false, 00:07:44.810 "seek_hole": false, 00:07:44.810 "unmap": true, 00:07:44.810 "write": true, 00:07:44.810 "write_zeroes": true, 00:07:44.810 "zcopy": false, 00:07:44.810 "zone_append": false, 00:07:44.810 "zone_management": false 00:07:44.810 }, 00:07:44.810 "uuid": "78ac5ab9-e177-4018-9340-e8b9ff22ba7b", 00:07:44.810 "zoned": false 00:07:44.810 } 00:07:44.810 ] 00:07:44.810 11:18:26 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@55 -- # /home/vagrant/spdk_repo/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:07:44.810 11:18:26 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@56 -- # run_test_pid=67046 00:07:44.810 11:18:26 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@57 -- # sleep 2 00:07:45.068 Running I/O for 10 seconds... 00:07:46.001 Latency(us) 00:07:46.001 [2024-10-07T11:18:27.712Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:07:46.001 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:07:46.001 Nvme0n1 : 1.00 8141.00 31.80 0.00 0.00 0.00 0.00 0.00 00:07:46.001 [2024-10-07T11:18:27.712Z] =================================================================================================================== 00:07:46.001 [2024-10-07T11:18:27.712Z] Total : 8141.00 31.80 0.00 0.00 0.00 0.00 0.00 00:07:46.001 00:07:46.938 11:18:28 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@60 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_lvol_grow_lvstore -u c6f3f844-c84d-4fda-afb1-d8770405c335 00:07:46.938 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:07:46.938 Nvme0n1 : 2.00 7881.50 30.79 0.00 0.00 0.00 0.00 0.00 00:07:46.938 [2024-10-07T11:18:28.649Z] =================================================================================================================== 00:07:46.938 [2024-10-07T11:18:28.649Z] Total : 7881.50 30.79 0.00 0.00 0.00 0.00 0.00 00:07:46.938 00:07:47.197 true 00:07:47.197 11:18:28 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@61 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u c6f3f844-c84d-4fda-afb1-d8770405c335 00:07:47.197 11:18:28 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@61 -- # jq -r '.[0].total_data_clusters' 00:07:47.764 11:18:29 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@61 -- # data_clusters=99 00:07:47.764 11:18:29 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@62 -- # (( data_clusters == 99 )) 00:07:47.764 11:18:29 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@65 -- # wait 67046 00:07:48.022 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:07:48.022 Nvme0n1 : 3.00 7754.67 30.29 0.00 0.00 0.00 0.00 0.00 00:07:48.022 [2024-10-07T11:18:29.733Z] =================================================================================================================== 00:07:48.022 [2024-10-07T11:18:29.733Z] Total : 7754.67 30.29 0.00 0.00 0.00 0.00 0.00 00:07:48.022 00:07:48.956 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:07:48.956 Nvme0n1 : 4.00 7678.50 29.99 0.00 0.00 0.00 0.00 0.00 00:07:48.956 [2024-10-07T11:18:30.667Z] =================================================================================================================== 00:07:48.956 [2024-10-07T11:18:30.667Z] Total : 7678.50 29.99 0.00 0.00 0.00 0.00 0.00 00:07:48.956 00:07:49.890 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:07:49.890 Nvme0n1 : 5.00 7279.60 28.44 0.00 0.00 0.00 0.00 0.00 00:07:49.890 [2024-10-07T11:18:31.601Z] =================================================================================================================== 00:07:49.890 [2024-10-07T11:18:31.601Z] Total : 7279.60 28.44 0.00 0.00 0.00 0.00 0.00 00:07:49.890 00:07:51.262 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:07:51.262 Nvme0n1 : 6.00 7212.67 28.17 0.00 0.00 0.00 0.00 0.00 00:07:51.262 [2024-10-07T11:18:32.974Z] =================================================================================================================== 00:07:51.263 [2024-10-07T11:18:32.974Z] Total : 7212.67 28.17 0.00 0.00 0.00 0.00 0.00 00:07:51.263 00:07:51.880 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:07:51.880 Nvme0n1 : 7.00 7184.43 28.06 0.00 0.00 0.00 0.00 0.00 00:07:51.880 [2024-10-07T11:18:33.591Z] =================================================================================================================== 00:07:51.880 [2024-10-07T11:18:33.591Z] Total : 7184.43 28.06 0.00 0.00 0.00 0.00 0.00 00:07:51.880 00:07:53.250 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:07:53.250 Nvme0n1 : 8.00 7144.50 27.91 0.00 0.00 0.00 0.00 0.00 00:07:53.250 [2024-10-07T11:18:34.961Z] =================================================================================================================== 00:07:53.250 [2024-10-07T11:18:34.961Z] Total : 7144.50 27.91 0.00 0.00 0.00 0.00 0.00 00:07:53.250 00:07:54.183 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:07:54.183 Nvme0n1 : 9.00 7165.22 27.99 0.00 0.00 0.00 0.00 0.00 00:07:54.183 [2024-10-07T11:18:35.894Z] =================================================================================================================== 00:07:54.183 [2024-10-07T11:18:35.894Z] Total : 7165.22 27.99 0.00 0.00 0.00 0.00 0.00 00:07:54.183 00:07:55.127 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:07:55.127 Nvme0n1 : 10.00 7173.20 28.02 0.00 0.00 0.00 0.00 0.00 00:07:55.127 [2024-10-07T11:18:36.838Z] =================================================================================================================== 00:07:55.127 [2024-10-07T11:18:36.838Z] Total : 7173.20 28.02 0.00 0.00 0.00 0.00 0.00 00:07:55.127 00:07:55.127 00:07:55.127 Latency(us) 00:07:55.127 [2024-10-07T11:18:36.838Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:07:55.127 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:07:55.127 Nvme0n1 : 10.00 7183.68 28.06 0.00 0.00 17812.32 6732.33 241172.48 00:07:55.127 [2024-10-07T11:18:36.838Z] =================================================================================================================== 00:07:55.127 [2024-10-07T11:18:36.838Z] Total : 7183.68 28.06 0.00 0.00 17812.32 6732.33 241172.48 00:07:55.127 { 00:07:55.127 "results": [ 00:07:55.127 { 00:07:55.127 "job": "Nvme0n1", 00:07:55.127 "core_mask": "0x2", 00:07:55.127 "workload": "randwrite", 00:07:55.127 "status": "finished", 00:07:55.127 "queue_depth": 128, 00:07:55.127 "io_size": 4096, 00:07:55.127 "runtime": 10.003234, 00:07:55.127 "iops": 7183.6767989232285, 00:07:55.127 "mibps": 28.06123749579386, 00:07:55.127 "io_failed": 0, 00:07:55.127 "io_timeout": 0, 00:07:55.127 "avg_latency_us": 17812.315607620876, 00:07:55.127 "min_latency_us": 6732.334545454545, 00:07:55.127 "max_latency_us": 241172.48 00:07:55.127 } 00:07:55.127 ], 00:07:55.127 "core_count": 1 00:07:55.127 } 00:07:55.127 11:18:36 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@66 -- # killprocess 67012 00:07:55.127 11:18:36 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@950 -- # '[' -z 67012 ']' 00:07:55.127 11:18:36 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@954 -- # kill -0 67012 00:07:55.127 11:18:36 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@955 -- # uname 00:07:55.127 11:18:36 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:07:55.127 11:18:36 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 67012 00:07:55.127 killing process with pid 67012 00:07:55.127 Received shutdown signal, test time was about 10.000000 seconds 00:07:55.127 00:07:55.127 Latency(us) 00:07:55.127 [2024-10-07T11:18:36.838Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:07:55.127 [2024-10-07T11:18:36.838Z] =================================================================================================================== 00:07:55.127 [2024-10-07T11:18:36.838Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:07:55.127 11:18:36 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@956 -- # process_name=reactor_1 00:07:55.127 11:18:36 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@960 -- # '[' reactor_1 = sudo ']' 00:07:55.127 11:18:36 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@968 -- # echo 'killing process with pid 67012' 00:07:55.127 11:18:36 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@969 -- # kill 67012 00:07:55.127 11:18:36 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@974 -- # wait 67012 00:07:55.411 11:18:36 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@68 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_listener discovery -t tcp -a 10.0.0.3 -s 4420 00:07:55.669 11:18:37 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@69 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:07:55.926 11:18:37 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@70 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u c6f3f844-c84d-4fda-afb1-d8770405c335 00:07:55.926 11:18:37 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@70 -- # jq -r '.[0].free_clusters' 00:07:56.183 11:18:37 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@70 -- # free_clusters=61 00:07:56.183 11:18:37 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@72 -- # [[ dirty == \d\i\r\t\y ]] 00:07:56.183 11:18:37 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@74 -- # kill -9 66365 00:07:56.183 11:18:37 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@75 -- # wait 66365 00:07:56.440 /home/vagrant/spdk_repo/spdk/test/nvmf/target/nvmf_lvs_grow.sh: line 75: 66365 Killed "${NVMF_APP[@]}" "$@" 00:07:56.440 11:18:37 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@75 -- # true 00:07:56.440 11:18:37 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@76 -- # nvmfappstart -m 0x1 00:07:56.440 11:18:37 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:07:56.440 11:18:37 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@724 -- # xtrace_disable 00:07:56.440 11:18:37 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@10 -- # set +x 00:07:56.440 11:18:37 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- nvmf/common.sh@507 -- # nvmfpid=67210 00:07:56.440 11:18:37 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- nvmf/common.sh@506 -- # ip netns exec nvmf_tgt_ns_spdk /home/vagrant/spdk_repo/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:07:56.440 11:18:37 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- nvmf/common.sh@508 -- # waitforlisten 67210 00:07:56.440 11:18:37 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@831 -- # '[' -z 67210 ']' 00:07:56.440 11:18:37 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:56.440 11:18:37 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@836 -- # local max_retries=100 00:07:56.441 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:56.441 11:18:37 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:56.441 11:18:37 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@840 -- # xtrace_disable 00:07:56.441 11:18:37 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@10 -- # set +x 00:07:56.441 [2024-10-07 11:18:37.976480] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:07:56.441 [2024-10-07 11:18:37.976601] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:07:56.441 [2024-10-07 11:18:38.109241] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:56.698 [2024-10-07 11:18:38.277862] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:07:56.698 [2024-10-07 11:18:38.277919] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:07:56.698 [2024-10-07 11:18:38.277931] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:07:56.698 [2024-10-07 11:18:38.277940] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:07:56.698 [2024-10-07 11:18:38.277948] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:07:56.698 [2024-10-07 11:18:38.278439] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:07:57.630 11:18:39 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:07:57.630 11:18:39 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@864 -- # return 0 00:07:57.630 11:18:39 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:07:57.630 11:18:39 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@730 -- # xtrace_disable 00:07:57.630 11:18:39 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@10 -- # set +x 00:07:57.630 11:18:39 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:07:57.630 11:18:39 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@77 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_aio_create /home/vagrant/spdk_repo/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:07:57.891 [2024-10-07 11:18:39.389261] blobstore.c:4875:bs_recover: *NOTICE*: Performing recovery on blobstore 00:07:57.891 [2024-10-07 11:18:39.389786] blobstore.c:4822:bs_load_replay_md_cpl: *NOTICE*: Recover: blob 0x0 00:07:57.891 [2024-10-07 11:18:39.389980] blobstore.c:4822:bs_load_replay_md_cpl: *NOTICE*: Recover: blob 0x1 00:07:57.891 11:18:39 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@77 -- # aio_bdev=aio_bdev 00:07:57.891 11:18:39 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@78 -- # waitforbdev 78ac5ab9-e177-4018-9340-e8b9ff22ba7b 00:07:57.891 11:18:39 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@899 -- # local bdev_name=78ac5ab9-e177-4018-9340-e8b9ff22ba7b 00:07:57.891 11:18:39 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@900 -- # local bdev_timeout= 00:07:57.891 11:18:39 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@901 -- # local i 00:07:57.891 11:18:39 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@902 -- # [[ -z '' ]] 00:07:57.891 11:18:39 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@902 -- # bdev_timeout=2000 00:07:57.891 11:18:39 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@904 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_wait_for_examine 00:07:58.148 11:18:39 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@906 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_get_bdevs -b 78ac5ab9-e177-4018-9340-e8b9ff22ba7b -t 2000 00:07:58.406 [ 00:07:58.406 { 00:07:58.406 "aliases": [ 00:07:58.406 "lvs/lvol" 00:07:58.406 ], 00:07:58.406 "assigned_rate_limits": { 00:07:58.406 "r_mbytes_per_sec": 0, 00:07:58.406 "rw_ios_per_sec": 0, 00:07:58.406 "rw_mbytes_per_sec": 0, 00:07:58.406 "w_mbytes_per_sec": 0 00:07:58.406 }, 00:07:58.406 "block_size": 4096, 00:07:58.406 "claimed": false, 00:07:58.406 "driver_specific": { 00:07:58.406 "lvol": { 00:07:58.406 "base_bdev": "aio_bdev", 00:07:58.406 "clone": false, 00:07:58.406 "esnap_clone": false, 00:07:58.406 "lvol_store_uuid": "c6f3f844-c84d-4fda-afb1-d8770405c335", 00:07:58.406 "num_allocated_clusters": 38, 00:07:58.406 "snapshot": false, 00:07:58.406 "thin_provision": false 00:07:58.406 } 00:07:58.406 }, 00:07:58.406 "name": "78ac5ab9-e177-4018-9340-e8b9ff22ba7b", 00:07:58.406 "num_blocks": 38912, 00:07:58.406 "product_name": "Logical Volume", 00:07:58.406 "supported_io_types": { 00:07:58.406 "abort": false, 00:07:58.406 "compare": false, 00:07:58.406 "compare_and_write": false, 00:07:58.406 "copy": false, 00:07:58.406 "flush": false, 00:07:58.406 "get_zone_info": false, 00:07:58.406 "nvme_admin": false, 00:07:58.406 "nvme_io": false, 00:07:58.406 "nvme_io_md": false, 00:07:58.406 "nvme_iov_md": false, 00:07:58.406 "read": true, 00:07:58.406 "reset": true, 00:07:58.406 "seek_data": true, 00:07:58.406 "seek_hole": true, 00:07:58.406 "unmap": true, 00:07:58.406 "write": true, 00:07:58.406 "write_zeroes": true, 00:07:58.406 "zcopy": false, 00:07:58.406 "zone_append": false, 00:07:58.406 "zone_management": false 00:07:58.406 }, 00:07:58.406 "uuid": "78ac5ab9-e177-4018-9340-e8b9ff22ba7b", 00:07:58.406 "zoned": false 00:07:58.406 } 00:07:58.406 ] 00:07:58.406 11:18:40 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@907 -- # return 0 00:07:58.406 11:18:40 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@79 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u c6f3f844-c84d-4fda-afb1-d8770405c335 00:07:58.406 11:18:40 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@79 -- # jq -r '.[0].free_clusters' 00:07:58.665 11:18:40 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@79 -- # (( free_clusters == 61 )) 00:07:58.665 11:18:40 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@80 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u c6f3f844-c84d-4fda-afb1-d8770405c335 00:07:58.665 11:18:40 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@80 -- # jq -r '.[0].total_data_clusters' 00:07:58.923 11:18:40 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@80 -- # (( data_clusters == 99 )) 00:07:58.923 11:18:40 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@84 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:07:59.181 [2024-10-07 11:18:40.862524] vbdev_lvol.c: 150:vbdev_lvs_hotremove_cb: *NOTICE*: bdev aio_bdev being removed: closing lvstore lvs 00:07:59.440 11:18:40 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@85 -- # NOT /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u c6f3f844-c84d-4fda-afb1-d8770405c335 00:07:59.440 11:18:40 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@650 -- # local es=0 00:07:59.440 11:18:40 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@652 -- # valid_exec_arg /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u c6f3f844-c84d-4fda-afb1-d8770405c335 00:07:59.440 11:18:40 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@638 -- # local arg=/home/vagrant/spdk_repo/spdk/scripts/rpc.py 00:07:59.440 11:18:40 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:07:59.440 11:18:40 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@642 -- # type -t /home/vagrant/spdk_repo/spdk/scripts/rpc.py 00:07:59.440 11:18:40 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:07:59.440 11:18:40 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@644 -- # type -P /home/vagrant/spdk_repo/spdk/scripts/rpc.py 00:07:59.440 11:18:40 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:07:59.440 11:18:40 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@644 -- # arg=/home/vagrant/spdk_repo/spdk/scripts/rpc.py 00:07:59.440 11:18:40 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@644 -- # [[ -x /home/vagrant/spdk_repo/spdk/scripts/rpc.py ]] 00:07:59.440 11:18:40 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@653 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u c6f3f844-c84d-4fda-afb1-d8770405c335 00:07:59.699 2024/10/07 11:18:41 error on JSON-RPC call, method: bdev_lvol_get_lvstores, params: map[uuid:c6f3f844-c84d-4fda-afb1-d8770405c335], err: error received for bdev_lvol_get_lvstores method, err: Code=-19 Msg=No such device 00:07:59.699 request: 00:07:59.699 { 00:07:59.699 "method": "bdev_lvol_get_lvstores", 00:07:59.699 "params": { 00:07:59.699 "uuid": "c6f3f844-c84d-4fda-afb1-d8770405c335" 00:07:59.699 } 00:07:59.699 } 00:07:59.699 Got JSON-RPC error response 00:07:59.699 GoRPCClient: error on JSON-RPC call 00:07:59.699 11:18:41 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@653 -- # es=1 00:07:59.699 11:18:41 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:07:59.699 11:18:41 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:07:59.699 11:18:41 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:07:59.699 11:18:41 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@86 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_aio_create /home/vagrant/spdk_repo/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:07:59.958 aio_bdev 00:07:59.958 11:18:41 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@87 -- # waitforbdev 78ac5ab9-e177-4018-9340-e8b9ff22ba7b 00:07:59.958 11:18:41 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@899 -- # local bdev_name=78ac5ab9-e177-4018-9340-e8b9ff22ba7b 00:07:59.958 11:18:41 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@900 -- # local bdev_timeout= 00:07:59.958 11:18:41 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@901 -- # local i 00:07:59.958 11:18:41 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@902 -- # [[ -z '' ]] 00:07:59.958 11:18:41 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@902 -- # bdev_timeout=2000 00:07:59.958 11:18:41 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@904 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_wait_for_examine 00:08:00.215 11:18:41 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@906 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_get_bdevs -b 78ac5ab9-e177-4018-9340-e8b9ff22ba7b -t 2000 00:08:00.473 [ 00:08:00.473 { 00:08:00.473 "aliases": [ 00:08:00.473 "lvs/lvol" 00:08:00.473 ], 00:08:00.473 "assigned_rate_limits": { 00:08:00.473 "r_mbytes_per_sec": 0, 00:08:00.473 "rw_ios_per_sec": 0, 00:08:00.473 "rw_mbytes_per_sec": 0, 00:08:00.473 "w_mbytes_per_sec": 0 00:08:00.473 }, 00:08:00.473 "block_size": 4096, 00:08:00.473 "claimed": false, 00:08:00.473 "driver_specific": { 00:08:00.473 "lvol": { 00:08:00.473 "base_bdev": "aio_bdev", 00:08:00.473 "clone": false, 00:08:00.473 "esnap_clone": false, 00:08:00.473 "lvol_store_uuid": "c6f3f844-c84d-4fda-afb1-d8770405c335", 00:08:00.473 "num_allocated_clusters": 38, 00:08:00.473 "snapshot": false, 00:08:00.473 "thin_provision": false 00:08:00.473 } 00:08:00.473 }, 00:08:00.473 "name": "78ac5ab9-e177-4018-9340-e8b9ff22ba7b", 00:08:00.473 "num_blocks": 38912, 00:08:00.473 "product_name": "Logical Volume", 00:08:00.473 "supported_io_types": { 00:08:00.473 "abort": false, 00:08:00.473 "compare": false, 00:08:00.473 "compare_and_write": false, 00:08:00.473 "copy": false, 00:08:00.473 "flush": false, 00:08:00.473 "get_zone_info": false, 00:08:00.473 "nvme_admin": false, 00:08:00.473 "nvme_io": false, 00:08:00.473 "nvme_io_md": false, 00:08:00.473 "nvme_iov_md": false, 00:08:00.473 "read": true, 00:08:00.473 "reset": true, 00:08:00.473 "seek_data": true, 00:08:00.473 "seek_hole": true, 00:08:00.473 "unmap": true, 00:08:00.473 "write": true, 00:08:00.473 "write_zeroes": true, 00:08:00.473 "zcopy": false, 00:08:00.473 "zone_append": false, 00:08:00.473 "zone_management": false 00:08:00.473 }, 00:08:00.473 "uuid": "78ac5ab9-e177-4018-9340-e8b9ff22ba7b", 00:08:00.473 "zoned": false 00:08:00.473 } 00:08:00.473 ] 00:08:00.473 11:18:42 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@907 -- # return 0 00:08:00.473 11:18:42 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@88 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u c6f3f844-c84d-4fda-afb1-d8770405c335 00:08:00.473 11:18:42 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@88 -- # jq -r '.[0].free_clusters' 00:08:00.732 11:18:42 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@88 -- # (( free_clusters == 61 )) 00:08:00.732 11:18:42 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@89 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u c6f3f844-c84d-4fda-afb1-d8770405c335 00:08:00.732 11:18:42 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@89 -- # jq -r '.[0].total_data_clusters' 00:08:01.298 11:18:42 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@89 -- # (( data_clusters == 99 )) 00:08:01.298 11:18:42 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@92 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_lvol_delete 78ac5ab9-e177-4018-9340-e8b9ff22ba7b 00:08:01.298 11:18:42 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@93 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u c6f3f844-c84d-4fda-afb1-d8770405c335 00:08:01.864 11:18:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@94 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:08:01.864 11:18:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- target/nvmf_lvs_grow.sh@95 -- # rm -f /home/vagrant/spdk_repo/spdk/test/nvmf/target/aio_bdev 00:08:02.429 00:08:02.429 real 0m21.778s 00:08:02.429 user 0m45.882s 00:08:02.429 sys 0m8.075s 00:08:02.429 ************************************ 00:08:02.429 END TEST lvs_grow_dirty 00:08:02.429 ************************************ 00:08:02.429 11:18:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@1126 -- # xtrace_disable 00:08:02.429 11:18:43 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow.lvs_grow_dirty -- common/autotest_common.sh@10 -- # set +x 00:08:02.429 11:18:44 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- target/nvmf_lvs_grow.sh@1 -- # process_shm --id 0 00:08:02.429 11:18:44 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@808 -- # type=--id 00:08:02.429 11:18:44 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@809 -- # id=0 00:08:02.429 11:18:44 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@810 -- # '[' --id = --pid ']' 00:08:02.429 11:18:44 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@814 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:08:02.429 11:18:44 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@814 -- # shm_files=nvmf_trace.0 00:08:02.429 11:18:44 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@816 -- # [[ -z nvmf_trace.0 ]] 00:08:02.429 11:18:44 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@820 -- # for n in $shm_files 00:08:02.429 11:18:44 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@821 -- # tar -C /dev/shm/ -cvzf /home/vagrant/spdk_repo/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:08:02.429 nvmf_trace.0 00:08:02.429 11:18:44 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@823 -- # return 0 00:08:02.429 11:18:44 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- target/nvmf_lvs_grow.sh@1 -- # nvmftestfini 00:08:02.429 11:18:44 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@514 -- # nvmfcleanup 00:08:02.429 11:18:44 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@121 -- # sync 00:08:02.687 11:18:44 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:08:02.687 11:18:44 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@124 -- # set +e 00:08:02.687 11:18:44 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@125 -- # for i in {1..20} 00:08:02.687 11:18:44 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:08:02.687 rmmod nvme_tcp 00:08:02.687 rmmod nvme_fabrics 00:08:02.687 rmmod nvme_keyring 00:08:02.687 11:18:44 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:08:02.687 11:18:44 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@128 -- # set -e 00:08:02.687 11:18:44 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@129 -- # return 0 00:08:02.687 11:18:44 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@515 -- # '[' -n 67210 ']' 00:08:02.687 11:18:44 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@516 -- # killprocess 67210 00:08:02.687 11:18:44 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@950 -- # '[' -z 67210 ']' 00:08:02.687 11:18:44 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@954 -- # kill -0 67210 00:08:02.687 11:18:44 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@955 -- # uname 00:08:02.687 11:18:44 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:08:02.687 11:18:44 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 67210 00:08:02.687 killing process with pid 67210 00:08:02.687 11:18:44 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:08:02.687 11:18:44 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:08:02.687 11:18:44 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@968 -- # echo 'killing process with pid 67210' 00:08:02.687 11:18:44 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@969 -- # kill 67210 00:08:02.687 11:18:44 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@974 -- # wait 67210 00:08:02.945 11:18:44 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:08:02.945 11:18:44 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:08:02.945 11:18:44 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:08:02.945 11:18:44 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@297 -- # iptr 00:08:02.945 11:18:44 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@789 -- # iptables-save 00:08:02.945 11:18:44 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:08:02.945 11:18:44 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@789 -- # iptables-restore 00:08:02.945 11:18:44 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@298 -- # [[ nvmf_tgt_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:08:02.945 11:18:44 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@299 -- # nvmf_veth_fini 00:08:02.945 11:18:44 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@233 -- # ip link set nvmf_init_br nomaster 00:08:02.945 11:18:44 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@234 -- # ip link set nvmf_init_br2 nomaster 00:08:02.945 11:18:44 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@235 -- # ip link set nvmf_tgt_br nomaster 00:08:03.203 11:18:44 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@236 -- # ip link set nvmf_tgt_br2 nomaster 00:08:03.203 11:18:44 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@237 -- # ip link set nvmf_init_br down 00:08:03.203 11:18:44 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@238 -- # ip link set nvmf_init_br2 down 00:08:03.203 11:18:44 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@239 -- # ip link set nvmf_tgt_br down 00:08:03.203 11:18:44 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@240 -- # ip link set nvmf_tgt_br2 down 00:08:03.203 11:18:44 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@241 -- # ip link delete nvmf_br type bridge 00:08:03.203 11:18:44 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@242 -- # ip link delete nvmf_init_if 00:08:03.203 11:18:44 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@243 -- # ip link delete nvmf_init_if2 00:08:03.203 11:18:44 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@244 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:08:03.203 11:18:44 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@245 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:08:03.203 11:18:44 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@246 -- # remove_spdk_ns 00:08:03.203 11:18:44 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:03.203 11:18:44 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:08:03.203 11:18:44 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:03.203 11:18:44 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- nvmf/common.sh@300 -- # return 0 00:08:03.203 00:08:03.203 real 0m44.979s 00:08:03.203 user 1m12.784s 00:08:03.203 sys 0m11.635s 00:08:03.203 11:18:44 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@1126 -- # xtrace_disable 00:08:03.203 11:18:44 nvmf_tcp.nvmf_target_core.nvmf_lvs_grow -- common/autotest_common.sh@10 -- # set +x 00:08:03.203 ************************************ 00:08:03.203 END TEST nvmf_lvs_grow 00:08:03.203 ************************************ 00:08:03.203 11:18:44 nvmf_tcp.nvmf_target_core -- nvmf/nvmf_target_core.sh@29 -- # run_test nvmf_bdev_io_wait /home/vagrant/spdk_repo/spdk/test/nvmf/target/bdev_io_wait.sh --transport=tcp 00:08:03.203 11:18:44 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:08:03.203 11:18:44 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1107 -- # xtrace_disable 00:08:03.203 11:18:44 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@10 -- # set +x 00:08:03.203 ************************************ 00:08:03.203 START TEST nvmf_bdev_io_wait 00:08:03.203 ************************************ 00:08:03.203 11:18:44 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/nvmf/target/bdev_io_wait.sh --transport=tcp 00:08:03.462 * Looking for test storage... 00:08:03.462 * Found test storage at /home/vagrant/spdk_repo/spdk/test/nvmf/target 00:08:03.462 11:18:44 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:08:03.462 11:18:44 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@1681 -- # lcov --version 00:08:03.462 11:18:44 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:08:03.462 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:08:03.462 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:08:03.462 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- scripts/common.sh@333 -- # local ver1 ver1_l 00:08:03.462 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- scripts/common.sh@334 -- # local ver2 ver2_l 00:08:03.462 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- scripts/common.sh@336 -- # IFS=.-: 00:08:03.462 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- scripts/common.sh@336 -- # read -ra ver1 00:08:03.462 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- scripts/common.sh@337 -- # IFS=.-: 00:08:03.462 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- scripts/common.sh@337 -- # read -ra ver2 00:08:03.462 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- scripts/common.sh@338 -- # local 'op=<' 00:08:03.462 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- scripts/common.sh@340 -- # ver1_l=2 00:08:03.462 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- scripts/common.sh@341 -- # ver2_l=1 00:08:03.462 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:08:03.462 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- scripts/common.sh@344 -- # case "$op" in 00:08:03.462 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- scripts/common.sh@345 -- # : 1 00:08:03.462 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- scripts/common.sh@364 -- # (( v = 0 )) 00:08:03.462 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:08:03.462 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- scripts/common.sh@365 -- # decimal 1 00:08:03.462 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- scripts/common.sh@353 -- # local d=1 00:08:03.462 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:08:03.462 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- scripts/common.sh@355 -- # echo 1 00:08:03.462 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- scripts/common.sh@365 -- # ver1[v]=1 00:08:03.462 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- scripts/common.sh@366 -- # decimal 2 00:08:03.462 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- scripts/common.sh@353 -- # local d=2 00:08:03.462 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:08:03.462 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- scripts/common.sh@355 -- # echo 2 00:08:03.462 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- scripts/common.sh@366 -- # ver2[v]=2 00:08:03.462 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:08:03.462 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:08:03.462 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- scripts/common.sh@368 -- # return 0 00:08:03.462 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:08:03.462 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:08:03.462 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:03.462 --rc genhtml_branch_coverage=1 00:08:03.462 --rc genhtml_function_coverage=1 00:08:03.462 --rc genhtml_legend=1 00:08:03.462 --rc geninfo_all_blocks=1 00:08:03.462 --rc geninfo_unexecuted_blocks=1 00:08:03.462 00:08:03.462 ' 00:08:03.462 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:08:03.462 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:03.462 --rc genhtml_branch_coverage=1 00:08:03.462 --rc genhtml_function_coverage=1 00:08:03.462 --rc genhtml_legend=1 00:08:03.462 --rc geninfo_all_blocks=1 00:08:03.462 --rc geninfo_unexecuted_blocks=1 00:08:03.462 00:08:03.462 ' 00:08:03.462 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:08:03.462 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:03.462 --rc genhtml_branch_coverage=1 00:08:03.462 --rc genhtml_function_coverage=1 00:08:03.462 --rc genhtml_legend=1 00:08:03.462 --rc geninfo_all_blocks=1 00:08:03.462 --rc geninfo_unexecuted_blocks=1 00:08:03.462 00:08:03.462 ' 00:08:03.462 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:08:03.462 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:03.462 --rc genhtml_branch_coverage=1 00:08:03.462 --rc genhtml_function_coverage=1 00:08:03.462 --rc genhtml_legend=1 00:08:03.462 --rc geninfo_all_blocks=1 00:08:03.462 --rc geninfo_unexecuted_blocks=1 00:08:03.462 00:08:03.462 ' 00:08:03.462 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- target/bdev_io_wait.sh@9 -- # source /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh 00:08:03.462 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@7 -- # uname -s 00:08:03.462 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:08:03.462 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:08:03.462 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:08:03.462 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:08:03.462 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:08:03.463 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:08:03.463 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:08:03.463 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:08:03.463 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:08:03.463 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:08:03.463 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:08:03.463 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@18 -- # NVME_HOSTID=3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:08:03.463 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:08:03.463 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:08:03.463 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@21 -- # NET_TYPE=virt 00:08:03.463 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:08:03.463 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@49 -- # source /home/vagrant/spdk_repo/spdk/scripts/common.sh 00:08:03.463 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- scripts/common.sh@15 -- # shopt -s extglob 00:08:03.463 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:08:03.463 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:08:03.463 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:08:03.463 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:03.463 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:03.463 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:03.463 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- paths/export.sh@5 -- # export PATH 00:08:03.463 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:03.463 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@51 -- # : 0 00:08:03.463 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:08:03.463 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:08:03.463 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:08:03.463 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:08:03.463 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:08:03.463 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:08:03.463 /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:08:03.463 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:08:03.463 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:08:03.463 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@55 -- # have_pci_nics=0 00:08:03.463 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- target/bdev_io_wait.sh@11 -- # MALLOC_BDEV_SIZE=64 00:08:03.463 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- target/bdev_io_wait.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:08:03.463 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- target/bdev_io_wait.sh@14 -- # nvmftestinit 00:08:03.463 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:08:03.463 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:08:03.463 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@474 -- # prepare_net_devs 00:08:03.463 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@436 -- # local -g is_hw=no 00:08:03.463 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@438 -- # remove_spdk_ns 00:08:03.463 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:03.463 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:08:03.463 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:03.463 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@440 -- # [[ virt != virt ]] 00:08:03.463 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@442 -- # [[ no == yes ]] 00:08:03.463 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@449 -- # [[ virt == phy ]] 00:08:03.463 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@452 -- # [[ virt == phy-fallback ]] 00:08:03.463 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@457 -- # [[ tcp == tcp ]] 00:08:03.463 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@458 -- # nvmf_veth_init 00:08:03.463 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@145 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:08:03.463 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@146 -- # NVMF_SECOND_INITIATOR_IP=10.0.0.2 00:08:03.463 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@147 -- # NVMF_FIRST_TARGET_IP=10.0.0.3 00:08:03.463 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@148 -- # NVMF_SECOND_TARGET_IP=10.0.0.4 00:08:03.463 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@149 -- # NVMF_INITIATOR_IP=10.0.0.1 00:08:03.463 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@150 -- # NVMF_BRIDGE=nvmf_br 00:08:03.463 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@151 -- # NVMF_INITIATOR_INTERFACE=nvmf_init_if 00:08:03.463 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@152 -- # NVMF_INITIATOR_INTERFACE2=nvmf_init_if2 00:08:03.463 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@153 -- # NVMF_INITIATOR_BRIDGE=nvmf_init_br 00:08:03.463 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@154 -- # NVMF_INITIATOR_BRIDGE2=nvmf_init_br2 00:08:03.463 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@155 -- # NVMF_TARGET_NAMESPACE=nvmf_tgt_ns_spdk 00:08:03.463 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@156 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:08:03.463 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@157 -- # NVMF_TARGET_INTERFACE=nvmf_tgt_if 00:08:03.463 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@158 -- # NVMF_TARGET_INTERFACE2=nvmf_tgt_if2 00:08:03.463 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@159 -- # NVMF_TARGET_BRIDGE=nvmf_tgt_br 00:08:03.463 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@160 -- # NVMF_TARGET_BRIDGE2=nvmf_tgt_br2 00:08:03.463 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@162 -- # ip link set nvmf_init_br nomaster 00:08:03.463 Cannot find device "nvmf_init_br" 00:08:03.463 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@162 -- # true 00:08:03.463 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@163 -- # ip link set nvmf_init_br2 nomaster 00:08:03.463 Cannot find device "nvmf_init_br2" 00:08:03.463 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@163 -- # true 00:08:03.463 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@164 -- # ip link set nvmf_tgt_br nomaster 00:08:03.722 Cannot find device "nvmf_tgt_br" 00:08:03.722 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@164 -- # true 00:08:03.722 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@165 -- # ip link set nvmf_tgt_br2 nomaster 00:08:03.722 Cannot find device "nvmf_tgt_br2" 00:08:03.722 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@165 -- # true 00:08:03.722 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@166 -- # ip link set nvmf_init_br down 00:08:03.722 Cannot find device "nvmf_init_br" 00:08:03.722 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@166 -- # true 00:08:03.722 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@167 -- # ip link set nvmf_init_br2 down 00:08:03.722 Cannot find device "nvmf_init_br2" 00:08:03.722 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@167 -- # true 00:08:03.722 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@168 -- # ip link set nvmf_tgt_br down 00:08:03.722 Cannot find device "nvmf_tgt_br" 00:08:03.722 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@168 -- # true 00:08:03.722 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@169 -- # ip link set nvmf_tgt_br2 down 00:08:03.722 Cannot find device "nvmf_tgt_br2" 00:08:03.722 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@169 -- # true 00:08:03.722 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@170 -- # ip link delete nvmf_br type bridge 00:08:03.722 Cannot find device "nvmf_br" 00:08:03.722 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@170 -- # true 00:08:03.722 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@171 -- # ip link delete nvmf_init_if 00:08:03.722 Cannot find device "nvmf_init_if" 00:08:03.722 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@171 -- # true 00:08:03.722 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@172 -- # ip link delete nvmf_init_if2 00:08:03.722 Cannot find device "nvmf_init_if2" 00:08:03.722 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@172 -- # true 00:08:03.722 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@173 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:08:03.722 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:08:03.722 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@173 -- # true 00:08:03.722 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@174 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:08:03.722 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:08:03.722 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@174 -- # true 00:08:03.722 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@177 -- # ip netns add nvmf_tgt_ns_spdk 00:08:03.722 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@180 -- # ip link add nvmf_init_if type veth peer name nvmf_init_br 00:08:03.722 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@181 -- # ip link add nvmf_init_if2 type veth peer name nvmf_init_br2 00:08:03.722 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@182 -- # ip link add nvmf_tgt_if type veth peer name nvmf_tgt_br 00:08:03.722 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@183 -- # ip link add nvmf_tgt_if2 type veth peer name nvmf_tgt_br2 00:08:03.722 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@186 -- # ip link set nvmf_tgt_if netns nvmf_tgt_ns_spdk 00:08:03.722 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@187 -- # ip link set nvmf_tgt_if2 netns nvmf_tgt_ns_spdk 00:08:03.722 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@190 -- # ip addr add 10.0.0.1/24 dev nvmf_init_if 00:08:03.722 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@191 -- # ip addr add 10.0.0.2/24 dev nvmf_init_if2 00:08:03.722 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@192 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.3/24 dev nvmf_tgt_if 00:08:03.722 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@193 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.4/24 dev nvmf_tgt_if2 00:08:03.722 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@196 -- # ip link set nvmf_init_if up 00:08:03.722 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@197 -- # ip link set nvmf_init_if2 up 00:08:03.722 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@198 -- # ip link set nvmf_init_br up 00:08:03.722 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@199 -- # ip link set nvmf_init_br2 up 00:08:03.722 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@200 -- # ip link set nvmf_tgt_br up 00:08:03.987 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@201 -- # ip link set nvmf_tgt_br2 up 00:08:03.987 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@202 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if up 00:08:03.987 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@203 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if2 up 00:08:03.987 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@204 -- # ip netns exec nvmf_tgt_ns_spdk ip link set lo up 00:08:03.987 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@207 -- # ip link add nvmf_br type bridge 00:08:03.987 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@208 -- # ip link set nvmf_br up 00:08:03.987 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@211 -- # ip link set nvmf_init_br master nvmf_br 00:08:03.987 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@212 -- # ip link set nvmf_init_br2 master nvmf_br 00:08:03.987 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@213 -- # ip link set nvmf_tgt_br master nvmf_br 00:08:03.987 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@214 -- # ip link set nvmf_tgt_br2 master nvmf_br 00:08:03.987 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@217 -- # ipts -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT 00:08:03.987 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT' 00:08:03.987 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@218 -- # ipts -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT 00:08:03.987 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT' 00:08:03.987 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@219 -- # ipts -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT 00:08:03.987 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@788 -- # iptables -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT -m comment --comment 'SPDK_NVMF:-A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT' 00:08:03.987 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@222 -- # ping -c 1 10.0.0.3 00:08:03.987 PING 10.0.0.3 (10.0.0.3) 56(84) bytes of data. 00:08:03.987 64 bytes from 10.0.0.3: icmp_seq=1 ttl=64 time=0.080 ms 00:08:03.987 00:08:03.987 --- 10.0.0.3 ping statistics --- 00:08:03.987 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:03.987 rtt min/avg/max/mdev = 0.080/0.080/0.080/0.000 ms 00:08:03.987 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@223 -- # ping -c 1 10.0.0.4 00:08:03.987 PING 10.0.0.4 (10.0.0.4) 56(84) bytes of data. 00:08:03.987 64 bytes from 10.0.0.4: icmp_seq=1 ttl=64 time=0.089 ms 00:08:03.987 00:08:03.987 --- 10.0.0.4 ping statistics --- 00:08:03.987 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:03.987 rtt min/avg/max/mdev = 0.089/0.089/0.089/0.000 ms 00:08:03.987 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@224 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.1 00:08:03.987 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:08:03.987 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.029 ms 00:08:03.987 00:08:03.987 --- 10.0.0.1 ping statistics --- 00:08:03.987 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:03.987 rtt min/avg/max/mdev = 0.029/0.029/0.029/0.000 ms 00:08:03.987 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@225 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.2 00:08:03.987 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:08:03.987 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.061 ms 00:08:03.987 00:08:03.987 --- 10.0.0.2 ping statistics --- 00:08:03.987 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:03.987 rtt min/avg/max/mdev = 0.061/0.061/0.061/0.000 ms 00:08:03.987 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@227 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:08:03.987 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@459 -- # return 0 00:08:03.987 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:08:03.987 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:08:03.987 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:08:03.987 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:08:03.987 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:08:03.987 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:08:03.987 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:08:03.987 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- target/bdev_io_wait.sh@15 -- # nvmfappstart -m 0xF --wait-for-rpc 00:08:03.987 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:08:03.987 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@724 -- # xtrace_disable 00:08:03.987 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@10 -- # set +x 00:08:03.987 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@507 -- # nvmfpid=67693 00:08:03.987 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@508 -- # waitforlisten 67693 00:08:03.987 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@506 -- # ip netns exec nvmf_tgt_ns_spdk /home/vagrant/spdk_repo/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:08:03.987 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@831 -- # '[' -z 67693 ']' 00:08:03.987 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:03.987 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@836 -- # local max_retries=100 00:08:03.987 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:03.987 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:03.987 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@840 -- # xtrace_disable 00:08:03.987 11:18:45 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@10 -- # set +x 00:08:03.988 [2024-10-07 11:18:45.669597] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:08:03.988 [2024-10-07 11:18:45.669730] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:08:04.245 [2024-10-07 11:18:45.809720] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 4 00:08:04.502 [2024-10-07 11:18:45.956237] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:08:04.502 [2024-10-07 11:18:45.956521] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:08:04.502 [2024-10-07 11:18:45.956664] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:08:04.502 [2024-10-07 11:18:45.956793] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:08:04.502 [2024-10-07 11:18:45.956835] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:08:04.502 [2024-10-07 11:18:45.958369] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:08:04.502 [2024-10-07 11:18:45.958487] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:08:04.502 [2024-10-07 11:18:45.958568] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:08:04.502 [2024-10-07 11:18:45.958568] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 3 00:08:05.067 11:18:46 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:08:05.067 11:18:46 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@864 -- # return 0 00:08:05.067 11:18:46 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:08:05.067 11:18:46 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@730 -- # xtrace_disable 00:08:05.067 11:18:46 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@10 -- # set +x 00:08:05.326 11:18:46 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:08:05.326 11:18:46 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- target/bdev_io_wait.sh@18 -- # rpc_cmd bdev_set_options -p 5 -c 1 00:08:05.326 11:18:46 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:05.326 11:18:46 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@10 -- # set +x 00:08:05.326 11:18:46 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:05.326 11:18:46 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- target/bdev_io_wait.sh@19 -- # rpc_cmd framework_start_init 00:08:05.326 11:18:46 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:05.326 11:18:46 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@10 -- # set +x 00:08:05.326 11:18:46 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:05.326 11:18:46 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- target/bdev_io_wait.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:08:05.326 11:18:46 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:05.326 11:18:46 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@10 -- # set +x 00:08:05.326 [2024-10-07 11:18:46.894373] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:08:05.326 11:18:46 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:05.326 11:18:46 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- target/bdev_io_wait.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:08:05.326 11:18:46 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:05.326 11:18:46 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@10 -- # set +x 00:08:05.326 Malloc0 00:08:05.326 11:18:46 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:05.326 11:18:46 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- target/bdev_io_wait.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:08:05.326 11:18:46 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:05.326 11:18:46 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@10 -- # set +x 00:08:05.326 11:18:46 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:05.326 11:18:46 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- target/bdev_io_wait.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:08:05.326 11:18:46 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:05.326 11:18:46 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@10 -- # set +x 00:08:05.326 11:18:46 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:05.326 11:18:46 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- target/bdev_io_wait.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4420 00:08:05.326 11:18:46 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:05.326 11:18:46 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@10 -- # set +x 00:08:05.326 [2024-10-07 11:18:46.965395] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:08:05.326 11:18:46 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:05.326 11:18:46 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- target/bdev_io_wait.sh@28 -- # WRITE_PID=67751 00:08:05.326 11:18:46 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- target/bdev_io_wait.sh@27 -- # gen_nvmf_target_json 00:08:05.326 11:18:46 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- target/bdev_io_wait.sh@27 -- # /home/vagrant/spdk_repo/spdk/build/examples/bdevperf -m 0x10 -i 1 --json /dev/fd/63 -q 128 -o 4096 -w write -t 1 -s 256 00:08:05.326 11:18:46 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@558 -- # config=() 00:08:05.326 11:18:46 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@558 -- # local subsystem config 00:08:05.326 11:18:46 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@560 -- # for subsystem in "${@:-1}" 00:08:05.326 11:18:46 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- target/bdev_io_wait.sh@30 -- # READ_PID=67753 00:08:05.326 11:18:46 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@580 -- # config+=("$(cat <<-EOF 00:08:05.326 { 00:08:05.326 "params": { 00:08:05.326 "name": "Nvme$subsystem", 00:08:05.326 "trtype": "$TEST_TRANSPORT", 00:08:05.326 "traddr": "$NVMF_FIRST_TARGET_IP", 00:08:05.326 "adrfam": "ipv4", 00:08:05.326 "trsvcid": "$NVMF_PORT", 00:08:05.326 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:08:05.326 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:08:05.326 "hdgst": ${hdgst:-false}, 00:08:05.326 "ddgst": ${ddgst:-false} 00:08:05.326 }, 00:08:05.326 "method": "bdev_nvme_attach_controller" 00:08:05.326 } 00:08:05.326 EOF 00:08:05.326 )") 00:08:05.327 11:18:46 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- target/bdev_io_wait.sh@29 -- # /home/vagrant/spdk_repo/spdk/build/examples/bdevperf -m 0x20 -i 2 --json /dev/fd/63 -q 128 -o 4096 -w read -t 1 -s 256 00:08:05.327 11:18:46 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- target/bdev_io_wait.sh@29 -- # gen_nvmf_target_json 00:08:05.327 11:18:46 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@558 -- # config=() 00:08:05.327 11:18:46 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- target/bdev_io_wait.sh@32 -- # FLUSH_PID=67756 00:08:05.327 11:18:46 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@558 -- # local subsystem config 00:08:05.327 11:18:46 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@580 -- # cat 00:08:05.327 11:18:46 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@560 -- # for subsystem in "${@:-1}" 00:08:05.327 11:18:46 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@580 -- # config+=("$(cat <<-EOF 00:08:05.327 { 00:08:05.327 "params": { 00:08:05.327 "name": "Nvme$subsystem", 00:08:05.327 "trtype": "$TEST_TRANSPORT", 00:08:05.327 "traddr": "$NVMF_FIRST_TARGET_IP", 00:08:05.327 "adrfam": "ipv4", 00:08:05.327 "trsvcid": "$NVMF_PORT", 00:08:05.327 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:08:05.327 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:08:05.327 "hdgst": ${hdgst:-false}, 00:08:05.327 "ddgst": ${ddgst:-false} 00:08:05.327 }, 00:08:05.327 "method": "bdev_nvme_attach_controller" 00:08:05.327 } 00:08:05.327 EOF 00:08:05.327 )") 00:08:05.327 11:18:46 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- target/bdev_io_wait.sh@34 -- # UNMAP_PID=67757 00:08:05.327 11:18:46 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- target/bdev_io_wait.sh@35 -- # sync 00:08:05.327 11:18:46 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- target/bdev_io_wait.sh@31 -- # /home/vagrant/spdk_repo/spdk/build/examples/bdevperf -m 0x40 -i 3 --json /dev/fd/63 -q 128 -o 4096 -w flush -t 1 -s 256 00:08:05.327 11:18:46 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- target/bdev_io_wait.sh@31 -- # gen_nvmf_target_json 00:08:05.327 11:18:46 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- target/bdev_io_wait.sh@33 -- # /home/vagrant/spdk_repo/spdk/build/examples/bdevperf -m 0x80 -i 4 --json /dev/fd/63 -q 128 -o 4096 -w unmap -t 1 -s 256 00:08:05.327 11:18:46 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@580 -- # cat 00:08:05.327 11:18:46 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@558 -- # config=() 00:08:05.327 11:18:46 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@558 -- # local subsystem config 00:08:05.327 11:18:46 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@560 -- # for subsystem in "${@:-1}" 00:08:05.327 11:18:46 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- target/bdev_io_wait.sh@33 -- # gen_nvmf_target_json 00:08:05.327 11:18:46 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@580 -- # config+=("$(cat <<-EOF 00:08:05.327 { 00:08:05.327 "params": { 00:08:05.327 "name": "Nvme$subsystem", 00:08:05.327 "trtype": "$TEST_TRANSPORT", 00:08:05.327 "traddr": "$NVMF_FIRST_TARGET_IP", 00:08:05.327 "adrfam": "ipv4", 00:08:05.327 "trsvcid": "$NVMF_PORT", 00:08:05.327 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:08:05.327 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:08:05.327 "hdgst": ${hdgst:-false}, 00:08:05.327 "ddgst": ${ddgst:-false} 00:08:05.327 }, 00:08:05.327 "method": "bdev_nvme_attach_controller" 00:08:05.327 } 00:08:05.327 EOF 00:08:05.327 )") 00:08:05.327 11:18:46 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@558 -- # config=() 00:08:05.327 11:18:46 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@558 -- # local subsystem config 00:08:05.327 11:18:46 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@560 -- # for subsystem in "${@:-1}" 00:08:05.327 11:18:46 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@580 -- # config+=("$(cat <<-EOF 00:08:05.327 { 00:08:05.327 "params": { 00:08:05.327 "name": "Nvme$subsystem", 00:08:05.327 "trtype": "$TEST_TRANSPORT", 00:08:05.327 "traddr": "$NVMF_FIRST_TARGET_IP", 00:08:05.327 "adrfam": "ipv4", 00:08:05.327 "trsvcid": "$NVMF_PORT", 00:08:05.327 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:08:05.327 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:08:05.327 "hdgst": ${hdgst:-false}, 00:08:05.327 "ddgst": ${ddgst:-false} 00:08:05.327 }, 00:08:05.327 "method": "bdev_nvme_attach_controller" 00:08:05.327 } 00:08:05.327 EOF 00:08:05.327 )") 00:08:05.327 11:18:46 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@580 -- # cat 00:08:05.327 11:18:46 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@582 -- # jq . 00:08:05.327 11:18:46 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@580 -- # cat 00:08:05.327 11:18:46 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@582 -- # jq . 00:08:05.327 11:18:46 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@583 -- # IFS=, 00:08:05.327 11:18:46 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@584 -- # printf '%s\n' '{ 00:08:05.327 "params": { 00:08:05.327 "name": "Nvme1", 00:08:05.327 "trtype": "tcp", 00:08:05.327 "traddr": "10.0.0.3", 00:08:05.327 "adrfam": "ipv4", 00:08:05.327 "trsvcid": "4420", 00:08:05.327 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:08:05.327 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:08:05.327 "hdgst": false, 00:08:05.327 "ddgst": false 00:08:05.327 }, 00:08:05.327 "method": "bdev_nvme_attach_controller" 00:08:05.327 }' 00:08:05.327 11:18:46 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@583 -- # IFS=, 00:08:05.327 11:18:46 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@584 -- # printf '%s\n' '{ 00:08:05.327 "params": { 00:08:05.327 "name": "Nvme1", 00:08:05.327 "trtype": "tcp", 00:08:05.327 "traddr": "10.0.0.3", 00:08:05.327 "adrfam": "ipv4", 00:08:05.327 "trsvcid": "4420", 00:08:05.327 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:08:05.327 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:08:05.327 "hdgst": false, 00:08:05.327 "ddgst": false 00:08:05.327 }, 00:08:05.327 "method": "bdev_nvme_attach_controller" 00:08:05.327 }' 00:08:05.327 11:18:46 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@582 -- # jq . 00:08:05.327 11:18:46 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@583 -- # IFS=, 00:08:05.327 11:18:46 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@582 -- # jq . 00:08:05.327 11:18:46 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@584 -- # printf '%s\n' '{ 00:08:05.327 "params": { 00:08:05.327 "name": "Nvme1", 00:08:05.327 "trtype": "tcp", 00:08:05.327 "traddr": "10.0.0.3", 00:08:05.327 "adrfam": "ipv4", 00:08:05.327 "trsvcid": "4420", 00:08:05.327 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:08:05.327 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:08:05.327 "hdgst": false, 00:08:05.327 "ddgst": false 00:08:05.327 }, 00:08:05.327 "method": "bdev_nvme_attach_controller" 00:08:05.327 }' 00:08:05.327 11:18:47 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@583 -- # IFS=, 00:08:05.327 11:18:47 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@584 -- # printf '%s\n' '{ 00:08:05.327 "params": { 00:08:05.327 "name": "Nvme1", 00:08:05.327 "trtype": "tcp", 00:08:05.327 "traddr": "10.0.0.3", 00:08:05.327 "adrfam": "ipv4", 00:08:05.327 "trsvcid": "4420", 00:08:05.327 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:08:05.327 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:08:05.327 "hdgst": false, 00:08:05.327 "ddgst": false 00:08:05.327 }, 00:08:05.327 "method": "bdev_nvme_attach_controller" 00:08:05.327 }' 00:08:05.327 [2024-10-07 11:18:47.031605] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:08:05.327 [2024-10-07 11:18:47.032324] [ DPDK EAL parameters: bdevperf -c 0x80 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk4 --proc-type=auto ] 00:08:05.585 11:18:47 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- target/bdev_io_wait.sh@37 -- # wait 67751 00:08:05.585 [2024-10-07 11:18:47.047888] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:08:05.585 [2024-10-07 11:18:47.047957] [ DPDK EAL parameters: bdevperf -c 0x10 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk1 --proc-type=auto ] 00:08:05.585 [2024-10-07 11:18:47.050341] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:08:05.585 [2024-10-07 11:18:47.050406] [ DPDK EAL parameters: bdevperf -c 0x20 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk2 --proc-type=auto ] 00:08:05.585 [2024-10-07 11:18:47.059127] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:08:05.585 [2024-10-07 11:18:47.059362] [ DPDK EAL parameters: bdevperf -c 0x40 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk3 --proc-type=auto ] 00:08:05.585 [2024-10-07 11:18:47.258574] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:05.843 [2024-10-07 11:18:47.354599] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:05.843 [2024-10-07 11:18:47.375702] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 7 00:08:05.843 [2024-10-07 11:18:47.453507] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:05.843 [2024-10-07 11:18:47.471087] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 5 00:08:05.843 [2024-10-07 11:18:47.548019] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 4 00:08:06.102 [2024-10-07 11:18:47.569927] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:06.102 Running I/O for 1 seconds... 00:08:06.102 [2024-10-07 11:18:47.696582] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 6 00:08:06.102 Running I/O for 1 seconds... 00:08:06.359 Running I/O for 1 seconds... 00:08:06.360 Running I/O for 1 seconds... 00:08:07.291 10731.00 IOPS, 41.92 MiB/s 00:08:07.291 Latency(us) 00:08:07.291 [2024-10-07T11:18:49.002Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:08:07.291 Job: Nvme1n1 (Core Mask 0x80, workload: unmap, depth: 128, IO size: 4096) 00:08:07.291 Nvme1n1 : 1.01 10795.43 42.17 0.00 0.00 11812.30 5808.87 17754.30 00:08:07.291 [2024-10-07T11:18:49.002Z] =================================================================================================================== 00:08:07.291 [2024-10-07T11:18:49.002Z] Total : 10795.43 42.17 0.00 0.00 11812.30 5808.87 17754.30 00:08:07.291 7430.00 IOPS, 29.02 MiB/s 00:08:07.291 Latency(us) 00:08:07.291 [2024-10-07T11:18:49.002Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:08:07.291 Job: Nvme1n1 (Core Mask 0x20, workload: read, depth: 128, IO size: 4096) 00:08:07.291 Nvme1n1 : 1.01 7477.29 29.21 0.00 0.00 17018.36 9413.35 25380.31 00:08:07.291 [2024-10-07T11:18:49.002Z] =================================================================================================================== 00:08:07.291 [2024-10-07T11:18:49.002Z] Total : 7477.29 29.21 0.00 0.00 17018.36 9413.35 25380.31 00:08:07.291 7945.00 IOPS, 31.04 MiB/s 00:08:07.291 Latency(us) 00:08:07.291 [2024-10-07T11:18:49.002Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:08:07.291 Job: Nvme1n1 (Core Mask 0x10, workload: write, depth: 128, IO size: 4096) 00:08:07.291 Nvme1n1 : 1.01 8025.75 31.35 0.00 0.00 15878.12 6374.87 26929.34 00:08:07.291 [2024-10-07T11:18:49.002Z] =================================================================================================================== 00:08:07.291 [2024-10-07T11:18:49.002Z] Total : 8025.75 31.35 0.00 0.00 15878.12 6374.87 26929.34 00:08:07.291 196248.00 IOPS, 766.59 MiB/s 00:08:07.291 Latency(us) 00:08:07.291 [2024-10-07T11:18:49.002Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:08:07.291 Job: Nvme1n1 (Core Mask 0x40, workload: flush, depth: 128, IO size: 4096) 00:08:07.291 Nvme1n1 : 1.00 195858.21 765.07 0.00 0.00 649.97 346.30 1980.97 00:08:07.291 [2024-10-07T11:18:49.002Z] =================================================================================================================== 00:08:07.291 [2024-10-07T11:18:49.002Z] Total : 195858.21 765.07 0.00 0.00 649.97 346.30 1980.97 00:08:07.549 11:18:49 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- target/bdev_io_wait.sh@38 -- # wait 67753 00:08:07.549 11:18:49 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- target/bdev_io_wait.sh@39 -- # wait 67756 00:08:07.549 11:18:49 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- target/bdev_io_wait.sh@40 -- # wait 67757 00:08:07.549 11:18:49 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- target/bdev_io_wait.sh@42 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:08:07.549 11:18:49 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:07.549 11:18:49 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@10 -- # set +x 00:08:07.549 11:18:49 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:07.549 11:18:49 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- target/bdev_io_wait.sh@44 -- # trap - SIGINT SIGTERM EXIT 00:08:07.549 11:18:49 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- target/bdev_io_wait.sh@46 -- # nvmftestfini 00:08:07.549 11:18:49 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@514 -- # nvmfcleanup 00:08:07.549 11:18:49 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@121 -- # sync 00:08:07.806 11:18:49 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:08:07.806 11:18:49 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@124 -- # set +e 00:08:07.806 11:18:49 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@125 -- # for i in {1..20} 00:08:07.806 11:18:49 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:08:07.806 rmmod nvme_tcp 00:08:07.806 rmmod nvme_fabrics 00:08:07.806 rmmod nvme_keyring 00:08:07.806 11:18:49 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:08:07.806 11:18:49 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@128 -- # set -e 00:08:07.806 11:18:49 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@129 -- # return 0 00:08:07.806 11:18:49 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@515 -- # '[' -n 67693 ']' 00:08:07.806 11:18:49 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@516 -- # killprocess 67693 00:08:07.806 11:18:49 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@950 -- # '[' -z 67693 ']' 00:08:07.806 11:18:49 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@954 -- # kill -0 67693 00:08:07.806 11:18:49 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@955 -- # uname 00:08:07.806 11:18:49 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:08:07.806 11:18:49 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 67693 00:08:07.806 killing process with pid 67693 00:08:07.806 11:18:49 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:08:07.806 11:18:49 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:08:07.806 11:18:49 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@968 -- # echo 'killing process with pid 67693' 00:08:07.806 11:18:49 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@969 -- # kill 67693 00:08:07.806 11:18:49 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@974 -- # wait 67693 00:08:08.063 11:18:49 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:08:08.063 11:18:49 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:08:08.063 11:18:49 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:08:08.063 11:18:49 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@297 -- # iptr 00:08:08.063 11:18:49 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@789 -- # iptables-save 00:08:08.063 11:18:49 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@789 -- # iptables-restore 00:08:08.063 11:18:49 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:08:08.063 11:18:49 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@298 -- # [[ nvmf_tgt_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:08:08.063 11:18:49 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@299 -- # nvmf_veth_fini 00:08:08.063 11:18:49 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@233 -- # ip link set nvmf_init_br nomaster 00:08:08.063 11:18:49 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@234 -- # ip link set nvmf_init_br2 nomaster 00:08:08.063 11:18:49 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@235 -- # ip link set nvmf_tgt_br nomaster 00:08:08.063 11:18:49 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@236 -- # ip link set nvmf_tgt_br2 nomaster 00:08:08.063 11:18:49 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@237 -- # ip link set nvmf_init_br down 00:08:08.063 11:18:49 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@238 -- # ip link set nvmf_init_br2 down 00:08:08.063 11:18:49 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@239 -- # ip link set nvmf_tgt_br down 00:08:08.063 11:18:49 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@240 -- # ip link set nvmf_tgt_br2 down 00:08:08.063 11:18:49 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@241 -- # ip link delete nvmf_br type bridge 00:08:08.320 11:18:49 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@242 -- # ip link delete nvmf_init_if 00:08:08.320 11:18:49 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@243 -- # ip link delete nvmf_init_if2 00:08:08.320 11:18:49 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@244 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:08:08.320 11:18:49 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@245 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:08:08.320 11:18:49 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@246 -- # remove_spdk_ns 00:08:08.320 11:18:49 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:08.320 11:18:49 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:08:08.320 11:18:49 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:08.320 11:18:49 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- nvmf/common.sh@300 -- # return 0 00:08:08.320 00:08:08.320 real 0m4.987s 00:08:08.320 user 0m19.870s 00:08:08.320 sys 0m2.694s 00:08:08.320 11:18:49 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@1126 -- # xtrace_disable 00:08:08.320 ************************************ 00:08:08.320 END TEST nvmf_bdev_io_wait 00:08:08.320 11:18:49 nvmf_tcp.nvmf_target_core.nvmf_bdev_io_wait -- common/autotest_common.sh@10 -- # set +x 00:08:08.320 ************************************ 00:08:08.320 11:18:49 nvmf_tcp.nvmf_target_core -- nvmf/nvmf_target_core.sh@30 -- # run_test nvmf_queue_depth /home/vagrant/spdk_repo/spdk/test/nvmf/target/queue_depth.sh --transport=tcp 00:08:08.320 11:18:49 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:08:08.320 11:18:49 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1107 -- # xtrace_disable 00:08:08.320 11:18:49 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@10 -- # set +x 00:08:08.320 ************************************ 00:08:08.320 START TEST nvmf_queue_depth 00:08:08.320 ************************************ 00:08:08.320 11:18:49 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/nvmf/target/queue_depth.sh --transport=tcp 00:08:08.320 * Looking for test storage... 00:08:08.320 * Found test storage at /home/vagrant/spdk_repo/spdk/test/nvmf/target 00:08:08.320 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:08:08.320 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:08:08.320 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@1681 -- # lcov --version 00:08:08.579 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:08:08.579 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:08:08.579 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- scripts/common.sh@333 -- # local ver1 ver1_l 00:08:08.579 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- scripts/common.sh@334 -- # local ver2 ver2_l 00:08:08.579 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- scripts/common.sh@336 -- # IFS=.-: 00:08:08.579 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- scripts/common.sh@336 -- # read -ra ver1 00:08:08.579 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- scripts/common.sh@337 -- # IFS=.-: 00:08:08.579 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- scripts/common.sh@337 -- # read -ra ver2 00:08:08.579 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- scripts/common.sh@338 -- # local 'op=<' 00:08:08.579 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- scripts/common.sh@340 -- # ver1_l=2 00:08:08.579 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- scripts/common.sh@341 -- # ver2_l=1 00:08:08.579 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:08:08.579 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- scripts/common.sh@344 -- # case "$op" in 00:08:08.579 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- scripts/common.sh@345 -- # : 1 00:08:08.579 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- scripts/common.sh@364 -- # (( v = 0 )) 00:08:08.579 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:08:08.579 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- scripts/common.sh@365 -- # decimal 1 00:08:08.579 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- scripts/common.sh@353 -- # local d=1 00:08:08.579 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:08:08.579 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- scripts/common.sh@355 -- # echo 1 00:08:08.579 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- scripts/common.sh@365 -- # ver1[v]=1 00:08:08.579 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- scripts/common.sh@366 -- # decimal 2 00:08:08.579 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- scripts/common.sh@353 -- # local d=2 00:08:08.579 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:08:08.579 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- scripts/common.sh@355 -- # echo 2 00:08:08.579 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- scripts/common.sh@366 -- # ver2[v]=2 00:08:08.579 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:08:08.579 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:08:08.579 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- scripts/common.sh@368 -- # return 0 00:08:08.579 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:08:08.579 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:08:08.579 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:08.579 --rc genhtml_branch_coverage=1 00:08:08.579 --rc genhtml_function_coverage=1 00:08:08.579 --rc genhtml_legend=1 00:08:08.579 --rc geninfo_all_blocks=1 00:08:08.579 --rc geninfo_unexecuted_blocks=1 00:08:08.579 00:08:08.579 ' 00:08:08.579 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:08:08.579 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:08.579 --rc genhtml_branch_coverage=1 00:08:08.579 --rc genhtml_function_coverage=1 00:08:08.579 --rc genhtml_legend=1 00:08:08.579 --rc geninfo_all_blocks=1 00:08:08.579 --rc geninfo_unexecuted_blocks=1 00:08:08.579 00:08:08.579 ' 00:08:08.579 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:08:08.579 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:08.580 --rc genhtml_branch_coverage=1 00:08:08.580 --rc genhtml_function_coverage=1 00:08:08.580 --rc genhtml_legend=1 00:08:08.580 --rc geninfo_all_blocks=1 00:08:08.580 --rc geninfo_unexecuted_blocks=1 00:08:08.580 00:08:08.580 ' 00:08:08.580 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:08:08.580 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:08.580 --rc genhtml_branch_coverage=1 00:08:08.580 --rc genhtml_function_coverage=1 00:08:08.580 --rc genhtml_legend=1 00:08:08.580 --rc geninfo_all_blocks=1 00:08:08.580 --rc geninfo_unexecuted_blocks=1 00:08:08.580 00:08:08.580 ' 00:08:08.580 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- target/queue_depth.sh@12 -- # source /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh 00:08:08.580 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@7 -- # uname -s 00:08:08.580 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:08:08.580 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:08:08.580 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:08:08.580 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:08:08.580 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:08:08.580 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:08:08.580 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:08:08.580 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:08:08.580 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:08:08.580 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:08:08.580 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:08:08.580 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@18 -- # NVME_HOSTID=3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:08:08.580 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:08:08.580 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:08:08.580 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@21 -- # NET_TYPE=virt 00:08:08.580 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:08:08.580 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@49 -- # source /home/vagrant/spdk_repo/spdk/scripts/common.sh 00:08:08.580 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- scripts/common.sh@15 -- # shopt -s extglob 00:08:08.580 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:08:08.580 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:08:08.580 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:08:08.580 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:08.580 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:08.580 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:08.580 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- paths/export.sh@5 -- # export PATH 00:08:08.580 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:08.580 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@51 -- # : 0 00:08:08.580 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:08:08.580 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:08:08.580 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:08:08.580 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:08:08.580 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:08:08.580 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:08:08.580 /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:08:08.580 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:08:08.580 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:08:08.580 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@55 -- # have_pci_nics=0 00:08:08.580 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- target/queue_depth.sh@14 -- # MALLOC_BDEV_SIZE=64 00:08:08.580 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- target/queue_depth.sh@15 -- # MALLOC_BLOCK_SIZE=512 00:08:08.580 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- target/queue_depth.sh@17 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:08:08.580 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- target/queue_depth.sh@19 -- # nvmftestinit 00:08:08.580 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:08:08.580 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:08:08.580 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@474 -- # prepare_net_devs 00:08:08.580 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@436 -- # local -g is_hw=no 00:08:08.580 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@438 -- # remove_spdk_ns 00:08:08.580 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:08.580 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:08:08.580 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:08.580 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@440 -- # [[ virt != virt ]] 00:08:08.580 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@442 -- # [[ no == yes ]] 00:08:08.580 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@449 -- # [[ virt == phy ]] 00:08:08.580 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@452 -- # [[ virt == phy-fallback ]] 00:08:08.580 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@457 -- # [[ tcp == tcp ]] 00:08:08.580 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@458 -- # nvmf_veth_init 00:08:08.580 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@145 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:08:08.580 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@146 -- # NVMF_SECOND_INITIATOR_IP=10.0.0.2 00:08:08.580 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@147 -- # NVMF_FIRST_TARGET_IP=10.0.0.3 00:08:08.580 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@148 -- # NVMF_SECOND_TARGET_IP=10.0.0.4 00:08:08.580 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@149 -- # NVMF_INITIATOR_IP=10.0.0.1 00:08:08.580 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@150 -- # NVMF_BRIDGE=nvmf_br 00:08:08.580 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@151 -- # NVMF_INITIATOR_INTERFACE=nvmf_init_if 00:08:08.580 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@152 -- # NVMF_INITIATOR_INTERFACE2=nvmf_init_if2 00:08:08.580 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@153 -- # NVMF_INITIATOR_BRIDGE=nvmf_init_br 00:08:08.580 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@154 -- # NVMF_INITIATOR_BRIDGE2=nvmf_init_br2 00:08:08.580 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@155 -- # NVMF_TARGET_NAMESPACE=nvmf_tgt_ns_spdk 00:08:08.580 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@156 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:08:08.580 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@157 -- # NVMF_TARGET_INTERFACE=nvmf_tgt_if 00:08:08.580 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@158 -- # NVMF_TARGET_INTERFACE2=nvmf_tgt_if2 00:08:08.580 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@159 -- # NVMF_TARGET_BRIDGE=nvmf_tgt_br 00:08:08.580 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@160 -- # NVMF_TARGET_BRIDGE2=nvmf_tgt_br2 00:08:08.580 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@162 -- # ip link set nvmf_init_br nomaster 00:08:08.580 Cannot find device "nvmf_init_br" 00:08:08.580 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@162 -- # true 00:08:08.580 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@163 -- # ip link set nvmf_init_br2 nomaster 00:08:08.580 Cannot find device "nvmf_init_br2" 00:08:08.580 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@163 -- # true 00:08:08.580 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@164 -- # ip link set nvmf_tgt_br nomaster 00:08:08.580 Cannot find device "nvmf_tgt_br" 00:08:08.580 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@164 -- # true 00:08:08.580 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@165 -- # ip link set nvmf_tgt_br2 nomaster 00:08:08.580 Cannot find device "nvmf_tgt_br2" 00:08:08.580 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@165 -- # true 00:08:08.580 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@166 -- # ip link set nvmf_init_br down 00:08:08.580 Cannot find device "nvmf_init_br" 00:08:08.580 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@166 -- # true 00:08:08.580 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@167 -- # ip link set nvmf_init_br2 down 00:08:08.580 Cannot find device "nvmf_init_br2" 00:08:08.580 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@167 -- # true 00:08:08.580 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@168 -- # ip link set nvmf_tgt_br down 00:08:08.580 Cannot find device "nvmf_tgt_br" 00:08:08.580 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@168 -- # true 00:08:08.580 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@169 -- # ip link set nvmf_tgt_br2 down 00:08:08.580 Cannot find device "nvmf_tgt_br2" 00:08:08.581 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@169 -- # true 00:08:08.581 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@170 -- # ip link delete nvmf_br type bridge 00:08:08.581 Cannot find device "nvmf_br" 00:08:08.581 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@170 -- # true 00:08:08.581 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@171 -- # ip link delete nvmf_init_if 00:08:08.838 Cannot find device "nvmf_init_if" 00:08:08.839 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@171 -- # true 00:08:08.839 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@172 -- # ip link delete nvmf_init_if2 00:08:08.839 Cannot find device "nvmf_init_if2" 00:08:08.839 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@172 -- # true 00:08:08.839 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@173 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:08:08.839 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:08:08.839 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@173 -- # true 00:08:08.839 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@174 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:08:08.839 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:08:08.839 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@174 -- # true 00:08:08.839 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@177 -- # ip netns add nvmf_tgt_ns_spdk 00:08:08.839 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@180 -- # ip link add nvmf_init_if type veth peer name nvmf_init_br 00:08:08.839 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@181 -- # ip link add nvmf_init_if2 type veth peer name nvmf_init_br2 00:08:08.839 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@182 -- # ip link add nvmf_tgt_if type veth peer name nvmf_tgt_br 00:08:08.839 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@183 -- # ip link add nvmf_tgt_if2 type veth peer name nvmf_tgt_br2 00:08:08.839 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@186 -- # ip link set nvmf_tgt_if netns nvmf_tgt_ns_spdk 00:08:08.839 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@187 -- # ip link set nvmf_tgt_if2 netns nvmf_tgt_ns_spdk 00:08:08.839 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@190 -- # ip addr add 10.0.0.1/24 dev nvmf_init_if 00:08:08.839 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@191 -- # ip addr add 10.0.0.2/24 dev nvmf_init_if2 00:08:08.839 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@192 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.3/24 dev nvmf_tgt_if 00:08:08.839 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@193 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.4/24 dev nvmf_tgt_if2 00:08:08.839 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@196 -- # ip link set nvmf_init_if up 00:08:08.839 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@197 -- # ip link set nvmf_init_if2 up 00:08:08.839 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@198 -- # ip link set nvmf_init_br up 00:08:08.839 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@199 -- # ip link set nvmf_init_br2 up 00:08:08.839 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@200 -- # ip link set nvmf_tgt_br up 00:08:08.839 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@201 -- # ip link set nvmf_tgt_br2 up 00:08:08.839 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@202 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if up 00:08:08.839 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@203 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if2 up 00:08:08.839 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@204 -- # ip netns exec nvmf_tgt_ns_spdk ip link set lo up 00:08:08.839 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@207 -- # ip link add nvmf_br type bridge 00:08:08.839 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@208 -- # ip link set nvmf_br up 00:08:08.839 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@211 -- # ip link set nvmf_init_br master nvmf_br 00:08:08.839 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@212 -- # ip link set nvmf_init_br2 master nvmf_br 00:08:08.839 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@213 -- # ip link set nvmf_tgt_br master nvmf_br 00:08:08.839 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@214 -- # ip link set nvmf_tgt_br2 master nvmf_br 00:08:08.839 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@217 -- # ipts -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT 00:08:08.839 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT' 00:08:08.839 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@218 -- # ipts -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT 00:08:08.839 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT' 00:08:08.839 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@219 -- # ipts -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT 00:08:08.839 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@788 -- # iptables -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT -m comment --comment 'SPDK_NVMF:-A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT' 00:08:08.839 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@222 -- # ping -c 1 10.0.0.3 00:08:08.839 PING 10.0.0.3 (10.0.0.3) 56(84) bytes of data. 00:08:08.839 64 bytes from 10.0.0.3: icmp_seq=1 ttl=64 time=0.091 ms 00:08:08.839 00:08:08.839 --- 10.0.0.3 ping statistics --- 00:08:08.839 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:08.839 rtt min/avg/max/mdev = 0.091/0.091/0.091/0.000 ms 00:08:08.839 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@223 -- # ping -c 1 10.0.0.4 00:08:08.839 PING 10.0.0.4 (10.0.0.4) 56(84) bytes of data. 00:08:08.839 64 bytes from 10.0.0.4: icmp_seq=1 ttl=64 time=0.041 ms 00:08:08.839 00:08:08.839 --- 10.0.0.4 ping statistics --- 00:08:08.839 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:08.839 rtt min/avg/max/mdev = 0.041/0.041/0.041/0.000 ms 00:08:08.839 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@224 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.1 00:08:08.839 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:08:08.839 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.056 ms 00:08:08.839 00:08:08.839 --- 10.0.0.1 ping statistics --- 00:08:08.839 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:08.839 rtt min/avg/max/mdev = 0.056/0.056/0.056/0.000 ms 00:08:08.839 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@225 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.2 00:08:08.839 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:08:08.839 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.063 ms 00:08:08.839 00:08:08.839 --- 10.0.0.2 ping statistics --- 00:08:08.839 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:08.839 rtt min/avg/max/mdev = 0.063/0.063/0.063/0.000 ms 00:08:08.839 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@227 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:08:08.839 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@459 -- # return 0 00:08:08.839 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:08:08.839 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:08:08.839 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:08:08.839 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:08:08.839 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:08:08.839 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:08:08.839 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:08:09.097 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- target/queue_depth.sh@21 -- # nvmfappstart -m 0x2 00:08:09.097 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:08:09.097 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@724 -- # xtrace_disable 00:08:09.097 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@10 -- # set +x 00:08:09.097 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@507 -- # nvmfpid=68042 00:08:09.097 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@506 -- # ip netns exec nvmf_tgt_ns_spdk /home/vagrant/spdk_repo/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:08:09.097 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@508 -- # waitforlisten 68042 00:08:09.097 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@831 -- # '[' -z 68042 ']' 00:08:09.097 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:09.097 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@836 -- # local max_retries=100 00:08:09.097 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:09.097 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:09.097 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@840 -- # xtrace_disable 00:08:09.097 11:18:50 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@10 -- # set +x 00:08:09.097 [2024-10-07 11:18:50.644699] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:08:09.097 [2024-10-07 11:18:50.644877] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:08:09.097 [2024-10-07 11:18:50.791756] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:09.355 [2024-10-07 11:18:50.926924] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:08:09.355 [2024-10-07 11:18:50.926999] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:08:09.355 [2024-10-07 11:18:50.927011] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:08:09.355 [2024-10-07 11:18:50.927020] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:08:09.355 [2024-10-07 11:18:50.927028] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:08:09.355 [2024-10-07 11:18:50.927505] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:08:10.289 11:18:51 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:08:10.290 11:18:51 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@864 -- # return 0 00:08:10.290 11:18:51 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:08:10.290 11:18:51 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@730 -- # xtrace_disable 00:08:10.290 11:18:51 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@10 -- # set +x 00:08:10.290 11:18:51 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:08:10.290 11:18:51 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- target/queue_depth.sh@23 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:08:10.290 11:18:51 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:10.290 11:18:51 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@10 -- # set +x 00:08:10.290 [2024-10-07 11:18:51.755031] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:08:10.290 11:18:51 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:10.290 11:18:51 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- target/queue_depth.sh@24 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:08:10.290 11:18:51 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:10.290 11:18:51 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@10 -- # set +x 00:08:10.290 Malloc0 00:08:10.290 11:18:51 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:10.290 11:18:51 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- target/queue_depth.sh@25 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:08:10.290 11:18:51 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:10.290 11:18:51 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@10 -- # set +x 00:08:10.290 11:18:51 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:10.290 11:18:51 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- target/queue_depth.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:08:10.290 11:18:51 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:10.290 11:18:51 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@10 -- # set +x 00:08:10.290 11:18:51 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:10.290 11:18:51 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- target/queue_depth.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4420 00:08:10.290 11:18:51 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:10.290 11:18:51 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@10 -- # set +x 00:08:10.290 [2024-10-07 11:18:51.831451] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:08:10.290 11:18:51 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:10.290 11:18:51 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- target/queue_depth.sh@30 -- # bdevperf_pid=68099 00:08:10.290 11:18:51 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- target/queue_depth.sh@32 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:08:10.290 11:18:51 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- target/queue_depth.sh@33 -- # waitforlisten 68099 /var/tmp/bdevperf.sock 00:08:10.290 11:18:51 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- target/queue_depth.sh@29 -- # /home/vagrant/spdk_repo/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 1024 -o 4096 -w verify -t 10 00:08:10.290 11:18:51 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@831 -- # '[' -z 68099 ']' 00:08:10.290 11:18:51 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:08:10.290 11:18:51 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@836 -- # local max_retries=100 00:08:10.290 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:08:10.290 11:18:51 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:08:10.290 11:18:51 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@840 -- # xtrace_disable 00:08:10.290 11:18:51 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@10 -- # set +x 00:08:10.290 [2024-10-07 11:18:51.892436] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:08:10.290 [2024-10-07 11:18:51.892515] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid68099 ] 00:08:10.548 [2024-10-07 11:18:52.030401] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:10.548 [2024-10-07 11:18:52.187399] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:08:11.527 11:18:52 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:08:11.527 11:18:52 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@864 -- # return 0 00:08:11.527 11:18:52 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- target/queue_depth.sh@34 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.3 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:08:11.527 11:18:52 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:11.527 11:18:52 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@10 -- # set +x 00:08:11.527 NVMe0n1 00:08:11.527 11:18:53 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:11.527 11:18:53 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- target/queue_depth.sh@35 -- # /home/vagrant/spdk_repo/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:08:11.527 Running I/O for 10 seconds... 00:08:13.832 7415.00 IOPS, 28.96 MiB/s [2024-10-07T11:18:56.477Z] 7983.00 IOPS, 31.18 MiB/s [2024-10-07T11:18:57.412Z] 8091.00 IOPS, 31.61 MiB/s [2024-10-07T11:18:58.345Z] 8179.00 IOPS, 31.95 MiB/s [2024-10-07T11:18:59.278Z] 8190.60 IOPS, 31.99 MiB/s [2024-10-07T11:19:00.212Z] 8251.67 IOPS, 32.23 MiB/s [2024-10-07T11:19:01.583Z] 8338.86 IOPS, 32.57 MiB/s [2024-10-07T11:19:02.514Z] 8401.50 IOPS, 32.82 MiB/s [2024-10-07T11:19:03.446Z] 8421.00 IOPS, 32.89 MiB/s [2024-10-07T11:19:03.446Z] 8458.70 IOPS, 33.04 MiB/s 00:08:21.735 Latency(us) 00:08:21.735 [2024-10-07T11:19:03.446Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:08:21.735 Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 1024, IO size: 4096) 00:08:21.735 Verification LBA range: start 0x0 length 0x4000 00:08:21.735 NVMe0n1 : 10.08 8491.03 33.17 0.00 0.00 120023.57 27882.59 88652.33 00:08:21.735 [2024-10-07T11:19:03.446Z] =================================================================================================================== 00:08:21.735 [2024-10-07T11:19:03.446Z] Total : 8491.03 33.17 0.00 0.00 120023.57 27882.59 88652.33 00:08:21.735 { 00:08:21.735 "results": [ 00:08:21.735 { 00:08:21.735 "job": "NVMe0n1", 00:08:21.735 "core_mask": "0x1", 00:08:21.735 "workload": "verify", 00:08:21.735 "status": "finished", 00:08:21.735 "verify_range": { 00:08:21.735 "start": 0, 00:08:21.735 "length": 16384 00:08:21.735 }, 00:08:21.735 "queue_depth": 1024, 00:08:21.735 "io_size": 4096, 00:08:21.735 "runtime": 10.08252, 00:08:21.735 "iops": 8491.032003903785, 00:08:21.735 "mibps": 33.16809376524916, 00:08:21.735 "io_failed": 0, 00:08:21.735 "io_timeout": 0, 00:08:21.735 "avg_latency_us": 120023.57271387173, 00:08:21.735 "min_latency_us": 27882.589090909092, 00:08:21.735 "max_latency_us": 88652.33454545455 00:08:21.735 } 00:08:21.735 ], 00:08:21.735 "core_count": 1 00:08:21.735 } 00:08:21.735 11:19:03 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- target/queue_depth.sh@39 -- # killprocess 68099 00:08:21.735 11:19:03 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@950 -- # '[' -z 68099 ']' 00:08:21.735 11:19:03 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@954 -- # kill -0 68099 00:08:21.735 11:19:03 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@955 -- # uname 00:08:21.735 11:19:03 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:08:21.735 11:19:03 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 68099 00:08:21.735 11:19:03 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:08:21.735 11:19:03 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:08:21.735 killing process with pid 68099 00:08:21.735 11:19:03 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@968 -- # echo 'killing process with pid 68099' 00:08:21.735 11:19:03 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@969 -- # kill 68099 00:08:21.735 Received shutdown signal, test time was about 10.000000 seconds 00:08:21.735 00:08:21.735 Latency(us) 00:08:21.735 [2024-10-07T11:19:03.446Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:08:21.735 [2024-10-07T11:19:03.446Z] =================================================================================================================== 00:08:21.735 [2024-10-07T11:19:03.446Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:08:21.735 11:19:03 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@974 -- # wait 68099 00:08:21.992 11:19:03 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- target/queue_depth.sh@41 -- # trap - SIGINT SIGTERM EXIT 00:08:21.992 11:19:03 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- target/queue_depth.sh@43 -- # nvmftestfini 00:08:21.992 11:19:03 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@514 -- # nvmfcleanup 00:08:21.992 11:19:03 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@121 -- # sync 00:08:21.992 11:19:03 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:08:21.992 11:19:03 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@124 -- # set +e 00:08:21.992 11:19:03 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@125 -- # for i in {1..20} 00:08:21.992 11:19:03 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:08:21.992 rmmod nvme_tcp 00:08:21.992 rmmod nvme_fabrics 00:08:21.992 rmmod nvme_keyring 00:08:22.249 11:19:03 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:08:22.249 11:19:03 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@128 -- # set -e 00:08:22.249 11:19:03 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@129 -- # return 0 00:08:22.249 11:19:03 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@515 -- # '[' -n 68042 ']' 00:08:22.249 11:19:03 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@516 -- # killprocess 68042 00:08:22.249 11:19:03 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@950 -- # '[' -z 68042 ']' 00:08:22.249 11:19:03 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@954 -- # kill -0 68042 00:08:22.249 11:19:03 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@955 -- # uname 00:08:22.249 11:19:03 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:08:22.249 11:19:03 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 68042 00:08:22.249 killing process with pid 68042 00:08:22.249 11:19:03 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@956 -- # process_name=reactor_1 00:08:22.249 11:19:03 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@960 -- # '[' reactor_1 = sudo ']' 00:08:22.249 11:19:03 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@968 -- # echo 'killing process with pid 68042' 00:08:22.249 11:19:03 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@969 -- # kill 68042 00:08:22.249 11:19:03 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@974 -- # wait 68042 00:08:22.506 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:08:22.506 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:08:22.506 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:08:22.506 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@297 -- # iptr 00:08:22.506 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@789 -- # iptables-save 00:08:22.506 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:08:22.506 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@789 -- # iptables-restore 00:08:22.506 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@298 -- # [[ nvmf_tgt_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:08:22.506 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@299 -- # nvmf_veth_fini 00:08:22.506 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@233 -- # ip link set nvmf_init_br nomaster 00:08:22.506 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@234 -- # ip link set nvmf_init_br2 nomaster 00:08:22.506 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@235 -- # ip link set nvmf_tgt_br nomaster 00:08:22.506 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@236 -- # ip link set nvmf_tgt_br2 nomaster 00:08:22.506 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@237 -- # ip link set nvmf_init_br down 00:08:22.506 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@238 -- # ip link set nvmf_init_br2 down 00:08:22.506 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@239 -- # ip link set nvmf_tgt_br down 00:08:22.506 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@240 -- # ip link set nvmf_tgt_br2 down 00:08:22.506 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@241 -- # ip link delete nvmf_br type bridge 00:08:22.764 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@242 -- # ip link delete nvmf_init_if 00:08:22.764 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@243 -- # ip link delete nvmf_init_if2 00:08:22.764 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@244 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:08:22.764 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@245 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:08:22.764 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@246 -- # remove_spdk_ns 00:08:22.764 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:22.764 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:08:22.764 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:22.764 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- nvmf/common.sh@300 -- # return 0 00:08:22.764 00:08:22.764 real 0m14.433s 00:08:22.764 user 0m24.377s 00:08:22.764 sys 0m2.313s 00:08:22.764 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@1126 -- # xtrace_disable 00:08:22.764 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_queue_depth -- common/autotest_common.sh@10 -- # set +x 00:08:22.764 ************************************ 00:08:22.764 END TEST nvmf_queue_depth 00:08:22.764 ************************************ 00:08:22.764 11:19:04 nvmf_tcp.nvmf_target_core -- nvmf/nvmf_target_core.sh@31 -- # run_test nvmf_target_multipath /home/vagrant/spdk_repo/spdk/test/nvmf/target/multipath.sh --transport=tcp 00:08:22.764 11:19:04 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:08:22.764 11:19:04 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1107 -- # xtrace_disable 00:08:22.764 11:19:04 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@10 -- # set +x 00:08:22.764 ************************************ 00:08:22.764 START TEST nvmf_target_multipath 00:08:22.764 ************************************ 00:08:22.764 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/nvmf/target/multipath.sh --transport=tcp 00:08:23.024 * Looking for test storage... 00:08:23.024 * Found test storage at /home/vagrant/spdk_repo/spdk/test/nvmf/target 00:08:23.024 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:08:23.024 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@1681 -- # lcov --version 00:08:23.024 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:08:23.024 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:08:23.024 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:08:23.024 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- scripts/common.sh@333 -- # local ver1 ver1_l 00:08:23.024 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- scripts/common.sh@334 -- # local ver2 ver2_l 00:08:23.024 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- scripts/common.sh@336 -- # IFS=.-: 00:08:23.024 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- scripts/common.sh@336 -- # read -ra ver1 00:08:23.024 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- scripts/common.sh@337 -- # IFS=.-: 00:08:23.024 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- scripts/common.sh@337 -- # read -ra ver2 00:08:23.024 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- scripts/common.sh@338 -- # local 'op=<' 00:08:23.024 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- scripts/common.sh@340 -- # ver1_l=2 00:08:23.024 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- scripts/common.sh@341 -- # ver2_l=1 00:08:23.024 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:08:23.024 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- scripts/common.sh@344 -- # case "$op" in 00:08:23.024 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- scripts/common.sh@345 -- # : 1 00:08:23.024 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- scripts/common.sh@364 -- # (( v = 0 )) 00:08:23.024 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:08:23.024 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- scripts/common.sh@365 -- # decimal 1 00:08:23.024 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- scripts/common.sh@353 -- # local d=1 00:08:23.024 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:08:23.024 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- scripts/common.sh@355 -- # echo 1 00:08:23.024 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- scripts/common.sh@365 -- # ver1[v]=1 00:08:23.024 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- scripts/common.sh@366 -- # decimal 2 00:08:23.024 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- scripts/common.sh@353 -- # local d=2 00:08:23.024 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:08:23.024 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- scripts/common.sh@355 -- # echo 2 00:08:23.024 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- scripts/common.sh@366 -- # ver2[v]=2 00:08:23.024 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:08:23.024 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:08:23.024 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- scripts/common.sh@368 -- # return 0 00:08:23.024 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:08:23.024 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:08:23.024 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:23.024 --rc genhtml_branch_coverage=1 00:08:23.024 --rc genhtml_function_coverage=1 00:08:23.024 --rc genhtml_legend=1 00:08:23.024 --rc geninfo_all_blocks=1 00:08:23.024 --rc geninfo_unexecuted_blocks=1 00:08:23.024 00:08:23.024 ' 00:08:23.024 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:08:23.024 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:23.024 --rc genhtml_branch_coverage=1 00:08:23.024 --rc genhtml_function_coverage=1 00:08:23.024 --rc genhtml_legend=1 00:08:23.024 --rc geninfo_all_blocks=1 00:08:23.024 --rc geninfo_unexecuted_blocks=1 00:08:23.024 00:08:23.024 ' 00:08:23.024 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:08:23.024 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:23.024 --rc genhtml_branch_coverage=1 00:08:23.024 --rc genhtml_function_coverage=1 00:08:23.024 --rc genhtml_legend=1 00:08:23.024 --rc geninfo_all_blocks=1 00:08:23.024 --rc geninfo_unexecuted_blocks=1 00:08:23.024 00:08:23.024 ' 00:08:23.024 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:08:23.024 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:23.024 --rc genhtml_branch_coverage=1 00:08:23.024 --rc genhtml_function_coverage=1 00:08:23.024 --rc genhtml_legend=1 00:08:23.024 --rc geninfo_all_blocks=1 00:08:23.024 --rc geninfo_unexecuted_blocks=1 00:08:23.024 00:08:23.024 ' 00:08:23.024 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@9 -- # source /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh 00:08:23.024 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@7 -- # uname -s 00:08:23.024 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:08:23.024 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:08:23.024 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:08:23.024 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:08:23.024 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:08:23.024 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:08:23.024 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:08:23.024 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:08:23.024 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:08:23.024 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:08:23.024 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:08:23.024 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@18 -- # NVME_HOSTID=3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:08:23.024 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:08:23.024 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:08:23.025 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@21 -- # NET_TYPE=virt 00:08:23.025 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:08:23.025 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@49 -- # source /home/vagrant/spdk_repo/spdk/scripts/common.sh 00:08:23.025 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- scripts/common.sh@15 -- # shopt -s extglob 00:08:23.025 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:08:23.025 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:08:23.025 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:08:23.025 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:23.025 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:23.025 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:23.025 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- paths/export.sh@5 -- # export PATH 00:08:23.025 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:23.025 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@51 -- # : 0 00:08:23.025 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:08:23.025 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:08:23.025 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:08:23.025 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:08:23.025 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:08:23.025 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:08:23.025 /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:08:23.025 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:08:23.025 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:08:23.025 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@55 -- # have_pci_nics=0 00:08:23.025 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@11 -- # MALLOC_BDEV_SIZE=64 00:08:23.025 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:08:23.025 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@13 -- # nqn=nqn.2016-06.io.spdk:cnode1 00:08:23.025 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@15 -- # rpc_py=/home/vagrant/spdk_repo/spdk/scripts/rpc.py 00:08:23.025 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@43 -- # nvmftestinit 00:08:23.025 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:08:23.025 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:08:23.025 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@474 -- # prepare_net_devs 00:08:23.025 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@436 -- # local -g is_hw=no 00:08:23.025 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@438 -- # remove_spdk_ns 00:08:23.025 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:23.025 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:08:23.025 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:23.025 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@440 -- # [[ virt != virt ]] 00:08:23.025 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@442 -- # [[ no == yes ]] 00:08:23.025 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@449 -- # [[ virt == phy ]] 00:08:23.025 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@452 -- # [[ virt == phy-fallback ]] 00:08:23.025 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@457 -- # [[ tcp == tcp ]] 00:08:23.025 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@458 -- # nvmf_veth_init 00:08:23.025 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@145 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:08:23.025 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@146 -- # NVMF_SECOND_INITIATOR_IP=10.0.0.2 00:08:23.025 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@147 -- # NVMF_FIRST_TARGET_IP=10.0.0.3 00:08:23.025 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@148 -- # NVMF_SECOND_TARGET_IP=10.0.0.4 00:08:23.025 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@149 -- # NVMF_INITIATOR_IP=10.0.0.1 00:08:23.025 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@150 -- # NVMF_BRIDGE=nvmf_br 00:08:23.025 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@151 -- # NVMF_INITIATOR_INTERFACE=nvmf_init_if 00:08:23.025 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@152 -- # NVMF_INITIATOR_INTERFACE2=nvmf_init_if2 00:08:23.025 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@153 -- # NVMF_INITIATOR_BRIDGE=nvmf_init_br 00:08:23.025 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@154 -- # NVMF_INITIATOR_BRIDGE2=nvmf_init_br2 00:08:23.025 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@155 -- # NVMF_TARGET_NAMESPACE=nvmf_tgt_ns_spdk 00:08:23.025 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@156 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:08:23.025 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@157 -- # NVMF_TARGET_INTERFACE=nvmf_tgt_if 00:08:23.025 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@158 -- # NVMF_TARGET_INTERFACE2=nvmf_tgt_if2 00:08:23.025 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@159 -- # NVMF_TARGET_BRIDGE=nvmf_tgt_br 00:08:23.025 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@160 -- # NVMF_TARGET_BRIDGE2=nvmf_tgt_br2 00:08:23.025 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@162 -- # ip link set nvmf_init_br nomaster 00:08:23.025 Cannot find device "nvmf_init_br" 00:08:23.025 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@162 -- # true 00:08:23.025 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@163 -- # ip link set nvmf_init_br2 nomaster 00:08:23.025 Cannot find device "nvmf_init_br2" 00:08:23.025 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@163 -- # true 00:08:23.025 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@164 -- # ip link set nvmf_tgt_br nomaster 00:08:23.025 Cannot find device "nvmf_tgt_br" 00:08:23.025 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@164 -- # true 00:08:23.025 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@165 -- # ip link set nvmf_tgt_br2 nomaster 00:08:23.025 Cannot find device "nvmf_tgt_br2" 00:08:23.025 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@165 -- # true 00:08:23.025 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@166 -- # ip link set nvmf_init_br down 00:08:23.025 Cannot find device "nvmf_init_br" 00:08:23.025 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@166 -- # true 00:08:23.025 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@167 -- # ip link set nvmf_init_br2 down 00:08:23.025 Cannot find device "nvmf_init_br2" 00:08:23.025 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@167 -- # true 00:08:23.025 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@168 -- # ip link set nvmf_tgt_br down 00:08:23.283 Cannot find device "nvmf_tgt_br" 00:08:23.283 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@168 -- # true 00:08:23.283 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@169 -- # ip link set nvmf_tgt_br2 down 00:08:23.283 Cannot find device "nvmf_tgt_br2" 00:08:23.283 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@169 -- # true 00:08:23.283 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@170 -- # ip link delete nvmf_br type bridge 00:08:23.283 Cannot find device "nvmf_br" 00:08:23.283 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@170 -- # true 00:08:23.283 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@171 -- # ip link delete nvmf_init_if 00:08:23.283 Cannot find device "nvmf_init_if" 00:08:23.283 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@171 -- # true 00:08:23.283 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@172 -- # ip link delete nvmf_init_if2 00:08:23.283 Cannot find device "nvmf_init_if2" 00:08:23.283 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@172 -- # true 00:08:23.283 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@173 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:08:23.283 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:08:23.283 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@173 -- # true 00:08:23.283 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@174 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:08:23.283 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:08:23.283 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@174 -- # true 00:08:23.283 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@177 -- # ip netns add nvmf_tgt_ns_spdk 00:08:23.283 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@180 -- # ip link add nvmf_init_if type veth peer name nvmf_init_br 00:08:23.284 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@181 -- # ip link add nvmf_init_if2 type veth peer name nvmf_init_br2 00:08:23.284 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@182 -- # ip link add nvmf_tgt_if type veth peer name nvmf_tgt_br 00:08:23.284 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@183 -- # ip link add nvmf_tgt_if2 type veth peer name nvmf_tgt_br2 00:08:23.284 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@186 -- # ip link set nvmf_tgt_if netns nvmf_tgt_ns_spdk 00:08:23.284 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@187 -- # ip link set nvmf_tgt_if2 netns nvmf_tgt_ns_spdk 00:08:23.284 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@190 -- # ip addr add 10.0.0.1/24 dev nvmf_init_if 00:08:23.284 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@191 -- # ip addr add 10.0.0.2/24 dev nvmf_init_if2 00:08:23.284 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@192 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.3/24 dev nvmf_tgt_if 00:08:23.284 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@193 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.4/24 dev nvmf_tgt_if2 00:08:23.284 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@196 -- # ip link set nvmf_init_if up 00:08:23.284 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@197 -- # ip link set nvmf_init_if2 up 00:08:23.284 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@198 -- # ip link set nvmf_init_br up 00:08:23.284 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@199 -- # ip link set nvmf_init_br2 up 00:08:23.284 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@200 -- # ip link set nvmf_tgt_br up 00:08:23.284 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@201 -- # ip link set nvmf_tgt_br2 up 00:08:23.284 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@202 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if up 00:08:23.284 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@203 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if2 up 00:08:23.284 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@204 -- # ip netns exec nvmf_tgt_ns_spdk ip link set lo up 00:08:23.284 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@207 -- # ip link add nvmf_br type bridge 00:08:23.284 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@208 -- # ip link set nvmf_br up 00:08:23.284 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@211 -- # ip link set nvmf_init_br master nvmf_br 00:08:23.284 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@212 -- # ip link set nvmf_init_br2 master nvmf_br 00:08:23.284 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@213 -- # ip link set nvmf_tgt_br master nvmf_br 00:08:23.284 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@214 -- # ip link set nvmf_tgt_br2 master nvmf_br 00:08:23.284 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@217 -- # ipts -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT 00:08:23.284 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT' 00:08:23.284 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@218 -- # ipts -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT 00:08:23.284 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT' 00:08:23.541 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@219 -- # ipts -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT 00:08:23.541 11:19:04 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@788 -- # iptables -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT -m comment --comment 'SPDK_NVMF:-A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT' 00:08:23.541 11:19:05 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@222 -- # ping -c 1 10.0.0.3 00:08:23.541 PING 10.0.0.3 (10.0.0.3) 56(84) bytes of data. 00:08:23.541 64 bytes from 10.0.0.3: icmp_seq=1 ttl=64 time=0.086 ms 00:08:23.541 00:08:23.541 --- 10.0.0.3 ping statistics --- 00:08:23.541 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:23.541 rtt min/avg/max/mdev = 0.086/0.086/0.086/0.000 ms 00:08:23.541 11:19:05 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@223 -- # ping -c 1 10.0.0.4 00:08:23.541 PING 10.0.0.4 (10.0.0.4) 56(84) bytes of data. 00:08:23.541 64 bytes from 10.0.0.4: icmp_seq=1 ttl=64 time=0.095 ms 00:08:23.541 00:08:23.541 --- 10.0.0.4 ping statistics --- 00:08:23.541 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:23.541 rtt min/avg/max/mdev = 0.095/0.095/0.095/0.000 ms 00:08:23.542 11:19:05 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@224 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.1 00:08:23.542 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:08:23.542 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.070 ms 00:08:23.542 00:08:23.542 --- 10.0.0.1 ping statistics --- 00:08:23.542 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:23.542 rtt min/avg/max/mdev = 0.070/0.070/0.070/0.000 ms 00:08:23.542 11:19:05 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@225 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.2 00:08:23.542 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:08:23.542 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.080 ms 00:08:23.542 00:08:23.542 --- 10.0.0.2 ping statistics --- 00:08:23.542 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:23.542 rtt min/avg/max/mdev = 0.080/0.080/0.080/0.000 ms 00:08:23.542 11:19:05 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@227 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:08:23.542 11:19:05 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@459 -- # return 0 00:08:23.542 11:19:05 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:08:23.542 11:19:05 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:08:23.542 11:19:05 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:08:23.542 11:19:05 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:08:23.542 11:19:05 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:08:23.542 11:19:05 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:08:23.542 11:19:05 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:08:23.542 11:19:05 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@45 -- # '[' -z 10.0.0.4 ']' 00:08:23.542 11:19:05 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@51 -- # '[' tcp '!=' tcp ']' 00:08:23.542 11:19:05 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@57 -- # nvmfappstart -m 0xF 00:08:23.542 11:19:05 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:08:23.542 11:19:05 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@724 -- # xtrace_disable 00:08:23.542 11:19:05 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@10 -- # set +x 00:08:23.542 11:19:05 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@507 -- # nvmfpid=68502 00:08:23.542 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:23.542 11:19:05 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@508 -- # waitforlisten 68502 00:08:23.542 11:19:05 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@831 -- # '[' -z 68502 ']' 00:08:23.542 11:19:05 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:23.542 11:19:05 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@836 -- # local max_retries=100 00:08:23.542 11:19:05 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@506 -- # ip netns exec nvmf_tgt_ns_spdk /home/vagrant/spdk_repo/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:08:23.542 11:19:05 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:23.542 11:19:05 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@840 -- # xtrace_disable 00:08:23.542 11:19:05 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@10 -- # set +x 00:08:23.542 [2024-10-07 11:19:05.162047] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:08:23.542 [2024-10-07 11:19:05.162180] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:08:23.798 [2024-10-07 11:19:05.305383] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 4 00:08:23.798 [2024-10-07 11:19:05.476637] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:08:23.798 [2024-10-07 11:19:05.476760] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:08:23.798 [2024-10-07 11:19:05.476775] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:08:23.798 [2024-10-07 11:19:05.476786] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:08:23.798 [2024-10-07 11:19:05.476795] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:08:23.798 [2024-10-07 11:19:05.478561] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:08:23.798 [2024-10-07 11:19:05.478652] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:08:23.798 [2024-10-07 11:19:05.478801] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 3 00:08:23.798 [2024-10-07 11:19:05.478807] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:08:24.731 11:19:06 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:08:24.731 11:19:06 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@864 -- # return 0 00:08:24.731 11:19:06 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:08:24.731 11:19:06 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@730 -- # xtrace_disable 00:08:24.731 11:19:06 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@10 -- # set +x 00:08:24.731 11:19:06 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:08:24.731 11:19:06 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@59 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:08:24.988 [2024-10-07 11:19:06.555590] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:08:24.988 11:19:06 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@61 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc0 00:08:25.246 Malloc0 00:08:25.246 11:19:06 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@62 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME -r 00:08:25.505 11:19:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@63 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:08:25.763 11:19:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@64 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4420 00:08:26.023 [2024-10-07 11:19:07.654558] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:08:26.023 11:19:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@65 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.4 -s 4420 00:08:26.282 [2024-10-07 11:19:07.926796] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.4 port 4420 *** 00:08:26.282 11:19:07 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@67 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --hostid=3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.3 -s 4420 -g -G 00:08:26.540 11:19:08 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@68 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --hostid=3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.4 -s 4420 -g -G 00:08:26.797 11:19:08 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@69 -- # waitforserial SPDKISFASTANDAWESOME 00:08:26.797 11:19:08 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@1198 -- # local i=0 00:08:26.797 11:19:08 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@1199 -- # local nvme_device_counter=1 nvme_devices=0 00:08:26.797 11:19:08 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@1200 -- # [[ -n '' ]] 00:08:26.797 11:19:08 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@1205 -- # sleep 2 00:08:28.695 11:19:10 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@1206 -- # (( i++ <= 15 )) 00:08:28.695 11:19:10 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@1207 -- # lsblk -l -o NAME,SERIAL 00:08:28.695 11:19:10 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@1207 -- # grep -c SPDKISFASTANDAWESOME 00:08:28.956 11:19:10 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@1207 -- # nvme_devices=1 00:08:28.956 11:19:10 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@1208 -- # (( nvme_devices == nvme_device_counter )) 00:08:28.956 11:19:10 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@1208 -- # return 0 00:08:28.956 11:19:10 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@72 -- # get_subsystem nqn.2016-06.io.spdk:cnode1 SPDKISFASTANDAWESOME 00:08:28.956 11:19:10 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@34 -- # local nqn=nqn.2016-06.io.spdk:cnode1 serial=SPDKISFASTANDAWESOME s 00:08:28.956 11:19:10 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@36 -- # for s in /sys/class/nvme-subsystem/* 00:08:28.956 11:19:10 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@37 -- # [[ nqn.2016-06.io.spdk:cnode1 == \n\q\n\.\2\0\1\6\-\0\6\.\i\o\.\s\p\d\k\:\c\n\o\d\e\1 ]] 00:08:28.956 11:19:10 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@37 -- # [[ SPDKISFASTANDAWESOME == \S\P\D\K\I\S\F\A\S\T\A\N\D\A\W\E\S\O\M\E ]] 00:08:28.956 11:19:10 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@38 -- # echo nvme-subsys0 00:08:28.956 11:19:10 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@38 -- # return 0 00:08:28.956 11:19:10 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@72 -- # subsystem=nvme-subsys0 00:08:28.956 11:19:10 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@73 -- # paths=(/sys/class/nvme-subsystem/$subsystem/nvme*/nvme*c*) 00:08:28.956 11:19:10 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@74 -- # paths=("${paths[@]##*/}") 00:08:28.956 11:19:10 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@76 -- # (( 2 == 2 )) 00:08:28.956 11:19:10 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@78 -- # p0=nvme0c0n1 00:08:28.956 11:19:10 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@79 -- # p1=nvme0c1n1 00:08:28.956 11:19:10 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@81 -- # check_ana_state nvme0c0n1 optimized 00:08:28.956 11:19:10 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@18 -- # local path=nvme0c0n1 ana_state=optimized 00:08:28.956 11:19:10 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@22 -- # local timeout=20 00:08:28.956 11:19:10 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@23 -- # local ana_state_f=/sys/block/nvme0c0n1/ana_state 00:08:28.956 11:19:10 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@25 -- # [[ ! -e /sys/block/nvme0c0n1/ana_state ]] 00:08:28.956 11:19:10 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@25 -- # [[ optimized != \o\p\t\i\m\i\z\e\d ]] 00:08:28.956 11:19:10 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@82 -- # check_ana_state nvme0c1n1 optimized 00:08:28.956 11:19:10 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@18 -- # local path=nvme0c1n1 ana_state=optimized 00:08:28.956 11:19:10 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@22 -- # local timeout=20 00:08:28.956 11:19:10 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@23 -- # local ana_state_f=/sys/block/nvme0c1n1/ana_state 00:08:28.956 11:19:10 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@25 -- # [[ ! -e /sys/block/nvme0c1n1/ana_state ]] 00:08:28.956 11:19:10 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@25 -- # [[ optimized != \o\p\t\i\m\i\z\e\d ]] 00:08:28.956 11:19:10 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@85 -- # echo numa 00:08:28.956 11:19:10 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@88 -- # fio_pid=68647 00:08:28.956 11:19:10 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@87 -- # /home/vagrant/spdk_repo/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 128 -t randrw -r 6 -v 00:08:28.956 11:19:10 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@90 -- # sleep 1 00:08:28.956 [global] 00:08:28.956 thread=1 00:08:28.956 invalidate=1 00:08:28.956 rw=randrw 00:08:28.956 time_based=1 00:08:28.956 runtime=6 00:08:28.956 ioengine=libaio 00:08:28.956 direct=1 00:08:28.957 bs=4096 00:08:28.957 iodepth=128 00:08:28.957 norandommap=0 00:08:28.957 numjobs=1 00:08:28.957 00:08:28.957 verify_dump=1 00:08:28.957 verify_backlog=512 00:08:28.957 verify_state_save=0 00:08:28.957 do_verify=1 00:08:28.957 verify=crc32c-intel 00:08:28.957 [job0] 00:08:28.957 filename=/dev/nvme0n1 00:08:28.957 Could not set queue depth (nvme0n1) 00:08:28.957 job0: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:08:28.957 fio-3.35 00:08:28.957 Starting 1 thread 00:08:29.892 11:19:11 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@92 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_listener_set_ana_state nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4420 -n inaccessible 00:08:30.150 11:19:11 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@93 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_listener_set_ana_state nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.4 -s 4420 -n non_optimized 00:08:30.714 11:19:12 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@95 -- # check_ana_state nvme0c0n1 inaccessible 00:08:30.714 11:19:12 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@18 -- # local path=nvme0c0n1 ana_state=inaccessible 00:08:30.714 11:19:12 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@22 -- # local timeout=20 00:08:30.714 11:19:12 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@23 -- # local ana_state_f=/sys/block/nvme0c0n1/ana_state 00:08:30.714 11:19:12 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@25 -- # [[ ! -e /sys/block/nvme0c0n1/ana_state ]] 00:08:30.714 11:19:12 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@25 -- # [[ inaccessible != \i\n\a\c\c\e\s\s\i\b\l\e ]] 00:08:30.714 11:19:12 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@96 -- # check_ana_state nvme0c1n1 non-optimized 00:08:30.714 11:19:12 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@18 -- # local path=nvme0c1n1 ana_state=non-optimized 00:08:30.714 11:19:12 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@22 -- # local timeout=20 00:08:30.714 11:19:12 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@23 -- # local ana_state_f=/sys/block/nvme0c1n1/ana_state 00:08:30.714 11:19:12 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@25 -- # [[ ! -e /sys/block/nvme0c1n1/ana_state ]] 00:08:30.714 11:19:12 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@25 -- # [[ optimized != \n\o\n\-\o\p\t\i\m\i\z\e\d ]] 00:08:30.714 11:19:12 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@25 -- # sleep 1s 00:08:31.646 11:19:13 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@26 -- # (( timeout-- == 0 )) 00:08:31.646 11:19:13 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@25 -- # [[ ! -e /sys/block/nvme0c1n1/ana_state ]] 00:08:31.646 11:19:13 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@25 -- # [[ non-optimized != \n\o\n\-\o\p\t\i\m\i\z\e\d ]] 00:08:31.646 11:19:13 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@98 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_listener_set_ana_state nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4420 -n non_optimized 00:08:31.903 11:19:13 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@99 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_listener_set_ana_state nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.4 -s 4420 -n inaccessible 00:08:32.198 11:19:13 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@101 -- # check_ana_state nvme0c0n1 non-optimized 00:08:32.198 11:19:13 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@18 -- # local path=nvme0c0n1 ana_state=non-optimized 00:08:32.198 11:19:13 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@22 -- # local timeout=20 00:08:32.198 11:19:13 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@23 -- # local ana_state_f=/sys/block/nvme0c0n1/ana_state 00:08:32.198 11:19:13 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@25 -- # [[ ! -e /sys/block/nvme0c0n1/ana_state ]] 00:08:32.198 11:19:13 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@25 -- # [[ non-optimized != \n\o\n\-\o\p\t\i\m\i\z\e\d ]] 00:08:32.198 11:19:13 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@102 -- # check_ana_state nvme0c1n1 inaccessible 00:08:32.198 11:19:13 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@18 -- # local path=nvme0c1n1 ana_state=inaccessible 00:08:32.198 11:19:13 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@22 -- # local timeout=20 00:08:32.198 11:19:13 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@23 -- # local ana_state_f=/sys/block/nvme0c1n1/ana_state 00:08:32.198 11:19:13 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@25 -- # [[ ! -e /sys/block/nvme0c1n1/ana_state ]] 00:08:32.198 11:19:13 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@25 -- # [[ non-optimized != \i\n\a\c\c\e\s\s\i\b\l\e ]] 00:08:32.198 11:19:13 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@25 -- # sleep 1s 00:08:33.180 11:19:14 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@26 -- # (( timeout-- == 0 )) 00:08:33.180 11:19:14 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@25 -- # [[ ! -e /sys/block/nvme0c1n1/ana_state ]] 00:08:33.180 11:19:14 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@25 -- # [[ inaccessible != \i\n\a\c\c\e\s\s\i\b\l\e ]] 00:08:33.180 11:19:14 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@104 -- # wait 68647 00:08:35.081 00:08:35.081 job0: (groupid=0, jobs=1): err= 0: pid=68668: Mon Oct 7 11:19:16 2024 00:08:35.081 read: IOPS=10.4k, BW=40.8MiB/s (42.8MB/s)(245MiB/6007msec) 00:08:35.081 slat (usec): min=2, max=7501, avg=55.33, stdev=256.25 00:08:35.081 clat (usec): min=1427, max=17705, avg=8371.55, stdev=1363.60 00:08:35.081 lat (usec): min=1458, max=17747, avg=8426.87, stdev=1374.41 00:08:35.081 clat percentiles (usec): 00:08:35.081 | 1.00th=[ 5014], 5.00th=[ 6325], 10.00th=[ 7046], 20.00th=[ 7504], 00:08:35.081 | 30.00th=[ 7767], 40.00th=[ 7963], 50.00th=[ 8225], 60.00th=[ 8455], 00:08:35.081 | 70.00th=[ 8848], 80.00th=[ 9241], 90.00th=[ 9896], 95.00th=[10814], 00:08:35.081 | 99.00th=[12518], 99.50th=[12911], 99.90th=[16581], 99.95th=[17171], 00:08:35.081 | 99.99th=[17433] 00:08:35.081 bw ( KiB/s): min=12112, max=25504, per=52.98%, avg=22129.45, stdev=4692.64, samples=11 00:08:35.081 iops : min= 3028, max= 6376, avg=5532.36, stdev=1173.16, samples=11 00:08:35.081 write: IOPS=6015, BW=23.5MiB/s (24.6MB/s)(130MiB/5525msec); 0 zone resets 00:08:35.081 slat (usec): min=4, max=8012, avg=65.88, stdev=180.02 00:08:35.081 clat (usec): min=1088, max=16887, avg=7125.58, stdev=1114.88 00:08:35.081 lat (usec): min=1372, max=16946, avg=7191.46, stdev=1119.47 00:08:35.081 clat percentiles (usec): 00:08:35.081 | 1.00th=[ 3884], 5.00th=[ 5080], 10.00th=[ 5997], 20.00th=[ 6456], 00:08:35.081 | 30.00th=[ 6783], 40.00th=[ 6980], 50.00th=[ 7177], 60.00th=[ 7373], 00:08:35.081 | 70.00th=[ 7570], 80.00th=[ 7832], 90.00th=[ 8160], 95.00th=[ 8455], 00:08:35.081 | 99.00th=[10683], 99.50th=[11469], 99.90th=[13435], 99.95th=[13960], 00:08:35.081 | 99.99th=[16909] 00:08:35.081 bw ( KiB/s): min=12240, max=25104, per=91.98%, avg=22130.18, stdev=4529.39, samples=11 00:08:35.081 iops : min= 3060, max= 6276, avg=5532.55, stdev=1132.35, samples=11 00:08:35.081 lat (msec) : 2=0.02%, 4=0.53%, 10=93.32%, 20=6.13% 00:08:35.081 cpu : usr=5.84%, sys=21.71%, ctx=6093, majf=0, minf=54 00:08:35.081 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.2%, >=64=99.7% 00:08:35.081 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:08:35.081 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:08:35.081 issued rwts: total=62729,33233,0,0 short=0,0,0,0 dropped=0,0,0,0 00:08:35.081 latency : target=0, window=0, percentile=100.00%, depth=128 00:08:35.081 00:08:35.081 Run status group 0 (all jobs): 00:08:35.081 READ: bw=40.8MiB/s (42.8MB/s), 40.8MiB/s-40.8MiB/s (42.8MB/s-42.8MB/s), io=245MiB (257MB), run=6007-6007msec 00:08:35.081 WRITE: bw=23.5MiB/s (24.6MB/s), 23.5MiB/s-23.5MiB/s (24.6MB/s-24.6MB/s), io=130MiB (136MB), run=5525-5525msec 00:08:35.081 00:08:35.081 Disk stats (read/write): 00:08:35.081 nvme0n1: ios=61816/32651, merge=0/0, ticks=483133/216615, in_queue=699748, util=98.46% 00:08:35.081 11:19:16 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@106 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_listener_set_ana_state nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4420 -n optimized 00:08:35.647 11:19:17 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@107 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_listener_set_ana_state nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.4 -s 4420 -n optimized 00:08:35.905 11:19:17 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@109 -- # check_ana_state nvme0c0n1 optimized 00:08:35.905 11:19:17 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@18 -- # local path=nvme0c0n1 ana_state=optimized 00:08:35.905 11:19:17 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@22 -- # local timeout=20 00:08:35.905 11:19:17 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@23 -- # local ana_state_f=/sys/block/nvme0c0n1/ana_state 00:08:35.905 11:19:17 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@25 -- # [[ ! -e /sys/block/nvme0c0n1/ana_state ]] 00:08:35.905 11:19:17 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@25 -- # [[ optimized != \o\p\t\i\m\i\z\e\d ]] 00:08:35.905 11:19:17 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@110 -- # check_ana_state nvme0c1n1 optimized 00:08:35.905 11:19:17 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@18 -- # local path=nvme0c1n1 ana_state=optimized 00:08:35.905 11:19:17 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@22 -- # local timeout=20 00:08:35.905 11:19:17 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@23 -- # local ana_state_f=/sys/block/nvme0c1n1/ana_state 00:08:35.905 11:19:17 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@25 -- # [[ ! -e /sys/block/nvme0c1n1/ana_state ]] 00:08:35.905 11:19:17 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@25 -- # [[ inaccessible != \o\p\t\i\m\i\z\e\d ]] 00:08:35.905 11:19:17 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@25 -- # sleep 1s 00:08:36.842 11:19:18 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@26 -- # (( timeout-- == 0 )) 00:08:36.842 11:19:18 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@25 -- # [[ ! -e /sys/block/nvme0c1n1/ana_state ]] 00:08:36.842 11:19:18 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@25 -- # [[ optimized != \o\p\t\i\m\i\z\e\d ]] 00:08:36.842 11:19:18 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@113 -- # echo round-robin 00:08:36.842 11:19:18 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@116 -- # fio_pid=68802 00:08:36.842 11:19:18 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@118 -- # sleep 1 00:08:36.842 11:19:18 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@115 -- # /home/vagrant/spdk_repo/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 128 -t randrw -r 6 -v 00:08:36.842 [global] 00:08:36.842 thread=1 00:08:36.842 invalidate=1 00:08:36.842 rw=randrw 00:08:36.842 time_based=1 00:08:36.842 runtime=6 00:08:36.842 ioengine=libaio 00:08:36.842 direct=1 00:08:36.842 bs=4096 00:08:36.842 iodepth=128 00:08:36.842 norandommap=0 00:08:36.842 numjobs=1 00:08:36.842 00:08:36.842 verify_dump=1 00:08:36.842 verify_backlog=512 00:08:36.842 verify_state_save=0 00:08:36.842 do_verify=1 00:08:36.842 verify=crc32c-intel 00:08:36.842 [job0] 00:08:36.842 filename=/dev/nvme0n1 00:08:36.842 Could not set queue depth (nvme0n1) 00:08:37.100 job0: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:08:37.100 fio-3.35 00:08:37.100 Starting 1 thread 00:08:38.035 11:19:19 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@120 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_listener_set_ana_state nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4420 -n inaccessible 00:08:38.293 11:19:19 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@121 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_listener_set_ana_state nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.4 -s 4420 -n non_optimized 00:08:38.551 11:19:20 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@123 -- # check_ana_state nvme0c0n1 inaccessible 00:08:38.551 11:19:20 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@18 -- # local path=nvme0c0n1 ana_state=inaccessible 00:08:38.551 11:19:20 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@22 -- # local timeout=20 00:08:38.551 11:19:20 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@23 -- # local ana_state_f=/sys/block/nvme0c0n1/ana_state 00:08:38.551 11:19:20 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@25 -- # [[ ! -e /sys/block/nvme0c0n1/ana_state ]] 00:08:38.551 11:19:20 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@25 -- # [[ inaccessible != \i\n\a\c\c\e\s\s\i\b\l\e ]] 00:08:38.551 11:19:20 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@124 -- # check_ana_state nvme0c1n1 non-optimized 00:08:38.551 11:19:20 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@18 -- # local path=nvme0c1n1 ana_state=non-optimized 00:08:38.551 11:19:20 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@22 -- # local timeout=20 00:08:38.551 11:19:20 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@23 -- # local ana_state_f=/sys/block/nvme0c1n1/ana_state 00:08:38.551 11:19:20 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@25 -- # [[ ! -e /sys/block/nvme0c1n1/ana_state ]] 00:08:38.551 11:19:20 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@25 -- # [[ optimized != \n\o\n\-\o\p\t\i\m\i\z\e\d ]] 00:08:38.551 11:19:20 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@25 -- # sleep 1s 00:08:39.573 11:19:21 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@26 -- # (( timeout-- == 0 )) 00:08:39.573 11:19:21 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@25 -- # [[ ! -e /sys/block/nvme0c1n1/ana_state ]] 00:08:39.573 11:19:21 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@25 -- # [[ non-optimized != \n\o\n\-\o\p\t\i\m\i\z\e\d ]] 00:08:39.573 11:19:21 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@126 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_listener_set_ana_state nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4420 -n non_optimized 00:08:39.833 11:19:21 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@127 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_listener_set_ana_state nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.4 -s 4420 -n inaccessible 00:08:40.092 11:19:21 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@129 -- # check_ana_state nvme0c0n1 non-optimized 00:08:40.092 11:19:21 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@18 -- # local path=nvme0c0n1 ana_state=non-optimized 00:08:40.092 11:19:21 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@22 -- # local timeout=20 00:08:40.092 11:19:21 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@23 -- # local ana_state_f=/sys/block/nvme0c0n1/ana_state 00:08:40.092 11:19:21 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@25 -- # [[ ! -e /sys/block/nvme0c0n1/ana_state ]] 00:08:40.092 11:19:21 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@25 -- # [[ non-optimized != \n\o\n\-\o\p\t\i\m\i\z\e\d ]] 00:08:40.092 11:19:21 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@130 -- # check_ana_state nvme0c1n1 inaccessible 00:08:40.092 11:19:21 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@18 -- # local path=nvme0c1n1 ana_state=inaccessible 00:08:40.092 11:19:21 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@22 -- # local timeout=20 00:08:40.092 11:19:21 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@23 -- # local ana_state_f=/sys/block/nvme0c1n1/ana_state 00:08:40.092 11:19:21 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@25 -- # [[ ! -e /sys/block/nvme0c1n1/ana_state ]] 00:08:40.092 11:19:21 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@25 -- # [[ non-optimized != \i\n\a\c\c\e\s\s\i\b\l\e ]] 00:08:40.092 11:19:21 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@25 -- # sleep 1s 00:08:41.026 11:19:22 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@26 -- # (( timeout-- == 0 )) 00:08:41.026 11:19:22 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@25 -- # [[ ! -e /sys/block/nvme0c1n1/ana_state ]] 00:08:41.026 11:19:22 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@25 -- # [[ inaccessible != \i\n\a\c\c\e\s\s\i\b\l\e ]] 00:08:41.026 11:19:22 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@132 -- # wait 68802 00:08:43.558 00:08:43.558 job0: (groupid=0, jobs=1): err= 0: pid=68823: Mon Oct 7 11:19:24 2024 00:08:43.558 read: IOPS=11.5k, BW=45.0MiB/s (47.1MB/s)(270MiB/6003msec) 00:08:43.558 slat (usec): min=2, max=8756, avg=43.44, stdev=221.62 00:08:43.558 clat (usec): min=448, max=16643, avg=7649.96, stdev=2059.45 00:08:43.558 lat (usec): min=475, max=16660, avg=7693.40, stdev=2076.48 00:08:43.558 clat percentiles (usec): 00:08:43.558 | 1.00th=[ 2040], 5.00th=[ 3130], 10.00th=[ 4228], 20.00th=[ 6652], 00:08:43.558 | 30.00th=[ 7504], 40.00th=[ 7767], 50.00th=[ 7963], 60.00th=[ 8225], 00:08:43.558 | 70.00th=[ 8586], 80.00th=[ 9110], 90.00th=[ 9634], 95.00th=[10290], 00:08:43.558 | 99.00th=[12125], 99.50th=[12649], 99.90th=[13960], 99.95th=[14222], 00:08:43.558 | 99.99th=[14484] 00:08:43.558 bw ( KiB/s): min= 7696, max=38320, per=53.24%, avg=24514.91, stdev=10355.54, samples=11 00:08:43.558 iops : min= 1924, max= 9580, avg=6128.73, stdev=2588.88, samples=11 00:08:43.558 write: IOPS=7085, BW=27.7MiB/s (29.0MB/s)(144MiB/5201msec); 0 zone resets 00:08:43.558 slat (usec): min=4, max=5071, avg=52.76, stdev=150.01 00:08:43.558 clat (usec): min=265, max=13930, avg=6336.65, stdev=1874.59 00:08:43.558 lat (usec): min=294, max=14199, avg=6389.41, stdev=1889.22 00:08:43.558 clat percentiles (usec): 00:08:43.558 | 1.00th=[ 1893], 5.00th=[ 2573], 10.00th=[ 3032], 20.00th=[ 4817], 00:08:43.558 | 30.00th=[ 5997], 40.00th=[ 6587], 50.00th=[ 6915], 60.00th=[ 7177], 00:08:43.558 | 70.00th=[ 7439], 80.00th=[ 7701], 90.00th=[ 8094], 95.00th=[ 8455], 00:08:43.558 | 99.00th=[ 9765], 99.50th=[10945], 99.90th=[12518], 99.95th=[13042], 00:08:43.558 | 99.99th=[13829] 00:08:43.558 bw ( KiB/s): min= 8176, max=37608, per=86.63%, avg=24554.91, stdev=10089.07, samples=11 00:08:43.558 iops : min= 2044, max= 9402, avg=6138.73, stdev=2522.27, samples=11 00:08:43.558 lat (usec) : 500=0.01%, 750=0.02%, 1000=0.04% 00:08:43.558 lat (msec) : 2=0.99%, 4=10.52%, 10=83.83%, 20=4.60% 00:08:43.558 cpu : usr=5.96%, sys=21.69%, ctx=6945, majf=0, minf=127 00:08:43.558 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.2%, >=64=99.7% 00:08:43.558 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:08:43.558 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:08:43.558 issued rwts: total=69103,36853,0,0 short=0,0,0,0 dropped=0,0,0,0 00:08:43.558 latency : target=0, window=0, percentile=100.00%, depth=128 00:08:43.558 00:08:43.558 Run status group 0 (all jobs): 00:08:43.558 READ: bw=45.0MiB/s (47.1MB/s), 45.0MiB/s-45.0MiB/s (47.1MB/s-47.1MB/s), io=270MiB (283MB), run=6003-6003msec 00:08:43.558 WRITE: bw=27.7MiB/s (29.0MB/s), 27.7MiB/s-27.7MiB/s (29.0MB/s-29.0MB/s), io=144MiB (151MB), run=5201-5201msec 00:08:43.558 00:08:43.558 Disk stats (read/write): 00:08:43.558 nvme0n1: ios=68132/36341, merge=0/0, ticks=489830/215229, in_queue=705059, util=98.56% 00:08:43.558 11:19:24 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@134 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:08:43.558 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 2 controller(s) 00:08:43.558 11:19:24 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@135 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:08:43.558 11:19:24 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@1219 -- # local i=0 00:08:43.558 11:19:24 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@1220 -- # lsblk -o NAME,SERIAL 00:08:43.558 11:19:24 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@1220 -- # grep -q -w SPDKISFASTANDAWESOME 00:08:43.558 11:19:24 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@1227 -- # lsblk -l -o NAME,SERIAL 00:08:43.558 11:19:24 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@1227 -- # grep -q -w SPDKISFASTANDAWESOME 00:08:43.558 11:19:24 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@1231 -- # return 0 00:08:43.558 11:19:24 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@137 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:08:43.558 11:19:25 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@139 -- # rm -f ./local-job0-0-verify.state 00:08:43.558 11:19:25 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@140 -- # rm -f ./local-job1-1-verify.state 00:08:43.558 11:19:25 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@142 -- # trap - SIGINT SIGTERM EXIT 00:08:43.558 11:19:25 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- target/multipath.sh@144 -- # nvmftestfini 00:08:43.558 11:19:25 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@514 -- # nvmfcleanup 00:08:43.558 11:19:25 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@121 -- # sync 00:08:43.558 11:19:25 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:08:43.558 11:19:25 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@124 -- # set +e 00:08:43.558 11:19:25 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@125 -- # for i in {1..20} 00:08:43.558 11:19:25 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:08:43.558 rmmod nvme_tcp 00:08:43.558 rmmod nvme_fabrics 00:08:43.558 rmmod nvme_keyring 00:08:43.558 11:19:25 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:08:43.817 11:19:25 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@128 -- # set -e 00:08:43.817 11:19:25 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@129 -- # return 0 00:08:43.817 11:19:25 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@515 -- # '[' -n 68502 ']' 00:08:43.817 11:19:25 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@516 -- # killprocess 68502 00:08:43.817 11:19:25 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@950 -- # '[' -z 68502 ']' 00:08:43.817 11:19:25 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@954 -- # kill -0 68502 00:08:43.817 11:19:25 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@955 -- # uname 00:08:43.817 11:19:25 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:08:43.817 11:19:25 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 68502 00:08:43.817 killing process with pid 68502 00:08:43.817 11:19:25 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:08:43.817 11:19:25 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:08:43.817 11:19:25 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@968 -- # echo 'killing process with pid 68502' 00:08:43.817 11:19:25 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@969 -- # kill 68502 00:08:43.817 11:19:25 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@974 -- # wait 68502 00:08:44.075 11:19:25 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:08:44.075 11:19:25 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:08:44.075 11:19:25 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:08:44.075 11:19:25 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@297 -- # iptr 00:08:44.075 11:19:25 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@789 -- # iptables-save 00:08:44.075 11:19:25 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:08:44.075 11:19:25 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@789 -- # iptables-restore 00:08:44.075 11:19:25 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@298 -- # [[ nvmf_tgt_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:08:44.075 11:19:25 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@299 -- # nvmf_veth_fini 00:08:44.075 11:19:25 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@233 -- # ip link set nvmf_init_br nomaster 00:08:44.075 11:19:25 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@234 -- # ip link set nvmf_init_br2 nomaster 00:08:44.075 11:19:25 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@235 -- # ip link set nvmf_tgt_br nomaster 00:08:44.075 11:19:25 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@236 -- # ip link set nvmf_tgt_br2 nomaster 00:08:44.075 11:19:25 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@237 -- # ip link set nvmf_init_br down 00:08:44.075 11:19:25 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@238 -- # ip link set nvmf_init_br2 down 00:08:44.075 11:19:25 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@239 -- # ip link set nvmf_tgt_br down 00:08:44.075 11:19:25 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@240 -- # ip link set nvmf_tgt_br2 down 00:08:44.075 11:19:25 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@241 -- # ip link delete nvmf_br type bridge 00:08:44.332 11:19:25 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@242 -- # ip link delete nvmf_init_if 00:08:44.332 11:19:25 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@243 -- # ip link delete nvmf_init_if2 00:08:44.332 11:19:25 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@244 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:08:44.332 11:19:25 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@245 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:08:44.332 11:19:25 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@246 -- # remove_spdk_ns 00:08:44.332 11:19:25 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:44.333 11:19:25 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:08:44.333 11:19:25 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:44.333 11:19:25 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- nvmf/common.sh@300 -- # return 0 00:08:44.333 ************************************ 00:08:44.333 END TEST nvmf_target_multipath 00:08:44.333 ************************************ 00:08:44.333 00:08:44.333 real 0m21.479s 00:08:44.333 user 1m23.125s 00:08:44.333 sys 0m6.621s 00:08:44.333 11:19:25 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@1126 -- # xtrace_disable 00:08:44.333 11:19:25 nvmf_tcp.nvmf_target_core.nvmf_target_multipath -- common/autotest_common.sh@10 -- # set +x 00:08:44.333 11:19:25 nvmf_tcp.nvmf_target_core -- nvmf/nvmf_target_core.sh@32 -- # run_test nvmf_zcopy /home/vagrant/spdk_repo/spdk/test/nvmf/target/zcopy.sh --transport=tcp 00:08:44.333 11:19:25 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:08:44.333 11:19:25 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1107 -- # xtrace_disable 00:08:44.333 11:19:25 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@10 -- # set +x 00:08:44.333 ************************************ 00:08:44.333 START TEST nvmf_zcopy 00:08:44.333 ************************************ 00:08:44.333 11:19:25 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/nvmf/target/zcopy.sh --transport=tcp 00:08:44.591 * Looking for test storage... 00:08:44.591 * Found test storage at /home/vagrant/spdk_repo/spdk/test/nvmf/target 00:08:44.591 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:08:44.591 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@1681 -- # lcov --version 00:08:44.591 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:08:44.591 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:08:44.591 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:08:44.591 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- scripts/common.sh@333 -- # local ver1 ver1_l 00:08:44.591 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- scripts/common.sh@334 -- # local ver2 ver2_l 00:08:44.591 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- scripts/common.sh@336 -- # IFS=.-: 00:08:44.591 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- scripts/common.sh@336 -- # read -ra ver1 00:08:44.591 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- scripts/common.sh@337 -- # IFS=.-: 00:08:44.591 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- scripts/common.sh@337 -- # read -ra ver2 00:08:44.591 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- scripts/common.sh@338 -- # local 'op=<' 00:08:44.591 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- scripts/common.sh@340 -- # ver1_l=2 00:08:44.591 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- scripts/common.sh@341 -- # ver2_l=1 00:08:44.591 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:08:44.591 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- scripts/common.sh@344 -- # case "$op" in 00:08:44.591 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- scripts/common.sh@345 -- # : 1 00:08:44.591 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- scripts/common.sh@364 -- # (( v = 0 )) 00:08:44.591 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:08:44.591 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- scripts/common.sh@365 -- # decimal 1 00:08:44.591 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- scripts/common.sh@353 -- # local d=1 00:08:44.591 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:08:44.591 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- scripts/common.sh@355 -- # echo 1 00:08:44.591 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- scripts/common.sh@365 -- # ver1[v]=1 00:08:44.591 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- scripts/common.sh@366 -- # decimal 2 00:08:44.591 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- scripts/common.sh@353 -- # local d=2 00:08:44.591 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:08:44.591 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- scripts/common.sh@355 -- # echo 2 00:08:44.591 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- scripts/common.sh@366 -- # ver2[v]=2 00:08:44.591 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:08:44.591 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:08:44.591 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- scripts/common.sh@368 -- # return 0 00:08:44.591 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:08:44.591 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:08:44.591 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:44.591 --rc genhtml_branch_coverage=1 00:08:44.591 --rc genhtml_function_coverage=1 00:08:44.591 --rc genhtml_legend=1 00:08:44.591 --rc geninfo_all_blocks=1 00:08:44.591 --rc geninfo_unexecuted_blocks=1 00:08:44.591 00:08:44.591 ' 00:08:44.591 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:08:44.591 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:44.591 --rc genhtml_branch_coverage=1 00:08:44.591 --rc genhtml_function_coverage=1 00:08:44.591 --rc genhtml_legend=1 00:08:44.591 --rc geninfo_all_blocks=1 00:08:44.591 --rc geninfo_unexecuted_blocks=1 00:08:44.591 00:08:44.591 ' 00:08:44.591 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:08:44.591 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:44.591 --rc genhtml_branch_coverage=1 00:08:44.591 --rc genhtml_function_coverage=1 00:08:44.591 --rc genhtml_legend=1 00:08:44.591 --rc geninfo_all_blocks=1 00:08:44.591 --rc geninfo_unexecuted_blocks=1 00:08:44.591 00:08:44.591 ' 00:08:44.591 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:08:44.591 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:44.591 --rc genhtml_branch_coverage=1 00:08:44.591 --rc genhtml_function_coverage=1 00:08:44.592 --rc genhtml_legend=1 00:08:44.592 --rc geninfo_all_blocks=1 00:08:44.592 --rc geninfo_unexecuted_blocks=1 00:08:44.592 00:08:44.592 ' 00:08:44.592 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- target/zcopy.sh@10 -- # source /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh 00:08:44.592 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@7 -- # uname -s 00:08:44.592 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:08:44.592 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:08:44.592 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:08:44.592 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:08:44.592 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:08:44.592 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:08:44.592 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:08:44.592 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:08:44.592 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:08:44.592 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:08:44.592 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:08:44.592 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@18 -- # NVME_HOSTID=3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:08:44.592 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:08:44.592 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:08:44.592 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@21 -- # NET_TYPE=virt 00:08:44.592 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:08:44.592 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@49 -- # source /home/vagrant/spdk_repo/spdk/scripts/common.sh 00:08:44.592 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- scripts/common.sh@15 -- # shopt -s extglob 00:08:44.592 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:08:44.592 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:08:44.592 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:08:44.592 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:44.592 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:44.592 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:44.592 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- paths/export.sh@5 -- # export PATH 00:08:44.592 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:44.592 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@51 -- # : 0 00:08:44.592 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:08:44.592 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:08:44.592 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:08:44.592 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:08:44.592 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:08:44.592 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:08:44.592 /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:08:44.592 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:08:44.592 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:08:44.592 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@55 -- # have_pci_nics=0 00:08:44.592 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- target/zcopy.sh@12 -- # nvmftestinit 00:08:44.592 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:08:44.592 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:08:44.592 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@474 -- # prepare_net_devs 00:08:44.592 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@436 -- # local -g is_hw=no 00:08:44.592 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@438 -- # remove_spdk_ns 00:08:44.592 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:44.592 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:08:44.592 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:44.592 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@440 -- # [[ virt != virt ]] 00:08:44.592 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@442 -- # [[ no == yes ]] 00:08:44.592 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@449 -- # [[ virt == phy ]] 00:08:44.592 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@452 -- # [[ virt == phy-fallback ]] 00:08:44.592 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@457 -- # [[ tcp == tcp ]] 00:08:44.592 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@458 -- # nvmf_veth_init 00:08:44.592 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@145 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:08:44.592 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@146 -- # NVMF_SECOND_INITIATOR_IP=10.0.0.2 00:08:44.592 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@147 -- # NVMF_FIRST_TARGET_IP=10.0.0.3 00:08:44.592 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@148 -- # NVMF_SECOND_TARGET_IP=10.0.0.4 00:08:44.592 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@149 -- # NVMF_INITIATOR_IP=10.0.0.1 00:08:44.592 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@150 -- # NVMF_BRIDGE=nvmf_br 00:08:44.592 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@151 -- # NVMF_INITIATOR_INTERFACE=nvmf_init_if 00:08:44.592 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@152 -- # NVMF_INITIATOR_INTERFACE2=nvmf_init_if2 00:08:44.592 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@153 -- # NVMF_INITIATOR_BRIDGE=nvmf_init_br 00:08:44.592 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@154 -- # NVMF_INITIATOR_BRIDGE2=nvmf_init_br2 00:08:44.592 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@155 -- # NVMF_TARGET_NAMESPACE=nvmf_tgt_ns_spdk 00:08:44.592 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@156 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:08:44.592 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@157 -- # NVMF_TARGET_INTERFACE=nvmf_tgt_if 00:08:44.592 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@158 -- # NVMF_TARGET_INTERFACE2=nvmf_tgt_if2 00:08:44.592 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@159 -- # NVMF_TARGET_BRIDGE=nvmf_tgt_br 00:08:44.592 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@160 -- # NVMF_TARGET_BRIDGE2=nvmf_tgt_br2 00:08:44.592 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@162 -- # ip link set nvmf_init_br nomaster 00:08:44.592 Cannot find device "nvmf_init_br" 00:08:44.592 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@162 -- # true 00:08:44.592 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@163 -- # ip link set nvmf_init_br2 nomaster 00:08:44.592 Cannot find device "nvmf_init_br2" 00:08:44.592 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@163 -- # true 00:08:44.592 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@164 -- # ip link set nvmf_tgt_br nomaster 00:08:44.592 Cannot find device "nvmf_tgt_br" 00:08:44.592 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@164 -- # true 00:08:44.592 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@165 -- # ip link set nvmf_tgt_br2 nomaster 00:08:44.592 Cannot find device "nvmf_tgt_br2" 00:08:44.592 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@165 -- # true 00:08:44.592 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@166 -- # ip link set nvmf_init_br down 00:08:44.592 Cannot find device "nvmf_init_br" 00:08:44.592 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@166 -- # true 00:08:44.592 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@167 -- # ip link set nvmf_init_br2 down 00:08:44.592 Cannot find device "nvmf_init_br2" 00:08:44.592 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@167 -- # true 00:08:44.592 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@168 -- # ip link set nvmf_tgt_br down 00:08:44.592 Cannot find device "nvmf_tgt_br" 00:08:44.592 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@168 -- # true 00:08:44.592 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@169 -- # ip link set nvmf_tgt_br2 down 00:08:44.592 Cannot find device "nvmf_tgt_br2" 00:08:44.592 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@169 -- # true 00:08:44.592 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@170 -- # ip link delete nvmf_br type bridge 00:08:44.592 Cannot find device "nvmf_br" 00:08:44.593 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@170 -- # true 00:08:44.593 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@171 -- # ip link delete nvmf_init_if 00:08:44.851 Cannot find device "nvmf_init_if" 00:08:44.851 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@171 -- # true 00:08:44.851 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@172 -- # ip link delete nvmf_init_if2 00:08:44.851 Cannot find device "nvmf_init_if2" 00:08:44.851 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@172 -- # true 00:08:44.851 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@173 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:08:44.851 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:08:44.851 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@173 -- # true 00:08:44.851 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@174 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:08:44.851 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:08:44.851 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@174 -- # true 00:08:44.851 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@177 -- # ip netns add nvmf_tgt_ns_spdk 00:08:44.851 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@180 -- # ip link add nvmf_init_if type veth peer name nvmf_init_br 00:08:44.851 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@181 -- # ip link add nvmf_init_if2 type veth peer name nvmf_init_br2 00:08:44.851 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@182 -- # ip link add nvmf_tgt_if type veth peer name nvmf_tgt_br 00:08:44.851 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@183 -- # ip link add nvmf_tgt_if2 type veth peer name nvmf_tgt_br2 00:08:44.851 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@186 -- # ip link set nvmf_tgt_if netns nvmf_tgt_ns_spdk 00:08:44.851 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@187 -- # ip link set nvmf_tgt_if2 netns nvmf_tgt_ns_spdk 00:08:44.851 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@190 -- # ip addr add 10.0.0.1/24 dev nvmf_init_if 00:08:44.851 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@191 -- # ip addr add 10.0.0.2/24 dev nvmf_init_if2 00:08:44.851 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@192 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.3/24 dev nvmf_tgt_if 00:08:44.851 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@193 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.4/24 dev nvmf_tgt_if2 00:08:44.851 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@196 -- # ip link set nvmf_init_if up 00:08:44.851 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@197 -- # ip link set nvmf_init_if2 up 00:08:44.851 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@198 -- # ip link set nvmf_init_br up 00:08:44.851 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@199 -- # ip link set nvmf_init_br2 up 00:08:44.851 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@200 -- # ip link set nvmf_tgt_br up 00:08:44.851 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@201 -- # ip link set nvmf_tgt_br2 up 00:08:44.851 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@202 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if up 00:08:44.851 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@203 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if2 up 00:08:44.851 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@204 -- # ip netns exec nvmf_tgt_ns_spdk ip link set lo up 00:08:44.851 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@207 -- # ip link add nvmf_br type bridge 00:08:44.851 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@208 -- # ip link set nvmf_br up 00:08:44.851 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@211 -- # ip link set nvmf_init_br master nvmf_br 00:08:44.851 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@212 -- # ip link set nvmf_init_br2 master nvmf_br 00:08:44.851 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@213 -- # ip link set nvmf_tgt_br master nvmf_br 00:08:44.851 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@214 -- # ip link set nvmf_tgt_br2 master nvmf_br 00:08:45.109 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@217 -- # ipts -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT 00:08:45.109 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT' 00:08:45.109 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@218 -- # ipts -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT 00:08:45.109 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT' 00:08:45.109 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@219 -- # ipts -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT 00:08:45.109 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@788 -- # iptables -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT -m comment --comment 'SPDK_NVMF:-A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT' 00:08:45.110 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@222 -- # ping -c 1 10.0.0.3 00:08:45.110 PING 10.0.0.3 (10.0.0.3) 56(84) bytes of data. 00:08:45.110 64 bytes from 10.0.0.3: icmp_seq=1 ttl=64 time=0.077 ms 00:08:45.110 00:08:45.110 --- 10.0.0.3 ping statistics --- 00:08:45.110 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:45.110 rtt min/avg/max/mdev = 0.077/0.077/0.077/0.000 ms 00:08:45.110 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@223 -- # ping -c 1 10.0.0.4 00:08:45.110 PING 10.0.0.4 (10.0.0.4) 56(84) bytes of data. 00:08:45.110 64 bytes from 10.0.0.4: icmp_seq=1 ttl=64 time=0.102 ms 00:08:45.110 00:08:45.110 --- 10.0.0.4 ping statistics --- 00:08:45.110 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:45.110 rtt min/avg/max/mdev = 0.102/0.102/0.102/0.000 ms 00:08:45.110 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@224 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.1 00:08:45.110 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:08:45.110 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.029 ms 00:08:45.110 00:08:45.110 --- 10.0.0.1 ping statistics --- 00:08:45.110 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:45.110 rtt min/avg/max/mdev = 0.029/0.029/0.029/0.000 ms 00:08:45.110 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@225 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.2 00:08:45.110 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:08:45.110 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.083 ms 00:08:45.110 00:08:45.110 --- 10.0.0.2 ping statistics --- 00:08:45.110 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:45.110 rtt min/avg/max/mdev = 0.083/0.083/0.083/0.000 ms 00:08:45.110 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@227 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:08:45.110 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@459 -- # return 0 00:08:45.110 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:08:45.110 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:08:45.110 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:08:45.110 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:08:45.110 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:08:45.110 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:08:45.110 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:08:45.110 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- target/zcopy.sh@13 -- # nvmfappstart -m 0x2 00:08:45.110 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:08:45.110 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@724 -- # xtrace_disable 00:08:45.110 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@10 -- # set +x 00:08:45.110 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@506 -- # ip netns exec nvmf_tgt_ns_spdk /home/vagrant/spdk_repo/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:08:45.110 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@507 -- # nvmfpid=69165 00:08:45.110 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@508 -- # waitforlisten 69165 00:08:45.110 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@831 -- # '[' -z 69165 ']' 00:08:45.110 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:45.110 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@836 -- # local max_retries=100 00:08:45.110 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:45.110 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:45.110 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@840 -- # xtrace_disable 00:08:45.110 11:19:26 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@10 -- # set +x 00:08:45.110 [2024-10-07 11:19:26.700391] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:08:45.110 [2024-10-07 11:19:26.700575] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:08:45.368 [2024-10-07 11:19:26.843691] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:45.368 [2024-10-07 11:19:27.005199] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:08:45.368 [2024-10-07 11:19:27.005262] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:08:45.368 [2024-10-07 11:19:27.005288] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:08:45.368 [2024-10-07 11:19:27.005297] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:08:45.368 [2024-10-07 11:19:27.005321] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:08:45.368 [2024-10-07 11:19:27.005856] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:08:46.340 11:19:27 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:08:46.340 11:19:27 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@864 -- # return 0 00:08:46.340 11:19:27 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:08:46.340 11:19:27 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@730 -- # xtrace_disable 00:08:46.340 11:19:27 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@10 -- # set +x 00:08:46.340 11:19:27 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:08:46.340 11:19:27 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- target/zcopy.sh@15 -- # '[' tcp '!=' tcp ']' 00:08:46.340 11:19:27 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- target/zcopy.sh@22 -- # rpc_cmd nvmf_create_transport -t tcp -o -c 0 --zcopy 00:08:46.340 11:19:27 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:46.340 11:19:27 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@10 -- # set +x 00:08:46.340 [2024-10-07 11:19:27.819752] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:08:46.340 11:19:27 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:46.340 11:19:27 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- target/zcopy.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:08:46.340 11:19:27 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:46.340 11:19:27 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@10 -- # set +x 00:08:46.340 11:19:27 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:46.340 11:19:27 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- target/zcopy.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4420 00:08:46.340 11:19:27 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:46.340 11:19:27 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@10 -- # set +x 00:08:46.340 [2024-10-07 11:19:27.835845] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:08:46.340 11:19:27 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:46.340 11:19:27 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- target/zcopy.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.3 -s 4420 00:08:46.340 11:19:27 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:46.340 11:19:27 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@10 -- # set +x 00:08:46.340 11:19:27 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:46.340 11:19:27 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- target/zcopy.sh@29 -- # rpc_cmd bdev_malloc_create 32 4096 -b malloc0 00:08:46.340 11:19:27 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:46.340 11:19:27 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@10 -- # set +x 00:08:46.340 malloc0 00:08:46.340 11:19:27 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:46.340 11:19:27 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- target/zcopy.sh@30 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:08:46.340 11:19:27 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:46.340 11:19:27 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@10 -- # set +x 00:08:46.340 11:19:27 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:46.340 11:19:27 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- target/zcopy.sh@33 -- # /home/vagrant/spdk_repo/spdk/build/examples/bdevperf --json /dev/fd/62 -t 10 -q 128 -w verify -o 8192 00:08:46.340 11:19:27 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- target/zcopy.sh@33 -- # gen_nvmf_target_json 00:08:46.340 11:19:27 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@558 -- # config=() 00:08:46.340 11:19:27 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@558 -- # local subsystem config 00:08:46.340 11:19:27 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@560 -- # for subsystem in "${@:-1}" 00:08:46.340 11:19:27 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@580 -- # config+=("$(cat <<-EOF 00:08:46.340 { 00:08:46.340 "params": { 00:08:46.340 "name": "Nvme$subsystem", 00:08:46.340 "trtype": "$TEST_TRANSPORT", 00:08:46.340 "traddr": "$NVMF_FIRST_TARGET_IP", 00:08:46.340 "adrfam": "ipv4", 00:08:46.340 "trsvcid": "$NVMF_PORT", 00:08:46.340 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:08:46.340 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:08:46.340 "hdgst": ${hdgst:-false}, 00:08:46.340 "ddgst": ${ddgst:-false} 00:08:46.340 }, 00:08:46.340 "method": "bdev_nvme_attach_controller" 00:08:46.340 } 00:08:46.340 EOF 00:08:46.340 )") 00:08:46.340 11:19:27 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@580 -- # cat 00:08:46.340 11:19:27 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@582 -- # jq . 00:08:46.340 11:19:27 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@583 -- # IFS=, 00:08:46.340 11:19:27 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@584 -- # printf '%s\n' '{ 00:08:46.340 "params": { 00:08:46.340 "name": "Nvme1", 00:08:46.340 "trtype": "tcp", 00:08:46.340 "traddr": "10.0.0.3", 00:08:46.340 "adrfam": "ipv4", 00:08:46.340 "trsvcid": "4420", 00:08:46.340 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:08:46.340 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:08:46.340 "hdgst": false, 00:08:46.340 "ddgst": false 00:08:46.340 }, 00:08:46.340 "method": "bdev_nvme_attach_controller" 00:08:46.340 }' 00:08:46.340 [2024-10-07 11:19:27.947827] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:08:46.340 [2024-10-07 11:19:27.947958] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid69216 ] 00:08:46.599 [2024-10-07 11:19:28.088530] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:46.599 [2024-10-07 11:19:28.258730] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:08:46.856 Running I/O for 10 seconds... 00:08:49.164 5753.00 IOPS, 44.95 MiB/s [2024-10-07T11:19:31.509Z] 5745.50 IOPS, 44.89 MiB/s [2024-10-07T11:19:32.883Z] 5752.67 IOPS, 44.94 MiB/s [2024-10-07T11:19:33.816Z] 5812.75 IOPS, 45.41 MiB/s [2024-10-07T11:19:34.750Z] 5866.60 IOPS, 45.83 MiB/s [2024-10-07T11:19:35.685Z] 5877.67 IOPS, 45.92 MiB/s [2024-10-07T11:19:36.619Z] 5914.57 IOPS, 46.21 MiB/s [2024-10-07T11:19:37.553Z] 5909.88 IOPS, 46.17 MiB/s [2024-10-07T11:19:38.543Z] 5884.33 IOPS, 45.97 MiB/s [2024-10-07T11:19:38.543Z] 5864.10 IOPS, 45.81 MiB/s 00:08:56.832 Latency(us) 00:08:56.832 [2024-10-07T11:19:38.543Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:08:56.832 Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 8192) 00:08:56.832 Verification LBA range: start 0x0 length 0x1000 00:08:56.833 Nvme1n1 : 10.01 5865.91 45.83 0.00 0.00 21751.86 1869.27 29669.93 00:08:56.833 [2024-10-07T11:19:38.544Z] =================================================================================================================== 00:08:56.833 [2024-10-07T11:19:38.544Z] Total : 5865.91 45.83 0.00 0.00 21751.86 1869.27 29669.93 00:08:57.399 11:19:38 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- target/zcopy.sh@39 -- # perfpid=69339 00:08:57.399 11:19:38 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- target/zcopy.sh@37 -- # /home/vagrant/spdk_repo/spdk/build/examples/bdevperf --json /dev/fd/63 -t 5 -q 128 -w randrw -M 50 -o 8192 00:08:57.399 11:19:38 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- target/zcopy.sh@41 -- # xtrace_disable 00:08:57.399 11:19:38 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- target/zcopy.sh@37 -- # gen_nvmf_target_json 00:08:57.399 11:19:38 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@558 -- # config=() 00:08:57.399 11:19:38 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@10 -- # set +x 00:08:57.399 11:19:38 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@558 -- # local subsystem config 00:08:57.399 11:19:38 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@560 -- # for subsystem in "${@:-1}" 00:08:57.399 11:19:38 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@580 -- # config+=("$(cat <<-EOF 00:08:57.399 { 00:08:57.399 "params": { 00:08:57.399 "name": "Nvme$subsystem", 00:08:57.399 "trtype": "$TEST_TRANSPORT", 00:08:57.399 "traddr": "$NVMF_FIRST_TARGET_IP", 00:08:57.399 "adrfam": "ipv4", 00:08:57.399 "trsvcid": "$NVMF_PORT", 00:08:57.399 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:08:57.399 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:08:57.399 "hdgst": ${hdgst:-false}, 00:08:57.399 "ddgst": ${ddgst:-false} 00:08:57.399 }, 00:08:57.399 "method": "bdev_nvme_attach_controller" 00:08:57.399 } 00:08:57.399 EOF 00:08:57.399 )") 00:08:57.399 11:19:38 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@580 -- # cat 00:08:57.399 11:19:38 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@582 -- # jq . 00:08:57.399 [2024-10-07 11:19:38.829026] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:57.399 [2024-10-07 11:19:38.829071] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:57.399 11:19:38 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@583 -- # IFS=, 00:08:57.399 11:19:38 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@584 -- # printf '%s\n' '{ 00:08:57.399 "params": { 00:08:57.399 "name": "Nvme1", 00:08:57.399 "trtype": "tcp", 00:08:57.399 "traddr": "10.0.0.3", 00:08:57.399 "adrfam": "ipv4", 00:08:57.399 "trsvcid": "4420", 00:08:57.399 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:08:57.399 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:08:57.399 "hdgst": false, 00:08:57.399 "ddgst": false 00:08:57.399 }, 00:08:57.399 "method": "bdev_nvme_attach_controller" 00:08:57.399 }' 00:08:57.399 2024/10/07 11:19:38 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:57.399 [2024-10-07 11:19:38.840997] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:57.399 [2024-10-07 11:19:38.841027] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:57.399 2024/10/07 11:19:38 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:57.399 [2024-10-07 11:19:38.852973] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:57.399 [2024-10-07 11:19:38.852999] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:57.399 2024/10/07 11:19:38 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:57.399 [2024-10-07 11:19:38.864976] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:57.399 [2024-10-07 11:19:38.865002] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:57.399 2024/10/07 11:19:38 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:57.399 [2024-10-07 11:19:38.869812] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:08:57.399 [2024-10-07 11:19:38.869893] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid69339 ] 00:08:57.399 [2024-10-07 11:19:38.876978] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:57.399 [2024-10-07 11:19:38.877001] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:57.399 2024/10/07 11:19:38 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:57.399 [2024-10-07 11:19:38.888987] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:57.399 [2024-10-07 11:19:38.889012] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:57.399 2024/10/07 11:19:38 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:57.399 [2024-10-07 11:19:38.900996] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:57.399 [2024-10-07 11:19:38.901024] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:57.399 2024/10/07 11:19:38 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:57.399 [2024-10-07 11:19:38.912992] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:57.399 [2024-10-07 11:19:38.913018] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:57.399 2024/10/07 11:19:38 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:57.399 [2024-10-07 11:19:38.925020] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:57.399 [2024-10-07 11:19:38.925061] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:57.399 2024/10/07 11:19:38 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:57.399 [2024-10-07 11:19:38.937021] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:57.399 [2024-10-07 11:19:38.937057] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:57.399 2024/10/07 11:19:38 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:57.399 [2024-10-07 11:19:38.948994] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:57.399 [2024-10-07 11:19:38.949019] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:57.399 2024/10/07 11:19:38 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:57.399 [2024-10-07 11:19:38.961046] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:57.399 [2024-10-07 11:19:38.961090] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:57.399 2024/10/07 11:19:38 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:57.399 [2024-10-07 11:19:38.973036] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:57.399 [2024-10-07 11:19:38.973079] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:57.399 2024/10/07 11:19:38 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:57.399 [2024-10-07 11:19:38.984992] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:57.399 [2024-10-07 11:19:38.985016] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:57.399 2024/10/07 11:19:38 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:57.399 [2024-10-07 11:19:38.996996] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:57.399 [2024-10-07 11:19:38.997020] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:57.399 2024/10/07 11:19:39 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:57.399 [2024-10-07 11:19:39.002532] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:08:57.399 [2024-10-07 11:19:39.009013] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:57.399 [2024-10-07 11:19:39.009040] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:57.399 2024/10/07 11:19:39 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:57.399 [2024-10-07 11:19:39.021033] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:57.399 [2024-10-07 11:19:39.021068] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:57.399 2024/10/07 11:19:39 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:57.399 [2024-10-07 11:19:39.033027] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:57.399 [2024-10-07 11:19:39.033059] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:57.399 2024/10/07 11:19:39 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:57.399 [2024-10-07 11:19:39.045086] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:57.399 [2024-10-07 11:19:39.045146] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:57.399 2024/10/07 11:19:39 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:57.399 [2024-10-07 11:19:39.057084] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:57.399 [2024-10-07 11:19:39.057140] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:57.399 2024/10/07 11:19:39 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:57.399 [2024-10-07 11:19:39.069085] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:57.399 [2024-10-07 11:19:39.069145] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:57.399 2024/10/07 11:19:39 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:57.399 [2024-10-07 11:19:39.081091] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:57.399 [2024-10-07 11:19:39.081136] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:57.399 2024/10/07 11:19:39 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:57.399 [2024-10-07 11:19:39.093108] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:57.399 [2024-10-07 11:19:39.093154] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:57.399 2024/10/07 11:19:39 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:57.399 [2024-10-07 11:19:39.105100] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:57.399 [2024-10-07 11:19:39.105144] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:57.658 2024/10/07 11:19:39 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:57.659 [2024-10-07 11:19:39.117125] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:57.659 [2024-10-07 11:19:39.117170] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:57.659 2024/10/07 11:19:39 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:57.659 [2024-10-07 11:19:39.129125] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:57.659 [2024-10-07 11:19:39.129169] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:57.659 2024/10/07 11:19:39 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:57.659 [2024-10-07 11:19:39.141139] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:57.659 [2024-10-07 11:19:39.141185] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:57.659 2024/10/07 11:19:39 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:57.659 [2024-10-07 11:19:39.153132] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:57.659 [2024-10-07 11:19:39.153172] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:57.659 [2024-10-07 11:19:39.157258] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:08:57.659 2024/10/07 11:19:39 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:57.659 [2024-10-07 11:19:39.165123] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:57.659 [2024-10-07 11:19:39.165159] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:57.659 2024/10/07 11:19:39 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:57.659 [2024-10-07 11:19:39.177145] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:57.659 [2024-10-07 11:19:39.177190] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:57.659 2024/10/07 11:19:39 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:57.659 [2024-10-07 11:19:39.189155] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:57.659 [2024-10-07 11:19:39.189199] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:57.659 2024/10/07 11:19:39 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:57.659 [2024-10-07 11:19:39.201144] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:57.659 [2024-10-07 11:19:39.201184] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:57.659 2024/10/07 11:19:39 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:57.659 [2024-10-07 11:19:39.213135] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:57.659 [2024-10-07 11:19:39.213172] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:57.659 2024/10/07 11:19:39 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:57.659 [2024-10-07 11:19:39.225162] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:57.659 [2024-10-07 11:19:39.225211] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:57.659 2024/10/07 11:19:39 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:57.659 [2024-10-07 11:19:39.237153] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:57.659 [2024-10-07 11:19:39.237195] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:57.659 2024/10/07 11:19:39 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:57.659 [2024-10-07 11:19:39.249174] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:57.659 [2024-10-07 11:19:39.249221] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:57.659 2024/10/07 11:19:39 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:57.659 [2024-10-07 11:19:39.261168] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:57.659 [2024-10-07 11:19:39.261210] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:57.659 2024/10/07 11:19:39 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:57.659 [2024-10-07 11:19:39.273168] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:57.659 [2024-10-07 11:19:39.273211] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:57.659 2024/10/07 11:19:39 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:57.659 [2024-10-07 11:19:39.285160] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:57.659 [2024-10-07 11:19:39.285201] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:57.659 2024/10/07 11:19:39 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:57.659 [2024-10-07 11:19:39.297150] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:57.659 [2024-10-07 11:19:39.297189] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:57.659 2024/10/07 11:19:39 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:57.659 [2024-10-07 11:19:39.309516] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:57.659 [2024-10-07 11:19:39.309564] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:57.659 2024/10/07 11:19:39 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:57.659 [2024-10-07 11:19:39.321529] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:57.659 [2024-10-07 11:19:39.321578] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:57.659 2024/10/07 11:19:39 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:57.659 [2024-10-07 11:19:39.333532] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:57.659 [2024-10-07 11:19:39.333575] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:57.659 2024/10/07 11:19:39 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:57.659 [2024-10-07 11:19:39.345498] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:57.659 [2024-10-07 11:19:39.345540] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:57.659 2024/10/07 11:19:39 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:57.659 [2024-10-07 11:19:39.357514] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:57.659 [2024-10-07 11:19:39.357565] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:57.659 2024/10/07 11:19:39 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:57.918 [2024-10-07 11:19:39.369540] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:57.918 [2024-10-07 11:19:39.369583] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:57.918 2024/10/07 11:19:39 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:57.918 Running I/O for 5 seconds... 00:08:57.918 [2024-10-07 11:19:39.381530] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:57.918 [2024-10-07 11:19:39.381568] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:57.918 2024/10/07 11:19:39 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:57.918 [2024-10-07 11:19:39.399872] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:57.918 [2024-10-07 11:19:39.399931] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:57.918 2024/10/07 11:19:39 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:57.918 [2024-10-07 11:19:39.415720] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:57.918 [2024-10-07 11:19:39.415764] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:57.918 2024/10/07 11:19:39 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:57.918 [2024-10-07 11:19:39.432721] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:57.918 [2024-10-07 11:19:39.432776] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:57.918 2024/10/07 11:19:39 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:57.918 [2024-10-07 11:19:39.449042] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:57.918 [2024-10-07 11:19:39.449076] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:57.918 2024/10/07 11:19:39 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:57.918 [2024-10-07 11:19:39.465875] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:57.918 [2024-10-07 11:19:39.465914] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:57.918 2024/10/07 11:19:39 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:57.918 [2024-10-07 11:19:39.482465] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:57.918 [2024-10-07 11:19:39.482503] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:57.918 2024/10/07 11:19:39 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:57.918 [2024-10-07 11:19:39.499135] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:57.918 [2024-10-07 11:19:39.499195] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:57.918 2024/10/07 11:19:39 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:57.918 [2024-10-07 11:19:39.517157] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:57.918 [2024-10-07 11:19:39.517200] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:57.918 2024/10/07 11:19:39 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:57.918 [2024-10-07 11:19:39.533525] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:57.918 [2024-10-07 11:19:39.533561] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:57.918 2024/10/07 11:19:39 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:57.918 [2024-10-07 11:19:39.549290] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:57.918 [2024-10-07 11:19:39.549326] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:57.918 2024/10/07 11:19:39 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:57.918 [2024-10-07 11:19:39.559106] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:57.918 [2024-10-07 11:19:39.559139] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:57.918 2024/10/07 11:19:39 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:57.918 [2024-10-07 11:19:39.575004] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:57.918 [2024-10-07 11:19:39.575044] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:57.918 2024/10/07 11:19:39 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:57.918 [2024-10-07 11:19:39.586255] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:57.918 [2024-10-07 11:19:39.586301] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:57.918 2024/10/07 11:19:39 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:57.918 [2024-10-07 11:19:39.601351] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:57.918 [2024-10-07 11:19:39.601442] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:57.918 2024/10/07 11:19:39 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:57.918 [2024-10-07 11:19:39.618368] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:57.918 [2024-10-07 11:19:39.618441] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:57.918 2024/10/07 11:19:39 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:58.176 [2024-10-07 11:19:39.636555] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:58.176 [2024-10-07 11:19:39.636622] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:58.176 2024/10/07 11:19:39 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:58.176 [2024-10-07 11:19:39.653183] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:58.176 [2024-10-07 11:19:39.653222] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:58.176 2024/10/07 11:19:39 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:58.176 [2024-10-07 11:19:39.668958] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:58.176 [2024-10-07 11:19:39.668994] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:58.176 2024/10/07 11:19:39 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:58.176 [2024-10-07 11:19:39.679513] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:58.176 [2024-10-07 11:19:39.679547] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:58.176 2024/10/07 11:19:39 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:58.176 [2024-10-07 11:19:39.694745] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:58.176 [2024-10-07 11:19:39.694778] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:58.176 2024/10/07 11:19:39 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:58.176 [2024-10-07 11:19:39.711398] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:58.176 [2024-10-07 11:19:39.711445] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:58.176 2024/10/07 11:19:39 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:58.176 [2024-10-07 11:19:39.728430] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:58.176 [2024-10-07 11:19:39.728463] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:58.176 2024/10/07 11:19:39 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:58.176 [2024-10-07 11:19:39.744318] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:58.176 [2024-10-07 11:19:39.744358] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:58.176 2024/10/07 11:19:39 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:58.176 [2024-10-07 11:19:39.761133] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:58.176 [2024-10-07 11:19:39.761169] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:58.176 2024/10/07 11:19:39 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:58.176 [2024-10-07 11:19:39.776856] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:58.176 [2024-10-07 11:19:39.776893] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:58.176 2024/10/07 11:19:39 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:58.176 [2024-10-07 11:19:39.793657] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:58.176 [2024-10-07 11:19:39.793703] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:58.176 2024/10/07 11:19:39 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:58.176 [2024-10-07 11:19:39.810505] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:58.176 [2024-10-07 11:19:39.810551] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:58.176 2024/10/07 11:19:39 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:58.176 [2024-10-07 11:19:39.826191] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:58.176 [2024-10-07 11:19:39.826236] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:58.176 2024/10/07 11:19:39 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:58.176 [2024-10-07 11:19:39.836178] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:58.176 [2024-10-07 11:19:39.836214] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:58.177 2024/10/07 11:19:39 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:58.177 [2024-10-07 11:19:39.851366] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:58.177 [2024-10-07 11:19:39.851401] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:58.177 2024/10/07 11:19:39 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:58.177 [2024-10-07 11:19:39.868149] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:58.177 [2024-10-07 11:19:39.868184] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:58.177 2024/10/07 11:19:39 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:58.177 [2024-10-07 11:19:39.884606] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:58.177 [2024-10-07 11:19:39.884642] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:58.435 2024/10/07 11:19:39 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:58.435 [2024-10-07 11:19:39.900523] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:58.435 [2024-10-07 11:19:39.900562] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:58.435 2024/10/07 11:19:39 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:58.435 [2024-10-07 11:19:39.916870] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:58.435 [2024-10-07 11:19:39.916906] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:58.435 2024/10/07 11:19:39 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:58.435 [2024-10-07 11:19:39.932772] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:58.435 [2024-10-07 11:19:39.932809] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:58.435 2024/10/07 11:19:39 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:58.435 [2024-10-07 11:19:39.943387] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:58.435 [2024-10-07 11:19:39.943432] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:58.435 2024/10/07 11:19:39 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:58.435 [2024-10-07 11:19:39.958206] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:58.435 [2024-10-07 11:19:39.958243] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:58.435 2024/10/07 11:19:39 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:58.435 [2024-10-07 11:19:39.974780] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:58.435 [2024-10-07 11:19:39.974845] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:58.435 2024/10/07 11:19:39 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:58.435 [2024-10-07 11:19:39.991448] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:58.435 [2024-10-07 11:19:39.991511] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:58.435 2024/10/07 11:19:39 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:58.435 [2024-10-07 11:19:40.008594] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:58.435 [2024-10-07 11:19:40.008651] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:58.435 2024/10/07 11:19:40 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:58.435 [2024-10-07 11:19:40.024550] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:58.435 [2024-10-07 11:19:40.024593] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:58.435 2024/10/07 11:19:40 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:58.435 [2024-10-07 11:19:40.035471] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:58.435 [2024-10-07 11:19:40.035508] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:58.435 2024/10/07 11:19:40 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:58.435 [2024-10-07 11:19:40.050048] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:58.435 [2024-10-07 11:19:40.050084] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:58.435 2024/10/07 11:19:40 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:58.435 [2024-10-07 11:19:40.061151] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:58.435 [2024-10-07 11:19:40.061217] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:58.435 2024/10/07 11:19:40 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:58.435 [2024-10-07 11:19:40.077133] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:58.435 [2024-10-07 11:19:40.077176] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:58.435 2024/10/07 11:19:40 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:58.435 [2024-10-07 11:19:40.087839] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:58.435 [2024-10-07 11:19:40.087887] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:58.435 2024/10/07 11:19:40 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:58.435 [2024-10-07 11:19:40.102888] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:58.436 [2024-10-07 11:19:40.102923] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:58.436 2024/10/07 11:19:40 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:58.436 [2024-10-07 11:19:40.120062] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:58.436 [2024-10-07 11:19:40.120121] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:58.436 2024/10/07 11:19:40 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:58.436 [2024-10-07 11:19:40.135821] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:58.436 [2024-10-07 11:19:40.135875] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:58.436 2024/10/07 11:19:40 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:58.694 [2024-10-07 11:19:40.152881] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:58.694 [2024-10-07 11:19:40.152935] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:58.694 2024/10/07 11:19:40 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:58.694 [2024-10-07 11:19:40.168547] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:58.694 [2024-10-07 11:19:40.168613] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:58.694 2024/10/07 11:19:40 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:58.694 [2024-10-07 11:19:40.185647] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:58.694 [2024-10-07 11:19:40.185726] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:58.694 2024/10/07 11:19:40 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:58.694 [2024-10-07 11:19:40.201766] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:58.694 [2024-10-07 11:19:40.201820] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:58.694 2024/10/07 11:19:40 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:58.694 [2024-10-07 11:19:40.218362] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:58.694 [2024-10-07 11:19:40.218435] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:58.694 2024/10/07 11:19:40 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:58.694 [2024-10-07 11:19:40.232945] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:58.694 [2024-10-07 11:19:40.232999] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:58.694 2024/10/07 11:19:40 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:58.694 [2024-10-07 11:19:40.249194] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:58.694 [2024-10-07 11:19:40.249237] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:58.694 2024/10/07 11:19:40 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:58.694 [2024-10-07 11:19:40.265882] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:58.694 [2024-10-07 11:19:40.265940] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:58.694 2024/10/07 11:19:40 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:58.694 [2024-10-07 11:19:40.283148] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:58.694 [2024-10-07 11:19:40.283200] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:58.694 2024/10/07 11:19:40 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:58.694 [2024-10-07 11:19:40.299136] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:58.694 [2024-10-07 11:19:40.299190] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:58.694 2024/10/07 11:19:40 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:58.694 [2024-10-07 11:19:40.314622] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:58.694 [2024-10-07 11:19:40.314672] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:58.694 2024/10/07 11:19:40 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:58.694 [2024-10-07 11:19:40.332112] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:58.694 [2024-10-07 11:19:40.332168] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:58.694 2024/10/07 11:19:40 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:58.694 [2024-10-07 11:19:40.347555] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:58.694 [2024-10-07 11:19:40.347602] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:58.694 2024/10/07 11:19:40 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:58.694 [2024-10-07 11:19:40.358305] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:58.694 [2024-10-07 11:19:40.358346] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:58.694 2024/10/07 11:19:40 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:58.694 [2024-10-07 11:19:40.372661] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:58.694 [2024-10-07 11:19:40.372713] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:58.694 2024/10/07 11:19:40 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:58.694 11207.00 IOPS, 87.55 MiB/s [2024-10-07T11:19:40.405Z] [2024-10-07 11:19:40.388782] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:58.694 [2024-10-07 11:19:40.388817] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:58.694 2024/10/07 11:19:40 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:58.953 [2024-10-07 11:19:40.404605] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:58.953 [2024-10-07 11:19:40.404639] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:58.953 2024/10/07 11:19:40 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:58.953 [2024-10-07 11:19:40.420648] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:58.953 [2024-10-07 11:19:40.420705] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:58.953 2024/10/07 11:19:40 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:58.953 [2024-10-07 11:19:40.438347] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:58.953 [2024-10-07 11:19:40.438419] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:58.953 2024/10/07 11:19:40 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:58.953 [2024-10-07 11:19:40.454263] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:58.953 [2024-10-07 11:19:40.454313] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:58.953 2024/10/07 11:19:40 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:58.953 [2024-10-07 11:19:40.470991] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:58.953 [2024-10-07 11:19:40.471023] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:58.953 2024/10/07 11:19:40 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:58.953 [2024-10-07 11:19:40.487756] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:58.953 [2024-10-07 11:19:40.487805] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:58.953 2024/10/07 11:19:40 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:58.953 [2024-10-07 11:19:40.502920] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:58.953 [2024-10-07 11:19:40.502953] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:58.953 2024/10/07 11:19:40 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:58.953 [2024-10-07 11:19:40.518721] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:58.953 [2024-10-07 11:19:40.518758] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:58.953 2024/10/07 11:19:40 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:58.953 [2024-10-07 11:19:40.535599] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:58.953 [2024-10-07 11:19:40.535634] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:58.953 2024/10/07 11:19:40 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:58.953 [2024-10-07 11:19:40.551312] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:58.953 [2024-10-07 11:19:40.551357] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:58.953 2024/10/07 11:19:40 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:58.953 [2024-10-07 11:19:40.567460] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:58.953 [2024-10-07 11:19:40.567499] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:58.953 2024/10/07 11:19:40 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:58.953 [2024-10-07 11:19:40.577984] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:58.953 [2024-10-07 11:19:40.578018] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:58.953 2024/10/07 11:19:40 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:58.953 [2024-10-07 11:19:40.592991] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:58.953 [2024-10-07 11:19:40.593030] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:58.954 2024/10/07 11:19:40 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:58.954 [2024-10-07 11:19:40.611228] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:58.954 [2024-10-07 11:19:40.611265] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:58.954 2024/10/07 11:19:40 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:58.954 [2024-10-07 11:19:40.626574] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:58.954 [2024-10-07 11:19:40.626608] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:58.954 2024/10/07 11:19:40 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:58.954 [2024-10-07 11:19:40.643161] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:58.954 [2024-10-07 11:19:40.643212] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:58.954 2024/10/07 11:19:40 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:58.954 [2024-10-07 11:19:40.659932] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:58.954 [2024-10-07 11:19:40.659979] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:59.212 2024/10/07 11:19:40 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:59.212 [2024-10-07 11:19:40.677662] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:59.212 [2024-10-07 11:19:40.677704] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:59.212 2024/10/07 11:19:40 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:59.212 [2024-10-07 11:19:40.693523] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:59.212 [2024-10-07 11:19:40.693557] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:59.212 2024/10/07 11:19:40 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:59.212 [2024-10-07 11:19:40.703588] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:59.212 [2024-10-07 11:19:40.703621] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:59.212 2024/10/07 11:19:40 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:59.212 [2024-10-07 11:19:40.717555] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:59.212 [2024-10-07 11:19:40.717589] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:59.212 2024/10/07 11:19:40 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:59.212 [2024-10-07 11:19:40.733598] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:59.212 [2024-10-07 11:19:40.733648] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:59.212 2024/10/07 11:19:40 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:59.212 [2024-10-07 11:19:40.750131] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:59.212 [2024-10-07 11:19:40.750166] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:59.212 2024/10/07 11:19:40 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:59.212 [2024-10-07 11:19:40.767426] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:59.212 [2024-10-07 11:19:40.767459] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:59.212 2024/10/07 11:19:40 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:59.212 [2024-10-07 11:19:40.783164] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:59.212 [2024-10-07 11:19:40.783199] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:59.212 2024/10/07 11:19:40 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:59.212 [2024-10-07 11:19:40.800357] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:59.212 [2024-10-07 11:19:40.800393] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:59.212 2024/10/07 11:19:40 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:59.212 [2024-10-07 11:19:40.816033] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:59.212 [2024-10-07 11:19:40.816068] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:59.212 2024/10/07 11:19:40 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:59.212 [2024-10-07 11:19:40.832450] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:59.212 [2024-10-07 11:19:40.832485] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:59.212 2024/10/07 11:19:40 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:59.212 [2024-10-07 11:19:40.847964] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:59.212 [2024-10-07 11:19:40.847998] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:59.212 2024/10/07 11:19:40 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:59.212 [2024-10-07 11:19:40.862331] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:59.212 [2024-10-07 11:19:40.862366] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:59.212 2024/10/07 11:19:40 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:59.212 [2024-10-07 11:19:40.879377] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:59.212 [2024-10-07 11:19:40.879435] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:59.212 2024/10/07 11:19:40 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:59.212 [2024-10-07 11:19:40.894679] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:59.212 [2024-10-07 11:19:40.894718] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:59.212 2024/10/07 11:19:40 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:59.212 [2024-10-07 11:19:40.903964] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:59.212 [2024-10-07 11:19:40.903998] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:59.212 2024/10/07 11:19:40 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:59.212 [2024-10-07 11:19:40.919590] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:59.212 [2024-10-07 11:19:40.919622] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:59.471 2024/10/07 11:19:40 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:59.471 [2024-10-07 11:19:40.936437] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:59.471 [2024-10-07 11:19:40.936478] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:59.471 2024/10/07 11:19:40 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:59.471 [2024-10-07 11:19:40.951507] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:59.471 [2024-10-07 11:19:40.951562] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:59.471 2024/10/07 11:19:40 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:59.471 [2024-10-07 11:19:40.968223] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:59.471 [2024-10-07 11:19:40.968260] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:59.471 2024/10/07 11:19:40 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:59.471 [2024-10-07 11:19:40.984196] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:59.471 [2024-10-07 11:19:40.984230] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:59.471 2024/10/07 11:19:40 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:59.471 [2024-10-07 11:19:41.001757] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:59.471 [2024-10-07 11:19:41.001790] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:59.471 2024/10/07 11:19:41 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:59.471 [2024-10-07 11:19:41.016924] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:59.471 [2024-10-07 11:19:41.016960] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:59.471 2024/10/07 11:19:41 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:59.471 [2024-10-07 11:19:41.027107] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:59.471 [2024-10-07 11:19:41.027141] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:59.471 2024/10/07 11:19:41 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:59.471 [2024-10-07 11:19:41.041331] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:59.471 [2024-10-07 11:19:41.041364] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:59.471 2024/10/07 11:19:41 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:59.471 [2024-10-07 11:19:41.052299] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:59.471 [2024-10-07 11:19:41.052337] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:59.471 2024/10/07 11:19:41 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:59.471 [2024-10-07 11:19:41.067376] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:59.471 [2024-10-07 11:19:41.067444] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:59.471 2024/10/07 11:19:41 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:59.471 [2024-10-07 11:19:41.083263] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:59.471 [2024-10-07 11:19:41.083322] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:59.472 2024/10/07 11:19:41 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:59.472 [2024-10-07 11:19:41.099440] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:59.472 [2024-10-07 11:19:41.099484] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:59.472 2024/10/07 11:19:41 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:59.472 [2024-10-07 11:19:41.116641] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:59.472 [2024-10-07 11:19:41.116676] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:59.472 2024/10/07 11:19:41 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:59.472 [2024-10-07 11:19:41.134802] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:59.472 [2024-10-07 11:19:41.134840] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:59.472 2024/10/07 11:19:41 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:59.472 [2024-10-07 11:19:41.150744] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:59.472 [2024-10-07 11:19:41.150781] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:59.472 2024/10/07 11:19:41 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:59.472 [2024-10-07 11:19:41.169350] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:59.472 [2024-10-07 11:19:41.169389] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:59.472 2024/10/07 11:19:41 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:59.730 [2024-10-07 11:19:41.184362] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:59.730 [2024-10-07 11:19:41.184398] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:59.730 2024/10/07 11:19:41 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:59.730 [2024-10-07 11:19:41.194866] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:59.730 [2024-10-07 11:19:41.194901] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:59.730 2024/10/07 11:19:41 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:59.730 [2024-10-07 11:19:41.210152] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:59.730 [2024-10-07 11:19:41.210184] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:59.730 2024/10/07 11:19:41 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:59.730 [2024-10-07 11:19:41.227103] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:59.730 [2024-10-07 11:19:41.227138] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:59.730 2024/10/07 11:19:41 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:59.730 [2024-10-07 11:19:41.242629] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:59.730 [2024-10-07 11:19:41.242663] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:59.730 2024/10/07 11:19:41 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:59.730 [2024-10-07 11:19:41.259880] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:59.730 [2024-10-07 11:19:41.259913] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:59.730 2024/10/07 11:19:41 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:59.730 [2024-10-07 11:19:41.274765] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:59.730 [2024-10-07 11:19:41.274799] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:59.730 2024/10/07 11:19:41 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:59.730 [2024-10-07 11:19:41.290464] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:59.730 [2024-10-07 11:19:41.290496] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:59.731 2024/10/07 11:19:41 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:59.731 [2024-10-07 11:19:41.300984] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:59.731 [2024-10-07 11:19:41.301016] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:59.731 2024/10/07 11:19:41 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:59.731 [2024-10-07 11:19:41.316019] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:59.731 [2024-10-07 11:19:41.316069] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:59.731 2024/10/07 11:19:41 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:59.731 [2024-10-07 11:19:41.332181] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:59.731 [2024-10-07 11:19:41.332222] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:59.731 2024/10/07 11:19:41 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:59.731 [2024-10-07 11:19:41.350390] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:59.731 [2024-10-07 11:19:41.350434] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:59.731 2024/10/07 11:19:41 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:59.731 [2024-10-07 11:19:41.364507] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:59.731 [2024-10-07 11:19:41.364540] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:59.731 2024/10/07 11:19:41 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:59.731 [2024-10-07 11:19:41.381087] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:59.731 [2024-10-07 11:19:41.381126] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:59.731 11363.50 IOPS, 88.78 MiB/s [2024-10-07T11:19:41.442Z] 2024/10/07 11:19:41 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:59.731 [2024-10-07 11:19:41.397243] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:59.731 [2024-10-07 11:19:41.397283] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:59.731 2024/10/07 11:19:41 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:59.731 [2024-10-07 11:19:41.414483] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:59.731 [2024-10-07 11:19:41.414520] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:59.731 2024/10/07 11:19:41 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:59.731 [2024-10-07 11:19:41.430244] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:59.731 [2024-10-07 11:19:41.430280] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:59.731 2024/10/07 11:19:41 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:59.989 [2024-10-07 11:19:41.440582] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:59.989 [2024-10-07 11:19:41.440614] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:59.989 2024/10/07 11:19:41 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:59.989 [2024-10-07 11:19:41.455804] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:59.989 [2024-10-07 11:19:41.455837] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:59.989 2024/10/07 11:19:41 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:59.989 [2024-10-07 11:19:41.473125] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:59.989 [2024-10-07 11:19:41.473160] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:59.989 2024/10/07 11:19:41 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:59.989 [2024-10-07 11:19:41.488881] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:59.989 [2024-10-07 11:19:41.488915] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:59.989 2024/10/07 11:19:41 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:59.989 [2024-10-07 11:19:41.505551] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:59.989 [2024-10-07 11:19:41.505584] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:59.989 2024/10/07 11:19:41 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:59.989 [2024-10-07 11:19:41.522247] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:59.989 [2024-10-07 11:19:41.522295] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:59.989 2024/10/07 11:19:41 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:59.989 [2024-10-07 11:19:41.537777] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:59.989 [2024-10-07 11:19:41.537810] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:59.989 2024/10/07 11:19:41 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:59.989 [2024-10-07 11:19:41.549949] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:59.989 [2024-10-07 11:19:41.549983] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:59.989 2024/10/07 11:19:41 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:59.989 [2024-10-07 11:19:41.567639] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:59.989 [2024-10-07 11:19:41.567674] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:59.989 2024/10/07 11:19:41 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:59.989 [2024-10-07 11:19:41.582636] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:59.989 [2024-10-07 11:19:41.582669] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:59.989 2024/10/07 11:19:41 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:59.989 [2024-10-07 11:19:41.593631] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:59.989 [2024-10-07 11:19:41.593675] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:59.989 2024/10/07 11:19:41 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:59.989 [2024-10-07 11:19:41.604938] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:59.989 [2024-10-07 11:19:41.604991] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:59.990 2024/10/07 11:19:41 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:59.990 [2024-10-07 11:19:41.621366] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:59.990 [2024-10-07 11:19:41.621398] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:59.990 2024/10/07 11:19:41 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:59.990 [2024-10-07 11:19:41.633133] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:59.990 [2024-10-07 11:19:41.633167] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:59.990 2024/10/07 11:19:41 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:59.990 [2024-10-07 11:19:41.650218] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:59.990 [2024-10-07 11:19:41.650253] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:59.990 2024/10/07 11:19:41 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:59.990 [2024-10-07 11:19:41.665140] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:59.990 [2024-10-07 11:19:41.665175] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:59.990 2024/10/07 11:19:41 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:59.990 [2024-10-07 11:19:41.680778] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:59.990 [2024-10-07 11:19:41.680812] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:59.990 2024/10/07 11:19:41 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:08:59.990 [2024-10-07 11:19:41.691834] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:08:59.990 [2024-10-07 11:19:41.691883] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:08:59.990 2024/10/07 11:19:41 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:00.248 [2024-10-07 11:19:41.707322] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:00.248 [2024-10-07 11:19:41.707361] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:00.248 2024/10/07 11:19:41 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:00.248 [2024-10-07 11:19:41.723386] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:00.248 [2024-10-07 11:19:41.723436] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:00.248 2024/10/07 11:19:41 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:00.248 [2024-10-07 11:19:41.739151] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:00.248 [2024-10-07 11:19:41.739202] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:00.248 2024/10/07 11:19:41 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:00.248 [2024-10-07 11:19:41.756431] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:00.248 [2024-10-07 11:19:41.756465] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:00.248 2024/10/07 11:19:41 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:00.248 [2024-10-07 11:19:41.771922] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:00.248 [2024-10-07 11:19:41.771957] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:00.248 2024/10/07 11:19:41 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:00.248 [2024-10-07 11:19:41.781916] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:00.248 [2024-10-07 11:19:41.781949] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:00.248 2024/10/07 11:19:41 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:00.248 [2024-10-07 11:19:41.798050] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:00.248 [2024-10-07 11:19:41.798084] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:00.248 2024/10/07 11:19:41 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:00.248 [2024-10-07 11:19:41.813718] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:00.248 [2024-10-07 11:19:41.813751] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:00.248 2024/10/07 11:19:41 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:00.248 [2024-10-07 11:19:41.824103] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:00.248 [2024-10-07 11:19:41.824135] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:00.248 2024/10/07 11:19:41 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:00.248 [2024-10-07 11:19:41.839154] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:00.248 [2024-10-07 11:19:41.839188] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:00.248 2024/10/07 11:19:41 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:00.248 [2024-10-07 11:19:41.856822] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:00.248 [2024-10-07 11:19:41.856866] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:00.248 2024/10/07 11:19:41 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:00.248 [2024-10-07 11:19:41.873375] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:00.248 [2024-10-07 11:19:41.873431] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:00.249 2024/10/07 11:19:41 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:00.249 [2024-10-07 11:19:41.890371] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:00.249 [2024-10-07 11:19:41.890420] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:00.249 2024/10/07 11:19:41 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:00.249 [2024-10-07 11:19:41.906435] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:00.249 [2024-10-07 11:19:41.906486] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:00.249 2024/10/07 11:19:41 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:00.249 [2024-10-07 11:19:41.924037] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:00.249 [2024-10-07 11:19:41.924085] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:00.249 2024/10/07 11:19:41 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:00.249 [2024-10-07 11:19:41.937923] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:00.249 [2024-10-07 11:19:41.937970] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:00.249 2024/10/07 11:19:41 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:00.249 [2024-10-07 11:19:41.956900] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:00.249 [2024-10-07 11:19:41.956951] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:00.507 2024/10/07 11:19:41 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:00.507 [2024-10-07 11:19:41.973517] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:00.507 [2024-10-07 11:19:41.973552] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:00.507 2024/10/07 11:19:41 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:00.507 [2024-10-07 11:19:41.991737] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:00.507 [2024-10-07 11:19:41.991771] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:00.507 2024/10/07 11:19:41 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:00.507 [2024-10-07 11:19:42.006961] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:00.507 [2024-10-07 11:19:42.006994] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:00.507 2024/10/07 11:19:42 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:00.507 [2024-10-07 11:19:42.019338] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:00.507 [2024-10-07 11:19:42.019371] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:00.507 2024/10/07 11:19:42 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:00.507 [2024-10-07 11:19:42.036315] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:00.507 [2024-10-07 11:19:42.036349] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:00.507 2024/10/07 11:19:42 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:00.507 [2024-10-07 11:19:42.051915] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:00.507 [2024-10-07 11:19:42.051950] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:00.507 2024/10/07 11:19:42 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:00.507 [2024-10-07 11:19:42.069635] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:00.507 [2024-10-07 11:19:42.069676] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:00.507 2024/10/07 11:19:42 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:00.508 [2024-10-07 11:19:42.084880] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:00.508 [2024-10-07 11:19:42.084913] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:00.508 2024/10/07 11:19:42 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:00.508 [2024-10-07 11:19:42.095532] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:00.508 [2024-10-07 11:19:42.095563] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:00.508 2024/10/07 11:19:42 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:00.508 [2024-10-07 11:19:42.110137] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:00.508 [2024-10-07 11:19:42.110174] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:00.508 2024/10/07 11:19:42 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:00.508 [2024-10-07 11:19:42.120822] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:00.508 [2024-10-07 11:19:42.120856] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:00.508 2024/10/07 11:19:42 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:00.508 [2024-10-07 11:19:42.135357] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:00.508 [2024-10-07 11:19:42.135390] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:00.508 2024/10/07 11:19:42 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:00.508 [2024-10-07 11:19:42.145877] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:00.508 [2024-10-07 11:19:42.145909] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:00.508 2024/10/07 11:19:42 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:00.508 [2024-10-07 11:19:42.160967] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:00.508 [2024-10-07 11:19:42.161001] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:00.508 2024/10/07 11:19:42 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:00.508 [2024-10-07 11:19:42.178286] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:00.508 [2024-10-07 11:19:42.178321] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:00.508 2024/10/07 11:19:42 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:00.508 [2024-10-07 11:19:42.193347] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:00.508 [2024-10-07 11:19:42.193380] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:00.508 2024/10/07 11:19:42 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:00.508 [2024-10-07 11:19:42.208815] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:00.508 [2024-10-07 11:19:42.208849] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:00.508 2024/10/07 11:19:42 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:00.766 [2024-10-07 11:19:42.219383] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:00.766 [2024-10-07 11:19:42.219429] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:00.766 2024/10/07 11:19:42 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:00.766 [2024-10-07 11:19:42.234400] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:00.766 [2024-10-07 11:19:42.234446] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:00.767 2024/10/07 11:19:42 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:00.767 [2024-10-07 11:19:42.251273] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:00.767 [2024-10-07 11:19:42.251307] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:00.767 2024/10/07 11:19:42 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:00.767 [2024-10-07 11:19:42.267674] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:00.767 [2024-10-07 11:19:42.267706] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:00.767 2024/10/07 11:19:42 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:00.767 [2024-10-07 11:19:42.284798] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:00.767 [2024-10-07 11:19:42.284832] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:00.767 2024/10/07 11:19:42 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:00.767 [2024-10-07 11:19:42.300124] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:00.767 [2024-10-07 11:19:42.300157] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:00.767 2024/10/07 11:19:42 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:00.767 [2024-10-07 11:19:42.310515] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:00.767 [2024-10-07 11:19:42.310546] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:00.767 2024/10/07 11:19:42 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:00.767 [2024-10-07 11:19:42.321378] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:00.767 [2024-10-07 11:19:42.321422] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:00.767 2024/10/07 11:19:42 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:00.767 [2024-10-07 11:19:42.332280] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:00.767 [2024-10-07 11:19:42.332324] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:00.767 2024/10/07 11:19:42 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:00.767 [2024-10-07 11:19:42.347078] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:00.767 [2024-10-07 11:19:42.347116] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:00.767 2024/10/07 11:19:42 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:00.767 [2024-10-07 11:19:42.363916] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:00.767 [2024-10-07 11:19:42.363953] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:00.767 2024/10/07 11:19:42 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:00.767 [2024-10-07 11:19:42.379657] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:00.767 [2024-10-07 11:19:42.379693] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:00.767 11350.00 IOPS, 88.67 MiB/s [2024-10-07T11:19:42.478Z] 2024/10/07 11:19:42 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:00.767 [2024-10-07 11:19:42.397233] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:00.767 [2024-10-07 11:19:42.397268] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:00.767 2024/10/07 11:19:42 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:00.767 [2024-10-07 11:19:42.412350] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:00.767 [2024-10-07 11:19:42.412383] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:00.767 2024/10/07 11:19:42 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:00.767 [2024-10-07 11:19:42.423122] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:00.767 [2024-10-07 11:19:42.423155] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:00.767 2024/10/07 11:19:42 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:00.767 [2024-10-07 11:19:42.437858] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:00.767 [2024-10-07 11:19:42.437892] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:00.767 2024/10/07 11:19:42 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:00.767 [2024-10-07 11:19:42.456211] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:00.767 [2024-10-07 11:19:42.456245] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:00.767 2024/10/07 11:19:42 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:00.767 [2024-10-07 11:19:42.471383] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:00.767 [2024-10-07 11:19:42.471429] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:00.767 2024/10/07 11:19:42 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:01.026 [2024-10-07 11:19:42.488818] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:01.026 [2024-10-07 11:19:42.488854] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:01.026 2024/10/07 11:19:42 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:01.026 [2024-10-07 11:19:42.504327] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:01.026 [2024-10-07 11:19:42.504362] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:01.026 2024/10/07 11:19:42 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:01.026 [2024-10-07 11:19:42.514907] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:01.026 [2024-10-07 11:19:42.514941] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:01.026 2024/10/07 11:19:42 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:01.026 [2024-10-07 11:19:42.529827] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:01.026 [2024-10-07 11:19:42.529862] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:01.026 2024/10/07 11:19:42 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:01.026 [2024-10-07 11:19:42.548055] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:01.026 [2024-10-07 11:19:42.548090] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:01.026 2024/10/07 11:19:42 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:01.026 [2024-10-07 11:19:42.563128] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:01.026 [2024-10-07 11:19:42.563162] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:01.026 2024/10/07 11:19:42 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:01.026 [2024-10-07 11:19:42.572501] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:01.026 [2024-10-07 11:19:42.572531] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:01.026 2024/10/07 11:19:42 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:01.026 [2024-10-07 11:19:42.588363] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:01.026 [2024-10-07 11:19:42.588403] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:01.026 2024/10/07 11:19:42 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:01.026 [2024-10-07 11:19:42.603797] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:01.026 [2024-10-07 11:19:42.603831] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:01.026 2024/10/07 11:19:42 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:01.026 [2024-10-07 11:19:42.614343] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:01.026 [2024-10-07 11:19:42.614375] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:01.026 2024/10/07 11:19:42 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:01.026 [2024-10-07 11:19:42.629066] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:01.026 [2024-10-07 11:19:42.629099] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:01.026 2024/10/07 11:19:42 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:01.026 [2024-10-07 11:19:42.641280] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:01.026 [2024-10-07 11:19:42.641316] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:01.026 2024/10/07 11:19:42 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:01.026 [2024-10-07 11:19:42.658884] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:01.026 [2024-10-07 11:19:42.658919] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:01.026 2024/10/07 11:19:42 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:01.026 [2024-10-07 11:19:42.674145] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:01.026 [2024-10-07 11:19:42.674178] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:01.026 2024/10/07 11:19:42 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:01.026 [2024-10-07 11:19:42.691389] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:01.026 [2024-10-07 11:19:42.691437] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:01.026 2024/10/07 11:19:42 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:01.026 [2024-10-07 11:19:42.706981] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:01.026 [2024-10-07 11:19:42.707016] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:01.026 2024/10/07 11:19:42 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:01.026 [2024-10-07 11:19:42.723974] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:01.026 [2024-10-07 11:19:42.724010] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:01.026 2024/10/07 11:19:42 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:01.285 [2024-10-07 11:19:42.740422] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:01.286 [2024-10-07 11:19:42.740454] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:01.286 2024/10/07 11:19:42 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:01.286 [2024-10-07 11:19:42.756204] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:01.286 [2024-10-07 11:19:42.756242] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:01.286 2024/10/07 11:19:42 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:01.286 [2024-10-07 11:19:42.774621] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:01.286 [2024-10-07 11:19:42.774667] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:01.286 2024/10/07 11:19:42 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:01.286 [2024-10-07 11:19:42.789024] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:01.286 [2024-10-07 11:19:42.789060] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:01.286 2024/10/07 11:19:42 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:01.286 [2024-10-07 11:19:42.805197] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:01.286 [2024-10-07 11:19:42.805235] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:01.286 2024/10/07 11:19:42 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:01.286 [2024-10-07 11:19:42.820711] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:01.286 [2024-10-07 11:19:42.820753] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:01.286 2024/10/07 11:19:42 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:01.286 [2024-10-07 11:19:42.837207] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:01.286 [2024-10-07 11:19:42.837248] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:01.286 2024/10/07 11:19:42 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:01.286 [2024-10-07 11:19:42.852772] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:01.286 [2024-10-07 11:19:42.852809] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:01.286 2024/10/07 11:19:42 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:01.286 [2024-10-07 11:19:42.870548] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:01.286 [2024-10-07 11:19:42.870582] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:01.286 2024/10/07 11:19:42 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:01.286 [2024-10-07 11:19:42.886460] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:01.286 [2024-10-07 11:19:42.886495] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:01.286 2024/10/07 11:19:42 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:01.286 [2024-10-07 11:19:42.899370] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:01.286 [2024-10-07 11:19:42.899424] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:01.286 2024/10/07 11:19:42 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:01.286 [2024-10-07 11:19:42.915183] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:01.286 [2024-10-07 11:19:42.915228] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:01.286 2024/10/07 11:19:42 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:01.286 [2024-10-07 11:19:42.930911] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:01.286 [2024-10-07 11:19:42.930958] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:01.286 2024/10/07 11:19:42 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:01.286 [2024-10-07 11:19:42.946821] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:01.286 [2024-10-07 11:19:42.946869] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:01.286 2024/10/07 11:19:42 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:01.286 [2024-10-07 11:19:42.963804] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:01.286 [2024-10-07 11:19:42.963857] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:01.286 2024/10/07 11:19:42 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:01.286 [2024-10-07 11:19:42.980798] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:01.286 [2024-10-07 11:19:42.980850] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:01.286 2024/10/07 11:19:42 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:01.545 [2024-10-07 11:19:42.995908] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:01.545 [2024-10-07 11:19:42.995957] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:01.545 2024/10/07 11:19:42 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:01.545 [2024-10-07 11:19:43.013406] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:01.545 [2024-10-07 11:19:43.013476] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:01.545 2024/10/07 11:19:43 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:01.545 [2024-10-07 11:19:43.028506] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:01.545 [2024-10-07 11:19:43.028559] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:01.545 2024/10/07 11:19:43 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:01.545 [2024-10-07 11:19:43.045254] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:01.545 [2024-10-07 11:19:43.045307] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:01.545 2024/10/07 11:19:43 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:01.545 [2024-10-07 11:19:43.061330] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:01.545 [2024-10-07 11:19:43.061383] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:01.545 2024/10/07 11:19:43 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:01.545 [2024-10-07 11:19:43.078737] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:01.545 [2024-10-07 11:19:43.078791] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:01.545 2024/10/07 11:19:43 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:01.545 [2024-10-07 11:19:43.095013] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:01.545 [2024-10-07 11:19:43.095063] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:01.545 2024/10/07 11:19:43 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:01.545 [2024-10-07 11:19:43.111817] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:01.545 [2024-10-07 11:19:43.111872] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:01.545 2024/10/07 11:19:43 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:01.545 [2024-10-07 11:19:43.127609] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:01.545 [2024-10-07 11:19:43.127667] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:01.545 2024/10/07 11:19:43 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:01.545 [2024-10-07 11:19:43.139880] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:01.545 [2024-10-07 11:19:43.139936] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:01.545 2024/10/07 11:19:43 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:01.545 [2024-10-07 11:19:43.156165] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:01.545 [2024-10-07 11:19:43.156217] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:01.545 2024/10/07 11:19:43 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:01.545 [2024-10-07 11:19:43.173016] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:01.545 [2024-10-07 11:19:43.173071] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:01.545 2024/10/07 11:19:43 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:01.545 [2024-10-07 11:19:43.189325] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:01.545 [2024-10-07 11:19:43.189383] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:01.545 2024/10/07 11:19:43 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:01.545 [2024-10-07 11:19:43.205594] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:01.546 [2024-10-07 11:19:43.205636] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:01.546 2024/10/07 11:19:43 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:01.546 [2024-10-07 11:19:43.221257] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:01.546 [2024-10-07 11:19:43.221292] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:01.546 2024/10/07 11:19:43 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:01.546 [2024-10-07 11:19:43.237399] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:01.546 [2024-10-07 11:19:43.237445] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:01.546 2024/10/07 11:19:43 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:01.546 [2024-10-07 11:19:43.252598] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:01.546 [2024-10-07 11:19:43.252631] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:01.805 2024/10/07 11:19:43 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:01.805 [2024-10-07 11:19:43.269334] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:01.805 [2024-10-07 11:19:43.269365] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:01.805 2024/10/07 11:19:43 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:01.805 [2024-10-07 11:19:43.285929] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:01.805 [2024-10-07 11:19:43.285963] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:01.805 2024/10/07 11:19:43 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:01.805 [2024-10-07 11:19:43.302824] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:01.805 [2024-10-07 11:19:43.302857] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:01.805 2024/10/07 11:19:43 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:01.805 [2024-10-07 11:19:43.318029] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:01.805 [2024-10-07 11:19:43.318064] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:01.805 2024/10/07 11:19:43 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:01.805 [2024-10-07 11:19:43.333489] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:01.805 [2024-10-07 11:19:43.333521] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:01.805 2024/10/07 11:19:43 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:01.805 [2024-10-07 11:19:43.348602] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:01.805 [2024-10-07 11:19:43.348634] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:01.805 2024/10/07 11:19:43 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:01.805 [2024-10-07 11:19:43.363891] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:01.805 [2024-10-07 11:19:43.363924] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:01.805 2024/10/07 11:19:43 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:01.805 [2024-10-07 11:19:43.378996] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:01.805 [2024-10-07 11:19:43.379029] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:01.805 11418.50 IOPS, 89.21 MiB/s [2024-10-07T11:19:43.516Z] 2024/10/07 11:19:43 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:01.805 [2024-10-07 11:19:43.396686] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:01.805 [2024-10-07 11:19:43.396721] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:01.805 2024/10/07 11:19:43 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:01.805 [2024-10-07 11:19:43.412129] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:01.805 [2024-10-07 11:19:43.412165] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:01.805 2024/10/07 11:19:43 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:01.805 [2024-10-07 11:19:43.428896] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:01.805 [2024-10-07 11:19:43.428932] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:01.805 2024/10/07 11:19:43 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:01.805 [2024-10-07 11:19:43.445935] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:01.805 [2024-10-07 11:19:43.445970] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:01.805 2024/10/07 11:19:43 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:01.805 [2024-10-07 11:19:43.462842] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:01.805 [2024-10-07 11:19:43.462877] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:01.805 2024/10/07 11:19:43 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:01.805 [2024-10-07 11:19:43.478700] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:01.805 [2024-10-07 11:19:43.478733] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:01.805 2024/10/07 11:19:43 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:01.805 [2024-10-07 11:19:43.494608] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:01.805 [2024-10-07 11:19:43.494641] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:01.805 2024/10/07 11:19:43 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:01.805 [2024-10-07 11:19:43.510146] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:01.805 [2024-10-07 11:19:43.510180] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:01.805 2024/10/07 11:19:43 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:02.064 [2024-10-07 11:19:43.528784] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:02.064 [2024-10-07 11:19:43.528818] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:02.064 2024/10/07 11:19:43 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:02.064 [2024-10-07 11:19:43.543777] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:02.064 [2024-10-07 11:19:43.543812] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:02.064 2024/10/07 11:19:43 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:02.064 [2024-10-07 11:19:43.560703] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:02.064 [2024-10-07 11:19:43.560739] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:02.064 2024/10/07 11:19:43 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:02.064 [2024-10-07 11:19:43.576912] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:02.064 [2024-10-07 11:19:43.576949] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:02.064 2024/10/07 11:19:43 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:02.064 [2024-10-07 11:19:43.594234] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:02.064 [2024-10-07 11:19:43.594269] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:02.064 2024/10/07 11:19:43 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:02.064 [2024-10-07 11:19:43.610136] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:02.064 [2024-10-07 11:19:43.610170] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:02.064 2024/10/07 11:19:43 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:02.065 [2024-10-07 11:19:43.625649] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:02.065 [2024-10-07 11:19:43.625716] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:02.065 2024/10/07 11:19:43 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:02.065 [2024-10-07 11:19:43.641012] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:02.065 [2024-10-07 11:19:43.641047] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:02.065 2024/10/07 11:19:43 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:02.065 [2024-10-07 11:19:43.653387] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:02.065 [2024-10-07 11:19:43.653430] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:02.065 2024/10/07 11:19:43 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:02.065 [2024-10-07 11:19:43.670995] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:02.065 [2024-10-07 11:19:43.671030] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:02.065 2024/10/07 11:19:43 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:02.065 [2024-10-07 11:19:43.686139] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:02.065 [2024-10-07 11:19:43.686174] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:02.065 2024/10/07 11:19:43 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:02.065 [2024-10-07 11:19:43.696743] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:02.065 [2024-10-07 11:19:43.696775] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:02.065 2024/10/07 11:19:43 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:02.065 [2024-10-07 11:19:43.711893] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:02.065 [2024-10-07 11:19:43.711926] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:02.065 2024/10/07 11:19:43 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:02.065 [2024-10-07 11:19:43.727856] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:02.065 [2024-10-07 11:19:43.727890] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:02.065 2024/10/07 11:19:43 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:02.065 [2024-10-07 11:19:43.738004] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:02.065 [2024-10-07 11:19:43.738037] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:02.065 2024/10/07 11:19:43 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:02.065 [2024-10-07 11:19:43.751996] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:02.065 [2024-10-07 11:19:43.752030] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:02.065 2024/10/07 11:19:43 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:02.065 [2024-10-07 11:19:43.762525] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:02.065 [2024-10-07 11:19:43.762558] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:02.065 2024/10/07 11:19:43 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:02.324 [2024-10-07 11:19:43.777658] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:02.324 [2024-10-07 11:19:43.777699] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:02.324 2024/10/07 11:19:43 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:02.324 [2024-10-07 11:19:43.795353] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:02.324 [2024-10-07 11:19:43.795387] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:02.324 2024/10/07 11:19:43 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:02.324 [2024-10-07 11:19:43.810665] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:02.324 [2024-10-07 11:19:43.810700] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:02.324 2024/10/07 11:19:43 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:02.324 [2024-10-07 11:19:43.827125] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:02.324 [2024-10-07 11:19:43.827158] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:02.324 2024/10/07 11:19:43 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:02.324 [2024-10-07 11:19:43.845108] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:02.324 [2024-10-07 11:19:43.845142] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:02.324 2024/10/07 11:19:43 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:02.324 [2024-10-07 11:19:43.860830] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:02.324 [2024-10-07 11:19:43.860863] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:02.324 2024/10/07 11:19:43 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:02.324 [2024-10-07 11:19:43.877937] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:02.324 [2024-10-07 11:19:43.877972] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:02.324 2024/10/07 11:19:43 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:02.324 [2024-10-07 11:19:43.893820] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:02.324 [2024-10-07 11:19:43.893852] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:02.324 2024/10/07 11:19:43 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:02.324 [2024-10-07 11:19:43.910377] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:02.324 [2024-10-07 11:19:43.910425] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:02.324 2024/10/07 11:19:43 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:02.324 [2024-10-07 11:19:43.928495] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:02.324 [2024-10-07 11:19:43.928529] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:02.324 2024/10/07 11:19:43 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:02.324 [2024-10-07 11:19:43.942907] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:02.324 [2024-10-07 11:19:43.942942] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:02.324 2024/10/07 11:19:43 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:02.324 [2024-10-07 11:19:43.959038] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:02.324 [2024-10-07 11:19:43.959072] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:02.324 2024/10/07 11:19:43 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:02.324 [2024-10-07 11:19:43.975704] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:02.324 [2024-10-07 11:19:43.975738] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:02.324 2024/10/07 11:19:43 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:02.324 [2024-10-07 11:19:43.991222] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:02.324 [2024-10-07 11:19:43.991255] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:02.324 2024/10/07 11:19:43 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:02.324 [2024-10-07 11:19:44.009242] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:02.324 [2024-10-07 11:19:44.009276] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:02.324 2024/10/07 11:19:44 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:02.324 [2024-10-07 11:19:44.024254] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:02.324 [2024-10-07 11:19:44.024288] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:02.324 2024/10/07 11:19:44 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:02.584 [2024-10-07 11:19:44.037617] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:02.584 [2024-10-07 11:19:44.037649] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:02.584 2024/10/07 11:19:44 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:02.584 [2024-10-07 11:19:44.055537] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:02.584 [2024-10-07 11:19:44.055569] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:02.584 2024/10/07 11:19:44 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:02.584 [2024-10-07 11:19:44.070169] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:02.584 [2024-10-07 11:19:44.070201] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:02.584 2024/10/07 11:19:44 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:02.584 [2024-10-07 11:19:44.079222] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:02.584 [2024-10-07 11:19:44.079256] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:02.584 2024/10/07 11:19:44 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:02.584 [2024-10-07 11:19:44.094625] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:02.584 [2024-10-07 11:19:44.094657] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:02.584 2024/10/07 11:19:44 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:02.584 [2024-10-07 11:19:44.111662] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:02.584 [2024-10-07 11:19:44.111695] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:02.584 2024/10/07 11:19:44 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:02.584 [2024-10-07 11:19:44.127193] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:02.584 [2024-10-07 11:19:44.127225] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:02.584 2024/10/07 11:19:44 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:02.584 [2024-10-07 11:19:44.137896] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:02.584 [2024-10-07 11:19:44.137928] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:02.584 2024/10/07 11:19:44 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:02.584 [2024-10-07 11:19:44.152271] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:02.584 [2024-10-07 11:19:44.152303] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:02.584 2024/10/07 11:19:44 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:02.584 [2024-10-07 11:19:44.161936] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:02.584 [2024-10-07 11:19:44.161976] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:02.584 2024/10/07 11:19:44 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:02.584 [2024-10-07 11:19:44.178323] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:02.584 [2024-10-07 11:19:44.178383] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:02.584 2024/10/07 11:19:44 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:02.584 [2024-10-07 11:19:44.194105] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:02.584 [2024-10-07 11:19:44.194138] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:02.584 2024/10/07 11:19:44 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:02.584 [2024-10-07 11:19:44.204856] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:02.584 [2024-10-07 11:19:44.204889] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:02.584 2024/10/07 11:19:44 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:02.584 [2024-10-07 11:19:44.215508] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:02.584 [2024-10-07 11:19:44.215543] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:02.584 2024/10/07 11:19:44 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:02.584 [2024-10-07 11:19:44.232787] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:02.584 [2024-10-07 11:19:44.232852] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:02.584 2024/10/07 11:19:44 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:02.584 [2024-10-07 11:19:44.248155] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:02.584 [2024-10-07 11:19:44.248188] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:02.584 2024/10/07 11:19:44 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:02.584 [2024-10-07 11:19:44.258829] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:02.584 [2024-10-07 11:19:44.258863] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:02.584 2024/10/07 11:19:44 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:02.584 [2024-10-07 11:19:44.273484] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:02.584 [2024-10-07 11:19:44.273523] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:02.584 2024/10/07 11:19:44 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:02.584 [2024-10-07 11:19:44.283889] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:02.584 [2024-10-07 11:19:44.283922] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:02.584 2024/10/07 11:19:44 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:02.844 [2024-10-07 11:19:44.299042] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:02.844 [2024-10-07 11:19:44.299104] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:02.844 2024/10/07 11:19:44 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:02.844 [2024-10-07 11:19:44.316494] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:02.844 [2024-10-07 11:19:44.316558] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:02.844 2024/10/07 11:19:44 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:02.844 [2024-10-07 11:19:44.332804] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:02.844 [2024-10-07 11:19:44.332867] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:02.844 2024/10/07 11:19:44 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:02.844 [2024-10-07 11:19:44.349053] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:02.844 [2024-10-07 11:19:44.349085] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:02.844 2024/10/07 11:19:44 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:02.844 [2024-10-07 11:19:44.365661] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:02.844 [2024-10-07 11:19:44.365702] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:02.844 2024/10/07 11:19:44 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:02.844 11466.80 IOPS, 89.58 MiB/s [2024-10-07T11:19:44.555Z] [2024-10-07 11:19:44.382834] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:02.844 [2024-10-07 11:19:44.382866] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:02.844 2024/10/07 11:19:44 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:02.844 00:09:02.844 Latency(us) 00:09:02.844 [2024-10-07T11:19:44.555Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:09:02.844 Job: Nvme1n1 (Core Mask 0x1, workload: randrw, percentage: 50, depth: 128, IO size: 8192) 00:09:02.844 Nvme1n1 : 5.01 11469.50 89.61 0.00 0.00 11146.41 4676.89 22520.55 00:09:02.844 [2024-10-07T11:19:44.555Z] =================================================================================================================== 00:09:02.844 [2024-10-07T11:19:44.555Z] Total : 11469.50 89.61 0.00 0.00 11146.41 4676.89 22520.55 00:09:02.844 [2024-10-07 11:19:44.394296] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:02.844 [2024-10-07 11:19:44.394321] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:02.844 2024/10/07 11:19:44 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:02.844 [2024-10-07 11:19:44.406296] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:02.844 [2024-10-07 11:19:44.406325] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:02.844 2024/10/07 11:19:44 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:02.844 [2024-10-07 11:19:44.414283] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:02.844 [2024-10-07 11:19:44.414307] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:02.844 2024/10/07 11:19:44 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:02.844 [2024-10-07 11:19:44.426344] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:02.844 [2024-10-07 11:19:44.426383] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:02.844 2024/10/07 11:19:44 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:02.844 [2024-10-07 11:19:44.438322] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:02.844 [2024-10-07 11:19:44.438358] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:02.844 2024/10/07 11:19:44 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:02.844 [2024-10-07 11:19:44.450314] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:02.844 [2024-10-07 11:19:44.450347] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:02.844 2024/10/07 11:19:44 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:02.844 [2024-10-07 11:19:44.458293] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:02.844 [2024-10-07 11:19:44.458317] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:02.844 2024/10/07 11:19:44 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:02.844 [2024-10-07 11:19:44.470317] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:02.844 [2024-10-07 11:19:44.470349] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:02.844 2024/10/07 11:19:44 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:02.844 [2024-10-07 11:19:44.482355] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:02.844 [2024-10-07 11:19:44.482396] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:02.844 2024/10/07 11:19:44 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:02.844 [2024-10-07 11:19:44.494367] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:02.844 [2024-10-07 11:19:44.494420] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:02.844 2024/10/07 11:19:44 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:02.844 [2024-10-07 11:19:44.506374] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:02.844 [2024-10-07 11:19:44.506430] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:02.845 2024/10/07 11:19:44 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:02.845 [2024-10-07 11:19:44.518358] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:02.845 [2024-10-07 11:19:44.518396] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:02.845 2024/10/07 11:19:44 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:02.845 [2024-10-07 11:19:44.530346] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:02.845 [2024-10-07 11:19:44.530382] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:02.845 2024/10/07 11:19:44 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:02.845 [2024-10-07 11:19:44.542350] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:02.845 [2024-10-07 11:19:44.542382] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:02.845 2024/10/07 11:19:44 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:03.105 [2024-10-07 11:19:44.554350] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:03.105 [2024-10-07 11:19:44.554383] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:03.105 2024/10/07 11:19:44 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:03.105 [2024-10-07 11:19:44.566354] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:03.105 [2024-10-07 11:19:44.566386] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:03.105 2024/10/07 11:19:44 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:03.105 [2024-10-07 11:19:44.578338] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:03.105 [2024-10-07 11:19:44.578364] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:03.106 2024/10/07 11:19:44 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:03.106 [2024-10-07 11:19:44.590336] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:03.106 [2024-10-07 11:19:44.590360] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:03.106 2024/10/07 11:19:44 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:03.106 [2024-10-07 11:19:44.602339] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:03.106 [2024-10-07 11:19:44.602362] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:03.106 2024/10/07 11:19:44 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:03.106 [2024-10-07 11:19:44.614368] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:03.106 [2024-10-07 11:19:44.614400] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:03.106 2024/10/07 11:19:44 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:03.106 [2024-10-07 11:19:44.626384] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:03.106 [2024-10-07 11:19:44.626441] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:03.106 2024/10/07 11:19:44 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:03.106 [2024-10-07 11:19:44.638369] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:03.106 [2024-10-07 11:19:44.638399] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:03.106 2024/10/07 11:19:44 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:03.106 [2024-10-07 11:19:44.650356] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:03.106 [2024-10-07 11:19:44.650380] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:03.106 2024/10/07 11:19:44 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:03.106 [2024-10-07 11:19:44.662385] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:03.106 [2024-10-07 11:19:44.662425] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:03.106 2024/10/07 11:19:44 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:03.106 [2024-10-07 11:19:44.674449] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:03.106 [2024-10-07 11:19:44.674503] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:03.106 2024/10/07 11:19:44 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:03.106 [2024-10-07 11:19:44.686437] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:03.106 [2024-10-07 11:19:44.686481] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:03.106 2024/10/07 11:19:44 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:03.106 [2024-10-07 11:19:44.698369] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:03.106 [2024-10-07 11:19:44.698393] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:03.106 2024/10/07 11:19:44 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:03.106 [2024-10-07 11:19:44.710394] subsystem.c:2128:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:09:03.106 [2024-10-07 11:19:44.710437] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:03.106 2024/10/07 11:19:44 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:malloc0 no_auto_visible:%!s(bool=false) nsid:1] nqn:nqn.2016-06.io.spdk:cnode1], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:03.106 /home/vagrant/spdk_repo/spdk/test/nvmf/target/zcopy.sh: line 42: kill: (69339) - No such process 00:09:03.106 11:19:44 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- target/zcopy.sh@49 -- # wait 69339 00:09:03.106 11:19:44 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- target/zcopy.sh@52 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:09:03.106 11:19:44 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:03.106 11:19:44 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@10 -- # set +x 00:09:03.106 11:19:44 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:03.106 11:19:44 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- target/zcopy.sh@53 -- # rpc_cmd bdev_delay_create -b malloc0 -d delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:09:03.106 11:19:44 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:03.106 11:19:44 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@10 -- # set +x 00:09:03.106 delay0 00:09:03.106 11:19:44 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:03.106 11:19:44 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- target/zcopy.sh@54 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 delay0 -n 1 00:09:03.106 11:19:44 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:03.106 11:19:44 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@10 -- # set +x 00:09:03.106 11:19:44 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:03.106 11:19:44 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- target/zcopy.sh@56 -- # /home/vagrant/spdk_repo/spdk/build/examples/abort -c 0x1 -t 5 -q 64 -w randrw -M 50 -l warning -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.3 trsvcid:4420 ns:1' 00:09:03.374 [2024-10-07 11:19:44.924681] nvme_fabric.c: 295:nvme_fabric_discover_probe: *WARNING*: Skipping unsupported current discovery service or discovery service referral 00:09:09.937 Initializing NVMe Controllers 00:09:09.937 Attached to NVMe over Fabrics controller at 10.0.0.3:4420: nqn.2016-06.io.spdk:cnode1 00:09:09.937 Associating TCP (addr:10.0.0.3 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:09:09.937 Initialization complete. Launching workers. 00:09:09.937 NS: TCP (addr:10.0.0.3 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 I/O completed: 320, failed: 82 00:09:09.937 CTRLR: TCP (addr:10.0.0.3 subnqn:nqn.2016-06.io.spdk:cnode1) abort submitted 369, failed to submit 33 00:09:09.937 success 180, unsuccessful 189, failed 0 00:09:09.937 11:19:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- target/zcopy.sh@59 -- # trap - SIGINT SIGTERM EXIT 00:09:09.937 11:19:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- target/zcopy.sh@60 -- # nvmftestfini 00:09:09.937 11:19:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@514 -- # nvmfcleanup 00:09:09.937 11:19:50 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@121 -- # sync 00:09:09.937 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:09:09.937 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@124 -- # set +e 00:09:09.937 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@125 -- # for i in {1..20} 00:09:09.937 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:09:09.937 rmmod nvme_tcp 00:09:09.937 rmmod nvme_fabrics 00:09:09.937 rmmod nvme_keyring 00:09:09.937 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:09:09.937 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@128 -- # set -e 00:09:09.937 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@129 -- # return 0 00:09:09.937 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@515 -- # '[' -n 69165 ']' 00:09:09.937 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@516 -- # killprocess 69165 00:09:09.937 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@950 -- # '[' -z 69165 ']' 00:09:09.937 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@954 -- # kill -0 69165 00:09:09.937 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@955 -- # uname 00:09:09.937 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:09:09.937 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 69165 00:09:09.937 killing process with pid 69165 00:09:09.937 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@956 -- # process_name=reactor_1 00:09:09.937 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@960 -- # '[' reactor_1 = sudo ']' 00:09:09.937 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@968 -- # echo 'killing process with pid 69165' 00:09:09.937 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@969 -- # kill 69165 00:09:09.937 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@974 -- # wait 69165 00:09:09.937 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:09:09.937 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:09:09.937 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:09:09.937 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@297 -- # iptr 00:09:09.937 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@789 -- # iptables-save 00:09:09.937 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:09:09.937 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@789 -- # iptables-restore 00:09:09.937 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@298 -- # [[ nvmf_tgt_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:09:09.937 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@299 -- # nvmf_veth_fini 00:09:09.937 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@233 -- # ip link set nvmf_init_br nomaster 00:09:09.937 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@234 -- # ip link set nvmf_init_br2 nomaster 00:09:09.937 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@235 -- # ip link set nvmf_tgt_br nomaster 00:09:09.937 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@236 -- # ip link set nvmf_tgt_br2 nomaster 00:09:09.937 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@237 -- # ip link set nvmf_init_br down 00:09:09.937 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@238 -- # ip link set nvmf_init_br2 down 00:09:09.937 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@239 -- # ip link set nvmf_tgt_br down 00:09:09.937 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@240 -- # ip link set nvmf_tgt_br2 down 00:09:09.937 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@241 -- # ip link delete nvmf_br type bridge 00:09:09.937 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@242 -- # ip link delete nvmf_init_if 00:09:09.937 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@243 -- # ip link delete nvmf_init_if2 00:09:09.937 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@244 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:09:09.937 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@245 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:09:09.937 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@246 -- # remove_spdk_ns 00:09:09.937 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:09:09.937 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:09:09.937 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:09:10.196 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- nvmf/common.sh@300 -- # return 0 00:09:10.196 00:09:10.196 real 0m25.683s 00:09:10.196 user 0m41.354s 00:09:10.196 sys 0m6.830s 00:09:10.196 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@1126 -- # xtrace_disable 00:09:10.196 ************************************ 00:09:10.196 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_zcopy -- common/autotest_common.sh@10 -- # set +x 00:09:10.196 END TEST nvmf_zcopy 00:09:10.196 ************************************ 00:09:10.196 11:19:51 nvmf_tcp.nvmf_target_core -- nvmf/nvmf_target_core.sh@33 -- # run_test nvmf_nmic /home/vagrant/spdk_repo/spdk/test/nvmf/target/nmic.sh --transport=tcp 00:09:10.196 11:19:51 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:09:10.196 11:19:51 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1107 -- # xtrace_disable 00:09:10.196 11:19:51 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@10 -- # set +x 00:09:10.196 ************************************ 00:09:10.196 START TEST nvmf_nmic 00:09:10.196 ************************************ 00:09:10.196 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/nvmf/target/nmic.sh --transport=tcp 00:09:10.196 * Looking for test storage... 00:09:10.196 * Found test storage at /home/vagrant/spdk_repo/spdk/test/nvmf/target 00:09:10.196 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:09:10.196 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@1681 -- # lcov --version 00:09:10.196 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:09:10.196 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:09:10.196 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_nmic -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:09:10.196 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_nmic -- scripts/common.sh@333 -- # local ver1 ver1_l 00:09:10.196 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_nmic -- scripts/common.sh@334 -- # local ver2 ver2_l 00:09:10.196 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_nmic -- scripts/common.sh@336 -- # IFS=.-: 00:09:10.196 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_nmic -- scripts/common.sh@336 -- # read -ra ver1 00:09:10.196 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_nmic -- scripts/common.sh@337 -- # IFS=.-: 00:09:10.196 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_nmic -- scripts/common.sh@337 -- # read -ra ver2 00:09:10.196 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_nmic -- scripts/common.sh@338 -- # local 'op=<' 00:09:10.196 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_nmic -- scripts/common.sh@340 -- # ver1_l=2 00:09:10.196 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_nmic -- scripts/common.sh@341 -- # ver2_l=1 00:09:10.196 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_nmic -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:09:10.196 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_nmic -- scripts/common.sh@344 -- # case "$op" in 00:09:10.196 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_nmic -- scripts/common.sh@345 -- # : 1 00:09:10.196 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_nmic -- scripts/common.sh@364 -- # (( v = 0 )) 00:09:10.196 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_nmic -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:09:10.196 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_nmic -- scripts/common.sh@365 -- # decimal 1 00:09:10.196 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_nmic -- scripts/common.sh@353 -- # local d=1 00:09:10.196 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_nmic -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:09:10.196 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_nmic -- scripts/common.sh@355 -- # echo 1 00:09:10.457 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_nmic -- scripts/common.sh@365 -- # ver1[v]=1 00:09:10.457 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_nmic -- scripts/common.sh@366 -- # decimal 2 00:09:10.457 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_nmic -- scripts/common.sh@353 -- # local d=2 00:09:10.457 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_nmic -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:09:10.457 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_nmic -- scripts/common.sh@355 -- # echo 2 00:09:10.457 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_nmic -- scripts/common.sh@366 -- # ver2[v]=2 00:09:10.457 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_nmic -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:09:10.457 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_nmic -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:09:10.457 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_nmic -- scripts/common.sh@368 -- # return 0 00:09:10.457 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:09:10.457 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:09:10.457 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:10.457 --rc genhtml_branch_coverage=1 00:09:10.457 --rc genhtml_function_coverage=1 00:09:10.457 --rc genhtml_legend=1 00:09:10.457 --rc geninfo_all_blocks=1 00:09:10.457 --rc geninfo_unexecuted_blocks=1 00:09:10.457 00:09:10.457 ' 00:09:10.457 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:09:10.457 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:10.457 --rc genhtml_branch_coverage=1 00:09:10.457 --rc genhtml_function_coverage=1 00:09:10.457 --rc genhtml_legend=1 00:09:10.457 --rc geninfo_all_blocks=1 00:09:10.457 --rc geninfo_unexecuted_blocks=1 00:09:10.457 00:09:10.457 ' 00:09:10.457 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:09:10.457 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:10.457 --rc genhtml_branch_coverage=1 00:09:10.457 --rc genhtml_function_coverage=1 00:09:10.457 --rc genhtml_legend=1 00:09:10.457 --rc geninfo_all_blocks=1 00:09:10.457 --rc geninfo_unexecuted_blocks=1 00:09:10.457 00:09:10.457 ' 00:09:10.457 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:09:10.457 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:10.457 --rc genhtml_branch_coverage=1 00:09:10.457 --rc genhtml_function_coverage=1 00:09:10.457 --rc genhtml_legend=1 00:09:10.457 --rc geninfo_all_blocks=1 00:09:10.457 --rc geninfo_unexecuted_blocks=1 00:09:10.457 00:09:10.457 ' 00:09:10.457 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_nmic -- target/nmic.sh@9 -- # source /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh 00:09:10.457 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@7 -- # uname -s 00:09:10.457 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:09:10.457 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:09:10.457 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:09:10.457 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:09:10.457 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:09:10.457 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:09:10.457 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:09:10.457 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:09:10.457 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:09:10.457 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:09:10.457 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:09:10.457 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@18 -- # NVME_HOSTID=3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:09:10.457 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:09:10.457 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:09:10.457 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@21 -- # NET_TYPE=virt 00:09:10.457 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:09:10.457 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@49 -- # source /home/vagrant/spdk_repo/spdk/scripts/common.sh 00:09:10.457 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_nmic -- scripts/common.sh@15 -- # shopt -s extglob 00:09:10.457 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_nmic -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:09:10.457 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_nmic -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:09:10.457 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_nmic -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:09:10.457 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_nmic -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:10.457 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_nmic -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:10.457 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_nmic -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:10.457 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_nmic -- paths/export.sh@5 -- # export PATH 00:09:10.457 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_nmic -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:10.457 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@51 -- # : 0 00:09:10.457 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:09:10.457 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:09:10.457 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:09:10.457 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:09:10.457 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:09:10.457 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:09:10.457 /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:09:10.457 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:09:10.457 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:09:10.457 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@55 -- # have_pci_nics=0 00:09:10.457 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_nmic -- target/nmic.sh@11 -- # MALLOC_BDEV_SIZE=64 00:09:10.457 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_nmic -- target/nmic.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:09:10.457 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_nmic -- target/nmic.sh@14 -- # nvmftestinit 00:09:10.457 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:09:10.457 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:09:10.457 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@474 -- # prepare_net_devs 00:09:10.457 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@436 -- # local -g is_hw=no 00:09:10.457 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@438 -- # remove_spdk_ns 00:09:10.457 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:09:10.457 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:09:10.457 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:09:10.457 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@440 -- # [[ virt != virt ]] 00:09:10.457 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@442 -- # [[ no == yes ]] 00:09:10.457 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@449 -- # [[ virt == phy ]] 00:09:10.457 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@452 -- # [[ virt == phy-fallback ]] 00:09:10.457 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@457 -- # [[ tcp == tcp ]] 00:09:10.457 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@458 -- # nvmf_veth_init 00:09:10.457 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@145 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:09:10.457 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@146 -- # NVMF_SECOND_INITIATOR_IP=10.0.0.2 00:09:10.458 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@147 -- # NVMF_FIRST_TARGET_IP=10.0.0.3 00:09:10.458 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@148 -- # NVMF_SECOND_TARGET_IP=10.0.0.4 00:09:10.458 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@149 -- # NVMF_INITIATOR_IP=10.0.0.1 00:09:10.458 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@150 -- # NVMF_BRIDGE=nvmf_br 00:09:10.458 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@151 -- # NVMF_INITIATOR_INTERFACE=nvmf_init_if 00:09:10.458 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@152 -- # NVMF_INITIATOR_INTERFACE2=nvmf_init_if2 00:09:10.458 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@153 -- # NVMF_INITIATOR_BRIDGE=nvmf_init_br 00:09:10.458 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@154 -- # NVMF_INITIATOR_BRIDGE2=nvmf_init_br2 00:09:10.458 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@155 -- # NVMF_TARGET_NAMESPACE=nvmf_tgt_ns_spdk 00:09:10.458 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@156 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:09:10.458 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@157 -- # NVMF_TARGET_INTERFACE=nvmf_tgt_if 00:09:10.458 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@158 -- # NVMF_TARGET_INTERFACE2=nvmf_tgt_if2 00:09:10.458 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@159 -- # NVMF_TARGET_BRIDGE=nvmf_tgt_br 00:09:10.458 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@160 -- # NVMF_TARGET_BRIDGE2=nvmf_tgt_br2 00:09:10.458 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@162 -- # ip link set nvmf_init_br nomaster 00:09:10.458 Cannot find device "nvmf_init_br" 00:09:10.458 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@162 -- # true 00:09:10.458 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@163 -- # ip link set nvmf_init_br2 nomaster 00:09:10.458 Cannot find device "nvmf_init_br2" 00:09:10.458 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@163 -- # true 00:09:10.458 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@164 -- # ip link set nvmf_tgt_br nomaster 00:09:10.458 Cannot find device "nvmf_tgt_br" 00:09:10.458 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@164 -- # true 00:09:10.458 11:19:51 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@165 -- # ip link set nvmf_tgt_br2 nomaster 00:09:10.458 Cannot find device "nvmf_tgt_br2" 00:09:10.458 11:19:52 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@165 -- # true 00:09:10.458 11:19:52 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@166 -- # ip link set nvmf_init_br down 00:09:10.458 Cannot find device "nvmf_init_br" 00:09:10.458 11:19:52 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@166 -- # true 00:09:10.458 11:19:52 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@167 -- # ip link set nvmf_init_br2 down 00:09:10.458 Cannot find device "nvmf_init_br2" 00:09:10.458 11:19:52 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@167 -- # true 00:09:10.458 11:19:52 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@168 -- # ip link set nvmf_tgt_br down 00:09:10.458 Cannot find device "nvmf_tgt_br" 00:09:10.458 11:19:52 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@168 -- # true 00:09:10.458 11:19:52 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@169 -- # ip link set nvmf_tgt_br2 down 00:09:10.458 Cannot find device "nvmf_tgt_br2" 00:09:10.458 11:19:52 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@169 -- # true 00:09:10.458 11:19:52 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@170 -- # ip link delete nvmf_br type bridge 00:09:10.458 Cannot find device "nvmf_br" 00:09:10.458 11:19:52 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@170 -- # true 00:09:10.458 11:19:52 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@171 -- # ip link delete nvmf_init_if 00:09:10.458 Cannot find device "nvmf_init_if" 00:09:10.458 11:19:52 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@171 -- # true 00:09:10.458 11:19:52 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@172 -- # ip link delete nvmf_init_if2 00:09:10.458 Cannot find device "nvmf_init_if2" 00:09:10.458 11:19:52 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@172 -- # true 00:09:10.458 11:19:52 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@173 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:09:10.458 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:09:10.458 11:19:52 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@173 -- # true 00:09:10.458 11:19:52 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@174 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:09:10.458 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:09:10.458 11:19:52 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@174 -- # true 00:09:10.458 11:19:52 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@177 -- # ip netns add nvmf_tgt_ns_spdk 00:09:10.458 11:19:52 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@180 -- # ip link add nvmf_init_if type veth peer name nvmf_init_br 00:09:10.458 11:19:52 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@181 -- # ip link add nvmf_init_if2 type veth peer name nvmf_init_br2 00:09:10.458 11:19:52 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@182 -- # ip link add nvmf_tgt_if type veth peer name nvmf_tgt_br 00:09:10.458 11:19:52 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@183 -- # ip link add nvmf_tgt_if2 type veth peer name nvmf_tgt_br2 00:09:10.458 11:19:52 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@186 -- # ip link set nvmf_tgt_if netns nvmf_tgt_ns_spdk 00:09:10.458 11:19:52 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@187 -- # ip link set nvmf_tgt_if2 netns nvmf_tgt_ns_spdk 00:09:10.717 11:19:52 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@190 -- # ip addr add 10.0.0.1/24 dev nvmf_init_if 00:09:10.717 11:19:52 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@191 -- # ip addr add 10.0.0.2/24 dev nvmf_init_if2 00:09:10.717 11:19:52 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@192 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.3/24 dev nvmf_tgt_if 00:09:10.717 11:19:52 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@193 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.4/24 dev nvmf_tgt_if2 00:09:10.717 11:19:52 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@196 -- # ip link set nvmf_init_if up 00:09:10.717 11:19:52 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@197 -- # ip link set nvmf_init_if2 up 00:09:10.717 11:19:52 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@198 -- # ip link set nvmf_init_br up 00:09:10.717 11:19:52 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@199 -- # ip link set nvmf_init_br2 up 00:09:10.717 11:19:52 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@200 -- # ip link set nvmf_tgt_br up 00:09:10.717 11:19:52 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@201 -- # ip link set nvmf_tgt_br2 up 00:09:10.717 11:19:52 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@202 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if up 00:09:10.717 11:19:52 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@203 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if2 up 00:09:10.717 11:19:52 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@204 -- # ip netns exec nvmf_tgt_ns_spdk ip link set lo up 00:09:10.717 11:19:52 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@207 -- # ip link add nvmf_br type bridge 00:09:10.717 11:19:52 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@208 -- # ip link set nvmf_br up 00:09:10.717 11:19:52 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@211 -- # ip link set nvmf_init_br master nvmf_br 00:09:10.717 11:19:52 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@212 -- # ip link set nvmf_init_br2 master nvmf_br 00:09:10.717 11:19:52 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@213 -- # ip link set nvmf_tgt_br master nvmf_br 00:09:10.717 11:19:52 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@214 -- # ip link set nvmf_tgt_br2 master nvmf_br 00:09:10.717 11:19:52 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@217 -- # ipts -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT 00:09:10.717 11:19:52 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT' 00:09:10.717 11:19:52 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@218 -- # ipts -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT 00:09:10.717 11:19:52 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT' 00:09:10.717 11:19:52 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@219 -- # ipts -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT 00:09:10.717 11:19:52 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@788 -- # iptables -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT -m comment --comment 'SPDK_NVMF:-A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT' 00:09:10.717 11:19:52 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@222 -- # ping -c 1 10.0.0.3 00:09:10.717 PING 10.0.0.3 (10.0.0.3) 56(84) bytes of data. 00:09:10.717 64 bytes from 10.0.0.3: icmp_seq=1 ttl=64 time=0.124 ms 00:09:10.717 00:09:10.717 --- 10.0.0.3 ping statistics --- 00:09:10.717 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:09:10.717 rtt min/avg/max/mdev = 0.124/0.124/0.124/0.000 ms 00:09:10.717 11:19:52 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@223 -- # ping -c 1 10.0.0.4 00:09:10.717 PING 10.0.0.4 (10.0.0.4) 56(84) bytes of data. 00:09:10.717 64 bytes from 10.0.0.4: icmp_seq=1 ttl=64 time=0.089 ms 00:09:10.717 00:09:10.717 --- 10.0.0.4 ping statistics --- 00:09:10.717 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:09:10.717 rtt min/avg/max/mdev = 0.089/0.089/0.089/0.000 ms 00:09:10.717 11:19:52 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@224 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.1 00:09:10.717 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:09:10.717 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.031 ms 00:09:10.717 00:09:10.717 --- 10.0.0.1 ping statistics --- 00:09:10.717 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:09:10.717 rtt min/avg/max/mdev = 0.031/0.031/0.031/0.000 ms 00:09:10.717 11:19:52 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@225 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.2 00:09:10.717 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:09:10.717 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.048 ms 00:09:10.717 00:09:10.717 --- 10.0.0.2 ping statistics --- 00:09:10.717 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:09:10.717 rtt min/avg/max/mdev = 0.048/0.048/0.048/0.000 ms 00:09:10.717 11:19:52 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@227 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:09:10.717 11:19:52 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@459 -- # return 0 00:09:10.717 11:19:52 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:09:10.717 11:19:52 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:09:10.717 11:19:52 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:09:10.717 11:19:52 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:09:10.717 11:19:52 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:09:10.717 11:19:52 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:09:10.717 11:19:52 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:09:10.717 11:19:52 nvmf_tcp.nvmf_target_core.nvmf_nmic -- target/nmic.sh@15 -- # nvmfappstart -m 0xF 00:09:10.717 11:19:52 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:09:10.717 11:19:52 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@724 -- # xtrace_disable 00:09:10.717 11:19:52 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@10 -- # set +x 00:09:10.717 11:19:52 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@507 -- # nvmfpid=69721 00:09:10.717 11:19:52 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@508 -- # waitforlisten 69721 00:09:10.717 11:19:52 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@831 -- # '[' -z 69721 ']' 00:09:10.717 11:19:52 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@506 -- # ip netns exec nvmf_tgt_ns_spdk /home/vagrant/spdk_repo/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:09:10.717 11:19:52 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:09:10.717 11:19:52 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@836 -- # local max_retries=100 00:09:10.717 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:09:10.717 11:19:52 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:09:10.717 11:19:52 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@840 -- # xtrace_disable 00:09:10.717 11:19:52 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@10 -- # set +x 00:09:10.717 [2024-10-07 11:19:52.423845] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:09:10.717 [2024-10-07 11:19:52.424597] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:09:10.975 [2024-10-07 11:19:52.565328] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 4 00:09:11.235 [2024-10-07 11:19:52.719964] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:09:11.235 [2024-10-07 11:19:52.720293] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:09:11.235 [2024-10-07 11:19:52.720376] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:09:11.235 [2024-10-07 11:19:52.720491] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:09:11.235 [2024-10-07 11:19:52.720569] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:09:11.235 [2024-10-07 11:19:52.722108] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:09:11.235 [2024-10-07 11:19:52.722255] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:09:11.235 [2024-10-07 11:19:52.723145] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 3 00:09:11.235 [2024-10-07 11:19:52.723181] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:09:11.799 11:19:53 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:09:11.799 11:19:53 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@864 -- # return 0 00:09:11.799 11:19:53 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:09:11.799 11:19:53 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@730 -- # xtrace_disable 00:09:11.799 11:19:53 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@10 -- # set +x 00:09:12.057 11:19:53 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:09:12.057 11:19:53 nvmf_tcp.nvmf_target_core.nvmf_nmic -- target/nmic.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:09:12.057 11:19:53 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:12.057 11:19:53 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@10 -- # set +x 00:09:12.057 [2024-10-07 11:19:53.554378] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:09:12.057 11:19:53 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:12.057 11:19:53 nvmf_tcp.nvmf_target_core.nvmf_nmic -- target/nmic.sh@20 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:09:12.057 11:19:53 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:12.057 11:19:53 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@10 -- # set +x 00:09:12.057 Malloc0 00:09:12.057 11:19:53 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:12.057 11:19:53 nvmf_tcp.nvmf_target_core.nvmf_nmic -- target/nmic.sh@21 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:09:12.057 11:19:53 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:12.057 11:19:53 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@10 -- # set +x 00:09:12.057 11:19:53 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:12.057 11:19:53 nvmf_tcp.nvmf_target_core.nvmf_nmic -- target/nmic.sh@22 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:09:12.057 11:19:53 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:12.057 11:19:53 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@10 -- # set +x 00:09:12.057 11:19:53 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:12.057 11:19:53 nvmf_tcp.nvmf_target_core.nvmf_nmic -- target/nmic.sh@23 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4420 00:09:12.057 11:19:53 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:12.057 11:19:53 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@10 -- # set +x 00:09:12.057 [2024-10-07 11:19:53.615761] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:09:12.057 test case1: single bdev can't be used in multiple subsystems 00:09:12.057 11:19:53 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:12.057 11:19:53 nvmf_tcp.nvmf_target_core.nvmf_nmic -- target/nmic.sh@25 -- # echo 'test case1: single bdev can'\''t be used in multiple subsystems' 00:09:12.057 11:19:53 nvmf_tcp.nvmf_target_core.nvmf_nmic -- target/nmic.sh@26 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK2 00:09:12.057 11:19:53 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:12.057 11:19:53 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@10 -- # set +x 00:09:12.057 11:19:53 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:12.057 11:19:53 nvmf_tcp.nvmf_target_core.nvmf_nmic -- target/nmic.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.3 -s 4420 00:09:12.057 11:19:53 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:12.057 11:19:53 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@10 -- # set +x 00:09:12.057 11:19:53 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:12.057 11:19:53 nvmf_tcp.nvmf_target_core.nvmf_nmic -- target/nmic.sh@28 -- # nmic_status=0 00:09:12.058 11:19:53 nvmf_tcp.nvmf_target_core.nvmf_nmic -- target/nmic.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc0 00:09:12.058 11:19:53 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:12.058 11:19:53 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@10 -- # set +x 00:09:12.058 [2024-10-07 11:19:53.639495] bdev.c:8202:bdev_open: *ERROR*: bdev Malloc0 already claimed: type exclusive_write by module NVMe-oF Target 00:09:12.058 [2024-10-07 11:19:53.639558] subsystem.c:2157:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode2: bdev Malloc0 cannot be opened, error=-1 00:09:12.058 [2024-10-07 11:19:53.639571] nvmf_rpc.c:1517:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:09:12.058 2024/10/07 11:19:53 error on JSON-RPC call, method: nvmf_subsystem_add_ns, params: map[namespace:map[bdev_name:Malloc0 no_auto_visible:%!s(bool=false)] nqn:nqn.2016-06.io.spdk:cnode2], err: error received for nvmf_subsystem_add_ns method, err: Code=-32602 Msg=Invalid parameters 00:09:12.058 request: 00:09:12.058 { 00:09:12.058 "method": "nvmf_subsystem_add_ns", 00:09:12.058 "params": { 00:09:12.058 "nqn": "nqn.2016-06.io.spdk:cnode2", 00:09:12.058 "namespace": { 00:09:12.058 "bdev_name": "Malloc0", 00:09:12.058 "no_auto_visible": false 00:09:12.058 } 00:09:12.058 } 00:09:12.058 } 00:09:12.058 Got JSON-RPC error response 00:09:12.058 GoRPCClient: error on JSON-RPC call 00:09:12.058 Adding namespace failed - expected result. 00:09:12.058 test case2: host connect to nvmf target in multiple paths 00:09:12.058 11:19:53 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:09:12.058 11:19:53 nvmf_tcp.nvmf_target_core.nvmf_nmic -- target/nmic.sh@29 -- # nmic_status=1 00:09:12.058 11:19:53 nvmf_tcp.nvmf_target_core.nvmf_nmic -- target/nmic.sh@31 -- # '[' 1 -eq 0 ']' 00:09:12.058 11:19:53 nvmf_tcp.nvmf_target_core.nvmf_nmic -- target/nmic.sh@36 -- # echo ' Adding namespace failed - expected result.' 00:09:12.058 11:19:53 nvmf_tcp.nvmf_target_core.nvmf_nmic -- target/nmic.sh@39 -- # echo 'test case2: host connect to nvmf target in multiple paths' 00:09:12.058 11:19:53 nvmf_tcp.nvmf_target_core.nvmf_nmic -- target/nmic.sh@40 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4421 00:09:12.058 11:19:53 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:12.058 11:19:53 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@10 -- # set +x 00:09:12.058 [2024-10-07 11:19:53.651726] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4421 *** 00:09:12.058 11:19:53 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:12.058 11:19:53 nvmf_tcp.nvmf_target_core.nvmf_nmic -- target/nmic.sh@41 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --hostid=3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.3 -s 4420 00:09:12.316 11:19:53 nvmf_tcp.nvmf_target_core.nvmf_nmic -- target/nmic.sh@42 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --hostid=3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.3 -s 4421 00:09:12.316 11:19:54 nvmf_tcp.nvmf_target_core.nvmf_nmic -- target/nmic.sh@44 -- # waitforserial SPDKISFASTANDAWESOME 00:09:12.316 11:19:54 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@1198 -- # local i=0 00:09:12.316 11:19:54 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@1199 -- # local nvme_device_counter=1 nvme_devices=0 00:09:12.316 11:19:54 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@1200 -- # [[ -n '' ]] 00:09:12.316 11:19:54 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@1205 -- # sleep 2 00:09:14.318 11:19:56 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@1206 -- # (( i++ <= 15 )) 00:09:14.318 11:19:56 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@1207 -- # lsblk -l -o NAME,SERIAL 00:09:14.318 11:19:56 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@1207 -- # grep -c SPDKISFASTANDAWESOME 00:09:14.318 11:19:56 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@1207 -- # nvme_devices=1 00:09:14.318 11:19:56 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@1208 -- # (( nvme_devices == nvme_device_counter )) 00:09:14.318 11:19:56 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@1208 -- # return 0 00:09:14.318 11:19:56 nvmf_tcp.nvmf_target_core.nvmf_nmic -- target/nmic.sh@46 -- # /home/vagrant/spdk_repo/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 1 -v 00:09:14.576 [global] 00:09:14.576 thread=1 00:09:14.576 invalidate=1 00:09:14.576 rw=write 00:09:14.576 time_based=1 00:09:14.576 runtime=1 00:09:14.576 ioengine=libaio 00:09:14.576 direct=1 00:09:14.576 bs=4096 00:09:14.576 iodepth=1 00:09:14.576 norandommap=0 00:09:14.576 numjobs=1 00:09:14.576 00:09:14.576 verify_dump=1 00:09:14.576 verify_backlog=512 00:09:14.576 verify_state_save=0 00:09:14.576 do_verify=1 00:09:14.576 verify=crc32c-intel 00:09:14.576 [job0] 00:09:14.576 filename=/dev/nvme0n1 00:09:14.576 Could not set queue depth (nvme0n1) 00:09:14.576 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:09:14.576 fio-3.35 00:09:14.576 Starting 1 thread 00:09:15.952 00:09:15.952 job0: (groupid=0, jobs=1): err= 0: pid=69837: Mon Oct 7 11:19:57 2024 00:09:15.952 read: IOPS=3358, BW=13.1MiB/s (13.8MB/s)(13.1MiB/1000msec) 00:09:15.952 slat (nsec): min=11503, max=56441, avg=14748.94, stdev=3301.39 00:09:15.952 clat (usec): min=120, max=450, avg=143.86, stdev=14.33 00:09:15.952 lat (usec): min=133, max=463, avg=158.61, stdev=14.86 00:09:15.952 clat percentiles (usec): 00:09:15.952 | 1.00th=[ 129], 5.00th=[ 133], 10.00th=[ 135], 20.00th=[ 137], 00:09:15.952 | 30.00th=[ 139], 40.00th=[ 141], 50.00th=[ 143], 60.00th=[ 145], 00:09:15.952 | 70.00th=[ 147], 80.00th=[ 151], 90.00th=[ 155], 95.00th=[ 159], 00:09:15.952 | 99.00th=[ 174], 99.50th=[ 202], 99.90th=[ 351], 99.95th=[ 379], 00:09:15.952 | 99.99th=[ 449] 00:09:15.952 write: IOPS=3584, BW=14.0MiB/s (14.7MB/s)(14.0MiB/1000msec); 0 zone resets 00:09:15.952 slat (usec): min=14, max=144, avg=22.29, stdev= 5.45 00:09:15.952 clat (usec): min=87, max=373, avg=104.94, stdev=12.57 00:09:15.952 lat (usec): min=106, max=425, avg=127.24, stdev=14.68 00:09:15.952 clat percentiles (usec): 00:09:15.952 | 1.00th=[ 94], 5.00th=[ 96], 10.00th=[ 97], 20.00th=[ 99], 00:09:15.952 | 30.00th=[ 100], 40.00th=[ 102], 50.00th=[ 103], 60.00th=[ 104], 00:09:15.952 | 70.00th=[ 106], 80.00th=[ 110], 90.00th=[ 115], 95.00th=[ 119], 00:09:15.952 | 99.00th=[ 133], 99.50th=[ 145], 99.90th=[ 334], 99.95th=[ 367], 00:09:15.952 | 99.99th=[ 375] 00:09:15.952 bw ( KiB/s): min=15592, max=15592, per=100.00%, avg=15592.00, stdev= 0.00, samples=1 00:09:15.952 iops : min= 3898, max= 3898, avg=3898.00, stdev= 0.00, samples=1 00:09:15.952 lat (usec) : 100=14.92%, 250=84.83%, 500=0.24% 00:09:15.952 cpu : usr=2.20%, sys=10.10%, ctx=6943, majf=0, minf=5 00:09:15.952 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:09:15.952 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:09:15.952 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:09:15.952 issued rwts: total=3358,3584,0,0 short=0,0,0,0 dropped=0,0,0,0 00:09:15.952 latency : target=0, window=0, percentile=100.00%, depth=1 00:09:15.952 00:09:15.952 Run status group 0 (all jobs): 00:09:15.952 READ: bw=13.1MiB/s (13.8MB/s), 13.1MiB/s-13.1MiB/s (13.8MB/s-13.8MB/s), io=13.1MiB (13.8MB), run=1000-1000msec 00:09:15.952 WRITE: bw=14.0MiB/s (14.7MB/s), 14.0MiB/s-14.0MiB/s (14.7MB/s-14.7MB/s), io=14.0MiB (14.7MB), run=1000-1000msec 00:09:15.952 00:09:15.952 Disk stats (read/write): 00:09:15.952 nvme0n1: ios=3122/3169, merge=0/0, ticks=483/361, in_queue=844, util=91.38% 00:09:15.952 11:19:57 nvmf_tcp.nvmf_target_core.nvmf_nmic -- target/nmic.sh@48 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:09:15.952 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 2 controller(s) 00:09:15.952 11:19:57 nvmf_tcp.nvmf_target_core.nvmf_nmic -- target/nmic.sh@49 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:09:15.952 11:19:57 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@1219 -- # local i=0 00:09:15.952 11:19:57 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@1220 -- # lsblk -o NAME,SERIAL 00:09:15.952 11:19:57 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@1220 -- # grep -q -w SPDKISFASTANDAWESOME 00:09:15.952 11:19:57 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@1227 -- # lsblk -l -o NAME,SERIAL 00:09:15.952 11:19:57 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@1227 -- # grep -q -w SPDKISFASTANDAWESOME 00:09:15.952 11:19:57 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@1231 -- # return 0 00:09:15.952 11:19:57 nvmf_tcp.nvmf_target_core.nvmf_nmic -- target/nmic.sh@51 -- # trap - SIGINT SIGTERM EXIT 00:09:15.952 11:19:57 nvmf_tcp.nvmf_target_core.nvmf_nmic -- target/nmic.sh@53 -- # nvmftestfini 00:09:15.952 11:19:57 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@514 -- # nvmfcleanup 00:09:15.952 11:19:57 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@121 -- # sync 00:09:15.952 11:19:57 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:09:15.952 11:19:57 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@124 -- # set +e 00:09:15.952 11:19:57 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@125 -- # for i in {1..20} 00:09:15.952 11:19:57 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:09:15.952 rmmod nvme_tcp 00:09:15.952 rmmod nvme_fabrics 00:09:15.952 rmmod nvme_keyring 00:09:15.952 11:19:57 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:09:15.952 11:19:57 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@128 -- # set -e 00:09:15.952 11:19:57 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@129 -- # return 0 00:09:15.952 11:19:57 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@515 -- # '[' -n 69721 ']' 00:09:15.952 11:19:57 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@516 -- # killprocess 69721 00:09:15.952 11:19:57 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@950 -- # '[' -z 69721 ']' 00:09:15.952 11:19:57 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@954 -- # kill -0 69721 00:09:15.952 11:19:57 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@955 -- # uname 00:09:15.952 11:19:57 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:09:15.952 11:19:57 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 69721 00:09:15.952 11:19:57 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:09:15.952 11:19:57 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:09:15.952 killing process with pid 69721 00:09:15.952 11:19:57 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@968 -- # echo 'killing process with pid 69721' 00:09:15.952 11:19:57 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@969 -- # kill 69721 00:09:15.952 11:19:57 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@974 -- # wait 69721 00:09:16.519 11:19:57 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:09:16.519 11:19:57 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:09:16.519 11:19:57 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:09:16.519 11:19:57 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@297 -- # iptr 00:09:16.519 11:19:57 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@789 -- # iptables-save 00:09:16.519 11:19:57 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:09:16.519 11:19:57 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@789 -- # iptables-restore 00:09:16.519 11:19:57 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@298 -- # [[ nvmf_tgt_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:09:16.519 11:19:57 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@299 -- # nvmf_veth_fini 00:09:16.519 11:19:57 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@233 -- # ip link set nvmf_init_br nomaster 00:09:16.519 11:19:57 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@234 -- # ip link set nvmf_init_br2 nomaster 00:09:16.519 11:19:57 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@235 -- # ip link set nvmf_tgt_br nomaster 00:09:16.519 11:19:57 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@236 -- # ip link set nvmf_tgt_br2 nomaster 00:09:16.519 11:19:57 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@237 -- # ip link set nvmf_init_br down 00:09:16.519 11:19:57 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@238 -- # ip link set nvmf_init_br2 down 00:09:16.519 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@239 -- # ip link set nvmf_tgt_br down 00:09:16.519 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@240 -- # ip link set nvmf_tgt_br2 down 00:09:16.519 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@241 -- # ip link delete nvmf_br type bridge 00:09:16.519 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@242 -- # ip link delete nvmf_init_if 00:09:16.519 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@243 -- # ip link delete nvmf_init_if2 00:09:16.519 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@244 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:09:16.519 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@245 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:09:16.520 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@246 -- # remove_spdk_ns 00:09:16.520 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:09:16.520 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:09:16.520 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:09:16.520 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_nmic -- nvmf/common.sh@300 -- # return 0 00:09:16.520 00:09:16.520 real 0m6.462s 00:09:16.520 user 0m20.427s 00:09:16.520 sys 0m1.605s 00:09:16.520 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@1126 -- # xtrace_disable 00:09:16.520 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_nmic -- common/autotest_common.sh@10 -- # set +x 00:09:16.520 ************************************ 00:09:16.520 END TEST nvmf_nmic 00:09:16.520 ************************************ 00:09:16.520 11:19:58 nvmf_tcp.nvmf_target_core -- nvmf/nvmf_target_core.sh@34 -- # run_test nvmf_fio_target /home/vagrant/spdk_repo/spdk/test/nvmf/target/fio.sh --transport=tcp 00:09:16.520 11:19:58 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:09:16.520 11:19:58 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1107 -- # xtrace_disable 00:09:16.520 11:19:58 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@10 -- # set +x 00:09:16.520 ************************************ 00:09:16.520 START TEST nvmf_fio_target 00:09:16.520 ************************************ 00:09:16.520 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/nvmf/target/fio.sh --transport=tcp 00:09:16.783 * Looking for test storage... 00:09:16.783 * Found test storage at /home/vagrant/spdk_repo/spdk/test/nvmf/target 00:09:16.783 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:09:16.783 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@1681 -- # lcov --version 00:09:16.783 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:09:16.783 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:09:16.783 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:09:16.783 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- scripts/common.sh@333 -- # local ver1 ver1_l 00:09:16.783 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- scripts/common.sh@334 -- # local ver2 ver2_l 00:09:16.783 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- scripts/common.sh@336 -- # IFS=.-: 00:09:16.783 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- scripts/common.sh@336 -- # read -ra ver1 00:09:16.783 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- scripts/common.sh@337 -- # IFS=.-: 00:09:16.783 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- scripts/common.sh@337 -- # read -ra ver2 00:09:16.783 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- scripts/common.sh@338 -- # local 'op=<' 00:09:16.783 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- scripts/common.sh@340 -- # ver1_l=2 00:09:16.783 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- scripts/common.sh@341 -- # ver2_l=1 00:09:16.784 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:09:16.784 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- scripts/common.sh@344 -- # case "$op" in 00:09:16.784 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- scripts/common.sh@345 -- # : 1 00:09:16.784 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- scripts/common.sh@364 -- # (( v = 0 )) 00:09:16.784 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:09:16.784 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- scripts/common.sh@365 -- # decimal 1 00:09:16.784 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- scripts/common.sh@353 -- # local d=1 00:09:16.784 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:09:16.784 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- scripts/common.sh@355 -- # echo 1 00:09:16.784 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- scripts/common.sh@365 -- # ver1[v]=1 00:09:16.784 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- scripts/common.sh@366 -- # decimal 2 00:09:16.784 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- scripts/common.sh@353 -- # local d=2 00:09:16.784 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:09:16.784 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- scripts/common.sh@355 -- # echo 2 00:09:16.784 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- scripts/common.sh@366 -- # ver2[v]=2 00:09:16.784 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:09:16.784 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:09:16.784 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- scripts/common.sh@368 -- # return 0 00:09:16.784 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:09:16.784 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:09:16.784 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:16.784 --rc genhtml_branch_coverage=1 00:09:16.784 --rc genhtml_function_coverage=1 00:09:16.784 --rc genhtml_legend=1 00:09:16.784 --rc geninfo_all_blocks=1 00:09:16.784 --rc geninfo_unexecuted_blocks=1 00:09:16.784 00:09:16.784 ' 00:09:16.784 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:09:16.784 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:16.784 --rc genhtml_branch_coverage=1 00:09:16.784 --rc genhtml_function_coverage=1 00:09:16.784 --rc genhtml_legend=1 00:09:16.784 --rc geninfo_all_blocks=1 00:09:16.784 --rc geninfo_unexecuted_blocks=1 00:09:16.784 00:09:16.784 ' 00:09:16.784 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:09:16.784 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:16.784 --rc genhtml_branch_coverage=1 00:09:16.784 --rc genhtml_function_coverage=1 00:09:16.784 --rc genhtml_legend=1 00:09:16.784 --rc geninfo_all_blocks=1 00:09:16.784 --rc geninfo_unexecuted_blocks=1 00:09:16.784 00:09:16.784 ' 00:09:16.784 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:09:16.784 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:16.784 --rc genhtml_branch_coverage=1 00:09:16.784 --rc genhtml_function_coverage=1 00:09:16.784 --rc genhtml_legend=1 00:09:16.784 --rc geninfo_all_blocks=1 00:09:16.784 --rc geninfo_unexecuted_blocks=1 00:09:16.784 00:09:16.784 ' 00:09:16.784 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@9 -- # source /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh 00:09:16.784 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@7 -- # uname -s 00:09:16.784 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:09:16.784 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:09:16.784 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:09:16.784 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:09:16.784 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:09:16.784 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:09:16.784 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:09:16.784 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:09:16.784 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:09:16.784 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:09:16.784 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:09:16.784 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@18 -- # NVME_HOSTID=3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:09:16.784 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:09:16.784 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:09:16.784 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@21 -- # NET_TYPE=virt 00:09:16.784 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:09:16.784 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@49 -- # source /home/vagrant/spdk_repo/spdk/scripts/common.sh 00:09:16.784 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- scripts/common.sh@15 -- # shopt -s extglob 00:09:16.784 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:09:16.784 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:09:16.784 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:09:16.784 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:16.784 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:16.784 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:16.784 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- paths/export.sh@5 -- # export PATH 00:09:16.784 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:16.784 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@51 -- # : 0 00:09:16.784 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:09:16.784 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:09:16.784 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:09:16.784 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:09:16.784 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:09:16.784 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:09:16.784 /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:09:16.784 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:09:16.784 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:09:16.784 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@55 -- # have_pci_nics=0 00:09:16.784 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:09:16.784 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:09:16.784 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@14 -- # rpc_py=/home/vagrant/spdk_repo/spdk/scripts/rpc.py 00:09:16.784 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@16 -- # nvmftestinit 00:09:16.784 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:09:16.784 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:09:16.784 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@474 -- # prepare_net_devs 00:09:16.784 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@436 -- # local -g is_hw=no 00:09:16.784 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@438 -- # remove_spdk_ns 00:09:16.784 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:09:16.784 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:09:16.784 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:09:16.784 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@440 -- # [[ virt != virt ]] 00:09:16.784 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@442 -- # [[ no == yes ]] 00:09:16.784 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@449 -- # [[ virt == phy ]] 00:09:16.784 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@452 -- # [[ virt == phy-fallback ]] 00:09:16.784 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@457 -- # [[ tcp == tcp ]] 00:09:16.784 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@458 -- # nvmf_veth_init 00:09:16.784 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@145 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:09:16.784 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@146 -- # NVMF_SECOND_INITIATOR_IP=10.0.0.2 00:09:16.784 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@147 -- # NVMF_FIRST_TARGET_IP=10.0.0.3 00:09:16.784 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@148 -- # NVMF_SECOND_TARGET_IP=10.0.0.4 00:09:16.784 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@149 -- # NVMF_INITIATOR_IP=10.0.0.1 00:09:16.784 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@150 -- # NVMF_BRIDGE=nvmf_br 00:09:16.785 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@151 -- # NVMF_INITIATOR_INTERFACE=nvmf_init_if 00:09:16.785 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@152 -- # NVMF_INITIATOR_INTERFACE2=nvmf_init_if2 00:09:16.785 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@153 -- # NVMF_INITIATOR_BRIDGE=nvmf_init_br 00:09:16.785 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@154 -- # NVMF_INITIATOR_BRIDGE2=nvmf_init_br2 00:09:16.785 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@155 -- # NVMF_TARGET_NAMESPACE=nvmf_tgt_ns_spdk 00:09:16.785 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@156 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:09:16.785 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@157 -- # NVMF_TARGET_INTERFACE=nvmf_tgt_if 00:09:16.785 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@158 -- # NVMF_TARGET_INTERFACE2=nvmf_tgt_if2 00:09:16.785 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@159 -- # NVMF_TARGET_BRIDGE=nvmf_tgt_br 00:09:16.785 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@160 -- # NVMF_TARGET_BRIDGE2=nvmf_tgt_br2 00:09:16.785 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@162 -- # ip link set nvmf_init_br nomaster 00:09:16.785 Cannot find device "nvmf_init_br" 00:09:16.785 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@162 -- # true 00:09:16.785 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@163 -- # ip link set nvmf_init_br2 nomaster 00:09:16.785 Cannot find device "nvmf_init_br2" 00:09:16.785 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@163 -- # true 00:09:16.785 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@164 -- # ip link set nvmf_tgt_br nomaster 00:09:16.785 Cannot find device "nvmf_tgt_br" 00:09:16.785 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@164 -- # true 00:09:16.785 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@165 -- # ip link set nvmf_tgt_br2 nomaster 00:09:17.061 Cannot find device "nvmf_tgt_br2" 00:09:17.061 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@165 -- # true 00:09:17.061 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@166 -- # ip link set nvmf_init_br down 00:09:17.061 Cannot find device "nvmf_init_br" 00:09:17.061 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@166 -- # true 00:09:17.061 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@167 -- # ip link set nvmf_init_br2 down 00:09:17.061 Cannot find device "nvmf_init_br2" 00:09:17.061 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@167 -- # true 00:09:17.061 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@168 -- # ip link set nvmf_tgt_br down 00:09:17.061 Cannot find device "nvmf_tgt_br" 00:09:17.061 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@168 -- # true 00:09:17.061 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@169 -- # ip link set nvmf_tgt_br2 down 00:09:17.061 Cannot find device "nvmf_tgt_br2" 00:09:17.061 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@169 -- # true 00:09:17.061 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@170 -- # ip link delete nvmf_br type bridge 00:09:17.061 Cannot find device "nvmf_br" 00:09:17.061 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@170 -- # true 00:09:17.061 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@171 -- # ip link delete nvmf_init_if 00:09:17.061 Cannot find device "nvmf_init_if" 00:09:17.061 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@171 -- # true 00:09:17.061 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@172 -- # ip link delete nvmf_init_if2 00:09:17.061 Cannot find device "nvmf_init_if2" 00:09:17.061 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@172 -- # true 00:09:17.061 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@173 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:09:17.061 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:09:17.061 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@173 -- # true 00:09:17.061 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@174 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:09:17.061 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:09:17.061 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@174 -- # true 00:09:17.061 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@177 -- # ip netns add nvmf_tgt_ns_spdk 00:09:17.061 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@180 -- # ip link add nvmf_init_if type veth peer name nvmf_init_br 00:09:17.061 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@181 -- # ip link add nvmf_init_if2 type veth peer name nvmf_init_br2 00:09:17.062 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@182 -- # ip link add nvmf_tgt_if type veth peer name nvmf_tgt_br 00:09:17.062 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@183 -- # ip link add nvmf_tgt_if2 type veth peer name nvmf_tgt_br2 00:09:17.062 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@186 -- # ip link set nvmf_tgt_if netns nvmf_tgt_ns_spdk 00:09:17.062 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@187 -- # ip link set nvmf_tgt_if2 netns nvmf_tgt_ns_spdk 00:09:17.062 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@190 -- # ip addr add 10.0.0.1/24 dev nvmf_init_if 00:09:17.062 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@191 -- # ip addr add 10.0.0.2/24 dev nvmf_init_if2 00:09:17.062 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@192 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.3/24 dev nvmf_tgt_if 00:09:17.062 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@193 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.4/24 dev nvmf_tgt_if2 00:09:17.062 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@196 -- # ip link set nvmf_init_if up 00:09:17.062 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@197 -- # ip link set nvmf_init_if2 up 00:09:17.062 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@198 -- # ip link set nvmf_init_br up 00:09:17.062 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@199 -- # ip link set nvmf_init_br2 up 00:09:17.062 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@200 -- # ip link set nvmf_tgt_br up 00:09:17.062 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@201 -- # ip link set nvmf_tgt_br2 up 00:09:17.062 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@202 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if up 00:09:17.062 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@203 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if2 up 00:09:17.062 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@204 -- # ip netns exec nvmf_tgt_ns_spdk ip link set lo up 00:09:17.062 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@207 -- # ip link add nvmf_br type bridge 00:09:17.062 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@208 -- # ip link set nvmf_br up 00:09:17.062 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@211 -- # ip link set nvmf_init_br master nvmf_br 00:09:17.321 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@212 -- # ip link set nvmf_init_br2 master nvmf_br 00:09:17.321 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@213 -- # ip link set nvmf_tgt_br master nvmf_br 00:09:17.321 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@214 -- # ip link set nvmf_tgt_br2 master nvmf_br 00:09:17.321 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@217 -- # ipts -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT 00:09:17.321 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT' 00:09:17.321 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@218 -- # ipts -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT 00:09:17.321 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT' 00:09:17.321 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@219 -- # ipts -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT 00:09:17.321 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@788 -- # iptables -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT -m comment --comment 'SPDK_NVMF:-A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT' 00:09:17.321 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@222 -- # ping -c 1 10.0.0.3 00:09:17.321 PING 10.0.0.3 (10.0.0.3) 56(84) bytes of data. 00:09:17.321 64 bytes from 10.0.0.3: icmp_seq=1 ttl=64 time=0.121 ms 00:09:17.321 00:09:17.321 --- 10.0.0.3 ping statistics --- 00:09:17.321 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:09:17.321 rtt min/avg/max/mdev = 0.121/0.121/0.121/0.000 ms 00:09:17.321 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@223 -- # ping -c 1 10.0.0.4 00:09:17.321 PING 10.0.0.4 (10.0.0.4) 56(84) bytes of data. 00:09:17.321 64 bytes from 10.0.0.4: icmp_seq=1 ttl=64 time=0.046 ms 00:09:17.321 00:09:17.321 --- 10.0.0.4 ping statistics --- 00:09:17.321 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:09:17.321 rtt min/avg/max/mdev = 0.046/0.046/0.046/0.000 ms 00:09:17.321 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@224 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.1 00:09:17.321 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:09:17.321 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.023 ms 00:09:17.321 00:09:17.321 --- 10.0.0.1 ping statistics --- 00:09:17.321 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:09:17.321 rtt min/avg/max/mdev = 0.023/0.023/0.023/0.000 ms 00:09:17.321 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@225 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.2 00:09:17.321 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:09:17.321 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.058 ms 00:09:17.321 00:09:17.321 --- 10.0.0.2 ping statistics --- 00:09:17.321 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:09:17.321 rtt min/avg/max/mdev = 0.058/0.058/0.058/0.000 ms 00:09:17.321 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@227 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:09:17.321 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@459 -- # return 0 00:09:17.321 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:09:17.321 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:09:17.321 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:09:17.321 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:09:17.321 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:09:17.321 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:09:17.321 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:09:17.321 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@17 -- # nvmfappstart -m 0xF 00:09:17.321 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:09:17.321 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@724 -- # xtrace_disable 00:09:17.321 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@10 -- # set +x 00:09:17.321 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@507 -- # nvmfpid=70065 00:09:17.321 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@508 -- # waitforlisten 70065 00:09:17.321 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@831 -- # '[' -z 70065 ']' 00:09:17.321 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:09:17.321 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@506 -- # ip netns exec nvmf_tgt_ns_spdk /home/vagrant/spdk_repo/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:09:17.321 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@836 -- # local max_retries=100 00:09:17.321 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:09:17.321 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:09:17.321 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@840 -- # xtrace_disable 00:09:17.321 11:19:58 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@10 -- # set +x 00:09:17.321 [2024-10-07 11:19:58.931962] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:09:17.321 [2024-10-07 11:19:58.932095] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:09:17.580 [2024-10-07 11:19:59.071700] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 4 00:09:17.580 [2024-10-07 11:19:59.250716] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:09:17.580 [2024-10-07 11:19:59.250776] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:09:17.580 [2024-10-07 11:19:59.250791] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:09:17.580 [2024-10-07 11:19:59.250802] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:09:17.580 [2024-10-07 11:19:59.250812] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:09:17.580 [2024-10-07 11:19:59.252562] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:09:17.580 [2024-10-07 11:19:59.252656] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:09:17.580 [2024-10-07 11:19:59.252703] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 3 00:09:17.580 [2024-10-07 11:19:59.252708] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:09:18.515 11:19:59 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:09:18.515 11:19:59 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@864 -- # return 0 00:09:18.515 11:19:59 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:09:18.515 11:19:59 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@730 -- # xtrace_disable 00:09:18.515 11:19:59 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@10 -- # set +x 00:09:18.515 11:19:59 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:09:18.515 11:19:59 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@19 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:09:18.773 [2024-10-07 11:20:00.278793] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:09:18.773 11:20:00 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@21 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:09:19.032 11:20:00 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@21 -- # malloc_bdevs='Malloc0 ' 00:09:19.032 11:20:00 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@22 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:09:19.637 11:20:01 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@22 -- # malloc_bdevs+=Malloc1 00:09:19.637 11:20:01 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@24 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:09:19.895 11:20:01 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@24 -- # raid_malloc_bdevs='Malloc2 ' 00:09:19.895 11:20:01 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@25 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:09:20.153 11:20:01 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@25 -- # raid_malloc_bdevs+=Malloc3 00:09:20.153 11:20:01 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@26 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_raid_create -n raid0 -z 64 -r 0 -b 'Malloc2 Malloc3' 00:09:20.411 11:20:01 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@29 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:09:20.670 11:20:02 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@29 -- # concat_malloc_bdevs='Malloc4 ' 00:09:20.670 11:20:02 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@30 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:09:21.237 11:20:02 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@30 -- # concat_malloc_bdevs+='Malloc5 ' 00:09:21.237 11:20:02 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:09:21.495 11:20:03 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@31 -- # concat_malloc_bdevs+=Malloc6 00:09:21.495 11:20:03 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@32 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_raid_create -n concat0 -r concat -z 64 -b 'Malloc4 Malloc5 Malloc6' 00:09:21.753 11:20:03 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@34 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:09:22.012 11:20:03 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@35 -- # for malloc_bdev in $malloc_bdevs 00:09:22.012 11:20:03 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@36 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:09:22.270 11:20:03 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@35 -- # for malloc_bdev in $malloc_bdevs 00:09:22.270 11:20:03 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@36 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:09:22.530 11:20:04 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@38 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4420 00:09:22.788 [2024-10-07 11:20:04.459334] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:09:22.788 11:20:04 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@41 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 raid0 00:09:23.046 11:20:04 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@44 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 concat0 00:09:23.613 11:20:05 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@46 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --hostid=3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.3 -s 4420 00:09:23.613 11:20:05 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@48 -- # waitforserial SPDKISFASTANDAWESOME 4 00:09:23.613 11:20:05 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@1198 -- # local i=0 00:09:23.613 11:20:05 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@1199 -- # local nvme_device_counter=1 nvme_devices=0 00:09:23.613 11:20:05 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@1200 -- # [[ -n 4 ]] 00:09:23.613 11:20:05 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@1201 -- # nvme_device_counter=4 00:09:23.613 11:20:05 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@1205 -- # sleep 2 00:09:25.515 11:20:07 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@1206 -- # (( i++ <= 15 )) 00:09:25.515 11:20:07 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@1207 -- # lsblk -l -o NAME,SERIAL 00:09:25.515 11:20:07 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@1207 -- # grep -c SPDKISFASTANDAWESOME 00:09:25.515 11:20:07 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@1207 -- # nvme_devices=4 00:09:25.515 11:20:07 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@1208 -- # (( nvme_devices == nvme_device_counter )) 00:09:25.515 11:20:07 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@1208 -- # return 0 00:09:25.515 11:20:07 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@50 -- # /home/vagrant/spdk_repo/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 1 -v 00:09:25.773 [global] 00:09:25.773 thread=1 00:09:25.773 invalidate=1 00:09:25.773 rw=write 00:09:25.773 time_based=1 00:09:25.773 runtime=1 00:09:25.773 ioengine=libaio 00:09:25.773 direct=1 00:09:25.773 bs=4096 00:09:25.773 iodepth=1 00:09:25.773 norandommap=0 00:09:25.773 numjobs=1 00:09:25.773 00:09:25.773 verify_dump=1 00:09:25.773 verify_backlog=512 00:09:25.773 verify_state_save=0 00:09:25.773 do_verify=1 00:09:25.773 verify=crc32c-intel 00:09:25.773 [job0] 00:09:25.773 filename=/dev/nvme0n1 00:09:25.773 [job1] 00:09:25.773 filename=/dev/nvme0n2 00:09:25.773 [job2] 00:09:25.773 filename=/dev/nvme0n3 00:09:25.773 [job3] 00:09:25.773 filename=/dev/nvme0n4 00:09:25.773 Could not set queue depth (nvme0n1) 00:09:25.773 Could not set queue depth (nvme0n2) 00:09:25.773 Could not set queue depth (nvme0n3) 00:09:25.773 Could not set queue depth (nvme0n4) 00:09:25.773 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:09:25.773 job1: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:09:25.773 job2: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:09:25.773 job3: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:09:25.773 fio-3.35 00:09:25.773 Starting 4 threads 00:09:27.148 00:09:27.148 job0: (groupid=0, jobs=1): err= 0: pid=70373: Mon Oct 7 11:20:08 2024 00:09:27.148 read: IOPS=1534, BW=6138KiB/s (6285kB/s)(6144KiB/1001msec) 00:09:27.148 slat (usec): min=10, max=111, avg=18.01, stdev= 6.64 00:09:27.148 clat (usec): min=185, max=903, avg=309.62, stdev=65.96 00:09:27.148 lat (usec): min=196, max=921, avg=327.63, stdev=67.11 00:09:27.148 clat percentiles (usec): 00:09:27.148 | 1.00th=[ 243], 5.00th=[ 255], 10.00th=[ 262], 20.00th=[ 269], 00:09:27.148 | 30.00th=[ 273], 40.00th=[ 281], 50.00th=[ 285], 60.00th=[ 293], 00:09:27.148 | 70.00th=[ 314], 80.00th=[ 347], 90.00th=[ 375], 95.00th=[ 461], 00:09:27.148 | 99.00th=[ 529], 99.50th=[ 570], 99.90th=[ 832], 99.95th=[ 906], 00:09:27.148 | 99.99th=[ 906] 00:09:27.148 write: IOPS=1850, BW=7401KiB/s (7578kB/s)(7408KiB/1001msec); 0 zone resets 00:09:27.148 slat (nsec): min=12946, max=87832, avg=27814.52, stdev=7839.41 00:09:27.148 clat (usec): min=125, max=2615, avg=236.67, stdev=89.38 00:09:27.148 lat (usec): min=150, max=2663, avg=264.48, stdev=91.09 00:09:27.148 clat percentiles (usec): 00:09:27.148 | 1.00th=[ 141], 5.00th=[ 186], 10.00th=[ 198], 20.00th=[ 204], 00:09:27.148 | 30.00th=[ 210], 40.00th=[ 217], 50.00th=[ 225], 60.00th=[ 235], 00:09:27.148 | 70.00th=[ 251], 80.00th=[ 265], 90.00th=[ 281], 95.00th=[ 297], 00:09:27.148 | 99.00th=[ 367], 99.50th=[ 457], 99.90th=[ 2180], 99.95th=[ 2606], 00:09:27.148 | 99.99th=[ 2606] 00:09:27.148 bw ( KiB/s): min= 8192, max= 8192, per=24.10%, avg=8192.00, stdev= 0.00, samples=1 00:09:27.148 iops : min= 2048, max= 2048, avg=2048.00, stdev= 0.00, samples=1 00:09:27.148 lat (usec) : 250=39.52%, 500=59.27%, 750=0.94%, 1000=0.15% 00:09:27.148 lat (msec) : 2=0.06%, 4=0.06% 00:09:27.148 cpu : usr=1.20%, sys=6.60%, ctx=3392, majf=0, minf=9 00:09:27.148 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:09:27.148 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:09:27.148 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:09:27.148 issued rwts: total=1536,1852,0,0 short=0,0,0,0 dropped=0,0,0,0 00:09:27.148 latency : target=0, window=0, percentile=100.00%, depth=1 00:09:27.148 job1: (groupid=0, jobs=1): err= 0: pid=70375: Mon Oct 7 11:20:08 2024 00:09:27.148 read: IOPS=1644, BW=6577KiB/s (6735kB/s)(6584KiB/1001msec) 00:09:27.148 slat (nsec): min=12003, max=67533, avg=22338.63, stdev=6980.93 00:09:27.148 clat (usec): min=162, max=802, avg=281.85, stdev=48.95 00:09:27.148 lat (usec): min=183, max=824, avg=304.19, stdev=50.87 00:09:27.148 clat percentiles (usec): 00:09:27.148 | 1.00th=[ 231], 5.00th=[ 239], 10.00th=[ 245], 20.00th=[ 253], 00:09:27.148 | 30.00th=[ 258], 40.00th=[ 265], 50.00th=[ 269], 60.00th=[ 273], 00:09:27.148 | 70.00th=[ 285], 80.00th=[ 302], 90.00th=[ 347], 95.00th=[ 363], 00:09:27.148 | 99.00th=[ 437], 99.50th=[ 490], 99.90th=[ 799], 99.95th=[ 799], 00:09:27.148 | 99.99th=[ 799] 00:09:27.148 write: IOPS=2045, BW=8184KiB/s (8380kB/s)(8192KiB/1001msec); 0 zone resets 00:09:27.148 slat (nsec): min=18245, max=94986, avg=32775.86, stdev=10331.46 00:09:27.148 clat (usec): min=100, max=2483, avg=206.56, stdev=71.26 00:09:27.148 lat (usec): min=121, max=2516, avg=239.33, stdev=73.13 00:09:27.148 clat percentiles (usec): 00:09:27.148 | 1.00th=[ 108], 5.00th=[ 119], 10.00th=[ 130], 20.00th=[ 184], 00:09:27.148 | 30.00th=[ 194], 40.00th=[ 200], 50.00th=[ 206], 60.00th=[ 215], 00:09:27.148 | 70.00th=[ 221], 80.00th=[ 233], 90.00th=[ 253], 95.00th=[ 273], 00:09:27.148 | 99.00th=[ 347], 99.50th=[ 383], 99.90th=[ 816], 99.95th=[ 832], 00:09:27.148 | 99.99th=[ 2474] 00:09:27.148 bw ( KiB/s): min= 8192, max= 8192, per=24.10%, avg=8192.00, stdev= 0.00, samples=1 00:09:27.148 iops : min= 2048, max= 2048, avg=2048.00, stdev= 0.00, samples=1 00:09:27.148 lat (usec) : 250=56.66%, 500=42.99%, 750=0.22%, 1000=0.11% 00:09:27.148 lat (msec) : 4=0.03% 00:09:27.148 cpu : usr=1.60%, sys=8.40%, ctx=3696, majf=0, minf=11 00:09:27.148 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:09:27.148 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:09:27.148 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:09:27.148 issued rwts: total=1646,2048,0,0 short=0,0,0,0 dropped=0,0,0,0 00:09:27.148 latency : target=0, window=0, percentile=100.00%, depth=1 00:09:27.148 job2: (groupid=0, jobs=1): err= 0: pid=70376: Mon Oct 7 11:20:08 2024 00:09:27.148 read: IOPS=1869, BW=7477KiB/s (7656kB/s)(7484KiB/1001msec) 00:09:27.148 slat (nsec): min=8672, max=59079, avg=17351.57, stdev=4365.57 00:09:27.148 clat (usec): min=153, max=2215, avg=277.36, stdev=144.95 00:09:27.148 lat (usec): min=167, max=2248, avg=294.71, stdev=146.23 00:09:27.148 clat percentiles (usec): 00:09:27.148 | 1.00th=[ 167], 5.00th=[ 172], 10.00th=[ 176], 20.00th=[ 180], 00:09:27.148 | 30.00th=[ 184], 40.00th=[ 188], 50.00th=[ 198], 60.00th=[ 277], 00:09:27.148 | 70.00th=[ 338], 80.00th=[ 375], 90.00th=[ 482], 95.00th=[ 519], 00:09:27.148 | 99.00th=[ 635], 99.50th=[ 717], 99.90th=[ 1975], 99.95th=[ 2212], 00:09:27.148 | 99.99th=[ 2212] 00:09:27.148 write: IOPS=2045, BW=8184KiB/s (8380kB/s)(8192KiB/1001msec); 0 zone resets 00:09:27.148 slat (usec): min=14, max=198, avg=27.28, stdev= 7.56 00:09:27.148 clat (usec): min=106, max=5107, avg=187.92, stdev=190.71 00:09:27.148 lat (usec): min=142, max=5131, avg=215.20, stdev=190.62 00:09:27.148 clat percentiles (usec): 00:09:27.148 | 1.00th=[ 124], 5.00th=[ 129], 10.00th=[ 131], 20.00th=[ 135], 00:09:27.148 | 30.00th=[ 139], 40.00th=[ 143], 50.00th=[ 149], 60.00th=[ 155], 00:09:27.148 | 70.00th=[ 215], 80.00th=[ 235], 90.00th=[ 255], 95.00th=[ 330], 00:09:27.149 | 99.00th=[ 375], 99.50th=[ 529], 99.90th=[ 4047], 99.95th=[ 4424], 00:09:27.149 | 99.99th=[ 5080] 00:09:27.149 bw ( KiB/s): min=11880, max=11880, per=34.94%, avg=11880.00, stdev= 0.00, samples=1 00:09:27.149 iops : min= 2970, max= 2970, avg=2970.00, stdev= 0.00, samples=1 00:09:27.149 lat (usec) : 250=73.08%, 500=22.84%, 750=3.70%, 1000=0.08% 00:09:27.149 lat (msec) : 2=0.18%, 4=0.05%, 10=0.08% 00:09:27.149 cpu : usr=1.80%, sys=6.70%, ctx=3922, majf=0, minf=7 00:09:27.149 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:09:27.149 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:09:27.149 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:09:27.149 issued rwts: total=1871,2048,0,0 short=0,0,0,0 dropped=0,0,0,0 00:09:27.149 latency : target=0, window=0, percentile=100.00%, depth=1 00:09:27.149 job3: (groupid=0, jobs=1): err= 0: pid=70377: Mon Oct 7 11:20:08 2024 00:09:27.149 read: IOPS=2285, BW=9143KiB/s (9362kB/s)(9152KiB/1001msec) 00:09:27.149 slat (nsec): min=11607, max=64119, avg=17573.50, stdev=6182.99 00:09:27.149 clat (usec): min=160, max=5897, avg=211.63, stdev=127.43 00:09:27.149 lat (usec): min=174, max=5911, avg=229.20, stdev=128.57 00:09:27.149 clat percentiles (usec): 00:09:27.149 | 1.00th=[ 165], 5.00th=[ 172], 10.00th=[ 174], 20.00th=[ 178], 00:09:27.149 | 30.00th=[ 182], 40.00th=[ 184], 50.00th=[ 188], 60.00th=[ 194], 00:09:27.149 | 70.00th=[ 202], 80.00th=[ 265], 90.00th=[ 285], 95.00th=[ 297], 00:09:27.149 | 99.00th=[ 351], 99.50th=[ 367], 99.90th=[ 379], 99.95th=[ 392], 00:09:27.149 | 99.99th=[ 5866] 00:09:27.149 write: IOPS=2557, BW=9.99MiB/s (10.5MB/s)(10.0MiB/1001msec); 0 zone resets 00:09:27.149 slat (usec): min=12, max=196, avg=23.30, stdev= 6.99 00:09:27.149 clat (usec): min=113, max=2249, avg=159.12, stdev=56.39 00:09:27.149 lat (usec): min=135, max=2273, avg=182.41, stdev=56.36 00:09:27.149 clat percentiles (usec): 00:09:27.149 | 1.00th=[ 124], 5.00th=[ 128], 10.00th=[ 131], 20.00th=[ 135], 00:09:27.149 | 30.00th=[ 139], 40.00th=[ 141], 50.00th=[ 145], 60.00th=[ 149], 00:09:27.149 | 70.00th=[ 155], 80.00th=[ 165], 90.00th=[ 235], 95.00th=[ 258], 00:09:27.149 | 99.00th=[ 277], 99.50th=[ 285], 99.90th=[ 314], 99.95th=[ 355], 00:09:27.149 | 99.99th=[ 2245] 00:09:27.149 bw ( KiB/s): min=12288, max=12288, per=36.14%, avg=12288.00, stdev= 0.00, samples=1 00:09:27.149 iops : min= 3072, max= 3072, avg=3072.00, stdev= 0.00, samples=1 00:09:27.149 lat (usec) : 250=84.92%, 500=15.04% 00:09:27.149 lat (msec) : 4=0.02%, 10=0.02% 00:09:27.149 cpu : usr=2.00%, sys=7.40%, ctx=4848, majf=0, minf=11 00:09:27.149 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:09:27.149 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:09:27.149 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:09:27.149 issued rwts: total=2288,2560,0,0 short=0,0,0,0 dropped=0,0,0,0 00:09:27.149 latency : target=0, window=0, percentile=100.00%, depth=1 00:09:27.149 00:09:27.149 Run status group 0 (all jobs): 00:09:27.149 READ: bw=28.6MiB/s (30.0MB/s), 6138KiB/s-9143KiB/s (6285kB/s-9362kB/s), io=28.7MiB (30.1MB), run=1001-1001msec 00:09:27.149 WRITE: bw=33.2MiB/s (34.8MB/s), 7401KiB/s-9.99MiB/s (7578kB/s-10.5MB/s), io=33.2MiB (34.8MB), run=1001-1001msec 00:09:27.149 00:09:27.149 Disk stats (read/write): 00:09:27.149 nvme0n1: ios=1425/1536, merge=0/0, ticks=451/363, in_queue=814, util=87.37% 00:09:27.149 nvme0n2: ios=1577/1538, merge=0/0, ticks=467/355, in_queue=822, util=88.40% 00:09:27.149 nvme0n3: ios=1536/1945, merge=0/0, ticks=400/369, in_queue=769, util=88.15% 00:09:27.149 nvme0n4: ios=2048/2278, merge=0/0, ticks=424/366, in_queue=790, util=89.64% 00:09:27.149 11:20:08 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@51 -- # /home/vagrant/spdk_repo/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t randwrite -r 1 -v 00:09:27.149 [global] 00:09:27.149 thread=1 00:09:27.149 invalidate=1 00:09:27.149 rw=randwrite 00:09:27.149 time_based=1 00:09:27.149 runtime=1 00:09:27.149 ioengine=libaio 00:09:27.149 direct=1 00:09:27.149 bs=4096 00:09:27.149 iodepth=1 00:09:27.149 norandommap=0 00:09:27.149 numjobs=1 00:09:27.149 00:09:27.149 verify_dump=1 00:09:27.149 verify_backlog=512 00:09:27.149 verify_state_save=0 00:09:27.149 do_verify=1 00:09:27.149 verify=crc32c-intel 00:09:27.149 [job0] 00:09:27.149 filename=/dev/nvme0n1 00:09:27.149 [job1] 00:09:27.149 filename=/dev/nvme0n2 00:09:27.149 [job2] 00:09:27.149 filename=/dev/nvme0n3 00:09:27.149 [job3] 00:09:27.149 filename=/dev/nvme0n4 00:09:27.149 Could not set queue depth (nvme0n1) 00:09:27.149 Could not set queue depth (nvme0n2) 00:09:27.149 Could not set queue depth (nvme0n3) 00:09:27.149 Could not set queue depth (nvme0n4) 00:09:27.149 job0: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:09:27.149 job1: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:09:27.149 job2: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:09:27.149 job3: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:09:27.149 fio-3.35 00:09:27.149 Starting 4 threads 00:09:28.520 00:09:28.520 job0: (groupid=0, jobs=1): err= 0: pid=70430: Mon Oct 7 11:20:09 2024 00:09:28.520 read: IOPS=2045, BW=8184KiB/s (8380kB/s)(8192KiB/1001msec) 00:09:28.520 slat (nsec): min=10124, max=30675, avg=12771.45, stdev=2213.00 00:09:28.520 clat (usec): min=137, max=470, avg=256.77, stdev=63.73 00:09:28.520 lat (usec): min=150, max=485, avg=269.54, stdev=63.67 00:09:28.520 clat percentiles (usec): 00:09:28.520 | 1.00th=[ 145], 5.00th=[ 153], 10.00th=[ 159], 20.00th=[ 172], 00:09:28.520 | 30.00th=[ 245], 40.00th=[ 260], 50.00th=[ 269], 60.00th=[ 277], 00:09:28.520 | 70.00th=[ 281], 80.00th=[ 293], 90.00th=[ 351], 95.00th=[ 363], 00:09:28.520 | 99.00th=[ 379], 99.50th=[ 383], 99.90th=[ 433], 99.95th=[ 457], 00:09:28.521 | 99.99th=[ 469] 00:09:28.521 write: IOPS=2069, BW=8280KiB/s (8478kB/s)(8288KiB/1001msec); 0 zone resets 00:09:28.521 slat (usec): min=10, max=151, avg=19.31, stdev= 5.87 00:09:28.521 clat (usec): min=104, max=813, avg=193.70, stdev=56.97 00:09:28.521 lat (usec): min=125, max=830, avg=213.01, stdev=56.79 00:09:28.521 clat percentiles (usec): 00:09:28.521 | 1.00th=[ 115], 5.00th=[ 123], 10.00th=[ 127], 20.00th=[ 133], 00:09:28.521 | 30.00th=[ 141], 40.00th=[ 176], 50.00th=[ 204], 60.00th=[ 219], 00:09:28.521 | 70.00th=[ 229], 80.00th=[ 245], 90.00th=[ 262], 95.00th=[ 273], 00:09:28.521 | 99.00th=[ 302], 99.50th=[ 330], 99.90th=[ 510], 99.95th=[ 578], 00:09:28.521 | 99.99th=[ 816] 00:09:28.521 bw ( KiB/s): min=10120, max=10120, per=24.67%, avg=10120.00, stdev= 0.00, samples=1 00:09:28.521 iops : min= 2530, max= 2530, avg=2530.00, stdev= 0.00, samples=1 00:09:28.521 lat (usec) : 250=58.03%, 500=41.87%, 750=0.07%, 1000=0.02% 00:09:28.521 cpu : usr=1.30%, sys=5.40%, ctx=4121, majf=0, minf=19 00:09:28.521 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:09:28.521 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:09:28.521 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:09:28.521 issued rwts: total=2048,2072,0,0 short=0,0,0,0 dropped=0,0,0,0 00:09:28.521 latency : target=0, window=0, percentile=100.00%, depth=1 00:09:28.521 job1: (groupid=0, jobs=1): err= 0: pid=70431: Mon Oct 7 11:20:09 2024 00:09:28.521 read: IOPS=2608, BW=10.2MiB/s (10.7MB/s)(10.2MiB/1001msec) 00:09:28.521 slat (nsec): min=12656, max=52342, avg=15932.18, stdev=4702.05 00:09:28.521 clat (usec): min=150, max=2329, avg=177.30, stdev=45.25 00:09:28.521 lat (usec): min=165, max=2358, avg=193.24, stdev=45.98 00:09:28.521 clat percentiles (usec): 00:09:28.521 | 1.00th=[ 157], 5.00th=[ 161], 10.00th=[ 163], 20.00th=[ 167], 00:09:28.521 | 30.00th=[ 169], 40.00th=[ 172], 50.00th=[ 176], 60.00th=[ 178], 00:09:28.521 | 70.00th=[ 182], 80.00th=[ 186], 90.00th=[ 192], 95.00th=[ 196], 00:09:28.521 | 99.00th=[ 206], 99.50th=[ 217], 99.90th=[ 523], 99.95th=[ 619], 00:09:28.521 | 99.99th=[ 2343] 00:09:28.521 write: IOPS=3068, BW=12.0MiB/s (12.6MB/s)(12.0MiB/1001msec); 0 zone resets 00:09:28.521 slat (usec): min=18, max=121, avg=23.93, stdev= 7.15 00:09:28.521 clat (usec): min=109, max=305, avg=134.16, stdev=11.02 00:09:28.521 lat (usec): min=131, max=427, avg=158.09, stdev=14.76 00:09:28.521 clat percentiles (usec): 00:09:28.521 | 1.00th=[ 117], 5.00th=[ 120], 10.00th=[ 123], 20.00th=[ 126], 00:09:28.521 | 30.00th=[ 128], 40.00th=[ 131], 50.00th=[ 133], 60.00th=[ 137], 00:09:28.521 | 70.00th=[ 139], 80.00th=[ 143], 90.00th=[ 149], 95.00th=[ 153], 00:09:28.521 | 99.00th=[ 165], 99.50th=[ 169], 99.90th=[ 180], 99.95th=[ 200], 00:09:28.521 | 99.99th=[ 306] 00:09:28.521 bw ( KiB/s): min=12288, max=12288, per=29.96%, avg=12288.00, stdev= 0.00, samples=1 00:09:28.521 iops : min= 3072, max= 3072, avg=3072.00, stdev= 0.00, samples=1 00:09:28.521 lat (usec) : 250=99.82%, 500=0.12%, 750=0.04% 00:09:28.521 lat (msec) : 4=0.02% 00:09:28.521 cpu : usr=2.40%, sys=8.20%, ctx=5689, majf=0, minf=14 00:09:28.521 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:09:28.521 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:09:28.521 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:09:28.521 issued rwts: total=2611,3072,0,0 short=0,0,0,0 dropped=0,0,0,0 00:09:28.521 latency : target=0, window=0, percentile=100.00%, depth=1 00:09:28.521 job2: (groupid=0, jobs=1): err= 0: pid=70432: Mon Oct 7 11:20:09 2024 00:09:28.521 read: IOPS=2723, BW=10.6MiB/s (11.2MB/s)(10.6MiB/1001msec) 00:09:28.521 slat (nsec): min=11865, max=39858, avg=14539.86, stdev=3050.76 00:09:28.521 clat (usec): min=147, max=2083, avg=172.94, stdev=40.84 00:09:28.521 lat (usec): min=160, max=2099, avg=187.48, stdev=40.98 00:09:28.521 clat percentiles (usec): 00:09:28.521 | 1.00th=[ 153], 5.00th=[ 157], 10.00th=[ 161], 20.00th=[ 163], 00:09:28.521 | 30.00th=[ 167], 40.00th=[ 169], 50.00th=[ 172], 60.00th=[ 174], 00:09:28.521 | 70.00th=[ 176], 80.00th=[ 180], 90.00th=[ 186], 95.00th=[ 190], 00:09:28.521 | 99.00th=[ 202], 99.50th=[ 206], 99.90th=[ 660], 99.95th=[ 685], 00:09:28.521 | 99.99th=[ 2089] 00:09:28.521 write: IOPS=3068, BW=12.0MiB/s (12.6MB/s)(12.0MiB/1001msec); 0 zone resets 00:09:28.521 slat (nsec): min=18385, max=89170, avg=21206.88, stdev=4532.35 00:09:28.521 clat (usec): min=112, max=261, avg=134.95, stdev=10.39 00:09:28.521 lat (usec): min=133, max=350, avg=156.16, stdev=11.88 00:09:28.521 clat percentiles (usec): 00:09:28.521 | 1.00th=[ 118], 5.00th=[ 122], 10.00th=[ 124], 20.00th=[ 127], 00:09:28.521 | 30.00th=[ 129], 40.00th=[ 131], 50.00th=[ 135], 60.00th=[ 137], 00:09:28.521 | 70.00th=[ 141], 80.00th=[ 143], 90.00th=[ 149], 95.00th=[ 155], 00:09:28.521 | 99.00th=[ 163], 99.50th=[ 169], 99.90th=[ 182], 99.95th=[ 186], 00:09:28.521 | 99.99th=[ 262] 00:09:28.521 bw ( KiB/s): min=12288, max=12288, per=29.96%, avg=12288.00, stdev= 0.00, samples=1 00:09:28.521 iops : min= 3072, max= 3072, avg=3072.00, stdev= 0.00, samples=1 00:09:28.521 lat (usec) : 250=99.90%, 500=0.05%, 750=0.03% 00:09:28.521 lat (msec) : 4=0.02% 00:09:28.521 cpu : usr=2.20%, sys=7.80%, ctx=5798, majf=0, minf=9 00:09:28.521 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:09:28.521 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:09:28.521 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:09:28.521 issued rwts: total=2726,3072,0,0 short=0,0,0,0 dropped=0,0,0,0 00:09:28.521 latency : target=0, window=0, percentile=100.00%, depth=1 00:09:28.521 job3: (groupid=0, jobs=1): err= 0: pid=70433: Mon Oct 7 11:20:09 2024 00:09:28.521 read: IOPS=1844, BW=7377KiB/s (7554kB/s)(7384KiB/1001msec) 00:09:28.521 slat (nsec): min=8560, max=53233, avg=14809.77, stdev=4673.99 00:09:28.521 clat (usec): min=158, max=3964, avg=285.31, stdev=183.90 00:09:28.521 lat (usec): min=174, max=3986, avg=300.12, stdev=183.90 00:09:28.521 clat percentiles (usec): 00:09:28.521 | 1.00th=[ 172], 5.00th=[ 186], 10.00th=[ 194], 20.00th=[ 249], 00:09:28.521 | 30.00th=[ 262], 40.00th=[ 269], 50.00th=[ 273], 60.00th=[ 281], 00:09:28.521 | 70.00th=[ 285], 80.00th=[ 297], 90.00th=[ 347], 95.00th=[ 363], 00:09:28.521 | 99.00th=[ 445], 99.50th=[ 848], 99.90th=[ 3949], 99.95th=[ 3949], 00:09:28.521 | 99.99th=[ 3949] 00:09:28.521 write: IOPS=2045, BW=8184KiB/s (8380kB/s)(8192KiB/1001msec); 0 zone resets 00:09:28.521 slat (usec): min=10, max=154, avg=20.09, stdev= 5.79 00:09:28.521 clat (usec): min=120, max=362, avg=194.46, stdev=44.04 00:09:28.521 lat (usec): min=136, max=475, avg=214.55, stdev=43.27 00:09:28.521 clat percentiles (usec): 00:09:28.521 | 1.00th=[ 130], 5.00th=[ 137], 10.00th=[ 141], 20.00th=[ 149], 00:09:28.521 | 30.00th=[ 157], 40.00th=[ 174], 50.00th=[ 192], 60.00th=[ 215], 00:09:28.521 | 70.00th=[ 227], 80.00th=[ 239], 90.00th=[ 253], 95.00th=[ 265], 00:09:28.521 | 99.00th=[ 281], 99.50th=[ 285], 99.90th=[ 322], 99.95th=[ 326], 00:09:28.521 | 99.99th=[ 363] 00:09:28.521 bw ( KiB/s): min= 8192, max= 8192, per=19.97%, avg=8192.00, stdev= 0.00, samples=1 00:09:28.521 iops : min= 2048, max= 2048, avg=2048.00, stdev= 0.00, samples=1 00:09:28.521 lat (usec) : 250=55.44%, 500=44.14%, 750=0.13%, 1000=0.08% 00:09:28.521 lat (msec) : 2=0.10%, 4=0.10% 00:09:28.521 cpu : usr=1.00%, sys=5.90%, ctx=3896, majf=0, minf=7 00:09:28.521 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:09:28.521 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:09:28.521 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:09:28.521 issued rwts: total=1846,2048,0,0 short=0,0,0,0 dropped=0,0,0,0 00:09:28.521 latency : target=0, window=0, percentile=100.00%, depth=1 00:09:28.521 00:09:28.521 Run status group 0 (all jobs): 00:09:28.521 READ: bw=36.0MiB/s (37.8MB/s), 7377KiB/s-10.6MiB/s (7554kB/s-11.2MB/s), io=36.1MiB (37.8MB), run=1001-1001msec 00:09:28.521 WRITE: bw=40.1MiB/s (42.0MB/s), 8184KiB/s-12.0MiB/s (8380kB/s-12.6MB/s), io=40.1MiB (42.0MB), run=1001-1001msec 00:09:28.521 00:09:28.521 Disk stats (read/write): 00:09:28.521 nvme0n1: ios=1641/2048, merge=0/0, ticks=426/393, in_queue=819, util=87.76% 00:09:28.521 nvme0n2: ios=2301/2560, merge=0/0, ticks=430/362, in_queue=792, util=87.80% 00:09:28.521 nvme0n3: ios=2391/2560, merge=0/0, ticks=418/361, in_queue=779, util=89.11% 00:09:28.521 nvme0n4: ios=1536/1816, merge=0/0, ticks=431/363, in_queue=794, util=89.25% 00:09:28.521 11:20:09 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@52 -- # /home/vagrant/spdk_repo/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 128 -t write -r 1 -v 00:09:28.521 [global] 00:09:28.521 thread=1 00:09:28.521 invalidate=1 00:09:28.521 rw=write 00:09:28.521 time_based=1 00:09:28.521 runtime=1 00:09:28.521 ioengine=libaio 00:09:28.521 direct=1 00:09:28.521 bs=4096 00:09:28.521 iodepth=128 00:09:28.521 norandommap=0 00:09:28.521 numjobs=1 00:09:28.521 00:09:28.521 verify_dump=1 00:09:28.521 verify_backlog=512 00:09:28.521 verify_state_save=0 00:09:28.521 do_verify=1 00:09:28.521 verify=crc32c-intel 00:09:28.521 [job0] 00:09:28.521 filename=/dev/nvme0n1 00:09:28.521 [job1] 00:09:28.521 filename=/dev/nvme0n2 00:09:28.521 [job2] 00:09:28.521 filename=/dev/nvme0n3 00:09:28.521 [job3] 00:09:28.521 filename=/dev/nvme0n4 00:09:28.521 Could not set queue depth (nvme0n1) 00:09:28.521 Could not set queue depth (nvme0n2) 00:09:28.521 Could not set queue depth (nvme0n3) 00:09:28.521 Could not set queue depth (nvme0n4) 00:09:28.521 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:09:28.521 job1: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:09:28.521 job2: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:09:28.521 job3: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:09:28.521 fio-3.35 00:09:28.521 Starting 4 threads 00:09:29.896 00:09:29.896 job0: (groupid=0, jobs=1): err= 0: pid=70492: Mon Oct 7 11:20:11 2024 00:09:29.896 read: IOPS=2033, BW=8135KiB/s (8330kB/s)(8192KiB/1007msec) 00:09:29.896 slat (usec): min=6, max=10161, avg=248.68, stdev=1125.70 00:09:29.896 clat (usec): min=13806, max=49032, avg=31522.40, stdev=10031.69 00:09:29.896 lat (usec): min=15226, max=49046, avg=31771.08, stdev=10066.95 00:09:29.896 clat percentiles (usec): 00:09:29.896 | 1.00th=[16188], 5.00th=[17957], 10.00th=[18220], 20.00th=[19792], 00:09:29.896 | 30.00th=[25035], 40.00th=[28967], 50.00th=[30540], 60.00th=[32375], 00:09:29.897 | 70.00th=[36439], 80.00th=[42730], 90.00th=[45876], 95.00th=[48497], 00:09:29.897 | 99.00th=[49021], 99.50th=[49021], 99.90th=[49021], 99.95th=[49021], 00:09:29.897 | 99.99th=[49021] 00:09:29.897 write: IOPS=2272, BW=9088KiB/s (9307kB/s)(9152KiB/1007msec); 0 zone resets 00:09:29.897 slat (usec): min=16, max=7489, avg=206.75, stdev=917.55 00:09:29.897 clat (usec): min=2537, max=61566, avg=27047.19, stdev=8205.95 00:09:29.897 lat (usec): min=8148, max=61612, avg=27253.94, stdev=8203.11 00:09:29.897 clat percentiles (usec): 00:09:29.897 | 1.00th=[15926], 5.00th=[17957], 10.00th=[19006], 20.00th=[19792], 00:09:29.897 | 30.00th=[20317], 40.00th=[24511], 50.00th=[27657], 60.00th=[28181], 00:09:29.897 | 70.00th=[28443], 80.00th=[29230], 90.00th=[39060], 95.00th=[45351], 00:09:29.897 | 99.00th=[55837], 99.50th=[58459], 99.90th=[61604], 99.95th=[61604], 00:09:29.897 | 99.99th=[61604] 00:09:29.897 bw ( KiB/s): min= 8288, max= 8992, per=16.73%, avg=8640.00, stdev=497.80, samples=2 00:09:29.897 iops : min= 2072, max= 2248, avg=2160.00, stdev=124.45, samples=2 00:09:29.897 lat (msec) : 4=0.02%, 10=0.18%, 20=23.15%, 50=75.37%, 100=1.27% 00:09:29.897 cpu : usr=2.39%, sys=7.36%, ctx=247, majf=0, minf=15 00:09:29.897 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.7%, >=64=98.5% 00:09:29.897 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:09:29.897 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:09:29.897 issued rwts: total=2048,2288,0,0 short=0,0,0,0 dropped=0,0,0,0 00:09:29.897 latency : target=0, window=0, percentile=100.00%, depth=128 00:09:29.897 job1: (groupid=0, jobs=1): err= 0: pid=70493: Mon Oct 7 11:20:11 2024 00:09:29.897 read: IOPS=2039, BW=8159KiB/s (8355kB/s)(8192KiB/1004msec) 00:09:29.897 slat (usec): min=3, max=11232, avg=229.26, stdev=1067.85 00:09:29.897 clat (usec): min=17959, max=40436, avg=29127.34, stdev=3384.57 00:09:29.897 lat (usec): min=21733, max=40456, avg=29356.59, stdev=3276.93 00:09:29.897 clat percentiles (usec): 00:09:29.897 | 1.00th=[21890], 5.00th=[24249], 10.00th=[24773], 20.00th=[26608], 00:09:29.897 | 30.00th=[27132], 40.00th=[27919], 50.00th=[28705], 60.00th=[29492], 00:09:29.897 | 70.00th=[30540], 80.00th=[32375], 90.00th=[34341], 95.00th=[34341], 00:09:29.897 | 99.00th=[36439], 99.50th=[37487], 99.90th=[40109], 99.95th=[40109], 00:09:29.897 | 99.99th=[40633] 00:09:29.897 write: IOPS=2268, BW=9076KiB/s (9294kB/s)(9112KiB/1004msec); 0 zone resets 00:09:29.897 slat (usec): min=11, max=7128, avg=225.45, stdev=985.54 00:09:29.897 clat (usec): min=1759, max=49149, avg=29175.64, stdev=7169.77 00:09:29.897 lat (usec): min=7245, max=49170, avg=29401.10, stdev=7144.18 00:09:29.897 clat percentiles (usec): 00:09:29.897 | 1.00th=[ 7635], 5.00th=[20841], 10.00th=[23462], 20.00th=[24249], 00:09:29.897 | 30.00th=[25560], 40.00th=[27132], 50.00th=[27657], 60.00th=[28443], 00:09:29.897 | 70.00th=[28705], 80.00th=[38536], 90.00th=[40633], 95.00th=[42206], 00:09:29.897 | 99.00th=[44827], 99.50th=[46400], 99.90th=[46924], 99.95th=[47449], 00:09:29.897 | 99.99th=[49021] 00:09:29.897 bw ( KiB/s): min= 8584, max= 8616, per=16.65%, avg=8600.00, stdev=22.63, samples=2 00:09:29.897 iops : min= 2146, max= 2154, avg=2150.00, stdev= 5.66, samples=2 00:09:29.897 lat (msec) : 2=0.02%, 10=0.74%, 20=1.18%, 50=98.06% 00:09:29.897 cpu : usr=2.19%, sys=6.18%, ctx=456, majf=0, minf=12 00:09:29.897 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.7%, >=64=98.5% 00:09:29.897 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:09:29.897 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:09:29.897 issued rwts: total=2048,2278,0,0 short=0,0,0,0 dropped=0,0,0,0 00:09:29.897 latency : target=0, window=0, percentile=100.00%, depth=128 00:09:29.897 job2: (groupid=0, jobs=1): err= 0: pid=70494: Mon Oct 7 11:20:11 2024 00:09:29.897 read: IOPS=2037, BW=8151KiB/s (8347kB/s)(8192KiB/1005msec) 00:09:29.897 slat (usec): min=3, max=10877, avg=226.63, stdev=1041.11 00:09:29.897 clat (usec): min=18713, max=39765, avg=28599.18, stdev=3933.67 00:09:29.897 lat (usec): min=19833, max=39801, avg=28825.81, stdev=3868.64 00:09:29.897 clat percentiles (usec): 00:09:29.897 | 1.00th=[21365], 5.00th=[22414], 10.00th=[23725], 20.00th=[24773], 00:09:29.897 | 30.00th=[25822], 40.00th=[27132], 50.00th=[28705], 60.00th=[29492], 00:09:29.897 | 70.00th=[30540], 80.00th=[32900], 90.00th=[34341], 95.00th=[34866], 00:09:29.897 | 99.00th=[35390], 99.50th=[35390], 99.90th=[36439], 99.95th=[36439], 00:09:29.897 | 99.99th=[39584] 00:09:29.897 write: IOPS=2315, BW=9262KiB/s (9484kB/s)(9308KiB/1005msec); 0 zone resets 00:09:29.897 slat (usec): min=12, max=7319, avg=223.57, stdev=941.03 00:09:29.897 clat (usec): min=1991, max=48900, avg=29080.43, stdev=7175.35 00:09:29.897 lat (usec): min=6261, max=48946, avg=29304.00, stdev=7159.42 00:09:29.897 clat percentiles (usec): 00:09:29.897 | 1.00th=[ 6652], 5.00th=[20055], 10.00th=[23725], 20.00th=[24511], 00:09:29.897 | 30.00th=[25560], 40.00th=[27132], 50.00th=[27657], 60.00th=[28181], 00:09:29.897 | 70.00th=[28705], 80.00th=[37487], 90.00th=[40633], 95.00th=[42206], 00:09:29.897 | 99.00th=[44303], 99.50th=[44827], 99.90th=[47973], 99.95th=[47973], 00:09:29.897 | 99.99th=[49021] 00:09:29.897 bw ( KiB/s): min= 8513, max= 9096, per=17.04%, avg=8804.50, stdev=412.24, samples=2 00:09:29.897 iops : min= 2128, max= 2274, avg=2201.00, stdev=103.24, samples=2 00:09:29.897 lat (msec) : 2=0.02%, 10=0.73%, 20=1.92%, 50=97.33% 00:09:29.897 cpu : usr=2.19%, sys=6.87%, ctx=438, majf=0, minf=7 00:09:29.897 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.7%, >=64=98.6% 00:09:29.897 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:09:29.897 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:09:29.897 issued rwts: total=2048,2327,0,0 short=0,0,0,0 dropped=0,0,0,0 00:09:29.897 latency : target=0, window=0, percentile=100.00%, depth=128 00:09:29.897 job3: (groupid=0, jobs=1): err= 0: pid=70495: Mon Oct 7 11:20:11 2024 00:09:29.897 read: IOPS=5603, BW=21.9MiB/s (23.0MB/s)(22.0MiB/1005msec) 00:09:29.897 slat (usec): min=5, max=7816, avg=83.35, stdev=431.68 00:09:29.897 clat (usec): min=6844, max=17764, avg=11010.28, stdev=1303.48 00:09:29.897 lat (usec): min=6898, max=17802, avg=11093.63, stdev=1332.66 00:09:29.897 clat percentiles (usec): 00:09:29.897 | 1.00th=[ 7570], 5.00th=[ 9110], 10.00th=[ 9765], 20.00th=[10159], 00:09:29.897 | 30.00th=[10421], 40.00th=[10683], 50.00th=[10814], 60.00th=[11076], 00:09:29.897 | 70.00th=[11469], 80.00th=[11994], 90.00th=[12649], 95.00th=[13566], 00:09:29.897 | 99.00th=[15008], 99.50th=[15139], 99.90th=[15270], 99.95th=[15664], 00:09:29.897 | 99.99th=[17695] 00:09:29.897 write: IOPS=6080, BW=23.8MiB/s (24.9MB/s)(23.9MiB/1005msec); 0 zone resets 00:09:29.897 slat (usec): min=10, max=6576, avg=80.04, stdev=399.36 00:09:29.897 clat (usec): min=1874, max=22183, avg=10643.66, stdev=1556.97 00:09:29.897 lat (usec): min=5934, max=22196, avg=10723.71, stdev=1577.45 00:09:29.897 clat percentiles (usec): 00:09:29.897 | 1.00th=[ 6783], 5.00th=[ 8848], 10.00th=[ 9765], 20.00th=[10028], 00:09:29.897 | 30.00th=[10159], 40.00th=[10421], 50.00th=[10552], 60.00th=[10683], 00:09:29.897 | 70.00th=[10814], 80.00th=[11076], 90.00th=[11338], 95.00th=[12649], 00:09:29.897 | 99.00th=[18744], 99.50th=[20317], 99.90th=[21627], 99.95th=[22152], 00:09:29.897 | 99.99th=[22152] 00:09:29.897 bw ( KiB/s): min=23288, max=24625, per=46.38%, avg=23956.50, stdev=945.40, samples=2 00:09:29.897 iops : min= 5822, max= 6156, avg=5989.00, stdev=236.17, samples=2 00:09:29.897 lat (msec) : 2=0.01%, 10=16.16%, 20=83.56%, 50=0.26% 00:09:29.897 cpu : usr=4.88%, sys=15.24%, ctx=598, majf=0, minf=10 00:09:29.897 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.3%, >=64=99.5% 00:09:29.897 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:09:29.897 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:09:29.897 issued rwts: total=5632,6111,0,0 short=0,0,0,0 dropped=0,0,0,0 00:09:29.897 latency : target=0, window=0, percentile=100.00%, depth=128 00:09:29.897 00:09:29.897 Run status group 0 (all jobs): 00:09:29.897 READ: bw=45.7MiB/s (47.9MB/s), 8135KiB/s-21.9MiB/s (8330kB/s-23.0MB/s), io=46.0MiB (48.2MB), run=1004-1007msec 00:09:29.897 WRITE: bw=50.4MiB/s (52.9MB/s), 9076KiB/s-23.8MiB/s (9294kB/s-24.9MB/s), io=50.8MiB (53.3MB), run=1004-1007msec 00:09:29.897 00:09:29.897 Disk stats (read/write): 00:09:29.897 nvme0n1: ios=1938/2048, merge=0/0, ticks=14332/11342, in_queue=25674, util=88.28% 00:09:29.897 nvme0n2: ios=1617/2048, merge=0/0, ticks=11211/13592, in_queue=24803, util=88.56% 00:09:29.897 nvme0n3: ios=1599/2048, merge=0/0, ticks=11252/14081, in_queue=25333, util=89.27% 00:09:29.897 nvme0n4: ios=5060/5120, merge=0/0, ticks=25657/22358, in_queue=48015, util=89.72% 00:09:29.897 11:20:11 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@53 -- # /home/vagrant/spdk_repo/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 128 -t randwrite -r 1 -v 00:09:29.897 [global] 00:09:29.897 thread=1 00:09:29.897 invalidate=1 00:09:29.897 rw=randwrite 00:09:29.897 time_based=1 00:09:29.897 runtime=1 00:09:29.897 ioengine=libaio 00:09:29.897 direct=1 00:09:29.897 bs=4096 00:09:29.897 iodepth=128 00:09:29.897 norandommap=0 00:09:29.897 numjobs=1 00:09:29.897 00:09:29.897 verify_dump=1 00:09:29.898 verify_backlog=512 00:09:29.898 verify_state_save=0 00:09:29.898 do_verify=1 00:09:29.898 verify=crc32c-intel 00:09:29.898 [job0] 00:09:29.898 filename=/dev/nvme0n1 00:09:29.898 [job1] 00:09:29.898 filename=/dev/nvme0n2 00:09:29.898 [job2] 00:09:29.898 filename=/dev/nvme0n3 00:09:29.898 [job3] 00:09:29.898 filename=/dev/nvme0n4 00:09:29.898 Could not set queue depth (nvme0n1) 00:09:29.898 Could not set queue depth (nvme0n2) 00:09:29.898 Could not set queue depth (nvme0n3) 00:09:29.898 Could not set queue depth (nvme0n4) 00:09:29.898 job0: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:09:29.898 job1: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:09:29.898 job2: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:09:29.898 job3: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:09:29.898 fio-3.35 00:09:29.898 Starting 4 threads 00:09:31.312 00:09:31.312 job0: (groupid=0, jobs=1): err= 0: pid=70555: Mon Oct 7 11:20:12 2024 00:09:31.312 read: IOPS=4876, BW=19.0MiB/s (20.0MB/s)(19.1MiB/1003msec) 00:09:31.312 slat (usec): min=3, max=7050, avg=102.06, stdev=488.99 00:09:31.312 clat (usec): min=476, max=27670, avg=13269.78, stdev=3993.64 00:09:31.312 lat (usec): min=3617, max=27684, avg=13371.84, stdev=4007.30 00:09:31.312 clat percentiles (usec): 00:09:31.312 | 1.00th=[ 7570], 5.00th=[ 9896], 10.00th=[10683], 20.00th=[11469], 00:09:31.312 | 30.00th=[11863], 40.00th=[11994], 50.00th=[12256], 60.00th=[12256], 00:09:31.312 | 70.00th=[12387], 80.00th=[12780], 90.00th=[20579], 95.00th=[23725], 00:09:31.312 | 99.00th=[26084], 99.50th=[27132], 99.90th=[27657], 99.95th=[27657], 00:09:31.312 | 99.99th=[27657] 00:09:31.312 write: IOPS=5104, BW=19.9MiB/s (20.9MB/s)(20.0MiB/1003msec); 0 zone resets 00:09:31.312 slat (usec): min=10, max=3170, avg=90.50, stdev=393.10 00:09:31.312 clat (usec): min=7946, max=24582, avg=12068.63, stdev=2596.21 00:09:31.312 lat (usec): min=7964, max=24601, avg=12159.14, stdev=2611.57 00:09:31.312 clat percentiles (usec): 00:09:31.312 | 1.00th=[ 8455], 5.00th=[ 9765], 10.00th=[10028], 20.00th=[10290], 00:09:31.312 | 30.00th=[10552], 40.00th=[10945], 50.00th=[11469], 60.00th=[12125], 00:09:31.312 | 70.00th=[12518], 80.00th=[12780], 90.00th=[15008], 95.00th=[18482], 00:09:31.312 | 99.00th=[21365], 99.50th=[21627], 99.90th=[23987], 99.95th=[24511], 00:09:31.312 | 99.99th=[24511] 00:09:31.312 bw ( KiB/s): min=18976, max=21984, per=33.47%, avg=20480.00, stdev=2126.98, samples=2 00:09:31.312 iops : min= 4744, max= 5496, avg=5120.00, stdev=531.74, samples=2 00:09:31.312 lat (usec) : 500=0.01% 00:09:31.312 lat (msec) : 4=0.26%, 10=8.54%, 20=83.77%, 50=7.42% 00:09:31.312 cpu : usr=4.49%, sys=13.27%, ctx=638, majf=0, minf=8 00:09:31.312 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.4% 00:09:31.312 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:09:31.312 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:09:31.312 issued rwts: total=4891,5120,0,0 short=0,0,0,0 dropped=0,0,0,0 00:09:31.312 latency : target=0, window=0, percentile=100.00%, depth=128 00:09:31.312 job1: (groupid=0, jobs=1): err= 0: pid=70556: Mon Oct 7 11:20:12 2024 00:09:31.312 read: IOPS=2391, BW=9566KiB/s (9795kB/s)(9604KiB/1004msec) 00:09:31.312 slat (usec): min=7, max=10827, avg=209.14, stdev=921.74 00:09:31.312 clat (usec): min=3482, max=39317, avg=25661.07, stdev=4594.35 00:09:31.312 lat (usec): min=3511, max=39342, avg=25870.21, stdev=4562.70 00:09:31.312 clat percentiles (usec): 00:09:31.312 | 1.00th=[ 9503], 5.00th=[20841], 10.00th=[22152], 20.00th=[23725], 00:09:31.312 | 30.00th=[23987], 40.00th=[24511], 50.00th=[24773], 60.00th=[25035], 00:09:31.312 | 70.00th=[25560], 80.00th=[28181], 90.00th=[32637], 95.00th=[34341], 00:09:31.312 | 99.00th=[39060], 99.50th=[39060], 99.90th=[39060], 99.95th=[39060], 00:09:31.312 | 99.99th=[39060] 00:09:31.312 write: IOPS=2549, BW=9.96MiB/s (10.4MB/s)(10.0MiB/1004msec); 0 zone resets 00:09:31.312 slat (usec): min=10, max=5709, avg=185.15, stdev=703.46 00:09:31.312 clat (usec): min=14361, max=37640, avg=25391.03, stdev=4218.35 00:09:31.312 lat (usec): min=14405, max=37659, avg=25576.18, stdev=4203.48 00:09:31.312 clat percentiles (usec): 00:09:31.312 | 1.00th=[19006], 5.00th=[21103], 10.00th=[21365], 20.00th=[21890], 00:09:31.312 | 30.00th=[23462], 40.00th=[23987], 50.00th=[24511], 60.00th=[25035], 00:09:31.312 | 70.00th=[25560], 80.00th=[26346], 90.00th=[31327], 95.00th=[36963], 00:09:31.312 | 99.00th=[37487], 99.50th=[37487], 99.90th=[37487], 99.95th=[37487], 00:09:31.312 | 99.99th=[37487] 00:09:31.312 bw ( KiB/s): min= 9600, max=10880, per=16.73%, avg=10240.00, stdev=905.10, samples=2 00:09:31.312 iops : min= 2400, max= 2720, avg=2560.00, stdev=226.27, samples=2 00:09:31.312 lat (msec) : 4=0.04%, 10=0.65%, 20=2.32%, 50=97.00% 00:09:31.312 cpu : usr=3.19%, sys=7.58%, ctx=351, majf=0, minf=13 00:09:31.312 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.7% 00:09:31.312 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:09:31.312 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:09:31.312 issued rwts: total=2401,2560,0,0 short=0,0,0,0 dropped=0,0,0,0 00:09:31.312 latency : target=0, window=0, percentile=100.00%, depth=128 00:09:31.312 job2: (groupid=0, jobs=1): err= 0: pid=70557: Mon Oct 7 11:20:12 2024 00:09:31.312 read: IOPS=2671, BW=10.4MiB/s (10.9MB/s)(10.5MiB/1004msec) 00:09:31.312 slat (usec): min=5, max=6777, avg=179.39, stdev=778.46 00:09:31.312 clat (usec): min=913, max=29814, avg=23070.47, stdev=3264.88 00:09:31.312 lat (usec): min=3868, max=29829, avg=23249.86, stdev=3201.48 00:09:31.312 clat percentiles (usec): 00:09:31.312 | 1.00th=[ 4359], 5.00th=[18482], 10.00th=[20579], 20.00th=[21627], 00:09:31.312 | 30.00th=[21890], 40.00th=[23200], 50.00th=[23987], 60.00th=[24249], 00:09:31.312 | 70.00th=[24511], 80.00th=[25035], 90.00th=[25560], 95.00th=[26346], 00:09:31.312 | 99.00th=[28443], 99.50th=[28967], 99.90th=[29754], 99.95th=[29754], 00:09:31.312 | 99.99th=[29754] 00:09:31.312 write: IOPS=3059, BW=12.0MiB/s (12.5MB/s)(12.0MiB/1004msec); 0 zone resets 00:09:31.312 slat (usec): min=14, max=7681, avg=160.43, stdev=704.71 00:09:31.312 clat (usec): min=11663, max=28797, avg=20943.83, stdev=3812.06 00:09:31.312 lat (usec): min=12642, max=28831, avg=21104.26, stdev=3781.94 00:09:31.312 clat percentiles (usec): 00:09:31.312 | 1.00th=[12911], 5.00th=[15139], 10.00th=[16057], 20.00th=[17695], 00:09:31.312 | 30.00th=[18482], 40.00th=[18744], 50.00th=[20579], 60.00th=[23462], 00:09:31.312 | 70.00th=[24249], 80.00th=[24511], 90.00th=[25297], 95.00th=[25822], 00:09:31.312 | 99.00th=[28181], 99.50th=[28443], 99.90th=[28705], 99.95th=[28705], 00:09:31.312 | 99.99th=[28705] 00:09:31.312 bw ( KiB/s): min=12240, max=12288, per=20.04%, avg=12264.00, stdev=33.94, samples=2 00:09:31.312 iops : min= 3060, max= 3072, avg=3066.00, stdev= 8.49, samples=2 00:09:31.312 lat (usec) : 1000=0.02% 00:09:31.312 lat (msec) : 4=0.12%, 10=0.43%, 20=28.85%, 50=70.58% 00:09:31.312 cpu : usr=2.49%, sys=9.87%, ctx=289, majf=0, minf=15 00:09:31.312 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.9% 00:09:31.312 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:09:31.312 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:09:31.312 issued rwts: total=2682,3072,0,0 short=0,0,0,0 dropped=0,0,0,0 00:09:31.312 latency : target=0, window=0, percentile=100.00%, depth=128 00:09:31.312 job3: (groupid=0, jobs=1): err= 0: pid=70558: Mon Oct 7 11:20:12 2024 00:09:31.312 read: IOPS=4563, BW=17.8MiB/s (18.7MB/s)(17.9MiB/1003msec) 00:09:31.312 slat (usec): min=4, max=6566, avg=107.63, stdev=545.52 00:09:31.312 clat (usec): min=630, max=25952, avg=14103.68, stdev=3269.28 00:09:31.312 lat (usec): min=3545, max=25969, avg=14211.31, stdev=3288.43 00:09:31.312 clat percentiles (usec): 00:09:31.312 | 1.00th=[ 7308], 5.00th=[10814], 10.00th=[11994], 20.00th=[12518], 00:09:31.312 | 30.00th=[12649], 40.00th=[12911], 50.00th=[13304], 60.00th=[13566], 00:09:31.312 | 70.00th=[13829], 80.00th=[14746], 90.00th=[19006], 95.00th=[22152], 00:09:31.312 | 99.00th=[24511], 99.50th=[24511], 99.90th=[25560], 99.95th=[25822], 00:09:31.312 | 99.99th=[25822] 00:09:31.312 write: IOPS=4594, BW=17.9MiB/s (18.8MB/s)(18.0MiB/1003msec); 0 zone resets 00:09:31.312 slat (usec): min=5, max=5056, avg=101.94, stdev=466.21 00:09:31.312 clat (usec): min=7619, max=25045, avg=13494.88, stdev=2297.73 00:09:31.312 lat (usec): min=7656, max=25182, avg=13596.81, stdev=2334.32 00:09:31.312 clat percentiles (usec): 00:09:31.312 | 1.00th=[ 8979], 5.00th=[11207], 10.00th=[11600], 20.00th=[11994], 00:09:31.312 | 30.00th=[12256], 40.00th=[12518], 50.00th=[12911], 60.00th=[13173], 00:09:31.312 | 70.00th=[13435], 80.00th=[14746], 90.00th=[17433], 95.00th=[18482], 00:09:31.312 | 99.00th=[20841], 99.50th=[21890], 99.90th=[24773], 99.95th=[25035], 00:09:31.312 | 99.99th=[25035] 00:09:31.312 bw ( KiB/s): min=16384, max=20480, per=30.12%, avg=18432.00, stdev=2896.31, samples=2 00:09:31.312 iops : min= 4096, max= 5120, avg=4608.00, stdev=724.08, samples=2 00:09:31.312 lat (usec) : 750=0.01% 00:09:31.312 lat (msec) : 4=0.24%, 10=1.85%, 20=92.50%, 50=5.40% 00:09:31.312 cpu : usr=4.09%, sys=13.27%, ctx=615, majf=0, minf=16 00:09:31.312 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.3% 00:09:31.312 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:09:31.312 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:09:31.312 issued rwts: total=4577,4608,0,0 short=0,0,0,0 dropped=0,0,0,0 00:09:31.312 latency : target=0, window=0, percentile=100.00%, depth=128 00:09:31.312 00:09:31.312 Run status group 0 (all jobs): 00:09:31.313 READ: bw=56.6MiB/s (59.4MB/s), 9566KiB/s-19.0MiB/s (9795kB/s-20.0MB/s), io=56.8MiB (59.6MB), run=1003-1004msec 00:09:31.313 WRITE: bw=59.8MiB/s (62.7MB/s), 9.96MiB/s-19.9MiB/s (10.4MB/s-20.9MB/s), io=60.0MiB (62.9MB), run=1003-1004msec 00:09:31.313 00:09:31.313 Disk stats (read/write): 00:09:31.313 nvme0n1: ios=4146/4183, merge=0/0, ticks=13273/11126, in_queue=24399, util=86.97% 00:09:31.313 nvme0n2: ios=2095/2135, merge=0/0, ticks=13248/12545, in_queue=25793, util=88.16% 00:09:31.313 nvme0n3: ios=2384/2560, merge=0/0, ticks=13490/11478, in_queue=24968, util=88.85% 00:09:31.313 nvme0n4: ios=3664/4096, merge=0/0, ticks=21712/20539, in_queue=42251, util=89.60% 00:09:31.313 11:20:12 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@55 -- # sync 00:09:31.313 11:20:12 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@59 -- # fio_pid=70571 00:09:31.313 11:20:12 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@58 -- # /home/vagrant/spdk_repo/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t read -r 10 00:09:31.313 11:20:12 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@61 -- # sleep 3 00:09:31.313 [global] 00:09:31.313 thread=1 00:09:31.313 invalidate=1 00:09:31.313 rw=read 00:09:31.313 time_based=1 00:09:31.313 runtime=10 00:09:31.313 ioengine=libaio 00:09:31.313 direct=1 00:09:31.313 bs=4096 00:09:31.313 iodepth=1 00:09:31.313 norandommap=1 00:09:31.313 numjobs=1 00:09:31.313 00:09:31.313 [job0] 00:09:31.313 filename=/dev/nvme0n1 00:09:31.313 [job1] 00:09:31.313 filename=/dev/nvme0n2 00:09:31.313 [job2] 00:09:31.313 filename=/dev/nvme0n3 00:09:31.313 [job3] 00:09:31.313 filename=/dev/nvme0n4 00:09:31.313 Could not set queue depth (nvme0n1) 00:09:31.313 Could not set queue depth (nvme0n2) 00:09:31.313 Could not set queue depth (nvme0n3) 00:09:31.313 Could not set queue depth (nvme0n4) 00:09:31.313 job0: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:09:31.313 job1: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:09:31.313 job2: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:09:31.313 job3: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:09:31.313 fio-3.35 00:09:31.313 Starting 4 threads 00:09:34.596 11:20:15 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@63 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_raid_delete concat0 00:09:34.597 fio: pid=70614, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:09:34.597 fio: io_u error on file /dev/nvme0n4: Operation not supported: read offset=57438208, buflen=4096 00:09:34.597 11:20:16 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@64 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_raid_delete raid0 00:09:34.855 fio: pid=70613, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:09:34.855 fio: io_u error on file /dev/nvme0n3: Operation not supported: read offset=61370368, buflen=4096 00:09:34.855 11:20:16 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:09:34.855 11:20:16 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@66 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_malloc_delete Malloc0 00:09:35.114 fio: pid=70611, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:09:35.114 fio: io_u error on file /dev/nvme0n1: Operation not supported: read offset=47874048, buflen=4096 00:09:35.114 11:20:16 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:09:35.114 11:20:16 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@66 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_malloc_delete Malloc1 00:09:35.372 fio: pid=70612, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:09:35.372 fio: io_u error on file /dev/nvme0n2: Operation not supported: read offset=61452288, buflen=4096 00:09:35.372 00:09:35.372 job0: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=70611: Mon Oct 7 11:20:16 2024 00:09:35.372 read: IOPS=3354, BW=13.1MiB/s (13.7MB/s)(45.7MiB/3485msec) 00:09:35.372 slat (usec): min=7, max=11807, avg=18.80, stdev=164.23 00:09:35.372 clat (usec): min=125, max=5173, avg=277.66, stdev=84.50 00:09:35.372 lat (usec): min=137, max=12031, avg=296.46, stdev=184.25 00:09:35.372 clat percentiles (usec): 00:09:35.372 | 1.00th=[ 145], 5.00th=[ 217], 10.00th=[ 233], 20.00th=[ 265], 00:09:35.372 | 30.00th=[ 269], 40.00th=[ 273], 50.00th=[ 277], 60.00th=[ 281], 00:09:35.372 | 70.00th=[ 289], 80.00th=[ 293], 90.00th=[ 306], 95.00th=[ 326], 00:09:35.372 | 99.00th=[ 396], 99.50th=[ 433], 99.90th=[ 963], 99.95th=[ 1582], 00:09:35.372 | 99.99th=[ 3556] 00:09:35.372 bw ( KiB/s): min=12128, max=13648, per=22.56%, avg=13290.67, stdev=590.54, samples=6 00:09:35.372 iops : min= 3032, max= 3412, avg=3322.67, stdev=147.64, samples=6 00:09:35.372 lat (usec) : 250=13.06%, 500=86.66%, 750=0.11%, 1000=0.07% 00:09:35.372 lat (msec) : 2=0.05%, 4=0.03%, 10=0.01% 00:09:35.372 cpu : usr=0.89%, sys=4.85%, ctx=11757, majf=0, minf=1 00:09:35.372 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:09:35.372 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:09:35.372 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:09:35.372 issued rwts: total=11689,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:09:35.372 latency : target=0, window=0, percentile=100.00%, depth=1 00:09:35.372 job1: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=70612: Mon Oct 7 11:20:16 2024 00:09:35.372 read: IOPS=3967, BW=15.5MiB/s (16.2MB/s)(58.6MiB/3782msec) 00:09:35.372 slat (usec): min=9, max=11857, avg=19.57, stdev=189.33 00:09:35.372 clat (usec): min=3, max=7222, avg=231.09, stdev=122.81 00:09:35.372 lat (usec): min=136, max=12112, avg=250.66, stdev=225.60 00:09:35.372 clat percentiles (usec): 00:09:35.372 | 1.00th=[ 130], 5.00th=[ 135], 10.00th=[ 139], 20.00th=[ 149], 00:09:35.372 | 30.00th=[ 159], 40.00th=[ 225], 50.00th=[ 265], 60.00th=[ 273], 00:09:35.372 | 70.00th=[ 277], 80.00th=[ 285], 90.00th=[ 289], 95.00th=[ 297], 00:09:35.372 | 99.00th=[ 322], 99.50th=[ 371], 99.90th=[ 988], 99.95th=[ 3294], 00:09:35.372 | 99.99th=[ 5145] 00:09:35.372 bw ( KiB/s): min=13256, max=20192, per=25.97%, avg=15300.71, stdev=3225.21, samples=7 00:09:35.372 iops : min= 3314, max= 5048, avg=3825.14, stdev=806.24, samples=7 00:09:35.372 lat (usec) : 4=0.01%, 250=43.65%, 500=56.09%, 750=0.07%, 1000=0.08% 00:09:35.372 lat (msec) : 2=0.03%, 4=0.05%, 10=0.02% 00:09:35.373 cpu : usr=1.27%, sys=5.05%, ctx=15021, majf=0, minf=1 00:09:35.373 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:09:35.373 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:09:35.373 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:09:35.373 issued rwts: total=15004,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:09:35.373 latency : target=0, window=0, percentile=100.00%, depth=1 00:09:35.373 job2: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=70613: Mon Oct 7 11:20:16 2024 00:09:35.373 read: IOPS=4651, BW=18.2MiB/s (19.1MB/s)(58.5MiB/3221msec) 00:09:35.373 slat (usec): min=6, max=7680, avg=14.62, stdev=87.18 00:09:35.373 clat (usec): min=151, max=3558, avg=198.96, stdev=60.44 00:09:35.373 lat (usec): min=163, max=7981, avg=213.58, stdev=107.29 00:09:35.373 clat percentiles (usec): 00:09:35.373 | 1.00th=[ 163], 5.00th=[ 167], 10.00th=[ 172], 20.00th=[ 176], 00:09:35.373 | 30.00th=[ 178], 40.00th=[ 182], 50.00th=[ 184], 60.00th=[ 188], 00:09:35.373 | 70.00th=[ 192], 80.00th=[ 198], 90.00th=[ 277], 95.00th=[ 306], 00:09:35.373 | 99.00th=[ 375], 99.50th=[ 396], 99.90th=[ 619], 99.95th=[ 881], 00:09:35.373 | 99.99th=[ 2278] 00:09:35.373 bw ( KiB/s): min=13288, max=20656, per=32.33%, avg=19045.33, stdev=2835.45, samples=6 00:09:35.373 iops : min= 3322, max= 5164, avg=4761.33, stdev=708.86, samples=6 00:09:35.373 lat (usec) : 250=88.24%, 500=11.62%, 750=0.08%, 1000=0.01% 00:09:35.373 lat (msec) : 2=0.03%, 4=0.01% 00:09:35.373 cpu : usr=1.30%, sys=5.22%, ctx=15099, majf=0, minf=2 00:09:35.373 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:09:35.373 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:09:35.373 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:09:35.373 issued rwts: total=14984,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:09:35.373 latency : target=0, window=0, percentile=100.00%, depth=1 00:09:35.373 job3: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=70614: Mon Oct 7 11:20:16 2024 00:09:35.373 read: IOPS=4745, BW=18.5MiB/s (19.4MB/s)(54.8MiB/2955msec) 00:09:35.373 slat (usec): min=6, max=108, avg=15.24, stdev= 4.34 00:09:35.373 clat (usec): min=155, max=6857, avg=194.00, stdev=81.90 00:09:35.373 lat (usec): min=167, max=6869, avg=209.23, stdev=82.27 00:09:35.373 clat percentiles (usec): 00:09:35.373 | 1.00th=[ 165], 5.00th=[ 172], 10.00th=[ 174], 20.00th=[ 178], 00:09:35.373 | 30.00th=[ 182], 40.00th=[ 184], 50.00th=[ 188], 60.00th=[ 190], 00:09:35.373 | 70.00th=[ 194], 80.00th=[ 198], 90.00th=[ 206], 95.00th=[ 215], 00:09:35.373 | 99.00th=[ 371], 99.50th=[ 392], 99.90th=[ 441], 99.95th=[ 693], 00:09:35.373 | 99.99th=[ 4178] 00:09:35.373 bw ( KiB/s): min=19120, max=19760, per=33.13%, avg=19516.80, stdev=274.67, samples=5 00:09:35.373 iops : min= 4780, max= 4940, avg=4879.20, stdev=68.67, samples=5 00:09:35.373 lat (usec) : 250=97.17%, 500=2.74%, 750=0.04%, 1000=0.01% 00:09:35.373 lat (msec) : 2=0.01%, 4=0.01%, 10=0.01% 00:09:35.373 cpu : usr=1.25%, sys=6.06%, ctx=14136, majf=0, minf=1 00:09:35.373 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:09:35.373 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:09:35.373 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:09:35.373 issued rwts: total=14024,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:09:35.373 latency : target=0, window=0, percentile=100.00%, depth=1 00:09:35.373 00:09:35.373 Run status group 0 (all jobs): 00:09:35.373 READ: bw=57.5MiB/s (60.3MB/s), 13.1MiB/s-18.5MiB/s (13.7MB/s-19.4MB/s), io=218MiB (228MB), run=2955-3782msec 00:09:35.373 00:09:35.373 Disk stats (read/write): 00:09:35.373 nvme0n1: ios=11195/0, merge=0/0, ticks=3142/0, in_queue=3142, util=95.16% 00:09:35.373 nvme0n2: ios=13904/0, merge=0/0, ticks=3333/0, in_queue=3333, util=94.86% 00:09:35.373 nvme0n3: ios=14627/0, merge=0/0, ticks=2910/0, in_queue=2910, util=96.39% 00:09:35.373 nvme0n4: ios=13785/0, merge=0/0, ticks=2626/0, in_queue=2626, util=96.55% 00:09:35.373 11:20:16 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:09:35.373 11:20:16 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@66 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_malloc_delete Malloc2 00:09:35.631 11:20:17 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:09:35.631 11:20:17 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@66 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_malloc_delete Malloc3 00:09:35.898 11:20:17 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:09:35.898 11:20:17 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@66 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_malloc_delete Malloc4 00:09:36.491 11:20:17 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:09:36.491 11:20:17 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@66 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_malloc_delete Malloc5 00:09:36.750 11:20:18 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:09:36.750 11:20:18 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@66 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_malloc_delete Malloc6 00:09:37.009 11:20:18 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@69 -- # fio_status=0 00:09:37.009 11:20:18 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@70 -- # wait 70571 00:09:37.009 11:20:18 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@70 -- # fio_status=4 00:09:37.009 11:20:18 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@72 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:09:37.009 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:37.009 11:20:18 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@73 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:09:37.009 11:20:18 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@1219 -- # local i=0 00:09:37.009 11:20:18 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@1220 -- # lsblk -o NAME,SERIAL 00:09:37.009 11:20:18 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@1220 -- # grep -q -w SPDKISFASTANDAWESOME 00:09:37.009 11:20:18 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@1227 -- # lsblk -l -o NAME,SERIAL 00:09:37.009 11:20:18 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@1227 -- # grep -q -w SPDKISFASTANDAWESOME 00:09:37.009 nvmf hotplug test: fio failed as expected 00:09:37.009 11:20:18 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@1231 -- # return 0 00:09:37.009 11:20:18 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@75 -- # '[' 4 -eq 0 ']' 00:09:37.009 11:20:18 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@80 -- # echo 'nvmf hotplug test: fio failed as expected' 00:09:37.009 11:20:18 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@83 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:09:37.576 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@85 -- # rm -f ./local-job0-0-verify.state 00:09:37.576 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@86 -- # rm -f ./local-job1-1-verify.state 00:09:37.576 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@87 -- # rm -f ./local-job2-2-verify.state 00:09:37.576 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@89 -- # trap - SIGINT SIGTERM EXIT 00:09:37.576 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- target/fio.sh@91 -- # nvmftestfini 00:09:37.576 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@514 -- # nvmfcleanup 00:09:37.576 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@121 -- # sync 00:09:37.576 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:09:37.576 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@124 -- # set +e 00:09:37.576 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@125 -- # for i in {1..20} 00:09:37.576 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:09:37.576 rmmod nvme_tcp 00:09:37.576 rmmod nvme_fabrics 00:09:37.576 rmmod nvme_keyring 00:09:37.576 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:09:37.576 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@128 -- # set -e 00:09:37.576 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@129 -- # return 0 00:09:37.576 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@515 -- # '[' -n 70065 ']' 00:09:37.576 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@516 -- # killprocess 70065 00:09:37.576 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@950 -- # '[' -z 70065 ']' 00:09:37.576 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@954 -- # kill -0 70065 00:09:37.576 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@955 -- # uname 00:09:37.576 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:09:37.576 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 70065 00:09:37.576 killing process with pid 70065 00:09:37.576 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:09:37.576 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:09:37.576 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@968 -- # echo 'killing process with pid 70065' 00:09:37.576 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@969 -- # kill 70065 00:09:37.576 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@974 -- # wait 70065 00:09:37.834 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:09:37.834 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:09:37.834 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:09:37.834 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@297 -- # iptr 00:09:37.834 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@789 -- # iptables-save 00:09:37.834 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@789 -- # iptables-restore 00:09:37.834 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:09:37.834 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@298 -- # [[ nvmf_tgt_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:09:37.834 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@299 -- # nvmf_veth_fini 00:09:37.834 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@233 -- # ip link set nvmf_init_br nomaster 00:09:37.834 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@234 -- # ip link set nvmf_init_br2 nomaster 00:09:37.834 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@235 -- # ip link set nvmf_tgt_br nomaster 00:09:37.834 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@236 -- # ip link set nvmf_tgt_br2 nomaster 00:09:37.834 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@237 -- # ip link set nvmf_init_br down 00:09:37.834 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@238 -- # ip link set nvmf_init_br2 down 00:09:37.834 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@239 -- # ip link set nvmf_tgt_br down 00:09:38.092 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@240 -- # ip link set nvmf_tgt_br2 down 00:09:38.092 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@241 -- # ip link delete nvmf_br type bridge 00:09:38.092 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@242 -- # ip link delete nvmf_init_if 00:09:38.092 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@243 -- # ip link delete nvmf_init_if2 00:09:38.092 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@244 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:09:38.092 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@245 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:09:38.092 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@246 -- # remove_spdk_ns 00:09:38.092 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:09:38.092 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:09:38.092 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:09:38.092 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- nvmf/common.sh@300 -- # return 0 00:09:38.092 ************************************ 00:09:38.092 END TEST nvmf_fio_target 00:09:38.092 ************************************ 00:09:38.092 00:09:38.092 real 0m21.484s 00:09:38.092 user 1m21.742s 00:09:38.092 sys 0m9.150s 00:09:38.092 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@1126 -- # xtrace_disable 00:09:38.092 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_fio_target -- common/autotest_common.sh@10 -- # set +x 00:09:38.092 11:20:19 nvmf_tcp.nvmf_target_core -- nvmf/nvmf_target_core.sh@35 -- # run_test nvmf_bdevio /home/vagrant/spdk_repo/spdk/test/nvmf/target/bdevio.sh --transport=tcp 00:09:38.092 11:20:19 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:09:38.092 11:20:19 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1107 -- # xtrace_disable 00:09:38.092 11:20:19 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@10 -- # set +x 00:09:38.092 ************************************ 00:09:38.092 START TEST nvmf_bdevio 00:09:38.092 ************************************ 00:09:38.092 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/nvmf/target/bdevio.sh --transport=tcp 00:09:38.351 * Looking for test storage... 00:09:38.351 * Found test storage at /home/vagrant/spdk_repo/spdk/test/nvmf/target 00:09:38.351 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:09:38.351 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@1681 -- # lcov --version 00:09:38.351 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:09:38.351 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:09:38.351 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:09:38.351 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- scripts/common.sh@333 -- # local ver1 ver1_l 00:09:38.351 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- scripts/common.sh@334 -- # local ver2 ver2_l 00:09:38.351 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- scripts/common.sh@336 -- # IFS=.-: 00:09:38.351 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- scripts/common.sh@336 -- # read -ra ver1 00:09:38.351 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- scripts/common.sh@337 -- # IFS=.-: 00:09:38.351 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- scripts/common.sh@337 -- # read -ra ver2 00:09:38.351 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- scripts/common.sh@338 -- # local 'op=<' 00:09:38.351 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- scripts/common.sh@340 -- # ver1_l=2 00:09:38.351 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- scripts/common.sh@341 -- # ver2_l=1 00:09:38.351 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:09:38.351 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- scripts/common.sh@344 -- # case "$op" in 00:09:38.351 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- scripts/common.sh@345 -- # : 1 00:09:38.351 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- scripts/common.sh@364 -- # (( v = 0 )) 00:09:38.351 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:09:38.351 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- scripts/common.sh@365 -- # decimal 1 00:09:38.351 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- scripts/common.sh@353 -- # local d=1 00:09:38.351 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:09:38.351 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- scripts/common.sh@355 -- # echo 1 00:09:38.351 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- scripts/common.sh@365 -- # ver1[v]=1 00:09:38.351 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- scripts/common.sh@366 -- # decimal 2 00:09:38.351 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- scripts/common.sh@353 -- # local d=2 00:09:38.351 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:09:38.351 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- scripts/common.sh@355 -- # echo 2 00:09:38.351 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- scripts/common.sh@366 -- # ver2[v]=2 00:09:38.351 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:09:38.351 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:09:38.351 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- scripts/common.sh@368 -- # return 0 00:09:38.351 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:09:38.351 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:09:38.351 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:38.351 --rc genhtml_branch_coverage=1 00:09:38.351 --rc genhtml_function_coverage=1 00:09:38.351 --rc genhtml_legend=1 00:09:38.351 --rc geninfo_all_blocks=1 00:09:38.351 --rc geninfo_unexecuted_blocks=1 00:09:38.351 00:09:38.351 ' 00:09:38.351 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:09:38.351 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:38.351 --rc genhtml_branch_coverage=1 00:09:38.351 --rc genhtml_function_coverage=1 00:09:38.351 --rc genhtml_legend=1 00:09:38.351 --rc geninfo_all_blocks=1 00:09:38.351 --rc geninfo_unexecuted_blocks=1 00:09:38.351 00:09:38.351 ' 00:09:38.351 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:09:38.351 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:38.351 --rc genhtml_branch_coverage=1 00:09:38.351 --rc genhtml_function_coverage=1 00:09:38.351 --rc genhtml_legend=1 00:09:38.351 --rc geninfo_all_blocks=1 00:09:38.351 --rc geninfo_unexecuted_blocks=1 00:09:38.351 00:09:38.351 ' 00:09:38.351 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:09:38.351 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:38.351 --rc genhtml_branch_coverage=1 00:09:38.351 --rc genhtml_function_coverage=1 00:09:38.351 --rc genhtml_legend=1 00:09:38.351 --rc geninfo_all_blocks=1 00:09:38.351 --rc geninfo_unexecuted_blocks=1 00:09:38.351 00:09:38.351 ' 00:09:38.351 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- target/bdevio.sh@9 -- # source /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh 00:09:38.351 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@7 -- # uname -s 00:09:38.351 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:09:38.351 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:09:38.351 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:09:38.351 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:09:38.351 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:09:38.351 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:09:38.351 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:09:38.351 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:09:38.351 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:09:38.351 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:09:38.351 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:09:38.351 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@18 -- # NVME_HOSTID=3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:09:38.352 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:09:38.352 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:09:38.352 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@21 -- # NET_TYPE=virt 00:09:38.352 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:09:38.352 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@49 -- # source /home/vagrant/spdk_repo/spdk/scripts/common.sh 00:09:38.352 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- scripts/common.sh@15 -- # shopt -s extglob 00:09:38.352 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:09:38.352 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:09:38.352 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:09:38.352 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:38.352 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:38.352 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:38.352 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- paths/export.sh@5 -- # export PATH 00:09:38.352 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:38.352 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@51 -- # : 0 00:09:38.352 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:09:38.352 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:09:38.352 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:09:38.352 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:09:38.352 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:09:38.352 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:09:38.352 /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:09:38.352 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:09:38.352 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:09:38.352 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@55 -- # have_pci_nics=0 00:09:38.352 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- target/bdevio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:09:38.352 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- target/bdevio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:09:38.352 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- target/bdevio.sh@14 -- # nvmftestinit 00:09:38.352 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:09:38.352 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:09:38.352 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@474 -- # prepare_net_devs 00:09:38.352 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@436 -- # local -g is_hw=no 00:09:38.352 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@438 -- # remove_spdk_ns 00:09:38.352 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:09:38.352 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:09:38.352 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:09:38.352 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@440 -- # [[ virt != virt ]] 00:09:38.352 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@442 -- # [[ no == yes ]] 00:09:38.352 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@449 -- # [[ virt == phy ]] 00:09:38.352 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@452 -- # [[ virt == phy-fallback ]] 00:09:38.352 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@457 -- # [[ tcp == tcp ]] 00:09:38.352 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@458 -- # nvmf_veth_init 00:09:38.352 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@145 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:09:38.352 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@146 -- # NVMF_SECOND_INITIATOR_IP=10.0.0.2 00:09:38.352 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@147 -- # NVMF_FIRST_TARGET_IP=10.0.0.3 00:09:38.352 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@148 -- # NVMF_SECOND_TARGET_IP=10.0.0.4 00:09:38.352 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@149 -- # NVMF_INITIATOR_IP=10.0.0.1 00:09:38.352 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@150 -- # NVMF_BRIDGE=nvmf_br 00:09:38.352 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@151 -- # NVMF_INITIATOR_INTERFACE=nvmf_init_if 00:09:38.352 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@152 -- # NVMF_INITIATOR_INTERFACE2=nvmf_init_if2 00:09:38.352 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@153 -- # NVMF_INITIATOR_BRIDGE=nvmf_init_br 00:09:38.352 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@154 -- # NVMF_INITIATOR_BRIDGE2=nvmf_init_br2 00:09:38.352 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@155 -- # NVMF_TARGET_NAMESPACE=nvmf_tgt_ns_spdk 00:09:38.352 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@156 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:09:38.352 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@157 -- # NVMF_TARGET_INTERFACE=nvmf_tgt_if 00:09:38.352 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@158 -- # NVMF_TARGET_INTERFACE2=nvmf_tgt_if2 00:09:38.352 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@159 -- # NVMF_TARGET_BRIDGE=nvmf_tgt_br 00:09:38.352 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@160 -- # NVMF_TARGET_BRIDGE2=nvmf_tgt_br2 00:09:38.352 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@162 -- # ip link set nvmf_init_br nomaster 00:09:38.352 Cannot find device "nvmf_init_br" 00:09:38.352 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@162 -- # true 00:09:38.352 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@163 -- # ip link set nvmf_init_br2 nomaster 00:09:38.352 Cannot find device "nvmf_init_br2" 00:09:38.352 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@163 -- # true 00:09:38.353 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@164 -- # ip link set nvmf_tgt_br nomaster 00:09:38.353 Cannot find device "nvmf_tgt_br" 00:09:38.353 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@164 -- # true 00:09:38.353 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@165 -- # ip link set nvmf_tgt_br2 nomaster 00:09:38.353 Cannot find device "nvmf_tgt_br2" 00:09:38.353 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@165 -- # true 00:09:38.353 11:20:19 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@166 -- # ip link set nvmf_init_br down 00:09:38.353 Cannot find device "nvmf_init_br" 00:09:38.353 11:20:20 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@166 -- # true 00:09:38.353 11:20:20 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@167 -- # ip link set nvmf_init_br2 down 00:09:38.353 Cannot find device "nvmf_init_br2" 00:09:38.353 11:20:20 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@167 -- # true 00:09:38.353 11:20:20 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@168 -- # ip link set nvmf_tgt_br down 00:09:38.353 Cannot find device "nvmf_tgt_br" 00:09:38.353 11:20:20 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@168 -- # true 00:09:38.353 11:20:20 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@169 -- # ip link set nvmf_tgt_br2 down 00:09:38.353 Cannot find device "nvmf_tgt_br2" 00:09:38.353 11:20:20 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@169 -- # true 00:09:38.353 11:20:20 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@170 -- # ip link delete nvmf_br type bridge 00:09:38.353 Cannot find device "nvmf_br" 00:09:38.353 11:20:20 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@170 -- # true 00:09:38.353 11:20:20 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@171 -- # ip link delete nvmf_init_if 00:09:38.611 Cannot find device "nvmf_init_if" 00:09:38.611 11:20:20 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@171 -- # true 00:09:38.611 11:20:20 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@172 -- # ip link delete nvmf_init_if2 00:09:38.611 Cannot find device "nvmf_init_if2" 00:09:38.611 11:20:20 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@172 -- # true 00:09:38.611 11:20:20 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@173 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:09:38.611 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:09:38.611 11:20:20 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@173 -- # true 00:09:38.611 11:20:20 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@174 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:09:38.611 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:09:38.611 11:20:20 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@174 -- # true 00:09:38.611 11:20:20 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@177 -- # ip netns add nvmf_tgt_ns_spdk 00:09:38.611 11:20:20 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@180 -- # ip link add nvmf_init_if type veth peer name nvmf_init_br 00:09:38.611 11:20:20 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@181 -- # ip link add nvmf_init_if2 type veth peer name nvmf_init_br2 00:09:38.611 11:20:20 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@182 -- # ip link add nvmf_tgt_if type veth peer name nvmf_tgt_br 00:09:38.611 11:20:20 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@183 -- # ip link add nvmf_tgt_if2 type veth peer name nvmf_tgt_br2 00:09:38.611 11:20:20 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@186 -- # ip link set nvmf_tgt_if netns nvmf_tgt_ns_spdk 00:09:38.611 11:20:20 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@187 -- # ip link set nvmf_tgt_if2 netns nvmf_tgt_ns_spdk 00:09:38.611 11:20:20 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@190 -- # ip addr add 10.0.0.1/24 dev nvmf_init_if 00:09:38.611 11:20:20 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@191 -- # ip addr add 10.0.0.2/24 dev nvmf_init_if2 00:09:38.611 11:20:20 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@192 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.3/24 dev nvmf_tgt_if 00:09:38.611 11:20:20 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@193 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.4/24 dev nvmf_tgt_if2 00:09:38.611 11:20:20 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@196 -- # ip link set nvmf_init_if up 00:09:38.611 11:20:20 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@197 -- # ip link set nvmf_init_if2 up 00:09:38.611 11:20:20 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@198 -- # ip link set nvmf_init_br up 00:09:38.612 11:20:20 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@199 -- # ip link set nvmf_init_br2 up 00:09:38.612 11:20:20 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@200 -- # ip link set nvmf_tgt_br up 00:09:38.612 11:20:20 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@201 -- # ip link set nvmf_tgt_br2 up 00:09:38.612 11:20:20 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@202 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if up 00:09:38.612 11:20:20 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@203 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if2 up 00:09:38.612 11:20:20 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@204 -- # ip netns exec nvmf_tgt_ns_spdk ip link set lo up 00:09:38.612 11:20:20 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@207 -- # ip link add nvmf_br type bridge 00:09:38.612 11:20:20 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@208 -- # ip link set nvmf_br up 00:09:38.612 11:20:20 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@211 -- # ip link set nvmf_init_br master nvmf_br 00:09:38.612 11:20:20 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@212 -- # ip link set nvmf_init_br2 master nvmf_br 00:09:38.612 11:20:20 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@213 -- # ip link set nvmf_tgt_br master nvmf_br 00:09:38.612 11:20:20 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@214 -- # ip link set nvmf_tgt_br2 master nvmf_br 00:09:38.612 11:20:20 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@217 -- # ipts -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT 00:09:38.612 11:20:20 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT' 00:09:38.612 11:20:20 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@218 -- # ipts -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT 00:09:38.612 11:20:20 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT' 00:09:38.612 11:20:20 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@219 -- # ipts -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT 00:09:38.612 11:20:20 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@788 -- # iptables -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT -m comment --comment 'SPDK_NVMF:-A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT' 00:09:38.612 11:20:20 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@222 -- # ping -c 1 10.0.0.3 00:09:38.612 PING 10.0.0.3 (10.0.0.3) 56(84) bytes of data. 00:09:38.612 64 bytes from 10.0.0.3: icmp_seq=1 ttl=64 time=0.106 ms 00:09:38.612 00:09:38.612 --- 10.0.0.3 ping statistics --- 00:09:38.612 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:09:38.612 rtt min/avg/max/mdev = 0.106/0.106/0.106/0.000 ms 00:09:38.612 11:20:20 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@223 -- # ping -c 1 10.0.0.4 00:09:38.612 PING 10.0.0.4 (10.0.0.4) 56(84) bytes of data. 00:09:38.612 64 bytes from 10.0.0.4: icmp_seq=1 ttl=64 time=0.067 ms 00:09:38.612 00:09:38.612 --- 10.0.0.4 ping statistics --- 00:09:38.612 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:09:38.612 rtt min/avg/max/mdev = 0.067/0.067/0.067/0.000 ms 00:09:38.612 11:20:20 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@224 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.1 00:09:38.870 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:09:38.870 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.047 ms 00:09:38.870 00:09:38.871 --- 10.0.0.1 ping statistics --- 00:09:38.871 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:09:38.871 rtt min/avg/max/mdev = 0.047/0.047/0.047/0.000 ms 00:09:38.871 11:20:20 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@225 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.2 00:09:38.871 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:09:38.871 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.065 ms 00:09:38.871 00:09:38.871 --- 10.0.0.2 ping statistics --- 00:09:38.871 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:09:38.871 rtt min/avg/max/mdev = 0.065/0.065/0.065/0.000 ms 00:09:38.871 11:20:20 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@227 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:09:38.871 11:20:20 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@459 -- # return 0 00:09:38.871 11:20:20 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:09:38.871 11:20:20 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:09:38.871 11:20:20 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:09:38.871 11:20:20 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:09:38.871 11:20:20 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:09:38.871 11:20:20 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:09:38.871 11:20:20 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:09:38.871 11:20:20 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- target/bdevio.sh@16 -- # nvmfappstart -m 0x78 00:09:38.871 11:20:20 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:09:38.871 11:20:20 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@724 -- # xtrace_disable 00:09:38.871 11:20:20 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@10 -- # set +x 00:09:38.871 11:20:20 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@507 -- # nvmfpid=71000 00:09:38.871 11:20:20 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@506 -- # ip netns exec nvmf_tgt_ns_spdk /home/vagrant/spdk_repo/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x78 00:09:38.871 11:20:20 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@508 -- # waitforlisten 71000 00:09:38.871 11:20:20 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@831 -- # '[' -z 71000 ']' 00:09:38.871 11:20:20 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:09:38.871 11:20:20 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@836 -- # local max_retries=100 00:09:38.871 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:09:38.871 11:20:20 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:09:38.871 11:20:20 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@840 -- # xtrace_disable 00:09:38.871 11:20:20 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@10 -- # set +x 00:09:38.871 [2024-10-07 11:20:20.420434] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:09:38.871 [2024-10-07 11:20:20.420560] [ DPDK EAL parameters: nvmf -c 0x78 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:09:38.871 [2024-10-07 11:20:20.561542] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 4 00:09:39.129 [2024-10-07 11:20:20.696365] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:09:39.129 [2024-10-07 11:20:20.696427] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:09:39.129 [2024-10-07 11:20:20.696441] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:09:39.129 [2024-10-07 11:20:20.696450] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:09:39.129 [2024-10-07 11:20:20.696458] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:09:39.129 [2024-10-07 11:20:20.698167] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 4 00:09:39.129 [2024-10-07 11:20:20.698322] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 5 00:09:39.129 [2024-10-07 11:20:20.698456] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 6 00:09:39.129 [2024-10-07 11:20:20.698550] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 3 00:09:40.063 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:09:40.063 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@864 -- # return 0 00:09:40.063 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:09:40.063 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@730 -- # xtrace_disable 00:09:40.063 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@10 -- # set +x 00:09:40.063 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:09:40.063 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- target/bdevio.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:09:40.063 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:40.063 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@10 -- # set +x 00:09:40.063 [2024-10-07 11:20:21.563502] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:09:40.063 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:40.063 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- target/bdevio.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:09:40.063 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:40.063 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@10 -- # set +x 00:09:40.064 Malloc0 00:09:40.064 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:40.064 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- target/bdevio.sh@20 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:09:40.064 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:40.064 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@10 -- # set +x 00:09:40.064 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:40.064 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- target/bdevio.sh@21 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:09:40.064 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:40.064 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@10 -- # set +x 00:09:40.064 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:40.064 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- target/bdevio.sh@22 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4420 00:09:40.064 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:40.064 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@10 -- # set +x 00:09:40.064 [2024-10-07 11:20:21.621602] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:09:40.064 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:40.064 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- target/bdevio.sh@24 -- # /home/vagrant/spdk_repo/spdk/test/bdev/bdevio/bdevio --json /dev/fd/62 00:09:40.064 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- target/bdevio.sh@24 -- # gen_nvmf_target_json 00:09:40.064 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@558 -- # config=() 00:09:40.064 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@558 -- # local subsystem config 00:09:40.064 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@560 -- # for subsystem in "${@:-1}" 00:09:40.064 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@580 -- # config+=("$(cat <<-EOF 00:09:40.064 { 00:09:40.064 "params": { 00:09:40.064 "name": "Nvme$subsystem", 00:09:40.064 "trtype": "$TEST_TRANSPORT", 00:09:40.064 "traddr": "$NVMF_FIRST_TARGET_IP", 00:09:40.064 "adrfam": "ipv4", 00:09:40.064 "trsvcid": "$NVMF_PORT", 00:09:40.064 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:09:40.064 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:09:40.064 "hdgst": ${hdgst:-false}, 00:09:40.064 "ddgst": ${ddgst:-false} 00:09:40.064 }, 00:09:40.064 "method": "bdev_nvme_attach_controller" 00:09:40.064 } 00:09:40.064 EOF 00:09:40.064 )") 00:09:40.064 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@580 -- # cat 00:09:40.064 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@582 -- # jq . 00:09:40.064 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@583 -- # IFS=, 00:09:40.064 11:20:21 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@584 -- # printf '%s\n' '{ 00:09:40.064 "params": { 00:09:40.064 "name": "Nvme1", 00:09:40.064 "trtype": "tcp", 00:09:40.064 "traddr": "10.0.0.3", 00:09:40.064 "adrfam": "ipv4", 00:09:40.064 "trsvcid": "4420", 00:09:40.064 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:09:40.064 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:09:40.064 "hdgst": false, 00:09:40.064 "ddgst": false 00:09:40.064 }, 00:09:40.064 "method": "bdev_nvme_attach_controller" 00:09:40.064 }' 00:09:40.064 [2024-10-07 11:20:21.687250] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:09:40.064 [2024-10-07 11:20:21.687853] [ DPDK EAL parameters: bdevio --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid71054 ] 00:09:40.324 [2024-10-07 11:20:21.830108] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 3 00:09:40.324 [2024-10-07 11:20:21.994328] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:09:40.324 [2024-10-07 11:20:21.994492] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:09:40.324 [2024-10-07 11:20:21.994498] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:09:40.584 I/O targets: 00:09:40.584 Nvme1n1: 131072 blocks of 512 bytes (64 MiB) 00:09:40.584 00:09:40.584 00:09:40.584 CUnit - A unit testing framework for C - Version 2.1-3 00:09:40.584 http://cunit.sourceforge.net/ 00:09:40.584 00:09:40.584 00:09:40.584 Suite: bdevio tests on: Nvme1n1 00:09:40.584 Test: blockdev write read block ...passed 00:09:40.842 Test: blockdev write zeroes read block ...passed 00:09:40.842 Test: blockdev write zeroes read no split ...passed 00:09:40.842 Test: blockdev write zeroes read split ...passed 00:09:40.842 Test: blockdev write zeroes read split partial ...passed 00:09:40.842 Test: blockdev reset ...[2024-10-07 11:20:22.327834] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:09:40.842 [2024-10-07 11:20:22.327953] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x176eb80 (9): Bad file descriptor 00:09:40.842 [2024-10-07 11:20:22.342701] bdev_nvme.c:2183:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:09:40.842 passed 00:09:40.842 Test: blockdev write read 8 blocks ...passed 00:09:40.842 Test: blockdev write read size > 128k ...passed 00:09:40.842 Test: blockdev write read invalid size ...passed 00:09:40.842 Test: blockdev write read offset + nbytes == size of blockdev ...passed 00:09:40.842 Test: blockdev write read offset + nbytes > size of blockdev ...passed 00:09:40.842 Test: blockdev write read max offset ...passed 00:09:40.842 Test: blockdev write read 2 blocks on overlapped address offset ...passed 00:09:40.842 Test: blockdev writev readv 8 blocks ...passed 00:09:40.842 Test: blockdev writev readv 30 x 1block ...passed 00:09:40.842 Test: blockdev writev readv block ...passed 00:09:40.842 Test: blockdev writev readv size > 128k ...passed 00:09:40.842 Test: blockdev writev readv size > 128k in two iovs ...passed 00:09:40.842 Test: blockdev comparev and writev ...[2024-10-07 11:20:22.517797] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:09:40.842 [2024-10-07 11:20:22.517980] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:09:40.842 [2024-10-07 11:20:22.518225] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:09:40.842 [2024-10-07 11:20:22.518357] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0022 p:0 m:0 dnr:0 00:09:40.842 [2024-10-07 11:20:22.518856] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:09:40.842 [2024-10-07 11:20:22.519006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0023 p:0 m:0 dnr:0 00:09:40.842 [2024-10-07 11:20:22.519126] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:09:40.842 [2024-10-07 11:20:22.519252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0024 p:0 m:0 dnr:0 00:09:40.842 [2024-10-07 11:20:22.519724] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:09:40.842 [2024-10-07 11:20:22.519873] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0025 p:0 m:0 dnr:0 00:09:40.842 [2024-10-07 11:20:22.520036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:09:40.842 [2024-10-07 11:20:22.520152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0026 p:0 m:0 dnr:0 00:09:40.842 [2024-10-07 11:20:22.520650] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:09:40.842 [2024-10-07 11:20:22.520797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0027 p:0 m:0 dnr:0 00:09:40.842 [2024-10-07 11:20:22.520938] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:09:40.842 [2024-10-07 11:20:22.520955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0028 p:0 m:0 dnr:0 00:09:41.100 passed 00:09:41.100 Test: blockdev nvme passthru rw ...passed 00:09:41.100 Test: blockdev nvme passthru vendor specific ...[2024-10-07 11:20:22.604701] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:09:41.100 [2024-10-07 11:20:22.604737] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002c p:0 m:0 dnr:0 00:09:41.100 [2024-10-07 11:20:22.604859] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:09:41.100 [2024-10-07 11:20:22.604875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002d p:0 m:0 dnr:0 00:09:41.100 passed 00:09:41.100 Test: blockdev nvme admin passthru ...[2024-10-07 11:20:22.604997] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:09:41.100 [2024-10-07 11:20:22.605026] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002e p:0 m:0 dnr:0 00:09:41.100 [2024-10-07 11:20:22.605132] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:09:41.100 [2024-10-07 11:20:22.605147] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002f p:0 m:0 dnr:0 00:09:41.100 passed 00:09:41.100 Test: blockdev copy ...passed 00:09:41.100 00:09:41.100 Run Summary: Type Total Ran Passed Failed Inactive 00:09:41.100 suites 1 1 n/a 0 0 00:09:41.100 tests 23 23 23 0 0 00:09:41.100 asserts 152 152 152 0 n/a 00:09:41.100 00:09:41.100 Elapsed time = 0.886 seconds 00:09:41.357 11:20:22 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- target/bdevio.sh@26 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:09:41.357 11:20:22 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:41.357 11:20:22 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@10 -- # set +x 00:09:41.357 11:20:22 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:41.357 11:20:22 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- target/bdevio.sh@28 -- # trap - SIGINT SIGTERM EXIT 00:09:41.357 11:20:22 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- target/bdevio.sh@30 -- # nvmftestfini 00:09:41.357 11:20:22 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@514 -- # nvmfcleanup 00:09:41.357 11:20:22 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@121 -- # sync 00:09:41.357 11:20:22 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:09:41.357 11:20:22 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@124 -- # set +e 00:09:41.357 11:20:22 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@125 -- # for i in {1..20} 00:09:41.357 11:20:22 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:09:41.357 rmmod nvme_tcp 00:09:41.357 rmmod nvme_fabrics 00:09:41.358 rmmod nvme_keyring 00:09:41.358 11:20:23 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:09:41.358 11:20:23 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@128 -- # set -e 00:09:41.358 11:20:23 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@129 -- # return 0 00:09:41.358 11:20:23 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@515 -- # '[' -n 71000 ']' 00:09:41.358 11:20:23 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@516 -- # killprocess 71000 00:09:41.358 11:20:23 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@950 -- # '[' -z 71000 ']' 00:09:41.358 11:20:23 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@954 -- # kill -0 71000 00:09:41.358 11:20:23 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@955 -- # uname 00:09:41.358 11:20:23 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:09:41.358 11:20:23 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 71000 00:09:41.358 11:20:23 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@956 -- # process_name=reactor_3 00:09:41.358 11:20:23 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@960 -- # '[' reactor_3 = sudo ']' 00:09:41.358 killing process with pid 71000 00:09:41.358 11:20:23 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@968 -- # echo 'killing process with pid 71000' 00:09:41.358 11:20:23 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@969 -- # kill 71000 00:09:41.358 11:20:23 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@974 -- # wait 71000 00:09:41.923 11:20:23 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:09:41.923 11:20:23 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:09:41.923 11:20:23 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:09:41.923 11:20:23 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@297 -- # iptr 00:09:41.923 11:20:23 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@789 -- # iptables-save 00:09:41.923 11:20:23 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:09:41.923 11:20:23 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@789 -- # iptables-restore 00:09:41.923 11:20:23 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@298 -- # [[ nvmf_tgt_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:09:41.923 11:20:23 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@299 -- # nvmf_veth_fini 00:09:41.923 11:20:23 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@233 -- # ip link set nvmf_init_br nomaster 00:09:41.923 11:20:23 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@234 -- # ip link set nvmf_init_br2 nomaster 00:09:41.923 11:20:23 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@235 -- # ip link set nvmf_tgt_br nomaster 00:09:41.923 11:20:23 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@236 -- # ip link set nvmf_tgt_br2 nomaster 00:09:41.923 11:20:23 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@237 -- # ip link set nvmf_init_br down 00:09:41.923 11:20:23 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@238 -- # ip link set nvmf_init_br2 down 00:09:41.923 11:20:23 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@239 -- # ip link set nvmf_tgt_br down 00:09:41.923 11:20:23 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@240 -- # ip link set nvmf_tgt_br2 down 00:09:41.923 11:20:23 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@241 -- # ip link delete nvmf_br type bridge 00:09:41.923 11:20:23 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@242 -- # ip link delete nvmf_init_if 00:09:41.923 11:20:23 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@243 -- # ip link delete nvmf_init_if2 00:09:41.923 11:20:23 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@244 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:09:41.923 11:20:23 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@245 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:09:41.923 11:20:23 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@246 -- # remove_spdk_ns 00:09:41.923 11:20:23 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:09:41.923 11:20:23 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:09:41.923 11:20:23 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:09:42.181 11:20:23 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- nvmf/common.sh@300 -- # return 0 00:09:42.181 00:09:42.181 real 0m3.916s 00:09:42.181 user 0m13.228s 00:09:42.181 sys 0m1.041s 00:09:42.181 11:20:23 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@1126 -- # xtrace_disable 00:09:42.181 ************************************ 00:09:42.181 END TEST nvmf_bdevio 00:09:42.181 ************************************ 00:09:42.181 11:20:23 nvmf_tcp.nvmf_target_core.nvmf_bdevio -- common/autotest_common.sh@10 -- # set +x 00:09:42.181 11:20:23 nvmf_tcp.nvmf_target_core -- nvmf/nvmf_target_core.sh@37 -- # trap - SIGINT SIGTERM EXIT 00:09:42.181 00:09:42.181 real 3m50.984s 00:09:42.181 user 12m17.971s 00:09:42.182 sys 1m5.609s 00:09:42.182 11:20:23 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@1126 -- # xtrace_disable 00:09:42.182 ************************************ 00:09:42.182 END TEST nvmf_target_core 00:09:42.182 11:20:23 nvmf_tcp.nvmf_target_core -- common/autotest_common.sh@10 -- # set +x 00:09:42.182 ************************************ 00:09:42.182 11:20:23 nvmf_tcp -- nvmf/nvmf.sh@15 -- # run_test nvmf_target_extra /home/vagrant/spdk_repo/spdk/test/nvmf/nvmf_target_extra.sh --transport=tcp 00:09:42.182 11:20:23 nvmf_tcp -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:09:42.182 11:20:23 nvmf_tcp -- common/autotest_common.sh@1107 -- # xtrace_disable 00:09:42.182 11:20:23 nvmf_tcp -- common/autotest_common.sh@10 -- # set +x 00:09:42.182 ************************************ 00:09:42.182 START TEST nvmf_target_extra 00:09:42.182 ************************************ 00:09:42.182 11:20:23 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/nvmf/nvmf_target_extra.sh --transport=tcp 00:09:42.182 * Looking for test storage... 00:09:42.182 * Found test storage at /home/vagrant/spdk_repo/spdk/test/nvmf 00:09:42.182 11:20:23 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:09:42.182 11:20:23 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1681 -- # lcov --version 00:09:42.182 11:20:23 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:09:42.440 11:20:23 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:09:42.440 11:20:23 nvmf_tcp.nvmf_target_extra -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:09:42.440 11:20:23 nvmf_tcp.nvmf_target_extra -- scripts/common.sh@333 -- # local ver1 ver1_l 00:09:42.440 11:20:23 nvmf_tcp.nvmf_target_extra -- scripts/common.sh@334 -- # local ver2 ver2_l 00:09:42.440 11:20:23 nvmf_tcp.nvmf_target_extra -- scripts/common.sh@336 -- # IFS=.-: 00:09:42.440 11:20:23 nvmf_tcp.nvmf_target_extra -- scripts/common.sh@336 -- # read -ra ver1 00:09:42.440 11:20:23 nvmf_tcp.nvmf_target_extra -- scripts/common.sh@337 -- # IFS=.-: 00:09:42.440 11:20:23 nvmf_tcp.nvmf_target_extra -- scripts/common.sh@337 -- # read -ra ver2 00:09:42.440 11:20:23 nvmf_tcp.nvmf_target_extra -- scripts/common.sh@338 -- # local 'op=<' 00:09:42.440 11:20:23 nvmf_tcp.nvmf_target_extra -- scripts/common.sh@340 -- # ver1_l=2 00:09:42.440 11:20:23 nvmf_tcp.nvmf_target_extra -- scripts/common.sh@341 -- # ver2_l=1 00:09:42.440 11:20:23 nvmf_tcp.nvmf_target_extra -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:09:42.440 11:20:23 nvmf_tcp.nvmf_target_extra -- scripts/common.sh@344 -- # case "$op" in 00:09:42.440 11:20:23 nvmf_tcp.nvmf_target_extra -- scripts/common.sh@345 -- # : 1 00:09:42.440 11:20:23 nvmf_tcp.nvmf_target_extra -- scripts/common.sh@364 -- # (( v = 0 )) 00:09:42.440 11:20:23 nvmf_tcp.nvmf_target_extra -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:09:42.440 11:20:23 nvmf_tcp.nvmf_target_extra -- scripts/common.sh@365 -- # decimal 1 00:09:42.440 11:20:23 nvmf_tcp.nvmf_target_extra -- scripts/common.sh@353 -- # local d=1 00:09:42.440 11:20:23 nvmf_tcp.nvmf_target_extra -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:09:42.440 11:20:23 nvmf_tcp.nvmf_target_extra -- scripts/common.sh@355 -- # echo 1 00:09:42.440 11:20:23 nvmf_tcp.nvmf_target_extra -- scripts/common.sh@365 -- # ver1[v]=1 00:09:42.440 11:20:23 nvmf_tcp.nvmf_target_extra -- scripts/common.sh@366 -- # decimal 2 00:09:42.440 11:20:23 nvmf_tcp.nvmf_target_extra -- scripts/common.sh@353 -- # local d=2 00:09:42.440 11:20:23 nvmf_tcp.nvmf_target_extra -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:09:42.440 11:20:23 nvmf_tcp.nvmf_target_extra -- scripts/common.sh@355 -- # echo 2 00:09:42.440 11:20:23 nvmf_tcp.nvmf_target_extra -- scripts/common.sh@366 -- # ver2[v]=2 00:09:42.440 11:20:23 nvmf_tcp.nvmf_target_extra -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:09:42.440 11:20:23 nvmf_tcp.nvmf_target_extra -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:09:42.440 11:20:23 nvmf_tcp.nvmf_target_extra -- scripts/common.sh@368 -- # return 0 00:09:42.440 11:20:23 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:09:42.440 11:20:23 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:09:42.440 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:42.440 --rc genhtml_branch_coverage=1 00:09:42.440 --rc genhtml_function_coverage=1 00:09:42.440 --rc genhtml_legend=1 00:09:42.440 --rc geninfo_all_blocks=1 00:09:42.440 --rc geninfo_unexecuted_blocks=1 00:09:42.440 00:09:42.440 ' 00:09:42.440 11:20:23 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:09:42.440 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:42.440 --rc genhtml_branch_coverage=1 00:09:42.440 --rc genhtml_function_coverage=1 00:09:42.440 --rc genhtml_legend=1 00:09:42.441 --rc geninfo_all_blocks=1 00:09:42.441 --rc geninfo_unexecuted_blocks=1 00:09:42.441 00:09:42.441 ' 00:09:42.441 11:20:23 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:09:42.441 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:42.441 --rc genhtml_branch_coverage=1 00:09:42.441 --rc genhtml_function_coverage=1 00:09:42.441 --rc genhtml_legend=1 00:09:42.441 --rc geninfo_all_blocks=1 00:09:42.441 --rc geninfo_unexecuted_blocks=1 00:09:42.441 00:09:42.441 ' 00:09:42.441 11:20:23 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:09:42.441 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:42.441 --rc genhtml_branch_coverage=1 00:09:42.441 --rc genhtml_function_coverage=1 00:09:42.441 --rc genhtml_legend=1 00:09:42.441 --rc geninfo_all_blocks=1 00:09:42.441 --rc geninfo_unexecuted_blocks=1 00:09:42.441 00:09:42.441 ' 00:09:42.441 11:20:23 nvmf_tcp.nvmf_target_extra -- nvmf/nvmf_target_extra.sh@9 -- # source /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh 00:09:42.441 11:20:23 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@7 -- # uname -s 00:09:42.441 11:20:23 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:09:42.441 11:20:23 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:09:42.441 11:20:23 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:09:42.441 11:20:23 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:09:42.441 11:20:23 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:09:42.441 11:20:23 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:09:42.441 11:20:23 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:09:42.441 11:20:23 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:09:42.441 11:20:23 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:09:42.441 11:20:23 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:09:42.441 11:20:23 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:09:42.441 11:20:23 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@18 -- # NVME_HOSTID=3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:09:42.441 11:20:23 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:09:42.441 11:20:23 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:09:42.441 11:20:23 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@21 -- # NET_TYPE=virt 00:09:42.441 11:20:23 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:09:42.441 11:20:23 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@49 -- # source /home/vagrant/spdk_repo/spdk/scripts/common.sh 00:09:42.441 11:20:23 nvmf_tcp.nvmf_target_extra -- scripts/common.sh@15 -- # shopt -s extglob 00:09:42.441 11:20:23 nvmf_tcp.nvmf_target_extra -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:09:42.441 11:20:23 nvmf_tcp.nvmf_target_extra -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:09:42.441 11:20:23 nvmf_tcp.nvmf_target_extra -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:09:42.441 11:20:23 nvmf_tcp.nvmf_target_extra -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:42.441 11:20:23 nvmf_tcp.nvmf_target_extra -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:42.441 11:20:23 nvmf_tcp.nvmf_target_extra -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:42.441 11:20:23 nvmf_tcp.nvmf_target_extra -- paths/export.sh@5 -- # export PATH 00:09:42.441 11:20:23 nvmf_tcp.nvmf_target_extra -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:42.441 11:20:23 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@51 -- # : 0 00:09:42.441 11:20:23 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:09:42.441 11:20:23 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:09:42.441 11:20:23 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:09:42.441 11:20:23 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:09:42.441 11:20:23 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:09:42.441 11:20:23 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:09:42.441 /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:09:42.441 11:20:23 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:09:42.441 11:20:23 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:09:42.441 11:20:23 nvmf_tcp.nvmf_target_extra -- nvmf/common.sh@55 -- # have_pci_nics=0 00:09:42.441 11:20:23 nvmf_tcp.nvmf_target_extra -- nvmf/nvmf_target_extra.sh@11 -- # trap 'exit 1' SIGINT SIGTERM EXIT 00:09:42.441 11:20:23 nvmf_tcp.nvmf_target_extra -- nvmf/nvmf_target_extra.sh@13 -- # TEST_ARGS=("$@") 00:09:42.441 11:20:23 nvmf_tcp.nvmf_target_extra -- nvmf/nvmf_target_extra.sh@15 -- # [[ 0 -eq 0 ]] 00:09:42.441 11:20:23 nvmf_tcp.nvmf_target_extra -- nvmf/nvmf_target_extra.sh@16 -- # run_test nvmf_example /home/vagrant/spdk_repo/spdk/test/nvmf/target/nvmf_example.sh --transport=tcp 00:09:42.441 11:20:23 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:09:42.441 11:20:23 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1107 -- # xtrace_disable 00:09:42.441 11:20:23 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@10 -- # set +x 00:09:42.441 ************************************ 00:09:42.441 START TEST nvmf_example 00:09:42.441 ************************************ 00:09:42.441 11:20:23 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/nvmf/target/nvmf_example.sh --transport=tcp 00:09:42.441 * Looking for test storage... 00:09:42.441 * Found test storage at /home/vagrant/spdk_repo/spdk/test/nvmf/target 00:09:42.441 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:09:42.441 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@1681 -- # lcov --version 00:09:42.441 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:09:42.700 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:09:42.700 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:09:42.700 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- scripts/common.sh@333 -- # local ver1 ver1_l 00:09:42.700 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- scripts/common.sh@334 -- # local ver2 ver2_l 00:09:42.700 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- scripts/common.sh@336 -- # IFS=.-: 00:09:42.700 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- scripts/common.sh@336 -- # read -ra ver1 00:09:42.700 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- scripts/common.sh@337 -- # IFS=.-: 00:09:42.700 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- scripts/common.sh@337 -- # read -ra ver2 00:09:42.700 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- scripts/common.sh@338 -- # local 'op=<' 00:09:42.700 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- scripts/common.sh@340 -- # ver1_l=2 00:09:42.700 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- scripts/common.sh@341 -- # ver2_l=1 00:09:42.700 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:09:42.700 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- scripts/common.sh@344 -- # case "$op" in 00:09:42.700 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- scripts/common.sh@345 -- # : 1 00:09:42.700 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- scripts/common.sh@364 -- # (( v = 0 )) 00:09:42.700 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:09:42.700 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- scripts/common.sh@365 -- # decimal 1 00:09:42.700 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- scripts/common.sh@353 -- # local d=1 00:09:42.700 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:09:42.700 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- scripts/common.sh@355 -- # echo 1 00:09:42.700 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- scripts/common.sh@365 -- # ver1[v]=1 00:09:42.700 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- scripts/common.sh@366 -- # decimal 2 00:09:42.700 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- scripts/common.sh@353 -- # local d=2 00:09:42.700 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:09:42.700 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- scripts/common.sh@355 -- # echo 2 00:09:42.700 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- scripts/common.sh@366 -- # ver2[v]=2 00:09:42.700 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:09:42.700 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:09:42.700 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- scripts/common.sh@368 -- # return 0 00:09:42.700 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:09:42.700 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:09:42.700 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:42.700 --rc genhtml_branch_coverage=1 00:09:42.700 --rc genhtml_function_coverage=1 00:09:42.700 --rc genhtml_legend=1 00:09:42.700 --rc geninfo_all_blocks=1 00:09:42.700 --rc geninfo_unexecuted_blocks=1 00:09:42.700 00:09:42.700 ' 00:09:42.700 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:09:42.700 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:42.700 --rc genhtml_branch_coverage=1 00:09:42.700 --rc genhtml_function_coverage=1 00:09:42.700 --rc genhtml_legend=1 00:09:42.700 --rc geninfo_all_blocks=1 00:09:42.700 --rc geninfo_unexecuted_blocks=1 00:09:42.700 00:09:42.700 ' 00:09:42.700 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:09:42.700 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:42.700 --rc genhtml_branch_coverage=1 00:09:42.700 --rc genhtml_function_coverage=1 00:09:42.700 --rc genhtml_legend=1 00:09:42.700 --rc geninfo_all_blocks=1 00:09:42.700 --rc geninfo_unexecuted_blocks=1 00:09:42.700 00:09:42.700 ' 00:09:42.700 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:09:42.700 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:42.700 --rc genhtml_branch_coverage=1 00:09:42.700 --rc genhtml_function_coverage=1 00:09:42.700 --rc genhtml_legend=1 00:09:42.700 --rc geninfo_all_blocks=1 00:09:42.700 --rc geninfo_unexecuted_blocks=1 00:09:42.700 00:09:42.700 ' 00:09:42.700 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- target/nvmf_example.sh@9 -- # source /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh 00:09:42.700 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@7 -- # uname -s 00:09:42.700 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:09:42.700 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:09:42.700 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:09:42.700 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:09:42.700 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:09:42.700 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:09:42.700 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:09:42.700 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:09:42.700 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:09:42.700 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:09:42.700 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:09:42.700 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@18 -- # NVME_HOSTID=3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:09:42.700 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:09:42.700 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:09:42.700 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@21 -- # NET_TYPE=virt 00:09:42.700 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:09:42.700 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@49 -- # source /home/vagrant/spdk_repo/spdk/scripts/common.sh 00:09:42.700 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- scripts/common.sh@15 -- # shopt -s extglob 00:09:42.700 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:09:42.700 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:09:42.700 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:09:42.700 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:42.701 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:42.701 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:42.701 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- paths/export.sh@5 -- # export PATH 00:09:42.701 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:42.701 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@51 -- # : 0 00:09:42.701 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:09:42.701 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:09:42.701 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:09:42.701 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:09:42.701 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:09:42.701 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:09:42.701 /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:09:42.701 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:09:42.701 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:09:42.701 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@55 -- # have_pci_nics=0 00:09:42.701 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- target/nvmf_example.sh@11 -- # NVMF_EXAMPLE=("$SPDK_EXAMPLE_DIR/nvmf") 00:09:42.701 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- target/nvmf_example.sh@13 -- # MALLOC_BDEV_SIZE=64 00:09:42.701 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- target/nvmf_example.sh@14 -- # MALLOC_BLOCK_SIZE=512 00:09:42.701 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- target/nvmf_example.sh@24 -- # build_nvmf_example_args 00:09:42.701 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- target/nvmf_example.sh@17 -- # '[' 0 -eq 1 ']' 00:09:42.701 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- target/nvmf_example.sh@20 -- # NVMF_EXAMPLE+=(-i "$NVMF_APP_SHM_ID" -g 10000) 00:09:42.701 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- target/nvmf_example.sh@21 -- # NVMF_EXAMPLE+=("${NO_HUGE[@]}") 00:09:42.701 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- target/nvmf_example.sh@40 -- # timing_enter nvmf_example_test 00:09:42.701 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@724 -- # xtrace_disable 00:09:42.701 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@10 -- # set +x 00:09:42.701 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- target/nvmf_example.sh@41 -- # nvmftestinit 00:09:42.701 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:09:42.701 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:09:42.701 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@474 -- # prepare_net_devs 00:09:42.701 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@436 -- # local -g is_hw=no 00:09:42.701 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@438 -- # remove_spdk_ns 00:09:42.701 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:09:42.701 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:09:42.701 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:09:42.701 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@440 -- # [[ virt != virt ]] 00:09:42.701 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@442 -- # [[ no == yes ]] 00:09:42.701 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@449 -- # [[ virt == phy ]] 00:09:42.701 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@452 -- # [[ virt == phy-fallback ]] 00:09:42.701 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@457 -- # [[ tcp == tcp ]] 00:09:42.701 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@458 -- # nvmf_veth_init 00:09:42.701 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@145 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:09:42.701 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@146 -- # NVMF_SECOND_INITIATOR_IP=10.0.0.2 00:09:42.701 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@147 -- # NVMF_FIRST_TARGET_IP=10.0.0.3 00:09:42.701 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@148 -- # NVMF_SECOND_TARGET_IP=10.0.0.4 00:09:42.701 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@149 -- # NVMF_INITIATOR_IP=10.0.0.1 00:09:42.701 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@150 -- # NVMF_BRIDGE=nvmf_br 00:09:42.701 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@151 -- # NVMF_INITIATOR_INTERFACE=nvmf_init_if 00:09:42.701 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@152 -- # NVMF_INITIATOR_INTERFACE2=nvmf_init_if2 00:09:42.701 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@153 -- # NVMF_INITIATOR_BRIDGE=nvmf_init_br 00:09:42.701 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@154 -- # NVMF_INITIATOR_BRIDGE2=nvmf_init_br2 00:09:42.701 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@155 -- # NVMF_TARGET_NAMESPACE=nvmf_tgt_ns_spdk 00:09:42.701 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@156 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:09:42.701 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@157 -- # NVMF_TARGET_INTERFACE=nvmf_tgt_if 00:09:42.701 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@158 -- # NVMF_TARGET_INTERFACE2=nvmf_tgt_if2 00:09:42.701 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@159 -- # NVMF_TARGET_BRIDGE=nvmf_tgt_br 00:09:42.701 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@160 -- # NVMF_TARGET_BRIDGE2=nvmf_tgt_br2 00:09:42.701 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@162 -- # ip link set nvmf_init_br nomaster 00:09:42.701 Cannot find device "nvmf_init_br" 00:09:42.701 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@162 -- # true 00:09:42.701 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@163 -- # ip link set nvmf_init_br2 nomaster 00:09:42.701 Cannot find device "nvmf_init_br2" 00:09:42.701 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@163 -- # true 00:09:42.701 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@164 -- # ip link set nvmf_tgt_br nomaster 00:09:42.701 Cannot find device "nvmf_tgt_br" 00:09:42.701 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@164 -- # true 00:09:42.701 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@165 -- # ip link set nvmf_tgt_br2 nomaster 00:09:42.701 Cannot find device "nvmf_tgt_br2" 00:09:42.701 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@165 -- # true 00:09:42.701 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@166 -- # ip link set nvmf_init_br down 00:09:42.701 Cannot find device "nvmf_init_br" 00:09:42.701 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@166 -- # true 00:09:42.701 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@167 -- # ip link set nvmf_init_br2 down 00:09:42.701 Cannot find device "nvmf_init_br2" 00:09:42.701 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@167 -- # true 00:09:42.701 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@168 -- # ip link set nvmf_tgt_br down 00:09:42.701 Cannot find device "nvmf_tgt_br" 00:09:42.701 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@168 -- # true 00:09:42.701 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@169 -- # ip link set nvmf_tgt_br2 down 00:09:42.701 Cannot find device "nvmf_tgt_br2" 00:09:42.701 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@169 -- # true 00:09:42.701 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@170 -- # ip link delete nvmf_br type bridge 00:09:42.701 Cannot find device "nvmf_br" 00:09:42.701 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@170 -- # true 00:09:42.701 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@171 -- # ip link delete nvmf_init_if 00:09:42.701 Cannot find device "nvmf_init_if" 00:09:42.701 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@171 -- # true 00:09:42.701 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@172 -- # ip link delete nvmf_init_if2 00:09:42.701 Cannot find device "nvmf_init_if2" 00:09:42.701 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@172 -- # true 00:09:42.701 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@173 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:09:42.701 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:09:42.701 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@173 -- # true 00:09:42.701 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@174 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:09:42.701 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:09:42.701 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@174 -- # true 00:09:42.701 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@177 -- # ip netns add nvmf_tgt_ns_spdk 00:09:42.701 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@180 -- # ip link add nvmf_init_if type veth peer name nvmf_init_br 00:09:42.701 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@181 -- # ip link add nvmf_init_if2 type veth peer name nvmf_init_br2 00:09:42.701 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@182 -- # ip link add nvmf_tgt_if type veth peer name nvmf_tgt_br 00:09:42.701 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@183 -- # ip link add nvmf_tgt_if2 type veth peer name nvmf_tgt_br2 00:09:42.960 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@186 -- # ip link set nvmf_tgt_if netns nvmf_tgt_ns_spdk 00:09:42.960 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@187 -- # ip link set nvmf_tgt_if2 netns nvmf_tgt_ns_spdk 00:09:42.960 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@190 -- # ip addr add 10.0.0.1/24 dev nvmf_init_if 00:09:42.960 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@191 -- # ip addr add 10.0.0.2/24 dev nvmf_init_if2 00:09:42.960 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@192 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.3/24 dev nvmf_tgt_if 00:09:42.960 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@193 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.4/24 dev nvmf_tgt_if2 00:09:42.960 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@196 -- # ip link set nvmf_init_if up 00:09:42.960 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@197 -- # ip link set nvmf_init_if2 up 00:09:42.960 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@198 -- # ip link set nvmf_init_br up 00:09:42.960 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@199 -- # ip link set nvmf_init_br2 up 00:09:42.960 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@200 -- # ip link set nvmf_tgt_br up 00:09:42.960 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@201 -- # ip link set nvmf_tgt_br2 up 00:09:42.960 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@202 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if up 00:09:42.960 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@203 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if2 up 00:09:42.960 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@204 -- # ip netns exec nvmf_tgt_ns_spdk ip link set lo up 00:09:42.960 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@207 -- # ip link add nvmf_br type bridge 00:09:42.960 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@208 -- # ip link set nvmf_br up 00:09:42.960 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@211 -- # ip link set nvmf_init_br master nvmf_br 00:09:42.960 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@212 -- # ip link set nvmf_init_br2 master nvmf_br 00:09:42.960 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@213 -- # ip link set nvmf_tgt_br master nvmf_br 00:09:42.960 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@214 -- # ip link set nvmf_tgt_br2 master nvmf_br 00:09:42.960 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@217 -- # ipts -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT 00:09:42.960 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT' 00:09:42.960 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@218 -- # ipts -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT 00:09:42.960 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT' 00:09:42.960 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@219 -- # ipts -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT 00:09:42.960 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@788 -- # iptables -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT -m comment --comment 'SPDK_NVMF:-A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT' 00:09:42.960 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@222 -- # ping -c 1 10.0.0.3 00:09:42.960 PING 10.0.0.3 (10.0.0.3) 56(84) bytes of data. 00:09:42.960 64 bytes from 10.0.0.3: icmp_seq=1 ttl=64 time=0.087 ms 00:09:42.960 00:09:42.960 --- 10.0.0.3 ping statistics --- 00:09:42.960 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:09:42.960 rtt min/avg/max/mdev = 0.087/0.087/0.087/0.000 ms 00:09:42.960 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@223 -- # ping -c 1 10.0.0.4 00:09:42.960 PING 10.0.0.4 (10.0.0.4) 56(84) bytes of data. 00:09:42.960 64 bytes from 10.0.0.4: icmp_seq=1 ttl=64 time=0.038 ms 00:09:42.960 00:09:42.960 --- 10.0.0.4 ping statistics --- 00:09:42.960 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:09:42.960 rtt min/avg/max/mdev = 0.038/0.038/0.038/0.000 ms 00:09:42.960 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@224 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.1 00:09:42.960 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:09:42.960 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.022 ms 00:09:42.960 00:09:42.960 --- 10.0.0.1 ping statistics --- 00:09:42.960 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:09:42.960 rtt min/avg/max/mdev = 0.022/0.022/0.022/0.000 ms 00:09:42.960 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@225 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.2 00:09:42.960 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:09:42.960 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.046 ms 00:09:42.960 00:09:42.960 --- 10.0.0.2 ping statistics --- 00:09:42.960 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:09:42.960 rtt min/avg/max/mdev = 0.046/0.046/0.046/0.000 ms 00:09:42.960 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@227 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:09:42.960 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@459 -- # return 0 00:09:42.960 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:09:42.960 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:09:42.960 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:09:42.960 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:09:42.960 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:09:42.960 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:09:42.960 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:09:42.961 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- target/nvmf_example.sh@42 -- # nvmfexamplestart '-m 0xF' 00:09:42.961 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- target/nvmf_example.sh@27 -- # timing_enter start_nvmf_example 00:09:42.961 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@724 -- # xtrace_disable 00:09:42.961 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@10 -- # set +x 00:09:42.961 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- target/nvmf_example.sh@29 -- # '[' tcp == tcp ']' 00:09:42.961 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- target/nvmf_example.sh@30 -- # NVMF_EXAMPLE=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_EXAMPLE[@]}") 00:09:42.961 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:09:42.961 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- target/nvmf_example.sh@34 -- # nvmfpid=71349 00:09:42.961 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- target/nvmf_example.sh@35 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:09:42.961 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- target/nvmf_example.sh@33 -- # ip netns exec nvmf_tgt_ns_spdk /home/vagrant/spdk_repo/spdk/build/examples/nvmf -i 0 -g 10000 -m 0xF 00:09:42.961 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- target/nvmf_example.sh@36 -- # waitforlisten 71349 00:09:42.961 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@831 -- # '[' -z 71349 ']' 00:09:42.961 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:09:42.961 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@836 -- # local max_retries=100 00:09:42.961 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:09:42.961 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@840 -- # xtrace_disable 00:09:42.961 11:20:24 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@10 -- # set +x 00:09:44.333 11:20:25 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:09:44.333 11:20:25 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@864 -- # return 0 00:09:44.333 11:20:25 nvmf_tcp.nvmf_target_extra.nvmf_example -- target/nvmf_example.sh@37 -- # timing_exit start_nvmf_example 00:09:44.333 11:20:25 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@730 -- # xtrace_disable 00:09:44.333 11:20:25 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@10 -- # set +x 00:09:44.333 11:20:25 nvmf_tcp.nvmf_target_extra.nvmf_example -- target/nvmf_example.sh@45 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:09:44.333 11:20:25 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:44.333 11:20:25 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@10 -- # set +x 00:09:44.333 11:20:25 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:44.333 11:20:25 nvmf_tcp.nvmf_target_extra.nvmf_example -- target/nvmf_example.sh@47 -- # rpc_cmd bdev_malloc_create 64 512 00:09:44.333 11:20:25 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:44.333 11:20:25 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@10 -- # set +x 00:09:44.333 11:20:25 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:44.333 11:20:25 nvmf_tcp.nvmf_target_extra.nvmf_example -- target/nvmf_example.sh@47 -- # malloc_bdevs='Malloc0 ' 00:09:44.333 11:20:25 nvmf_tcp.nvmf_target_extra.nvmf_example -- target/nvmf_example.sh@49 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:09:44.333 11:20:25 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:44.333 11:20:25 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@10 -- # set +x 00:09:44.333 11:20:25 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:44.333 11:20:25 nvmf_tcp.nvmf_target_extra.nvmf_example -- target/nvmf_example.sh@52 -- # for malloc_bdev in $malloc_bdevs 00:09:44.333 11:20:25 nvmf_tcp.nvmf_target_extra.nvmf_example -- target/nvmf_example.sh@53 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:09:44.333 11:20:25 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:44.333 11:20:25 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@10 -- # set +x 00:09:44.333 11:20:25 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:44.333 11:20:25 nvmf_tcp.nvmf_target_extra.nvmf_example -- target/nvmf_example.sh@57 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4420 00:09:44.333 11:20:25 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:44.333 11:20:25 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@10 -- # set +x 00:09:44.333 11:20:25 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:44.333 11:20:25 nvmf_tcp.nvmf_target_extra.nvmf_example -- target/nvmf_example.sh@59 -- # perf=/home/vagrant/spdk_repo/spdk/build/bin/spdk_nvme_perf 00:09:44.333 11:20:25 nvmf_tcp.nvmf_target_extra.nvmf_example -- target/nvmf_example.sh@61 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randrw -M 30 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.3 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:09:56.537 Initializing NVMe Controllers 00:09:56.537 Attached to NVMe over Fabrics controller at 10.0.0.3:4420: nqn.2016-06.io.spdk:cnode1 00:09:56.537 Associating TCP (addr:10.0.0.3 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:09:56.537 Initialization complete. Launching workers. 00:09:56.537 ======================================================== 00:09:56.537 Latency(us) 00:09:56.537 Device Information : IOPS MiB/s Average min max 00:09:56.537 TCP (addr:10.0.0.3 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 14536.95 56.78 4402.71 719.40 21186.28 00:09:56.537 ======================================================== 00:09:56.537 Total : 14536.95 56.78 4402.71 719.40 21186.28 00:09:56.537 00:09:56.537 11:20:36 nvmf_tcp.nvmf_target_extra.nvmf_example -- target/nvmf_example.sh@65 -- # trap - SIGINT SIGTERM EXIT 00:09:56.537 11:20:36 nvmf_tcp.nvmf_target_extra.nvmf_example -- target/nvmf_example.sh@66 -- # nvmftestfini 00:09:56.537 11:20:36 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@514 -- # nvmfcleanup 00:09:56.537 11:20:36 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@121 -- # sync 00:09:56.537 11:20:36 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:09:56.537 11:20:36 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@124 -- # set +e 00:09:56.537 11:20:36 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@125 -- # for i in {1..20} 00:09:56.537 11:20:36 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:09:56.537 rmmod nvme_tcp 00:09:56.537 rmmod nvme_fabrics 00:09:56.537 rmmod nvme_keyring 00:09:56.537 11:20:36 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:09:56.537 11:20:36 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@128 -- # set -e 00:09:56.537 11:20:36 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@129 -- # return 0 00:09:56.537 11:20:36 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@515 -- # '[' -n 71349 ']' 00:09:56.537 11:20:36 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@516 -- # killprocess 71349 00:09:56.537 11:20:36 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@950 -- # '[' -z 71349 ']' 00:09:56.537 11:20:36 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@954 -- # kill -0 71349 00:09:56.537 11:20:36 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@955 -- # uname 00:09:56.537 11:20:36 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:09:56.537 11:20:36 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 71349 00:09:56.537 killing process with pid 71349 00:09:56.537 11:20:36 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@956 -- # process_name=nvmf 00:09:56.537 11:20:36 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@960 -- # '[' nvmf = sudo ']' 00:09:56.537 11:20:36 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@968 -- # echo 'killing process with pid 71349' 00:09:56.537 11:20:36 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@969 -- # kill 71349 00:09:56.537 11:20:36 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@974 -- # wait 71349 00:09:56.537 nvmf threads initialize successfully 00:09:56.537 bdev subsystem init successfully 00:09:56.537 created a nvmf target service 00:09:56.537 create targets's poll groups done 00:09:56.537 all subsystems of target started 00:09:56.537 nvmf target is running 00:09:56.537 all subsystems of target stopped 00:09:56.537 destroy targets's poll groups done 00:09:56.537 destroyed the nvmf target service 00:09:56.537 bdev subsystem finish successfully 00:09:56.537 nvmf threads destroy successfully 00:09:56.537 11:20:36 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:09:56.537 11:20:36 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:09:56.537 11:20:36 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:09:56.537 11:20:36 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@297 -- # iptr 00:09:56.537 11:20:36 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@789 -- # iptables-save 00:09:56.537 11:20:36 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:09:56.537 11:20:36 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@789 -- # iptables-restore 00:09:56.537 11:20:36 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@298 -- # [[ nvmf_tgt_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:09:56.537 11:20:36 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@299 -- # nvmf_veth_fini 00:09:56.537 11:20:36 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@233 -- # ip link set nvmf_init_br nomaster 00:09:56.537 11:20:36 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@234 -- # ip link set nvmf_init_br2 nomaster 00:09:56.537 11:20:36 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@235 -- # ip link set nvmf_tgt_br nomaster 00:09:56.537 11:20:36 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@236 -- # ip link set nvmf_tgt_br2 nomaster 00:09:56.537 11:20:36 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@237 -- # ip link set nvmf_init_br down 00:09:56.537 11:20:36 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@238 -- # ip link set nvmf_init_br2 down 00:09:56.537 11:20:36 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@239 -- # ip link set nvmf_tgt_br down 00:09:56.537 11:20:36 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@240 -- # ip link set nvmf_tgt_br2 down 00:09:56.537 11:20:36 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@241 -- # ip link delete nvmf_br type bridge 00:09:56.537 11:20:36 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@242 -- # ip link delete nvmf_init_if 00:09:56.537 11:20:36 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@243 -- # ip link delete nvmf_init_if2 00:09:56.537 11:20:36 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@244 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:09:56.537 11:20:36 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@245 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:09:56.537 11:20:36 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@246 -- # remove_spdk_ns 00:09:56.537 11:20:36 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:09:56.537 11:20:36 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:09:56.537 11:20:36 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:09:56.537 11:20:36 nvmf_tcp.nvmf_target_extra.nvmf_example -- nvmf/common.sh@300 -- # return 0 00:09:56.537 11:20:36 nvmf_tcp.nvmf_target_extra.nvmf_example -- target/nvmf_example.sh@67 -- # timing_exit nvmf_example_test 00:09:56.537 11:20:36 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@730 -- # xtrace_disable 00:09:56.537 11:20:36 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@10 -- # set +x 00:09:56.537 00:09:56.537 real 0m12.921s 00:09:56.537 user 0m45.189s 00:09:56.537 sys 0m2.171s 00:09:56.537 11:20:36 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@1126 -- # xtrace_disable 00:09:56.537 ************************************ 00:09:56.537 END TEST nvmf_example 00:09:56.537 11:20:36 nvmf_tcp.nvmf_target_extra.nvmf_example -- common/autotest_common.sh@10 -- # set +x 00:09:56.537 ************************************ 00:09:56.537 11:20:36 nvmf_tcp.nvmf_target_extra -- nvmf/nvmf_target_extra.sh@17 -- # run_test nvmf_filesystem /home/vagrant/spdk_repo/spdk/test/nvmf/target/filesystem.sh --transport=tcp 00:09:56.537 11:20:36 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:09:56.537 11:20:36 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1107 -- # xtrace_disable 00:09:56.537 11:20:36 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@10 -- # set +x 00:09:56.537 ************************************ 00:09:56.537 START TEST nvmf_filesystem 00:09:56.537 ************************************ 00:09:56.537 11:20:36 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/nvmf/target/filesystem.sh --transport=tcp 00:09:56.537 * Looking for test storage... 00:09:56.537 * Found test storage at /home/vagrant/spdk_repo/spdk/test/nvmf/target 00:09:56.537 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:09:56.537 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:09:56.537 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@1681 -- # lcov --version 00:09:56.537 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:09:56.537 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:09:56.538 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@333 -- # local ver1 ver1_l 00:09:56.538 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@334 -- # local ver2 ver2_l 00:09:56.538 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@336 -- # IFS=.-: 00:09:56.538 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@336 -- # read -ra ver1 00:09:56.538 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@337 -- # IFS=.-: 00:09:56.538 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@337 -- # read -ra ver2 00:09:56.538 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@338 -- # local 'op=<' 00:09:56.538 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@340 -- # ver1_l=2 00:09:56.538 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@341 -- # ver2_l=1 00:09:56.538 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:09:56.538 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@344 -- # case "$op" in 00:09:56.538 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@345 -- # : 1 00:09:56.538 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@364 -- # (( v = 0 )) 00:09:56.538 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:09:56.538 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@365 -- # decimal 1 00:09:56.538 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@353 -- # local d=1 00:09:56.538 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:09:56.538 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@355 -- # echo 1 00:09:56.538 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@365 -- # ver1[v]=1 00:09:56.538 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@366 -- # decimal 2 00:09:56.538 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@353 -- # local d=2 00:09:56.538 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:09:56.538 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@355 -- # echo 2 00:09:56.538 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@366 -- # ver2[v]=2 00:09:56.538 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:09:56.538 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:09:56.538 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@368 -- # return 0 00:09:56.538 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:09:56.538 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:09:56.538 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:56.538 --rc genhtml_branch_coverage=1 00:09:56.538 --rc genhtml_function_coverage=1 00:09:56.538 --rc genhtml_legend=1 00:09:56.538 --rc geninfo_all_blocks=1 00:09:56.538 --rc geninfo_unexecuted_blocks=1 00:09:56.538 00:09:56.538 ' 00:09:56.538 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:09:56.538 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:56.538 --rc genhtml_branch_coverage=1 00:09:56.538 --rc genhtml_function_coverage=1 00:09:56.538 --rc genhtml_legend=1 00:09:56.538 --rc geninfo_all_blocks=1 00:09:56.538 --rc geninfo_unexecuted_blocks=1 00:09:56.538 00:09:56.538 ' 00:09:56.538 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:09:56.538 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:56.538 --rc genhtml_branch_coverage=1 00:09:56.538 --rc genhtml_function_coverage=1 00:09:56.538 --rc genhtml_legend=1 00:09:56.538 --rc geninfo_all_blocks=1 00:09:56.538 --rc geninfo_unexecuted_blocks=1 00:09:56.538 00:09:56.538 ' 00:09:56.538 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:09:56.538 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:56.538 --rc genhtml_branch_coverage=1 00:09:56.538 --rc genhtml_function_coverage=1 00:09:56.538 --rc genhtml_legend=1 00:09:56.538 --rc geninfo_all_blocks=1 00:09:56.538 --rc geninfo_unexecuted_blocks=1 00:09:56.538 00:09:56.538 ' 00:09:56.538 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- target/filesystem.sh@9 -- # source /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh 00:09:56.538 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@7 -- # rpc_py=rpc_cmd 00:09:56.538 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@34 -- # set -e 00:09:56.538 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@35 -- # shopt -s nullglob 00:09:56.538 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@36 -- # shopt -s extglob 00:09:56.538 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@37 -- # shopt -s inherit_errexit 00:09:56.538 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@39 -- # '[' -z /home/vagrant/spdk_repo/spdk/../output ']' 00:09:56.538 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@44 -- # [[ -e /home/vagrant/spdk_repo/spdk/test/common/build_config.sh ]] 00:09:56.538 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@45 -- # source /home/vagrant/spdk_repo/spdk/test/common/build_config.sh 00:09:56.538 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@1 -- # CONFIG_WPDK_DIR= 00:09:56.538 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@2 -- # CONFIG_ASAN=n 00:09:56.538 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@3 -- # CONFIG_VBDEV_COMPRESS=n 00:09:56.538 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@4 -- # CONFIG_HAVE_EXECINFO_H=y 00:09:56.538 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@5 -- # CONFIG_USDT=y 00:09:56.538 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@6 -- # CONFIG_CUSTOMOCF=n 00:09:56.538 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@7 -- # CONFIG_PREFIX=/usr/local 00:09:56.538 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@8 -- # CONFIG_RBD=n 00:09:56.538 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@9 -- # CONFIG_LIBDIR= 00:09:56.538 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@10 -- # CONFIG_IDXD=y 00:09:56.538 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@11 -- # CONFIG_NVME_CUSE=y 00:09:56.538 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@12 -- # CONFIG_SMA=n 00:09:56.538 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@13 -- # CONFIG_VTUNE=n 00:09:56.538 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@14 -- # CONFIG_TSAN=n 00:09:56.538 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@15 -- # CONFIG_RDMA_SEND_WITH_INVAL=y 00:09:56.538 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@16 -- # CONFIG_VFIO_USER_DIR= 00:09:56.538 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@17 -- # CONFIG_PGO_CAPTURE=n 00:09:56.538 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@18 -- # CONFIG_HAVE_UUID_GENERATE_SHA1=y 00:09:56.538 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@19 -- # CONFIG_ENV=/home/vagrant/spdk_repo/spdk/lib/env_dpdk 00:09:56.538 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@20 -- # CONFIG_LTO=n 00:09:56.538 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@21 -- # CONFIG_ISCSI_INITIATOR=y 00:09:56.538 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@22 -- # CONFIG_CET=n 00:09:56.538 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@23 -- # CONFIG_VBDEV_COMPRESS_MLX5=n 00:09:56.538 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@24 -- # CONFIG_OCF_PATH= 00:09:56.538 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@25 -- # CONFIG_RDMA_SET_TOS=y 00:09:56.538 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@26 -- # CONFIG_AIO_FSDEV=y 00:09:56.538 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@27 -- # CONFIG_HAVE_ARC4RANDOM=y 00:09:56.538 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@28 -- # CONFIG_HAVE_LIBARCHIVE=n 00:09:56.538 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@29 -- # CONFIG_UBLK=y 00:09:56.538 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@30 -- # CONFIG_ISAL_CRYPTO=y 00:09:56.538 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@31 -- # CONFIG_OPENSSL_PATH= 00:09:56.538 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@32 -- # CONFIG_OCF=n 00:09:56.538 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@33 -- # CONFIG_FUSE=n 00:09:56.539 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@34 -- # CONFIG_VTUNE_DIR= 00:09:56.539 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@35 -- # CONFIG_FUZZER_LIB= 00:09:56.539 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@36 -- # CONFIG_FUZZER=n 00:09:56.539 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@37 -- # CONFIG_FSDEV=y 00:09:56.539 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@38 -- # CONFIG_DPDK_DIR=/home/vagrant/spdk_repo/spdk/dpdk/build 00:09:56.539 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@39 -- # CONFIG_CRYPTO=n 00:09:56.539 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@40 -- # CONFIG_PGO_USE=n 00:09:56.539 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@41 -- # CONFIG_VHOST=y 00:09:56.539 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@42 -- # CONFIG_DAOS=n 00:09:56.539 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@43 -- # CONFIG_DPDK_INC_DIR= 00:09:56.539 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@44 -- # CONFIG_DAOS_DIR= 00:09:56.539 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@45 -- # CONFIG_UNIT_TESTS=n 00:09:56.539 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@46 -- # CONFIG_RDMA_SET_ACK_TIMEOUT=y 00:09:56.539 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@47 -- # CONFIG_VIRTIO=y 00:09:56.539 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@48 -- # CONFIG_DPDK_UADK=n 00:09:56.539 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@49 -- # CONFIG_COVERAGE=y 00:09:56.539 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@50 -- # CONFIG_RDMA=y 00:09:56.539 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@51 -- # CONFIG_HAVE_STRUCT_STAT_ST_ATIM=y 00:09:56.539 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@52 -- # CONFIG_HAVE_LZ4=n 00:09:56.539 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@53 -- # CONFIG_FIO_SOURCE_DIR=/usr/src/fio 00:09:56.539 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@54 -- # CONFIG_URING_PATH= 00:09:56.539 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@55 -- # CONFIG_XNVME=n 00:09:56.539 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@56 -- # CONFIG_VFIO_USER=n 00:09:56.539 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@57 -- # CONFIG_ARCH=native 00:09:56.539 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@58 -- # CONFIG_HAVE_EVP_MAC=y 00:09:56.539 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@59 -- # CONFIG_URING_ZNS=n 00:09:56.539 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@60 -- # CONFIG_WERROR=y 00:09:56.539 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@61 -- # CONFIG_HAVE_LIBBSD=n 00:09:56.539 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@62 -- # CONFIG_UBSAN=y 00:09:56.539 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@63 -- # CONFIG_HAVE_STRUCT_STAT_ST_ATIMESPEC=n 00:09:56.539 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@64 -- # CONFIG_IPSEC_MB_DIR= 00:09:56.539 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@65 -- # CONFIG_GOLANG=y 00:09:56.539 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@66 -- # CONFIG_ISAL=y 00:09:56.539 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@67 -- # CONFIG_IDXD_KERNEL=y 00:09:56.539 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@68 -- # CONFIG_DPDK_LIB_DIR= 00:09:56.539 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@69 -- # CONFIG_RDMA_PROV=verbs 00:09:56.539 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@70 -- # CONFIG_APPS=y 00:09:56.539 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@71 -- # CONFIG_SHARED=y 00:09:56.539 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@72 -- # CONFIG_HAVE_KEYUTILS=y 00:09:56.539 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@73 -- # CONFIG_FC_PATH= 00:09:56.539 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@74 -- # CONFIG_DPDK_PKG_CONFIG=n 00:09:56.539 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@75 -- # CONFIG_FC=n 00:09:56.539 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@76 -- # CONFIG_AVAHI=y 00:09:56.539 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@77 -- # CONFIG_FIO_PLUGIN=y 00:09:56.539 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@78 -- # CONFIG_RAID5F=n 00:09:56.539 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@79 -- # CONFIG_EXAMPLES=y 00:09:56.539 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@80 -- # CONFIG_TESTS=y 00:09:56.539 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@81 -- # CONFIG_CRYPTO_MLX5=n 00:09:56.539 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@82 -- # CONFIG_MAX_LCORES=128 00:09:56.539 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@83 -- # CONFIG_IPSEC_MB=n 00:09:56.539 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@84 -- # CONFIG_PGO_DIR= 00:09:56.539 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@85 -- # CONFIG_DEBUG=y 00:09:56.539 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@86 -- # CONFIG_DPDK_COMPRESSDEV=n 00:09:56.539 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@87 -- # CONFIG_CROSS_PREFIX= 00:09:56.539 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@88 -- # CONFIG_COPY_FILE_RANGE=y 00:09:56.539 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/build_config.sh@89 -- # CONFIG_URING=n 00:09:56.539 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@54 -- # source /home/vagrant/spdk_repo/spdk/test/common/applications.sh 00:09:56.539 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/applications.sh@8 -- # dirname /home/vagrant/spdk_repo/spdk/test/common/applications.sh 00:09:56.539 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/applications.sh@8 -- # readlink -f /home/vagrant/spdk_repo/spdk/test/common 00:09:56.539 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/applications.sh@8 -- # _root=/home/vagrant/spdk_repo/spdk/test/common 00:09:56.539 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/applications.sh@9 -- # _root=/home/vagrant/spdk_repo/spdk 00:09:56.539 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/applications.sh@10 -- # _app_dir=/home/vagrant/spdk_repo/spdk/build/bin 00:09:56.539 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/applications.sh@11 -- # _test_app_dir=/home/vagrant/spdk_repo/spdk/test/app 00:09:56.539 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/applications.sh@12 -- # _examples_dir=/home/vagrant/spdk_repo/spdk/build/examples 00:09:56.539 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/applications.sh@14 -- # VHOST_FUZZ_APP=("$_test_app_dir/fuzz/vhost_fuzz/vhost_fuzz") 00:09:56.539 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/applications.sh@15 -- # ISCSI_APP=("$_app_dir/iscsi_tgt") 00:09:56.539 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/applications.sh@16 -- # NVMF_APP=("$_app_dir/nvmf_tgt") 00:09:56.539 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/applications.sh@17 -- # VHOST_APP=("$_app_dir/vhost") 00:09:56.539 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/applications.sh@18 -- # DD_APP=("$_app_dir/spdk_dd") 00:09:56.539 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/applications.sh@19 -- # SPDK_APP=("$_app_dir/spdk_tgt") 00:09:56.539 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/applications.sh@22 -- # [[ -e /home/vagrant/spdk_repo/spdk/include/spdk/config.h ]] 00:09:56.539 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/applications.sh@23 -- # [[ #ifndef SPDK_CONFIG_H 00:09:56.539 #define SPDK_CONFIG_H 00:09:56.539 #define SPDK_CONFIG_AIO_FSDEV 1 00:09:56.539 #define SPDK_CONFIG_APPS 1 00:09:56.539 #define SPDK_CONFIG_ARCH native 00:09:56.539 #undef SPDK_CONFIG_ASAN 00:09:56.539 #define SPDK_CONFIG_AVAHI 1 00:09:56.539 #undef SPDK_CONFIG_CET 00:09:56.539 #define SPDK_CONFIG_COPY_FILE_RANGE 1 00:09:56.539 #define SPDK_CONFIG_COVERAGE 1 00:09:56.539 #define SPDK_CONFIG_CROSS_PREFIX 00:09:56.539 #undef SPDK_CONFIG_CRYPTO 00:09:56.539 #undef SPDK_CONFIG_CRYPTO_MLX5 00:09:56.539 #undef SPDK_CONFIG_CUSTOMOCF 00:09:56.539 #undef SPDK_CONFIG_DAOS 00:09:56.539 #define SPDK_CONFIG_DAOS_DIR 00:09:56.539 #define SPDK_CONFIG_DEBUG 1 00:09:56.539 #undef SPDK_CONFIG_DPDK_COMPRESSDEV 00:09:56.539 #define SPDK_CONFIG_DPDK_DIR /home/vagrant/spdk_repo/spdk/dpdk/build 00:09:56.539 #define SPDK_CONFIG_DPDK_INC_DIR 00:09:56.539 #define SPDK_CONFIG_DPDK_LIB_DIR 00:09:56.539 #undef SPDK_CONFIG_DPDK_PKG_CONFIG 00:09:56.539 #undef SPDK_CONFIG_DPDK_UADK 00:09:56.539 #define SPDK_CONFIG_ENV /home/vagrant/spdk_repo/spdk/lib/env_dpdk 00:09:56.539 #define SPDK_CONFIG_EXAMPLES 1 00:09:56.539 #undef SPDK_CONFIG_FC 00:09:56.539 #define SPDK_CONFIG_FC_PATH 00:09:56.539 #define SPDK_CONFIG_FIO_PLUGIN 1 00:09:56.539 #define SPDK_CONFIG_FIO_SOURCE_DIR /usr/src/fio 00:09:56.539 #define SPDK_CONFIG_FSDEV 1 00:09:56.539 #undef SPDK_CONFIG_FUSE 00:09:56.540 #undef SPDK_CONFIG_FUZZER 00:09:56.540 #define SPDK_CONFIG_FUZZER_LIB 00:09:56.540 #define SPDK_CONFIG_GOLANG 1 00:09:56.540 #define SPDK_CONFIG_HAVE_ARC4RANDOM 1 00:09:56.540 #define SPDK_CONFIG_HAVE_EVP_MAC 1 00:09:56.540 #define SPDK_CONFIG_HAVE_EXECINFO_H 1 00:09:56.540 #define SPDK_CONFIG_HAVE_KEYUTILS 1 00:09:56.540 #undef SPDK_CONFIG_HAVE_LIBARCHIVE 00:09:56.540 #undef SPDK_CONFIG_HAVE_LIBBSD 00:09:56.540 #undef SPDK_CONFIG_HAVE_LZ4 00:09:56.540 #define SPDK_CONFIG_HAVE_STRUCT_STAT_ST_ATIM 1 00:09:56.540 #undef SPDK_CONFIG_HAVE_STRUCT_STAT_ST_ATIMESPEC 00:09:56.540 #define SPDK_CONFIG_HAVE_UUID_GENERATE_SHA1 1 00:09:56.540 #define SPDK_CONFIG_IDXD 1 00:09:56.540 #define SPDK_CONFIG_IDXD_KERNEL 1 00:09:56.540 #undef SPDK_CONFIG_IPSEC_MB 00:09:56.540 #define SPDK_CONFIG_IPSEC_MB_DIR 00:09:56.540 #define SPDK_CONFIG_ISAL 1 00:09:56.540 #define SPDK_CONFIG_ISAL_CRYPTO 1 00:09:56.540 #define SPDK_CONFIG_ISCSI_INITIATOR 1 00:09:56.540 #define SPDK_CONFIG_LIBDIR 00:09:56.540 #undef SPDK_CONFIG_LTO 00:09:56.540 #define SPDK_CONFIG_MAX_LCORES 128 00:09:56.540 #define SPDK_CONFIG_NVME_CUSE 1 00:09:56.540 #undef SPDK_CONFIG_OCF 00:09:56.540 #define SPDK_CONFIG_OCF_PATH 00:09:56.540 #define SPDK_CONFIG_OPENSSL_PATH 00:09:56.540 #undef SPDK_CONFIG_PGO_CAPTURE 00:09:56.540 #define SPDK_CONFIG_PGO_DIR 00:09:56.540 #undef SPDK_CONFIG_PGO_USE 00:09:56.540 #define SPDK_CONFIG_PREFIX /usr/local 00:09:56.540 #undef SPDK_CONFIG_RAID5F 00:09:56.540 #undef SPDK_CONFIG_RBD 00:09:56.540 #define SPDK_CONFIG_RDMA 1 00:09:56.540 #define SPDK_CONFIG_RDMA_PROV verbs 00:09:56.540 #define SPDK_CONFIG_RDMA_SEND_WITH_INVAL 1 00:09:56.540 #define SPDK_CONFIG_RDMA_SET_ACK_TIMEOUT 1 00:09:56.540 #define SPDK_CONFIG_RDMA_SET_TOS 1 00:09:56.540 #define SPDK_CONFIG_SHARED 1 00:09:56.540 #undef SPDK_CONFIG_SMA 00:09:56.540 #define SPDK_CONFIG_TESTS 1 00:09:56.540 #undef SPDK_CONFIG_TSAN 00:09:56.540 #define SPDK_CONFIG_UBLK 1 00:09:56.540 #define SPDK_CONFIG_UBSAN 1 00:09:56.540 #undef SPDK_CONFIG_UNIT_TESTS 00:09:56.540 #undef SPDK_CONFIG_URING 00:09:56.540 #define SPDK_CONFIG_URING_PATH 00:09:56.540 #undef SPDK_CONFIG_URING_ZNS 00:09:56.540 #define SPDK_CONFIG_USDT 1 00:09:56.540 #undef SPDK_CONFIG_VBDEV_COMPRESS 00:09:56.540 #undef SPDK_CONFIG_VBDEV_COMPRESS_MLX5 00:09:56.540 #undef SPDK_CONFIG_VFIO_USER 00:09:56.540 #define SPDK_CONFIG_VFIO_USER_DIR 00:09:56.540 #define SPDK_CONFIG_VHOST 1 00:09:56.540 #define SPDK_CONFIG_VIRTIO 1 00:09:56.540 #undef SPDK_CONFIG_VTUNE 00:09:56.540 #define SPDK_CONFIG_VTUNE_DIR 00:09:56.540 #define SPDK_CONFIG_WERROR 1 00:09:56.540 #define SPDK_CONFIG_WPDK_DIR 00:09:56.540 #undef SPDK_CONFIG_XNVME 00:09:56.540 #endif /* SPDK_CONFIG_H */ == *\#\d\e\f\i\n\e\ \S\P\D\K\_\C\O\N\F\I\G\_\D\E\B\U\G* ]] 00:09:56.540 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/applications.sh@24 -- # (( SPDK_AUTOTEST_DEBUG_APPS )) 00:09:56.540 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@55 -- # source /home/vagrant/spdk_repo/spdk/scripts/common.sh 00:09:56.540 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@15 -- # shopt -s extglob 00:09:56.540 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:09:56.540 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:09:56.540 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:09:56.540 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:56.540 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:56.540 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:56.540 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- paths/export.sh@5 -- # export PATH 00:09:56.540 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:56.540 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@56 -- # source /home/vagrant/spdk_repo/spdk/scripts/perf/pm/common 00:09:56.540 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- pm/common@6 -- # dirname /home/vagrant/spdk_repo/spdk/scripts/perf/pm/common 00:09:56.540 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- pm/common@6 -- # readlink -f /home/vagrant/spdk_repo/spdk/scripts/perf/pm 00:09:56.540 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- pm/common@6 -- # _pmdir=/home/vagrant/spdk_repo/spdk/scripts/perf/pm 00:09:56.540 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- pm/common@7 -- # readlink -f /home/vagrant/spdk_repo/spdk/scripts/perf/pm/../../../ 00:09:56.540 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- pm/common@7 -- # _pmrootdir=/home/vagrant/spdk_repo/spdk 00:09:56.540 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- pm/common@64 -- # TEST_TAG=N/A 00:09:56.540 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- pm/common@65 -- # TEST_TAG_FILE=/home/vagrant/spdk_repo/spdk/.run_test_name 00:09:56.540 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- pm/common@67 -- # PM_OUTPUTDIR=/home/vagrant/spdk_repo/spdk/../output/power 00:09:56.540 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- pm/common@68 -- # uname -s 00:09:56.540 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- pm/common@68 -- # PM_OS=Linux 00:09:56.540 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- pm/common@70 -- # MONITOR_RESOURCES_SUDO=() 00:09:56.540 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- pm/common@70 -- # declare -A MONITOR_RESOURCES_SUDO 00:09:56.540 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- pm/common@71 -- # MONITOR_RESOURCES_SUDO["collect-bmc-pm"]=1 00:09:56.540 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- pm/common@72 -- # MONITOR_RESOURCES_SUDO["collect-cpu-load"]=0 00:09:56.540 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- pm/common@73 -- # MONITOR_RESOURCES_SUDO["collect-cpu-temp"]=0 00:09:56.540 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- pm/common@74 -- # MONITOR_RESOURCES_SUDO["collect-vmstat"]=0 00:09:56.540 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- pm/common@76 -- # SUDO[0]= 00:09:56.540 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- pm/common@76 -- # SUDO[1]='sudo -E' 00:09:56.540 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- pm/common@78 -- # MONITOR_RESOURCES=(collect-cpu-load collect-vmstat) 00:09:56.540 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- pm/common@79 -- # [[ Linux == FreeBSD ]] 00:09:56.540 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- pm/common@81 -- # [[ Linux == Linux ]] 00:09:56.540 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- pm/common@81 -- # [[ QEMU != QEMU ]] 00:09:56.540 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- pm/common@88 -- # [[ ! -d /home/vagrant/spdk_repo/spdk/../output/power ]] 00:09:56.540 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@58 -- # : 0 00:09:56.540 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@59 -- # export RUN_NIGHTLY 00:09:56.540 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@62 -- # : 0 00:09:56.540 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@63 -- # export SPDK_AUTOTEST_DEBUG_APPS 00:09:56.540 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@64 -- # : 0 00:09:56.540 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@65 -- # export SPDK_RUN_VALGRIND 00:09:56.540 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@66 -- # : 1 00:09:56.541 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@67 -- # export SPDK_RUN_FUNCTIONAL_TEST 00:09:56.541 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@68 -- # : 0 00:09:56.541 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@69 -- # export SPDK_TEST_UNITTEST 00:09:56.541 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@70 -- # : 00:09:56.541 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@71 -- # export SPDK_TEST_AUTOBUILD 00:09:56.541 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@72 -- # : 0 00:09:56.541 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@73 -- # export SPDK_TEST_RELEASE_BUILD 00:09:56.541 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@74 -- # : 0 00:09:56.541 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@75 -- # export SPDK_TEST_ISAL 00:09:56.541 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@76 -- # : 0 00:09:56.541 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@77 -- # export SPDK_TEST_ISCSI 00:09:56.541 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@78 -- # : 0 00:09:56.541 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@79 -- # export SPDK_TEST_ISCSI_INITIATOR 00:09:56.541 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@80 -- # : 0 00:09:56.541 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@81 -- # export SPDK_TEST_NVME 00:09:56.541 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@82 -- # : 0 00:09:56.541 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@83 -- # export SPDK_TEST_NVME_PMR 00:09:56.541 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@84 -- # : 0 00:09:56.541 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@85 -- # export SPDK_TEST_NVME_BP 00:09:56.541 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@86 -- # : 0 00:09:56.541 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@87 -- # export SPDK_TEST_NVME_CLI 00:09:56.541 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@88 -- # : 0 00:09:56.541 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@89 -- # export SPDK_TEST_NVME_CUSE 00:09:56.541 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@90 -- # : 0 00:09:56.541 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@91 -- # export SPDK_TEST_NVME_FDP 00:09:56.541 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@92 -- # : 1 00:09:56.541 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@93 -- # export SPDK_TEST_NVMF 00:09:56.541 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@94 -- # : 0 00:09:56.541 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@95 -- # export SPDK_TEST_VFIOUSER 00:09:56.541 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@96 -- # : 0 00:09:56.541 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@97 -- # export SPDK_TEST_VFIOUSER_QEMU 00:09:56.541 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@98 -- # : 0 00:09:56.541 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@99 -- # export SPDK_TEST_FUZZER 00:09:56.541 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@100 -- # : 0 00:09:56.541 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@101 -- # export SPDK_TEST_FUZZER_SHORT 00:09:56.541 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@102 -- # : tcp 00:09:56.541 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@103 -- # export SPDK_TEST_NVMF_TRANSPORT 00:09:56.541 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@104 -- # : 0 00:09:56.541 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@105 -- # export SPDK_TEST_RBD 00:09:56.541 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@106 -- # : 0 00:09:56.541 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@107 -- # export SPDK_TEST_VHOST 00:09:56.541 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@108 -- # : 0 00:09:56.541 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@109 -- # export SPDK_TEST_BLOCKDEV 00:09:56.541 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@110 -- # : 0 00:09:56.541 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@111 -- # export SPDK_TEST_RAID 00:09:56.541 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@112 -- # : 0 00:09:56.541 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@113 -- # export SPDK_TEST_IOAT 00:09:56.541 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@114 -- # : 0 00:09:56.541 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@115 -- # export SPDK_TEST_BLOBFS 00:09:56.541 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@116 -- # : 0 00:09:56.541 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@117 -- # export SPDK_TEST_VHOST_INIT 00:09:56.541 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@118 -- # : 0 00:09:56.541 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@119 -- # export SPDK_TEST_LVOL 00:09:56.541 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@120 -- # : 0 00:09:56.541 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@121 -- # export SPDK_TEST_VBDEV_COMPRESS 00:09:56.541 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@122 -- # : 0 00:09:56.541 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@123 -- # export SPDK_RUN_ASAN 00:09:56.541 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@124 -- # : 1 00:09:56.541 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@125 -- # export SPDK_RUN_UBSAN 00:09:56.541 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@126 -- # : 00:09:56.541 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@127 -- # export SPDK_RUN_EXTERNAL_DPDK 00:09:56.541 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@128 -- # : 0 00:09:56.541 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@129 -- # export SPDK_RUN_NON_ROOT 00:09:56.541 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@130 -- # : 0 00:09:56.541 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@131 -- # export SPDK_TEST_CRYPTO 00:09:56.541 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@132 -- # : 0 00:09:56.541 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@133 -- # export SPDK_TEST_FTL 00:09:56.541 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@134 -- # : 0 00:09:56.541 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@135 -- # export SPDK_TEST_OCF 00:09:56.541 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@136 -- # : 0 00:09:56.541 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@137 -- # export SPDK_TEST_VMD 00:09:56.541 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@138 -- # : 0 00:09:56.541 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@139 -- # export SPDK_TEST_OPAL 00:09:56.541 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@140 -- # : 00:09:56.541 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@141 -- # export SPDK_TEST_NATIVE_DPDK 00:09:56.541 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@142 -- # : true 00:09:56.541 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@143 -- # export SPDK_AUTOTEST_X 00:09:56.541 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@144 -- # : 0 00:09:56.541 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@145 -- # export SPDK_TEST_URING 00:09:56.541 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@146 -- # : 1 00:09:56.541 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@147 -- # export SPDK_TEST_USDT 00:09:56.541 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@148 -- # : 0 00:09:56.541 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@149 -- # export SPDK_TEST_USE_IGB_UIO 00:09:56.541 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@150 -- # : 0 00:09:56.541 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@151 -- # export SPDK_TEST_SCHEDULER 00:09:56.541 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@152 -- # : 0 00:09:56.541 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@153 -- # export SPDK_TEST_SCANBUILD 00:09:56.541 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@154 -- # : 00:09:56.541 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@155 -- # export SPDK_TEST_NVMF_NICS 00:09:56.541 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@156 -- # : 0 00:09:56.541 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@157 -- # export SPDK_TEST_SMA 00:09:56.541 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@158 -- # : 0 00:09:56.541 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@159 -- # export SPDK_TEST_DAOS 00:09:56.542 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@160 -- # : 0 00:09:56.542 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@161 -- # export SPDK_TEST_XNVME 00:09:56.542 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@162 -- # : 0 00:09:56.542 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@163 -- # export SPDK_TEST_ACCEL 00:09:56.542 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@164 -- # : 0 00:09:56.542 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@165 -- # export SPDK_TEST_ACCEL_DSA 00:09:56.542 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@166 -- # : 0 00:09:56.542 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@167 -- # export SPDK_TEST_ACCEL_IAA 00:09:56.542 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@169 -- # : 00:09:56.542 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@170 -- # export SPDK_TEST_FUZZER_TARGET 00:09:56.542 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@171 -- # : 1 00:09:56.542 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@172 -- # export SPDK_TEST_NVMF_MDNS 00:09:56.542 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@173 -- # : 1 00:09:56.542 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@174 -- # export SPDK_JSONRPC_GO_CLIENT 00:09:56.542 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@175 -- # : 0 00:09:56.542 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@176 -- # export SPDK_TEST_SETUP 00:09:56.542 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@179 -- # export SPDK_LIB_DIR=/home/vagrant/spdk_repo/spdk/build/lib 00:09:56.542 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@179 -- # SPDK_LIB_DIR=/home/vagrant/spdk_repo/spdk/build/lib 00:09:56.542 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@180 -- # export DPDK_LIB_DIR=/home/vagrant/spdk_repo/spdk/dpdk/build/lib 00:09:56.542 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@180 -- # DPDK_LIB_DIR=/home/vagrant/spdk_repo/spdk/dpdk/build/lib 00:09:56.542 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@181 -- # export VFIO_LIB_DIR=/home/vagrant/spdk_repo/spdk/build/libvfio-user/usr/local/lib 00:09:56.542 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@181 -- # VFIO_LIB_DIR=/home/vagrant/spdk_repo/spdk/build/libvfio-user/usr/local/lib 00:09:56.542 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@182 -- # export LD_LIBRARY_PATH=:/home/vagrant/spdk_repo/spdk/build/lib:/home/vagrant/spdk_repo/spdk/dpdk/build/lib:/home/vagrant/spdk_repo/spdk/build/libvfio-user/usr/local/lib:/home/vagrant/spdk_repo/spdk/build/lib:/home/vagrant/spdk_repo/spdk/dpdk/build/lib:/home/vagrant/spdk_repo/spdk/build/libvfio-user/usr/local/lib:/home/vagrant/spdk_repo/spdk/build/lib:/home/vagrant/spdk_repo/spdk/dpdk/build/lib:/home/vagrant/spdk_repo/spdk/build/libvfio-user/usr/local/lib:/home/vagrant/spdk_repo/spdk/build/lib:/home/vagrant/spdk_repo/spdk/dpdk/build/lib:/home/vagrant/spdk_repo/spdk/build/libvfio-user/usr/local/lib:/home/vagrant/spdk_repo/spdk/build/lib:/home/vagrant/spdk_repo/spdk/dpdk/build/lib:/home/vagrant/spdk_repo/spdk/build/libvfio-user/usr/local/lib 00:09:56.542 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@182 -- # LD_LIBRARY_PATH=:/home/vagrant/spdk_repo/spdk/build/lib:/home/vagrant/spdk_repo/spdk/dpdk/build/lib:/home/vagrant/spdk_repo/spdk/build/libvfio-user/usr/local/lib:/home/vagrant/spdk_repo/spdk/build/lib:/home/vagrant/spdk_repo/spdk/dpdk/build/lib:/home/vagrant/spdk_repo/spdk/build/libvfio-user/usr/local/lib:/home/vagrant/spdk_repo/spdk/build/lib:/home/vagrant/spdk_repo/spdk/dpdk/build/lib:/home/vagrant/spdk_repo/spdk/build/libvfio-user/usr/local/lib:/home/vagrant/spdk_repo/spdk/build/lib:/home/vagrant/spdk_repo/spdk/dpdk/build/lib:/home/vagrant/spdk_repo/spdk/build/libvfio-user/usr/local/lib:/home/vagrant/spdk_repo/spdk/build/lib:/home/vagrant/spdk_repo/spdk/dpdk/build/lib:/home/vagrant/spdk_repo/spdk/build/libvfio-user/usr/local/lib 00:09:56.542 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@185 -- # export PCI_BLOCK_SYNC_ON_RESET=yes 00:09:56.542 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@185 -- # PCI_BLOCK_SYNC_ON_RESET=yes 00:09:56.542 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@189 -- # export PYTHONPATH=:/home/vagrant/spdk_repo/spdk/python:/home/vagrant/spdk_repo/spdk/test/rpc_plugins:/home/vagrant/spdk_repo/spdk/python:/home/vagrant/spdk_repo/spdk/test/rpc_plugins:/home/vagrant/spdk_repo/spdk/python:/home/vagrant/spdk_repo/spdk/test/rpc_plugins:/home/vagrant/spdk_repo/spdk/python:/home/vagrant/spdk_repo/spdk/test/rpc_plugins:/home/vagrant/spdk_repo/spdk/python 00:09:56.542 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@189 -- # PYTHONPATH=:/home/vagrant/spdk_repo/spdk/python:/home/vagrant/spdk_repo/spdk/test/rpc_plugins:/home/vagrant/spdk_repo/spdk/python:/home/vagrant/spdk_repo/spdk/test/rpc_plugins:/home/vagrant/spdk_repo/spdk/python:/home/vagrant/spdk_repo/spdk/test/rpc_plugins:/home/vagrant/spdk_repo/spdk/python:/home/vagrant/spdk_repo/spdk/test/rpc_plugins:/home/vagrant/spdk_repo/spdk/python 00:09:56.542 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@193 -- # export PYTHONDONTWRITEBYTECODE=1 00:09:56.542 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@193 -- # PYTHONDONTWRITEBYTECODE=1 00:09:56.542 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@197 -- # export ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:09:56.542 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@197 -- # ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:09:56.542 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@198 -- # export UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:09:56.542 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@198 -- # UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:09:56.542 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@202 -- # asan_suppression_file=/var/tmp/asan_suppression_file 00:09:56.542 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@203 -- # rm -rf /var/tmp/asan_suppression_file 00:09:56.542 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@204 -- # cat 00:09:56.542 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@240 -- # echo leak:libfuse3.so 00:09:56.542 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@242 -- # export LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:09:56.542 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@242 -- # LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:09:56.542 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@244 -- # export DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:09:56.542 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@244 -- # DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:09:56.542 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@246 -- # '[' -z /var/spdk/dependencies ']' 00:09:56.542 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@249 -- # export DEPENDENCY_DIR 00:09:56.542 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@253 -- # export SPDK_BIN_DIR=/home/vagrant/spdk_repo/spdk/build/bin 00:09:56.542 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@253 -- # SPDK_BIN_DIR=/home/vagrant/spdk_repo/spdk/build/bin 00:09:56.542 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@254 -- # export SPDK_EXAMPLE_DIR=/home/vagrant/spdk_repo/spdk/build/examples 00:09:56.542 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@254 -- # SPDK_EXAMPLE_DIR=/home/vagrant/spdk_repo/spdk/build/examples 00:09:56.542 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@257 -- # export QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:09:56.542 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@257 -- # QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:09:56.542 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@258 -- # export VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:09:56.542 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@258 -- # VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:09:56.542 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@260 -- # export AR_TOOL=/home/vagrant/spdk_repo/spdk/scripts/ar-xnvme-fixer 00:09:56.542 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@260 -- # AR_TOOL=/home/vagrant/spdk_repo/spdk/scripts/ar-xnvme-fixer 00:09:56.542 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@263 -- # export UNBIND_ENTIRE_IOMMU_GROUP=yes 00:09:56.542 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@263 -- # UNBIND_ENTIRE_IOMMU_GROUP=yes 00:09:56.543 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@265 -- # _LCOV_MAIN=0 00:09:56.543 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@266 -- # _LCOV_LLVM=1 00:09:56.543 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@267 -- # _LCOV= 00:09:56.543 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@268 -- # [[ '' == *clang* ]] 00:09:56.543 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@268 -- # [[ 0 -eq 1 ]] 00:09:56.543 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@270 -- # _lcov_opt[_LCOV_LLVM]='--gcov-tool /home/vagrant/spdk_repo/spdk/test/fuzz/llvm/llvm-gcov.sh' 00:09:56.543 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@271 -- # _lcov_opt[_LCOV_MAIN]= 00:09:56.543 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@273 -- # lcov_opt= 00:09:56.543 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@276 -- # '[' 0 -eq 0 ']' 00:09:56.543 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@277 -- # export valgrind= 00:09:56.543 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@277 -- # valgrind= 00:09:56.543 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@283 -- # uname -s 00:09:56.543 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@283 -- # '[' Linux = Linux ']' 00:09:56.543 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@284 -- # HUGEMEM=4096 00:09:56.543 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@285 -- # export CLEAR_HUGE=yes 00:09:56.543 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@285 -- # CLEAR_HUGE=yes 00:09:56.543 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@287 -- # MAKE=make 00:09:56.543 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@288 -- # MAKEFLAGS=-j10 00:09:56.543 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@304 -- # export HUGEMEM=4096 00:09:56.543 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@304 -- # HUGEMEM=4096 00:09:56.543 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@306 -- # NO_HUGE=() 00:09:56.543 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@307 -- # TEST_MODE= 00:09:56.543 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@308 -- # for i in "$@" 00:09:56.543 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@309 -- # case "$i" in 00:09:56.543 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@314 -- # TEST_TRANSPORT=tcp 00:09:56.543 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@329 -- # [[ -z 71622 ]] 00:09:56.543 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@329 -- # kill -0 71622 00:09:56.543 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@1666 -- # set_test_storage 2147483648 00:09:56.543 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@339 -- # [[ -v testdir ]] 00:09:56.543 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@341 -- # local requested_size=2147483648 00:09:56.543 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@342 -- # local mount target_dir 00:09:56.543 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@344 -- # local -A mounts fss sizes avails uses 00:09:56.543 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@345 -- # local source fs size avail mount use 00:09:56.543 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@347 -- # local storage_fallback storage_candidates 00:09:56.543 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@349 -- # mktemp -udt spdk.XXXXXX 00:09:56.543 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@349 -- # storage_fallback=/tmp/spdk.NgLbp7 00:09:56.543 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@354 -- # storage_candidates=("$testdir" "$storage_fallback/tests/${testdir##*/}" "$storage_fallback") 00:09:56.543 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@356 -- # [[ -n '' ]] 00:09:56.543 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@361 -- # [[ -n '' ]] 00:09:56.543 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@366 -- # mkdir -p /home/vagrant/spdk_repo/spdk/test/nvmf/target /tmp/spdk.NgLbp7/tests/target /tmp/spdk.NgLbp7 00:09:56.543 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@369 -- # requested_size=2214592512 00:09:56.543 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@371 -- # read -r source fs size use avail _ mount 00:09:56.543 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@338 -- # df -T 00:09:56.543 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@338 -- # grep -v Filesystem 00:09:56.543 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@372 -- # mounts["$mount"]=/dev/vda5 00:09:56.543 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@372 -- # fss["$mount"]=btrfs 00:09:56.543 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@373 -- # avails["$mount"]=13986754560 00:09:56.543 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@373 -- # sizes["$mount"]=20314062848 00:09:56.543 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@374 -- # uses["$mount"]=5582082048 00:09:56.543 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@371 -- # read -r source fs size use avail _ mount 00:09:56.543 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@372 -- # mounts["$mount"]=devtmpfs 00:09:56.543 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@372 -- # fss["$mount"]=devtmpfs 00:09:56.543 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@373 -- # avails["$mount"]=4194304 00:09:56.543 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@373 -- # sizes["$mount"]=4194304 00:09:56.543 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@374 -- # uses["$mount"]=0 00:09:56.543 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@371 -- # read -r source fs size use avail _ mount 00:09:56.543 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@372 -- # mounts["$mount"]=tmpfs 00:09:56.543 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@372 -- # fss["$mount"]=tmpfs 00:09:56.543 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@373 -- # avails["$mount"]=6256394240 00:09:56.543 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@373 -- # sizes["$mount"]=6266425344 00:09:56.543 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@374 -- # uses["$mount"]=10031104 00:09:56.543 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@371 -- # read -r source fs size use avail _ mount 00:09:56.543 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@372 -- # mounts["$mount"]=tmpfs 00:09:56.543 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@372 -- # fss["$mount"]=tmpfs 00:09:56.543 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@373 -- # avails["$mount"]=2486431744 00:09:56.543 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@373 -- # sizes["$mount"]=2506571776 00:09:56.543 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@374 -- # uses["$mount"]=20140032 00:09:56.543 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@371 -- # read -r source fs size use avail _ mount 00:09:56.543 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@372 -- # mounts["$mount"]=/dev/vda5 00:09:56.543 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@372 -- # fss["$mount"]=btrfs 00:09:56.543 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@373 -- # avails["$mount"]=13986754560 00:09:56.543 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@373 -- # sizes["$mount"]=20314062848 00:09:56.543 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@374 -- # uses["$mount"]=5582082048 00:09:56.543 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@371 -- # read -r source fs size use avail _ mount 00:09:56.543 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@372 -- # mounts["$mount"]=/dev/vda2 00:09:56.543 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@372 -- # fss["$mount"]=ext4 00:09:56.543 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@373 -- # avails["$mount"]=840085504 00:09:56.543 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@373 -- # sizes["$mount"]=1012768768 00:09:56.543 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@374 -- # uses["$mount"]=103477248 00:09:56.543 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@371 -- # read -r source fs size use avail _ mount 00:09:56.543 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@372 -- # mounts["$mount"]=/dev/vda3 00:09:56.543 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@372 -- # fss["$mount"]=vfat 00:09:56.543 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@373 -- # avails["$mount"]=91617280 00:09:56.543 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@373 -- # sizes["$mount"]=104607744 00:09:56.543 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@374 -- # uses["$mount"]=12990464 00:09:56.543 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@371 -- # read -r source fs size use avail _ mount 00:09:56.543 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@372 -- # mounts["$mount"]=tmpfs 00:09:56.544 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@372 -- # fss["$mount"]=tmpfs 00:09:56.544 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@373 -- # avails["$mount"]=6266281984 00:09:56.544 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@373 -- # sizes["$mount"]=6266429440 00:09:56.544 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@374 -- # uses["$mount"]=147456 00:09:56.544 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@371 -- # read -r source fs size use avail _ mount 00:09:56.544 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@372 -- # mounts["$mount"]=tmpfs 00:09:56.544 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@372 -- # fss["$mount"]=tmpfs 00:09:56.544 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@373 -- # avails["$mount"]=1253269504 00:09:56.544 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@373 -- # sizes["$mount"]=1253281792 00:09:56.544 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@374 -- # uses["$mount"]=12288 00:09:56.544 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@371 -- # read -r source fs size use avail _ mount 00:09:56.544 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@372 -- # mounts["$mount"]=:/mnt/jenkins_nvme/jenkins/workspace/nvmf-tcp-vg-autotest_3/fedora39-libvirt/output 00:09:56.544 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@372 -- # fss["$mount"]=fuse.sshfs 00:09:56.544 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@373 -- # avails["$mount"]=93523824640 00:09:56.544 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@373 -- # sizes["$mount"]=105088212992 00:09:56.544 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@374 -- # uses["$mount"]=6178955264 00:09:56.544 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@371 -- # read -r source fs size use avail _ mount 00:09:56.544 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@377 -- # printf '* Looking for test storage...\n' 00:09:56.544 * Looking for test storage... 00:09:56.544 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@379 -- # local target_space new_size 00:09:56.544 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@380 -- # for target_dir in "${storage_candidates[@]}" 00:09:56.544 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@383 -- # df /home/vagrant/spdk_repo/spdk/test/nvmf/target 00:09:56.544 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@383 -- # awk '$1 !~ /Filesystem/{print $6}' 00:09:56.544 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@383 -- # mount=/home 00:09:56.544 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@385 -- # target_space=13986754560 00:09:56.544 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@386 -- # (( target_space == 0 || target_space < requested_size )) 00:09:56.544 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@389 -- # (( target_space >= requested_size )) 00:09:56.544 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@391 -- # [[ btrfs == tmpfs ]] 00:09:56.544 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@391 -- # [[ btrfs == ramfs ]] 00:09:56.544 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@391 -- # [[ /home == / ]] 00:09:56.544 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@398 -- # export SPDK_TEST_STORAGE=/home/vagrant/spdk_repo/spdk/test/nvmf/target 00:09:56.544 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@398 -- # SPDK_TEST_STORAGE=/home/vagrant/spdk_repo/spdk/test/nvmf/target 00:09:56.544 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@399 -- # printf '* Found test storage at %s\n' /home/vagrant/spdk_repo/spdk/test/nvmf/target 00:09:56.544 * Found test storage at /home/vagrant/spdk_repo/spdk/test/nvmf/target 00:09:56.544 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@400 -- # return 0 00:09:56.544 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@1668 -- # set -o errtrace 00:09:56.544 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@1669 -- # shopt -s extdebug 00:09:56.544 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@1670 -- # trap 'trap - ERR; print_backtrace >&2' ERR 00:09:56.544 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@1672 -- # PS4=' \t ${test_domain:-} -- ${BASH_SOURCE#${BASH_SOURCE%/*/*}/}@${LINENO} -- \$ ' 00:09:56.544 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@1673 -- # true 00:09:56.544 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@1675 -- # xtrace_fd 00:09:56.544 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@25 -- # [[ -n 15 ]] 00:09:56.544 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@25 -- # [[ -e /proc/self/fd/15 ]] 00:09:56.544 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@27 -- # exec 00:09:56.544 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@29 -- # exec 00:09:56.544 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@31 -- # xtrace_restore 00:09:56.544 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@16 -- # unset -v 'X_STACK[0 - 1 < 0 ? 0 : 0 - 1]' 00:09:56.544 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@17 -- # (( 0 == 0 )) 00:09:56.544 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@18 -- # set -x 00:09:56.544 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:09:56.544 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@1681 -- # lcov --version 00:09:56.544 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:09:56.544 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:09:56.544 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:09:56.544 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@333 -- # local ver1 ver1_l 00:09:56.544 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@334 -- # local ver2 ver2_l 00:09:56.544 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@336 -- # IFS=.-: 00:09:56.544 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@336 -- # read -ra ver1 00:09:56.544 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@337 -- # IFS=.-: 00:09:56.544 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@337 -- # read -ra ver2 00:09:56.544 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@338 -- # local 'op=<' 00:09:56.544 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@340 -- # ver1_l=2 00:09:56.544 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@341 -- # ver2_l=1 00:09:56.544 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:09:56.544 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@344 -- # case "$op" in 00:09:56.544 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@345 -- # : 1 00:09:56.544 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@364 -- # (( v = 0 )) 00:09:56.544 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:09:56.544 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@365 -- # decimal 1 00:09:56.544 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@353 -- # local d=1 00:09:56.544 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:09:56.544 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@355 -- # echo 1 00:09:56.544 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@365 -- # ver1[v]=1 00:09:56.544 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@366 -- # decimal 2 00:09:56.544 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@353 -- # local d=2 00:09:56.544 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:09:56.544 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@355 -- # echo 2 00:09:56.544 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@366 -- # ver2[v]=2 00:09:56.544 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:09:56.544 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:09:56.544 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@368 -- # return 0 00:09:56.544 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:09:56.544 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:09:56.544 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:56.544 --rc genhtml_branch_coverage=1 00:09:56.544 --rc genhtml_function_coverage=1 00:09:56.544 --rc genhtml_legend=1 00:09:56.544 --rc geninfo_all_blocks=1 00:09:56.544 --rc geninfo_unexecuted_blocks=1 00:09:56.544 00:09:56.544 ' 00:09:56.544 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:09:56.544 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:56.544 --rc genhtml_branch_coverage=1 00:09:56.544 --rc genhtml_function_coverage=1 00:09:56.544 --rc genhtml_legend=1 00:09:56.545 --rc geninfo_all_blocks=1 00:09:56.545 --rc geninfo_unexecuted_blocks=1 00:09:56.545 00:09:56.545 ' 00:09:56.545 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:09:56.545 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:56.545 --rc genhtml_branch_coverage=1 00:09:56.545 --rc genhtml_function_coverage=1 00:09:56.545 --rc genhtml_legend=1 00:09:56.545 --rc geninfo_all_blocks=1 00:09:56.545 --rc geninfo_unexecuted_blocks=1 00:09:56.545 00:09:56.545 ' 00:09:56.545 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:09:56.545 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:56.545 --rc genhtml_branch_coverage=1 00:09:56.545 --rc genhtml_function_coverage=1 00:09:56.545 --rc genhtml_legend=1 00:09:56.545 --rc geninfo_all_blocks=1 00:09:56.545 --rc geninfo_unexecuted_blocks=1 00:09:56.545 00:09:56.545 ' 00:09:56.545 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- target/filesystem.sh@10 -- # source /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh 00:09:56.545 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@7 -- # uname -s 00:09:56.545 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:09:56.545 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:09:56.545 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:09:56.545 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:09:56.545 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:09:56.545 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:09:56.545 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:09:56.545 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:09:56.545 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:09:56.545 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:09:56.545 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:09:56.545 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@18 -- # NVME_HOSTID=3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:09:56.545 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:09:56.545 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:09:56.545 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@21 -- # NET_TYPE=virt 00:09:56.545 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:09:56.545 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@49 -- # source /home/vagrant/spdk_repo/spdk/scripts/common.sh 00:09:56.545 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@15 -- # shopt -s extglob 00:09:56.545 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:09:56.545 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:09:56.545 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:09:56.545 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:56.545 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:56.545 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:56.545 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- paths/export.sh@5 -- # export PATH 00:09:56.545 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:56.545 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@51 -- # : 0 00:09:56.545 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:09:56.545 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:09:56.545 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:09:56.545 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:09:56.545 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:09:56.545 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:09:56.545 /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:09:56.545 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:09:56.545 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:09:56.545 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@55 -- # have_pci_nics=0 00:09:56.545 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- target/filesystem.sh@12 -- # MALLOC_BDEV_SIZE=512 00:09:56.545 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- target/filesystem.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:09:56.545 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- target/filesystem.sh@15 -- # nvmftestinit 00:09:56.545 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:09:56.545 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:09:56.545 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@474 -- # prepare_net_devs 00:09:56.545 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@436 -- # local -g is_hw=no 00:09:56.545 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@438 -- # remove_spdk_ns 00:09:56.545 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:09:56.545 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:09:56.545 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:09:56.545 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@440 -- # [[ virt != virt ]] 00:09:56.545 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@442 -- # [[ no == yes ]] 00:09:56.545 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@449 -- # [[ virt == phy ]] 00:09:56.545 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@452 -- # [[ virt == phy-fallback ]] 00:09:56.545 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@457 -- # [[ tcp == tcp ]] 00:09:56.545 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@458 -- # nvmf_veth_init 00:09:56.545 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@145 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:09:56.545 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@146 -- # NVMF_SECOND_INITIATOR_IP=10.0.0.2 00:09:56.545 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@147 -- # NVMF_FIRST_TARGET_IP=10.0.0.3 00:09:56.545 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@148 -- # NVMF_SECOND_TARGET_IP=10.0.0.4 00:09:56.545 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@149 -- # NVMF_INITIATOR_IP=10.0.0.1 00:09:56.545 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@150 -- # NVMF_BRIDGE=nvmf_br 00:09:56.545 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@151 -- # NVMF_INITIATOR_INTERFACE=nvmf_init_if 00:09:56.545 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@152 -- # NVMF_INITIATOR_INTERFACE2=nvmf_init_if2 00:09:56.545 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@153 -- # NVMF_INITIATOR_BRIDGE=nvmf_init_br 00:09:56.545 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@154 -- # NVMF_INITIATOR_BRIDGE2=nvmf_init_br2 00:09:56.545 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@155 -- # NVMF_TARGET_NAMESPACE=nvmf_tgt_ns_spdk 00:09:56.546 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@156 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:09:56.546 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@157 -- # NVMF_TARGET_INTERFACE=nvmf_tgt_if 00:09:56.546 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@158 -- # NVMF_TARGET_INTERFACE2=nvmf_tgt_if2 00:09:56.546 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@159 -- # NVMF_TARGET_BRIDGE=nvmf_tgt_br 00:09:56.546 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@160 -- # NVMF_TARGET_BRIDGE2=nvmf_tgt_br2 00:09:56.546 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@162 -- # ip link set nvmf_init_br nomaster 00:09:56.546 Cannot find device "nvmf_init_br" 00:09:56.546 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@162 -- # true 00:09:56.546 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@163 -- # ip link set nvmf_init_br2 nomaster 00:09:56.546 Cannot find device "nvmf_init_br2" 00:09:56.546 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@163 -- # true 00:09:56.546 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@164 -- # ip link set nvmf_tgt_br nomaster 00:09:56.546 Cannot find device "nvmf_tgt_br" 00:09:56.546 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@164 -- # true 00:09:56.546 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@165 -- # ip link set nvmf_tgt_br2 nomaster 00:09:56.546 Cannot find device "nvmf_tgt_br2" 00:09:56.546 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@165 -- # true 00:09:56.546 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@166 -- # ip link set nvmf_init_br down 00:09:56.546 Cannot find device "nvmf_init_br" 00:09:56.546 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@166 -- # true 00:09:56.546 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@167 -- # ip link set nvmf_init_br2 down 00:09:56.546 Cannot find device "nvmf_init_br2" 00:09:56.546 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@167 -- # true 00:09:56.546 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@168 -- # ip link set nvmf_tgt_br down 00:09:56.546 Cannot find device "nvmf_tgt_br" 00:09:56.546 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@168 -- # true 00:09:56.546 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@169 -- # ip link set nvmf_tgt_br2 down 00:09:56.546 Cannot find device "nvmf_tgt_br2" 00:09:56.546 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@169 -- # true 00:09:56.546 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@170 -- # ip link delete nvmf_br type bridge 00:09:56.546 Cannot find device "nvmf_br" 00:09:56.546 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@170 -- # true 00:09:56.546 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@171 -- # ip link delete nvmf_init_if 00:09:56.546 Cannot find device "nvmf_init_if" 00:09:56.546 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@171 -- # true 00:09:56.546 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@172 -- # ip link delete nvmf_init_if2 00:09:56.546 Cannot find device "nvmf_init_if2" 00:09:56.546 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@172 -- # true 00:09:56.546 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@173 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:09:56.546 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:09:56.546 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@173 -- # true 00:09:56.546 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@174 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:09:56.546 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:09:56.546 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@174 -- # true 00:09:56.546 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@177 -- # ip netns add nvmf_tgt_ns_spdk 00:09:56.546 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@180 -- # ip link add nvmf_init_if type veth peer name nvmf_init_br 00:09:56.546 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@181 -- # ip link add nvmf_init_if2 type veth peer name nvmf_init_br2 00:09:56.546 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@182 -- # ip link add nvmf_tgt_if type veth peer name nvmf_tgt_br 00:09:56.546 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@183 -- # ip link add nvmf_tgt_if2 type veth peer name nvmf_tgt_br2 00:09:56.546 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@186 -- # ip link set nvmf_tgt_if netns nvmf_tgt_ns_spdk 00:09:56.546 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@187 -- # ip link set nvmf_tgt_if2 netns nvmf_tgt_ns_spdk 00:09:56.546 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@190 -- # ip addr add 10.0.0.1/24 dev nvmf_init_if 00:09:56.546 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@191 -- # ip addr add 10.0.0.2/24 dev nvmf_init_if2 00:09:56.546 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@192 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.3/24 dev nvmf_tgt_if 00:09:56.546 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@193 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.4/24 dev nvmf_tgt_if2 00:09:56.546 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@196 -- # ip link set nvmf_init_if up 00:09:56.546 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@197 -- # ip link set nvmf_init_if2 up 00:09:56.546 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@198 -- # ip link set nvmf_init_br up 00:09:56.546 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@199 -- # ip link set nvmf_init_br2 up 00:09:56.546 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@200 -- # ip link set nvmf_tgt_br up 00:09:56.546 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@201 -- # ip link set nvmf_tgt_br2 up 00:09:56.546 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@202 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if up 00:09:56.546 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@203 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if2 up 00:09:56.546 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@204 -- # ip netns exec nvmf_tgt_ns_spdk ip link set lo up 00:09:56.546 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@207 -- # ip link add nvmf_br type bridge 00:09:56.546 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@208 -- # ip link set nvmf_br up 00:09:56.546 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@211 -- # ip link set nvmf_init_br master nvmf_br 00:09:56.546 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@212 -- # ip link set nvmf_init_br2 master nvmf_br 00:09:56.546 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@213 -- # ip link set nvmf_tgt_br master nvmf_br 00:09:56.546 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@214 -- # ip link set nvmf_tgt_br2 master nvmf_br 00:09:56.546 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@217 -- # ipts -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT 00:09:56.546 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT' 00:09:56.546 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@218 -- # ipts -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT 00:09:56.546 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT' 00:09:56.546 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@219 -- # ipts -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT 00:09:56.546 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@788 -- # iptables -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT -m comment --comment 'SPDK_NVMF:-A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT' 00:09:56.546 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@222 -- # ping -c 1 10.0.0.3 00:09:56.546 PING 10.0.0.3 (10.0.0.3) 56(84) bytes of data. 00:09:56.546 64 bytes from 10.0.0.3: icmp_seq=1 ttl=64 time=0.095 ms 00:09:56.546 00:09:56.546 --- 10.0.0.3 ping statistics --- 00:09:56.546 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:09:56.546 rtt min/avg/max/mdev = 0.095/0.095/0.095/0.000 ms 00:09:56.546 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@223 -- # ping -c 1 10.0.0.4 00:09:56.546 PING 10.0.0.4 (10.0.0.4) 56(84) bytes of data. 00:09:56.546 64 bytes from 10.0.0.4: icmp_seq=1 ttl=64 time=0.072 ms 00:09:56.546 00:09:56.546 --- 10.0.0.4 ping statistics --- 00:09:56.546 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:09:56.546 rtt min/avg/max/mdev = 0.072/0.072/0.072/0.000 ms 00:09:56.546 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@224 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.1 00:09:56.546 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:09:56.546 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.038 ms 00:09:56.546 00:09:56.546 --- 10.0.0.1 ping statistics --- 00:09:56.546 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:09:56.546 rtt min/avg/max/mdev = 0.038/0.038/0.038/0.000 ms 00:09:56.546 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@225 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.2 00:09:56.546 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:09:56.546 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.065 ms 00:09:56.546 00:09:56.546 --- 10.0.0.2 ping statistics --- 00:09:56.546 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:09:56.546 rtt min/avg/max/mdev = 0.065/0.065/0.065/0.000 ms 00:09:56.546 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@227 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:09:56.546 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@459 -- # return 0 00:09:56.546 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:09:56.546 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:09:56.547 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:09:56.547 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:09:56.547 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:09:56.547 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:09:56.547 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:09:56.547 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- target/filesystem.sh@105 -- # run_test nvmf_filesystem_no_in_capsule nvmf_filesystem_part 0 00:09:56.547 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:09:56.547 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@1107 -- # xtrace_disable 00:09:56.547 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@10 -- # set +x 00:09:56.547 ************************************ 00:09:56.547 START TEST nvmf_filesystem_no_in_capsule 00:09:56.547 ************************************ 00:09:56.547 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@1125 -- # nvmf_filesystem_part 0 00:09:56.547 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- target/filesystem.sh@47 -- # in_capsule=0 00:09:56.547 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- target/filesystem.sh@49 -- # nvmfappstart -m 0xF 00:09:56.547 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:09:56.547 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@724 -- # xtrace_disable 00:09:56.547 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@10 -- # set +x 00:09:56.547 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- nvmf/common.sh@507 -- # nvmfpid=71817 00:09:56.547 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- nvmf/common.sh@506 -- # ip netns exec nvmf_tgt_ns_spdk /home/vagrant/spdk_repo/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:09:56.547 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- nvmf/common.sh@508 -- # waitforlisten 71817 00:09:56.547 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@831 -- # '[' -z 71817 ']' 00:09:56.547 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:09:56.547 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@836 -- # local max_retries=100 00:09:56.547 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:09:56.547 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:09:56.547 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@840 -- # xtrace_disable 00:09:56.547 11:20:37 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@10 -- # set +x 00:09:56.547 [2024-10-07 11:20:37.935235] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:09:56.547 [2024-10-07 11:20:37.935361] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:09:56.547 [2024-10-07 11:20:38.079337] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 4 00:09:56.810 [2024-10-07 11:20:38.253211] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:09:56.810 [2024-10-07 11:20:38.253306] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:09:56.810 [2024-10-07 11:20:38.253320] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:09:56.810 [2024-10-07 11:20:38.253331] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:09:56.810 [2024-10-07 11:20:38.253340] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:09:56.810 [2024-10-07 11:20:38.255071] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:09:56.810 [2024-10-07 11:20:38.255237] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:09:56.810 [2024-10-07 11:20:38.255296] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 3 00:09:56.810 [2024-10-07 11:20:38.255451] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:09:57.749 11:20:39 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:09:57.749 11:20:39 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@864 -- # return 0 00:09:57.749 11:20:39 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:09:57.749 11:20:39 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@730 -- # xtrace_disable 00:09:57.749 11:20:39 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@10 -- # set +x 00:09:57.749 11:20:39 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:09:57.749 11:20:39 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- target/filesystem.sh@50 -- # malloc_name=Malloc1 00:09:57.749 11:20:39 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- target/filesystem.sh@52 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 0 00:09:57.749 11:20:39 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:57.749 11:20:39 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@10 -- # set +x 00:09:57.749 [2024-10-07 11:20:39.145845] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:09:57.749 11:20:39 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:57.749 11:20:39 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- target/filesystem.sh@53 -- # rpc_cmd bdev_malloc_create 512 512 -b Malloc1 00:09:57.749 11:20:39 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:57.749 11:20:39 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@10 -- # set +x 00:09:57.749 Malloc1 00:09:57.750 11:20:39 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:57.750 11:20:39 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- target/filesystem.sh@54 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:09:57.750 11:20:39 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:57.750 11:20:39 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@10 -- # set +x 00:09:57.750 11:20:39 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:57.750 11:20:39 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- target/filesystem.sh@55 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:09:57.750 11:20:39 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:57.750 11:20:39 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@10 -- # set +x 00:09:57.750 11:20:39 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:57.750 11:20:39 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- target/filesystem.sh@56 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4420 00:09:57.750 11:20:39 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:57.750 11:20:39 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@10 -- # set +x 00:09:57.750 [2024-10-07 11:20:39.373002] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:09:57.750 11:20:39 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:57.750 11:20:39 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- target/filesystem.sh@58 -- # get_bdev_size Malloc1 00:09:57.750 11:20:39 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@1378 -- # local bdev_name=Malloc1 00:09:57.750 11:20:39 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@1379 -- # local bdev_info 00:09:57.750 11:20:39 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@1380 -- # local bs 00:09:57.750 11:20:39 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@1381 -- # local nb 00:09:57.750 11:20:39 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@1382 -- # rpc_cmd bdev_get_bdevs -b Malloc1 00:09:57.750 11:20:39 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:57.750 11:20:39 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@10 -- # set +x 00:09:57.750 11:20:39 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:57.750 11:20:39 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@1382 -- # bdev_info='[ 00:09:57.750 { 00:09:57.750 "aliases": [ 00:09:57.750 "00c6f2fc-3c23-4c84-8ce8-c602c875f82b" 00:09:57.750 ], 00:09:57.750 "assigned_rate_limits": { 00:09:57.750 "r_mbytes_per_sec": 0, 00:09:57.750 "rw_ios_per_sec": 0, 00:09:57.750 "rw_mbytes_per_sec": 0, 00:09:57.750 "w_mbytes_per_sec": 0 00:09:57.750 }, 00:09:57.750 "block_size": 512, 00:09:57.750 "claim_type": "exclusive_write", 00:09:57.750 "claimed": true, 00:09:57.750 "driver_specific": {}, 00:09:57.750 "memory_domains": [ 00:09:57.750 { 00:09:57.750 "dma_device_id": "system", 00:09:57.750 "dma_device_type": 1 00:09:57.750 }, 00:09:57.750 { 00:09:57.750 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:09:57.750 "dma_device_type": 2 00:09:57.750 } 00:09:57.750 ], 00:09:57.750 "name": "Malloc1", 00:09:57.750 "num_blocks": 1048576, 00:09:57.750 "product_name": "Malloc disk", 00:09:57.750 "supported_io_types": { 00:09:57.750 "abort": true, 00:09:57.750 "compare": false, 00:09:57.750 "compare_and_write": false, 00:09:57.750 "copy": true, 00:09:57.750 "flush": true, 00:09:57.750 "get_zone_info": false, 00:09:57.750 "nvme_admin": false, 00:09:57.750 "nvme_io": false, 00:09:57.750 "nvme_io_md": false, 00:09:57.750 "nvme_iov_md": false, 00:09:57.750 "read": true, 00:09:57.750 "reset": true, 00:09:57.750 "seek_data": false, 00:09:57.750 "seek_hole": false, 00:09:57.750 "unmap": true, 00:09:57.750 "write": true, 00:09:57.750 "write_zeroes": true, 00:09:57.750 "zcopy": true, 00:09:57.750 "zone_append": false, 00:09:57.750 "zone_management": false 00:09:57.750 }, 00:09:57.750 "uuid": "00c6f2fc-3c23-4c84-8ce8-c602c875f82b", 00:09:57.750 "zoned": false 00:09:57.750 } 00:09:57.750 ]' 00:09:57.750 11:20:39 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@1383 -- # jq '.[] .block_size' 00:09:57.750 11:20:39 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@1383 -- # bs=512 00:09:57.750 11:20:39 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@1384 -- # jq '.[] .num_blocks' 00:09:58.009 11:20:39 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@1384 -- # nb=1048576 00:09:58.009 11:20:39 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@1387 -- # bdev_size=512 00:09:58.009 11:20:39 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@1388 -- # echo 512 00:09:58.009 11:20:39 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- target/filesystem.sh@58 -- # malloc_size=536870912 00:09:58.009 11:20:39 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- target/filesystem.sh@60 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --hostid=3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.3 -s 4420 00:09:58.009 11:20:39 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- target/filesystem.sh@62 -- # waitforserial SPDKISFASTANDAWESOME 00:09:58.009 11:20:39 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@1198 -- # local i=0 00:09:58.009 11:20:39 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@1199 -- # local nvme_device_counter=1 nvme_devices=0 00:09:58.009 11:20:39 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@1200 -- # [[ -n '' ]] 00:09:58.009 11:20:39 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@1205 -- # sleep 2 00:10:00.542 11:20:41 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@1206 -- # (( i++ <= 15 )) 00:10:00.542 11:20:41 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@1207 -- # lsblk -l -o NAME,SERIAL 00:10:00.542 11:20:41 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@1207 -- # grep -c SPDKISFASTANDAWESOME 00:10:00.542 11:20:41 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@1207 -- # nvme_devices=1 00:10:00.542 11:20:41 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@1208 -- # (( nvme_devices == nvme_device_counter )) 00:10:00.542 11:20:41 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@1208 -- # return 0 00:10:00.542 11:20:41 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- target/filesystem.sh@63 -- # lsblk -l -o NAME,SERIAL 00:10:00.542 11:20:41 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- target/filesystem.sh@63 -- # grep -oP '([\w]*)(?=\s+SPDKISFASTANDAWESOME)' 00:10:00.542 11:20:41 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- target/filesystem.sh@63 -- # nvme_name=nvme0n1 00:10:00.542 11:20:41 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- target/filesystem.sh@64 -- # sec_size_to_bytes nvme0n1 00:10:00.542 11:20:41 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- setup/common.sh@76 -- # local dev=nvme0n1 00:10:00.542 11:20:41 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:10:00.542 11:20:41 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- setup/common.sh@80 -- # echo 536870912 00:10:00.542 11:20:41 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- target/filesystem.sh@64 -- # nvme_size=536870912 00:10:00.542 11:20:41 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- target/filesystem.sh@66 -- # mkdir -p /mnt/device 00:10:00.542 11:20:41 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- target/filesystem.sh@67 -- # (( nvme_size == malloc_size )) 00:10:00.542 11:20:41 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- target/filesystem.sh@68 -- # parted -s /dev/nvme0n1 mklabel gpt mkpart SPDK_TEST 0% 100% 00:10:00.542 11:20:41 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- target/filesystem.sh@69 -- # partprobe 00:10:00.542 11:20:41 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- target/filesystem.sh@70 -- # sleep 1 00:10:01.537 11:20:42 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- target/filesystem.sh@76 -- # '[' 0 -eq 0 ']' 00:10:01.537 11:20:42 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- target/filesystem.sh@77 -- # run_test filesystem_ext4 nvmf_filesystem_create ext4 nvme0n1 00:10:01.537 11:20:42 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@1101 -- # '[' 4 -le 1 ']' 00:10:01.537 11:20:42 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@1107 -- # xtrace_disable 00:10:01.537 11:20:42 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@10 -- # set +x 00:10:01.537 ************************************ 00:10:01.537 START TEST filesystem_ext4 00:10:01.537 ************************************ 00:10:01.537 11:20:42 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_ext4 -- common/autotest_common.sh@1125 -- # nvmf_filesystem_create ext4 nvme0n1 00:10:01.537 11:20:42 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_ext4 -- target/filesystem.sh@18 -- # fstype=ext4 00:10:01.537 11:20:42 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_ext4 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:10:01.537 11:20:42 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_ext4 -- target/filesystem.sh@21 -- # make_filesystem ext4 /dev/nvme0n1p1 00:10:01.537 11:20:42 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_ext4 -- common/autotest_common.sh@926 -- # local fstype=ext4 00:10:01.537 11:20:42 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_ext4 -- common/autotest_common.sh@927 -- # local dev_name=/dev/nvme0n1p1 00:10:01.537 11:20:42 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_ext4 -- common/autotest_common.sh@928 -- # local i=0 00:10:01.537 11:20:42 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_ext4 -- common/autotest_common.sh@929 -- # local force 00:10:01.537 11:20:42 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_ext4 -- common/autotest_common.sh@931 -- # '[' ext4 = ext4 ']' 00:10:01.537 11:20:42 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_ext4 -- common/autotest_common.sh@932 -- # force=-F 00:10:01.537 11:20:42 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_ext4 -- common/autotest_common.sh@937 -- # mkfs.ext4 -F /dev/nvme0n1p1 00:10:01.537 mke2fs 1.47.0 (5-Feb-2023) 00:10:01.537 Discarding device blocks: 0/522240 done 00:10:01.537 Creating filesystem with 522240 1k blocks and 130560 inodes 00:10:01.537 Filesystem UUID: 00c8bc40-183d-424e-a5bf-985d179bb0d4 00:10:01.537 Superblock backups stored on blocks: 00:10:01.537 8193, 24577, 40961, 57345, 73729, 204801, 221185, 401409 00:10:01.537 00:10:01.537 Allocating group tables: 0/64 done 00:10:01.537 Writing inode tables: 0/64 done 00:10:01.537 Creating journal (8192 blocks): done 00:10:01.537 Writing superblocks and filesystem accounting information: 0/64 done 00:10:01.537 00:10:01.537 11:20:43 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_ext4 -- common/autotest_common.sh@945 -- # return 0 00:10:01.537 11:20:43 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_ext4 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:10:06.805 11:20:48 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_ext4 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:10:06.805 11:20:48 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_ext4 -- target/filesystem.sh@25 -- # sync 00:10:07.063 11:20:48 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_ext4 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:10:07.063 11:20:48 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_ext4 -- target/filesystem.sh@27 -- # sync 00:10:07.063 11:20:48 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_ext4 -- target/filesystem.sh@29 -- # i=0 00:10:07.063 11:20:48 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_ext4 -- target/filesystem.sh@30 -- # umount /mnt/device 00:10:07.063 11:20:48 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_ext4 -- target/filesystem.sh@37 -- # kill -0 71817 00:10:07.063 11:20:48 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_ext4 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:10:07.063 11:20:48 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_ext4 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:10:07.063 11:20:48 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_ext4 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:10:07.063 11:20:48 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_ext4 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:10:07.063 00:10:07.063 real 0m5.674s 00:10:07.063 user 0m0.032s 00:10:07.063 sys 0m0.053s 00:10:07.064 11:20:48 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_ext4 -- common/autotest_common.sh@1126 -- # xtrace_disable 00:10:07.064 11:20:48 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_ext4 -- common/autotest_common.sh@10 -- # set +x 00:10:07.064 ************************************ 00:10:07.064 END TEST filesystem_ext4 00:10:07.064 ************************************ 00:10:07.064 11:20:48 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- target/filesystem.sh@78 -- # run_test filesystem_btrfs nvmf_filesystem_create btrfs nvme0n1 00:10:07.064 11:20:48 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@1101 -- # '[' 4 -le 1 ']' 00:10:07.064 11:20:48 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@1107 -- # xtrace_disable 00:10:07.064 11:20:48 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@10 -- # set +x 00:10:07.064 ************************************ 00:10:07.064 START TEST filesystem_btrfs 00:10:07.064 ************************************ 00:10:07.064 11:20:48 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_btrfs -- common/autotest_common.sh@1125 -- # nvmf_filesystem_create btrfs nvme0n1 00:10:07.064 11:20:48 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_btrfs -- target/filesystem.sh@18 -- # fstype=btrfs 00:10:07.064 11:20:48 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_btrfs -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:10:07.064 11:20:48 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_btrfs -- target/filesystem.sh@21 -- # make_filesystem btrfs /dev/nvme0n1p1 00:10:07.064 11:20:48 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_btrfs -- common/autotest_common.sh@926 -- # local fstype=btrfs 00:10:07.064 11:20:48 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_btrfs -- common/autotest_common.sh@927 -- # local dev_name=/dev/nvme0n1p1 00:10:07.064 11:20:48 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_btrfs -- common/autotest_common.sh@928 -- # local i=0 00:10:07.064 11:20:48 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_btrfs -- common/autotest_common.sh@929 -- # local force 00:10:07.064 11:20:48 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_btrfs -- common/autotest_common.sh@931 -- # '[' btrfs = ext4 ']' 00:10:07.064 11:20:48 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_btrfs -- common/autotest_common.sh@934 -- # force=-f 00:10:07.064 11:20:48 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_btrfs -- common/autotest_common.sh@937 -- # mkfs.btrfs -f /dev/nvme0n1p1 00:10:07.322 btrfs-progs v6.8.1 00:10:07.322 See https://btrfs.readthedocs.io for more information. 00:10:07.322 00:10:07.322 Performing full device TRIM /dev/nvme0n1p1 (510.00MiB) ... 00:10:07.322 NOTE: several default settings have changed in version 5.15, please make sure 00:10:07.322 this does not affect your deployments: 00:10:07.322 - DUP for metadata (-m dup) 00:10:07.322 - enabled no-holes (-O no-holes) 00:10:07.322 - enabled free-space-tree (-R free-space-tree) 00:10:07.322 00:10:07.322 Label: (null) 00:10:07.322 UUID: d69a99dc-47f8-41f1-afb7-e89abf08f965 00:10:07.322 Node size: 16384 00:10:07.322 Sector size: 4096 (CPU page size: 4096) 00:10:07.322 Filesystem size: 510.00MiB 00:10:07.322 Block group profiles: 00:10:07.322 Data: single 8.00MiB 00:10:07.322 Metadata: DUP 32.00MiB 00:10:07.322 System: DUP 8.00MiB 00:10:07.322 SSD detected: yes 00:10:07.322 Zoned device: no 00:10:07.322 Features: extref, skinny-metadata, no-holes, free-space-tree 00:10:07.322 Checksum: crc32c 00:10:07.322 Number of devices: 1 00:10:07.322 Devices: 00:10:07.322 ID SIZE PATH 00:10:07.322 1 510.00MiB /dev/nvme0n1p1 00:10:07.322 00:10:07.322 11:20:48 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_btrfs -- common/autotest_common.sh@945 -- # return 0 00:10:07.322 11:20:48 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_btrfs -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:10:07.322 11:20:48 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_btrfs -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:10:07.322 11:20:48 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_btrfs -- target/filesystem.sh@25 -- # sync 00:10:07.322 11:20:48 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_btrfs -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:10:07.322 11:20:48 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_btrfs -- target/filesystem.sh@27 -- # sync 00:10:07.322 11:20:48 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_btrfs -- target/filesystem.sh@29 -- # i=0 00:10:07.322 11:20:48 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_btrfs -- target/filesystem.sh@30 -- # umount /mnt/device 00:10:07.322 11:20:48 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_btrfs -- target/filesystem.sh@37 -- # kill -0 71817 00:10:07.322 11:20:48 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_btrfs -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:10:07.322 11:20:48 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_btrfs -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:10:07.322 11:20:48 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_btrfs -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:10:07.322 11:20:48 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_btrfs -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:10:07.322 00:10:07.322 real 0m0.306s 00:10:07.322 user 0m0.019s 00:10:07.322 sys 0m0.061s 00:10:07.322 11:20:48 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_btrfs -- common/autotest_common.sh@1126 -- # xtrace_disable 00:10:07.322 11:20:48 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_btrfs -- common/autotest_common.sh@10 -- # set +x 00:10:07.322 ************************************ 00:10:07.322 END TEST filesystem_btrfs 00:10:07.322 ************************************ 00:10:07.322 11:20:48 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- target/filesystem.sh@79 -- # run_test filesystem_xfs nvmf_filesystem_create xfs nvme0n1 00:10:07.322 11:20:48 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@1101 -- # '[' 4 -le 1 ']' 00:10:07.322 11:20:48 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@1107 -- # xtrace_disable 00:10:07.322 11:20:48 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@10 -- # set +x 00:10:07.322 ************************************ 00:10:07.322 START TEST filesystem_xfs 00:10:07.322 ************************************ 00:10:07.322 11:20:48 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_xfs -- common/autotest_common.sh@1125 -- # nvmf_filesystem_create xfs nvme0n1 00:10:07.322 11:20:48 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_xfs -- target/filesystem.sh@18 -- # fstype=xfs 00:10:07.322 11:20:48 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_xfs -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:10:07.323 11:20:48 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_xfs -- target/filesystem.sh@21 -- # make_filesystem xfs /dev/nvme0n1p1 00:10:07.323 11:20:48 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_xfs -- common/autotest_common.sh@926 -- # local fstype=xfs 00:10:07.323 11:20:48 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_xfs -- common/autotest_common.sh@927 -- # local dev_name=/dev/nvme0n1p1 00:10:07.323 11:20:48 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_xfs -- common/autotest_common.sh@928 -- # local i=0 00:10:07.323 11:20:48 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_xfs -- common/autotest_common.sh@929 -- # local force 00:10:07.323 11:20:48 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_xfs -- common/autotest_common.sh@931 -- # '[' xfs = ext4 ']' 00:10:07.323 11:20:48 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_xfs -- common/autotest_common.sh@934 -- # force=-f 00:10:07.323 11:20:48 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_xfs -- common/autotest_common.sh@937 -- # mkfs.xfs -f /dev/nvme0n1p1 00:10:07.580 meta-data=/dev/nvme0n1p1 isize=512 agcount=4, agsize=32640 blks 00:10:07.580 = sectsz=512 attr=2, projid32bit=1 00:10:07.580 = crc=1 finobt=1, sparse=1, rmapbt=0 00:10:07.580 = reflink=1 bigtime=1 inobtcount=1 nrext64=0 00:10:07.580 data = bsize=4096 blocks=130560, imaxpct=25 00:10:07.580 = sunit=0 swidth=0 blks 00:10:07.580 naming =version 2 bsize=4096 ascii-ci=0, ftype=1 00:10:07.580 log =internal log bsize=4096 blocks=16384, version=2 00:10:07.580 = sectsz=512 sunit=0 blks, lazy-count=1 00:10:07.580 realtime =none extsz=4096 blocks=0, rtextents=0 00:10:08.146 Discarding blocks...Done. 00:10:08.146 11:20:49 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_xfs -- common/autotest_common.sh@945 -- # return 0 00:10:08.146 11:20:49 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_xfs -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:10:10.671 11:20:52 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_xfs -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:10:10.671 11:20:52 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_xfs -- target/filesystem.sh@25 -- # sync 00:10:10.671 11:20:52 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_xfs -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:10:10.671 11:20:52 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_xfs -- target/filesystem.sh@27 -- # sync 00:10:10.671 11:20:52 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_xfs -- target/filesystem.sh@29 -- # i=0 00:10:10.671 11:20:52 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_xfs -- target/filesystem.sh@30 -- # umount /mnt/device 00:10:10.671 11:20:52 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_xfs -- target/filesystem.sh@37 -- # kill -0 71817 00:10:10.671 11:20:52 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_xfs -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:10:10.671 11:20:52 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_xfs -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:10:10.671 11:20:52 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_xfs -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:10:10.671 11:20:52 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_xfs -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:10:10.671 00:10:10.671 real 0m3.185s 00:10:10.671 user 0m0.023s 00:10:10.671 sys 0m0.062s 00:10:10.671 11:20:52 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_xfs -- common/autotest_common.sh@1126 -- # xtrace_disable 00:10:10.671 11:20:52 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule.filesystem_xfs -- common/autotest_common.sh@10 -- # set +x 00:10:10.671 ************************************ 00:10:10.671 END TEST filesystem_xfs 00:10:10.671 ************************************ 00:10:10.671 11:20:52 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- target/filesystem.sh@91 -- # flock /dev/nvme0n1 parted -s /dev/nvme0n1 rm 1 00:10:10.671 11:20:52 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- target/filesystem.sh@93 -- # sync 00:10:10.671 11:20:52 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- target/filesystem.sh@94 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:10:10.672 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:10.672 11:20:52 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- target/filesystem.sh@95 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:10:10.672 11:20:52 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@1219 -- # local i=0 00:10:10.672 11:20:52 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@1220 -- # lsblk -o NAME,SERIAL 00:10:10.672 11:20:52 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@1220 -- # grep -q -w SPDKISFASTANDAWESOME 00:10:10.672 11:20:52 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@1227 -- # lsblk -l -o NAME,SERIAL 00:10:10.672 11:20:52 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@1227 -- # grep -q -w SPDKISFASTANDAWESOME 00:10:10.672 11:20:52 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@1231 -- # return 0 00:10:10.672 11:20:52 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- target/filesystem.sh@97 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:10:10.672 11:20:52 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@561 -- # xtrace_disable 00:10:10.672 11:20:52 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@10 -- # set +x 00:10:10.672 11:20:52 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:10:10.672 11:20:52 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- target/filesystem.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:10:10.672 11:20:52 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- target/filesystem.sh@101 -- # killprocess 71817 00:10:10.672 11:20:52 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@950 -- # '[' -z 71817 ']' 00:10:10.672 11:20:52 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@954 -- # kill -0 71817 00:10:10.672 11:20:52 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@955 -- # uname 00:10:10.672 11:20:52 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:10:10.672 11:20:52 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 71817 00:10:10.672 11:20:52 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:10:10.672 killing process with pid 71817 00:10:10.672 11:20:52 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:10:10.672 11:20:52 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@968 -- # echo 'killing process with pid 71817' 00:10:10.672 11:20:52 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@969 -- # kill 71817 00:10:10.672 11:20:52 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@974 -- # wait 71817 00:10:11.605 11:20:52 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- target/filesystem.sh@102 -- # nvmfpid= 00:10:11.605 00:10:11.605 real 0m15.118s 00:10:11.605 user 0m57.523s 00:10:11.605 sys 0m2.156s 00:10:11.605 11:20:52 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@1126 -- # xtrace_disable 00:10:11.605 11:20:52 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_no_in_capsule -- common/autotest_common.sh@10 -- # set +x 00:10:11.605 ************************************ 00:10:11.605 END TEST nvmf_filesystem_no_in_capsule 00:10:11.605 ************************************ 00:10:11.605 11:20:53 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- target/filesystem.sh@106 -- # run_test nvmf_filesystem_in_capsule nvmf_filesystem_part 4096 00:10:11.605 11:20:53 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:10:11.605 11:20:53 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@1107 -- # xtrace_disable 00:10:11.605 11:20:53 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@10 -- # set +x 00:10:11.605 ************************************ 00:10:11.605 START TEST nvmf_filesystem_in_capsule 00:10:11.605 ************************************ 00:10:11.605 11:20:53 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@1125 -- # nvmf_filesystem_part 4096 00:10:11.605 11:20:53 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- target/filesystem.sh@47 -- # in_capsule=4096 00:10:11.606 11:20:53 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- target/filesystem.sh@49 -- # nvmfappstart -m 0xF 00:10:11.606 11:20:53 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:10:11.606 11:20:53 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@724 -- # xtrace_disable 00:10:11.606 11:20:53 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@10 -- # set +x 00:10:11.606 11:20:53 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- nvmf/common.sh@507 -- # nvmfpid=72195 00:10:11.606 11:20:53 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- nvmf/common.sh@508 -- # waitforlisten 72195 00:10:11.606 11:20:53 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@831 -- # '[' -z 72195 ']' 00:10:11.606 11:20:53 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- nvmf/common.sh@506 -- # ip netns exec nvmf_tgt_ns_spdk /home/vagrant/spdk_repo/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:10:11.606 11:20:53 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:10:11.606 11:20:53 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@836 -- # local max_retries=100 00:10:11.606 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:10:11.606 11:20:53 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:10:11.606 11:20:53 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@840 -- # xtrace_disable 00:10:11.606 11:20:53 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@10 -- # set +x 00:10:11.606 [2024-10-07 11:20:53.109328] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:10:11.606 [2024-10-07 11:20:53.109514] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:10:11.606 [2024-10-07 11:20:53.255802] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 4 00:10:11.864 [2024-10-07 11:20:53.405463] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:10:11.864 [2024-10-07 11:20:53.405549] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:10:11.864 [2024-10-07 11:20:53.405561] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:10:11.864 [2024-10-07 11:20:53.405570] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:10:11.864 [2024-10-07 11:20:53.405578] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:10:11.864 [2024-10-07 11:20:53.407088] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:10:11.864 [2024-10-07 11:20:53.407235] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:10:11.864 [2024-10-07 11:20:53.407335] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 3 00:10:11.864 [2024-10-07 11:20:53.407427] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:10:12.427 11:20:54 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:10:12.427 11:20:54 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@864 -- # return 0 00:10:12.427 11:20:54 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:10:12.427 11:20:54 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@730 -- # xtrace_disable 00:10:12.427 11:20:54 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@10 -- # set +x 00:10:12.685 11:20:54 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:10:12.685 11:20:54 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- target/filesystem.sh@50 -- # malloc_name=Malloc1 00:10:12.685 11:20:54 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- target/filesystem.sh@52 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 4096 00:10:12.685 11:20:54 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@561 -- # xtrace_disable 00:10:12.685 11:20:54 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@10 -- # set +x 00:10:12.685 [2024-10-07 11:20:54.166157] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:10:12.685 11:20:54 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:10:12.685 11:20:54 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- target/filesystem.sh@53 -- # rpc_cmd bdev_malloc_create 512 512 -b Malloc1 00:10:12.685 11:20:54 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@561 -- # xtrace_disable 00:10:12.685 11:20:54 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@10 -- # set +x 00:10:12.685 Malloc1 00:10:12.685 11:20:54 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:10:12.685 11:20:54 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- target/filesystem.sh@54 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:10:12.685 11:20:54 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@561 -- # xtrace_disable 00:10:12.685 11:20:54 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@10 -- # set +x 00:10:12.685 11:20:54 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:10:12.685 11:20:54 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- target/filesystem.sh@55 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:10:12.685 11:20:54 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@561 -- # xtrace_disable 00:10:12.685 11:20:54 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@10 -- # set +x 00:10:12.685 11:20:54 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:10:12.685 11:20:54 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- target/filesystem.sh@56 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4420 00:10:12.685 11:20:54 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@561 -- # xtrace_disable 00:10:12.685 11:20:54 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@10 -- # set +x 00:10:12.952 [2024-10-07 11:20:54.396447] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:10:12.952 11:20:54 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:10:12.952 11:20:54 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- target/filesystem.sh@58 -- # get_bdev_size Malloc1 00:10:12.952 11:20:54 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@1378 -- # local bdev_name=Malloc1 00:10:12.952 11:20:54 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@1379 -- # local bdev_info 00:10:12.952 11:20:54 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@1380 -- # local bs 00:10:12.952 11:20:54 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@1381 -- # local nb 00:10:12.952 11:20:54 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@1382 -- # rpc_cmd bdev_get_bdevs -b Malloc1 00:10:12.952 11:20:54 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@561 -- # xtrace_disable 00:10:12.952 11:20:54 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@10 -- # set +x 00:10:12.952 11:20:54 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:10:12.952 11:20:54 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@1382 -- # bdev_info='[ 00:10:12.952 { 00:10:12.952 "aliases": [ 00:10:12.952 "d59f3d95-efae-446a-b6be-af205633b0d8" 00:10:12.952 ], 00:10:12.952 "assigned_rate_limits": { 00:10:12.952 "r_mbytes_per_sec": 0, 00:10:12.952 "rw_ios_per_sec": 0, 00:10:12.952 "rw_mbytes_per_sec": 0, 00:10:12.952 "w_mbytes_per_sec": 0 00:10:12.952 }, 00:10:12.952 "block_size": 512, 00:10:12.952 "claim_type": "exclusive_write", 00:10:12.952 "claimed": true, 00:10:12.952 "driver_specific": {}, 00:10:12.952 "memory_domains": [ 00:10:12.952 { 00:10:12.952 "dma_device_id": "system", 00:10:12.952 "dma_device_type": 1 00:10:12.952 }, 00:10:12.952 { 00:10:12.952 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:10:12.952 "dma_device_type": 2 00:10:12.952 } 00:10:12.952 ], 00:10:12.952 "name": "Malloc1", 00:10:12.952 "num_blocks": 1048576, 00:10:12.952 "product_name": "Malloc disk", 00:10:12.952 "supported_io_types": { 00:10:12.952 "abort": true, 00:10:12.952 "compare": false, 00:10:12.952 "compare_and_write": false, 00:10:12.952 "copy": true, 00:10:12.952 "flush": true, 00:10:12.952 "get_zone_info": false, 00:10:12.952 "nvme_admin": false, 00:10:12.952 "nvme_io": false, 00:10:12.952 "nvme_io_md": false, 00:10:12.952 "nvme_iov_md": false, 00:10:12.952 "read": true, 00:10:12.952 "reset": true, 00:10:12.952 "seek_data": false, 00:10:12.952 "seek_hole": false, 00:10:12.952 "unmap": true, 00:10:12.952 "write": true, 00:10:12.952 "write_zeroes": true, 00:10:12.952 "zcopy": true, 00:10:12.952 "zone_append": false, 00:10:12.952 "zone_management": false 00:10:12.952 }, 00:10:12.952 "uuid": "d59f3d95-efae-446a-b6be-af205633b0d8", 00:10:12.952 "zoned": false 00:10:12.952 } 00:10:12.952 ]' 00:10:12.952 11:20:54 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@1383 -- # jq '.[] .block_size' 00:10:12.952 11:20:54 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@1383 -- # bs=512 00:10:12.952 11:20:54 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@1384 -- # jq '.[] .num_blocks' 00:10:12.952 11:20:54 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@1384 -- # nb=1048576 00:10:12.952 11:20:54 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@1387 -- # bdev_size=512 00:10:12.952 11:20:54 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@1388 -- # echo 512 00:10:12.952 11:20:54 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- target/filesystem.sh@58 -- # malloc_size=536870912 00:10:12.952 11:20:54 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- target/filesystem.sh@60 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --hostid=3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.3 -s 4420 00:10:13.210 11:20:54 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- target/filesystem.sh@62 -- # waitforserial SPDKISFASTANDAWESOME 00:10:13.210 11:20:54 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@1198 -- # local i=0 00:10:13.210 11:20:54 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@1199 -- # local nvme_device_counter=1 nvme_devices=0 00:10:13.210 11:20:54 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@1200 -- # [[ -n '' ]] 00:10:13.210 11:20:54 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@1205 -- # sleep 2 00:10:15.112 11:20:56 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@1206 -- # (( i++ <= 15 )) 00:10:15.112 11:20:56 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@1207 -- # lsblk -l -o NAME,SERIAL 00:10:15.112 11:20:56 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@1207 -- # grep -c SPDKISFASTANDAWESOME 00:10:15.112 11:20:56 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@1207 -- # nvme_devices=1 00:10:15.112 11:20:56 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@1208 -- # (( nvme_devices == nvme_device_counter )) 00:10:15.112 11:20:56 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@1208 -- # return 0 00:10:15.112 11:20:56 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- target/filesystem.sh@63 -- # lsblk -l -o NAME,SERIAL 00:10:15.112 11:20:56 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- target/filesystem.sh@63 -- # grep -oP '([\w]*)(?=\s+SPDKISFASTANDAWESOME)' 00:10:15.112 11:20:56 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- target/filesystem.sh@63 -- # nvme_name=nvme0n1 00:10:15.112 11:20:56 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- target/filesystem.sh@64 -- # sec_size_to_bytes nvme0n1 00:10:15.112 11:20:56 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- setup/common.sh@76 -- # local dev=nvme0n1 00:10:15.112 11:20:56 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:10:15.112 11:20:56 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- setup/common.sh@80 -- # echo 536870912 00:10:15.112 11:20:56 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- target/filesystem.sh@64 -- # nvme_size=536870912 00:10:15.112 11:20:56 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- target/filesystem.sh@66 -- # mkdir -p /mnt/device 00:10:15.112 11:20:56 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- target/filesystem.sh@67 -- # (( nvme_size == malloc_size )) 00:10:15.112 11:20:56 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- target/filesystem.sh@68 -- # parted -s /dev/nvme0n1 mklabel gpt mkpart SPDK_TEST 0% 100% 00:10:15.112 11:20:56 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- target/filesystem.sh@69 -- # partprobe 00:10:15.112 11:20:56 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- target/filesystem.sh@70 -- # sleep 1 00:10:16.488 11:20:57 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- target/filesystem.sh@76 -- # '[' 4096 -eq 0 ']' 00:10:16.488 11:20:57 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- target/filesystem.sh@81 -- # run_test filesystem_in_capsule_ext4 nvmf_filesystem_create ext4 nvme0n1 00:10:16.488 11:20:57 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@1101 -- # '[' 4 -le 1 ']' 00:10:16.488 11:20:57 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@1107 -- # xtrace_disable 00:10:16.488 11:20:57 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@10 -- # set +x 00:10:16.488 ************************************ 00:10:16.488 START TEST filesystem_in_capsule_ext4 00:10:16.488 ************************************ 00:10:16.488 11:20:57 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_ext4 -- common/autotest_common.sh@1125 -- # nvmf_filesystem_create ext4 nvme0n1 00:10:16.488 11:20:57 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_ext4 -- target/filesystem.sh@18 -- # fstype=ext4 00:10:16.488 11:20:57 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_ext4 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:10:16.488 11:20:57 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_ext4 -- target/filesystem.sh@21 -- # make_filesystem ext4 /dev/nvme0n1p1 00:10:16.488 11:20:57 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_ext4 -- common/autotest_common.sh@926 -- # local fstype=ext4 00:10:16.488 11:20:57 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_ext4 -- common/autotest_common.sh@927 -- # local dev_name=/dev/nvme0n1p1 00:10:16.488 11:20:57 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_ext4 -- common/autotest_common.sh@928 -- # local i=0 00:10:16.488 11:20:57 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_ext4 -- common/autotest_common.sh@929 -- # local force 00:10:16.488 11:20:57 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_ext4 -- common/autotest_common.sh@931 -- # '[' ext4 = ext4 ']' 00:10:16.488 11:20:57 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_ext4 -- common/autotest_common.sh@932 -- # force=-F 00:10:16.488 11:20:57 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_ext4 -- common/autotest_common.sh@937 -- # mkfs.ext4 -F /dev/nvme0n1p1 00:10:16.488 mke2fs 1.47.0 (5-Feb-2023) 00:10:16.488 Discarding device blocks: 0/522240 done 00:10:16.488 Creating filesystem with 522240 1k blocks and 130560 inodes 00:10:16.488 Filesystem UUID: ee084f94-8b85-4e37-a798-f26bb6c6aa00 00:10:16.488 Superblock backups stored on blocks: 00:10:16.488 8193, 24577, 40961, 57345, 73729, 204801, 221185, 401409 00:10:16.488 00:10:16.488 Allocating group tables: 0/64 done 00:10:16.488 Writing inode tables: 0/64 done 00:10:16.488 Creating journal (8192 blocks): done 00:10:16.488 Writing superblocks and filesystem accounting information: 0/64 done 00:10:16.488 00:10:16.488 11:20:58 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_ext4 -- common/autotest_common.sh@945 -- # return 0 00:10:16.488 11:20:58 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_ext4 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:10:21.790 11:21:03 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_ext4 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:10:21.790 11:21:03 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_ext4 -- target/filesystem.sh@25 -- # sync 00:10:21.790 11:21:03 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_ext4 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:10:21.790 11:21:03 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_ext4 -- target/filesystem.sh@27 -- # sync 00:10:21.790 11:21:03 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_ext4 -- target/filesystem.sh@29 -- # i=0 00:10:21.790 11:21:03 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_ext4 -- target/filesystem.sh@30 -- # umount /mnt/device 00:10:21.790 11:21:03 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_ext4 -- target/filesystem.sh@37 -- # kill -0 72195 00:10:21.790 11:21:03 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_ext4 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:10:21.790 11:21:03 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_ext4 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:10:21.790 11:21:03 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_ext4 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:10:21.790 11:21:03 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_ext4 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:10:21.790 00:10:21.790 real 0m5.590s 00:10:21.790 user 0m0.027s 00:10:21.790 sys 0m0.065s 00:10:21.790 11:21:03 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_ext4 -- common/autotest_common.sh@1126 -- # xtrace_disable 00:10:21.790 11:21:03 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_ext4 -- common/autotest_common.sh@10 -- # set +x 00:10:21.790 ************************************ 00:10:21.790 END TEST filesystem_in_capsule_ext4 00:10:21.791 ************************************ 00:10:21.791 11:21:03 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- target/filesystem.sh@82 -- # run_test filesystem_in_capsule_btrfs nvmf_filesystem_create btrfs nvme0n1 00:10:21.791 11:21:03 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@1101 -- # '[' 4 -le 1 ']' 00:10:21.791 11:21:03 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@1107 -- # xtrace_disable 00:10:21.791 11:21:03 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@10 -- # set +x 00:10:21.791 ************************************ 00:10:21.791 START TEST filesystem_in_capsule_btrfs 00:10:21.791 ************************************ 00:10:21.791 11:21:03 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_btrfs -- common/autotest_common.sh@1125 -- # nvmf_filesystem_create btrfs nvme0n1 00:10:21.791 11:21:03 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_btrfs -- target/filesystem.sh@18 -- # fstype=btrfs 00:10:21.791 11:21:03 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_btrfs -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:10:21.791 11:21:03 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_btrfs -- target/filesystem.sh@21 -- # make_filesystem btrfs /dev/nvme0n1p1 00:10:21.791 11:21:03 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_btrfs -- common/autotest_common.sh@926 -- # local fstype=btrfs 00:10:21.791 11:21:03 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_btrfs -- common/autotest_common.sh@927 -- # local dev_name=/dev/nvme0n1p1 00:10:21.791 11:21:03 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_btrfs -- common/autotest_common.sh@928 -- # local i=0 00:10:21.791 11:21:03 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_btrfs -- common/autotest_common.sh@929 -- # local force 00:10:21.791 11:21:03 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_btrfs -- common/autotest_common.sh@931 -- # '[' btrfs = ext4 ']' 00:10:21.791 11:21:03 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_btrfs -- common/autotest_common.sh@934 -- # force=-f 00:10:21.791 11:21:03 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_btrfs -- common/autotest_common.sh@937 -- # mkfs.btrfs -f /dev/nvme0n1p1 00:10:22.049 btrfs-progs v6.8.1 00:10:22.049 See https://btrfs.readthedocs.io for more information. 00:10:22.049 00:10:22.049 Performing full device TRIM /dev/nvme0n1p1 (510.00MiB) ... 00:10:22.049 NOTE: several default settings have changed in version 5.15, please make sure 00:10:22.049 this does not affect your deployments: 00:10:22.049 - DUP for metadata (-m dup) 00:10:22.049 - enabled no-holes (-O no-holes) 00:10:22.049 - enabled free-space-tree (-R free-space-tree) 00:10:22.049 00:10:22.049 Label: (null) 00:10:22.049 UUID: 8f4f8d01-e051-4779-bb77-583eed51c0bf 00:10:22.049 Node size: 16384 00:10:22.049 Sector size: 4096 (CPU page size: 4096) 00:10:22.049 Filesystem size: 510.00MiB 00:10:22.049 Block group profiles: 00:10:22.049 Data: single 8.00MiB 00:10:22.049 Metadata: DUP 32.00MiB 00:10:22.049 System: DUP 8.00MiB 00:10:22.049 SSD detected: yes 00:10:22.049 Zoned device: no 00:10:22.049 Features: extref, skinny-metadata, no-holes, free-space-tree 00:10:22.049 Checksum: crc32c 00:10:22.049 Number of devices: 1 00:10:22.049 Devices: 00:10:22.049 ID SIZE PATH 00:10:22.049 1 510.00MiB /dev/nvme0n1p1 00:10:22.049 00:10:22.049 11:21:03 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_btrfs -- common/autotest_common.sh@945 -- # return 0 00:10:22.049 11:21:03 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_btrfs -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:10:22.049 11:21:03 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_btrfs -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:10:22.049 11:21:03 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_btrfs -- target/filesystem.sh@25 -- # sync 00:10:22.049 11:21:03 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_btrfs -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:10:22.049 11:21:03 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_btrfs -- target/filesystem.sh@27 -- # sync 00:10:22.049 11:21:03 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_btrfs -- target/filesystem.sh@29 -- # i=0 00:10:22.049 11:21:03 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_btrfs -- target/filesystem.sh@30 -- # umount /mnt/device 00:10:22.049 11:21:03 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_btrfs -- target/filesystem.sh@37 -- # kill -0 72195 00:10:22.049 11:21:03 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_btrfs -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:10:22.049 11:21:03 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_btrfs -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:10:22.049 11:21:03 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_btrfs -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:10:22.049 11:21:03 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_btrfs -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:10:22.308 00:10:22.308 real 0m0.295s 00:10:22.308 user 0m0.018s 00:10:22.308 sys 0m0.061s 00:10:22.308 11:21:03 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_btrfs -- common/autotest_common.sh@1126 -- # xtrace_disable 00:10:22.308 11:21:03 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_btrfs -- common/autotest_common.sh@10 -- # set +x 00:10:22.308 ************************************ 00:10:22.308 END TEST filesystem_in_capsule_btrfs 00:10:22.308 ************************************ 00:10:22.308 11:21:03 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- target/filesystem.sh@83 -- # run_test filesystem_in_capsule_xfs nvmf_filesystem_create xfs nvme0n1 00:10:22.308 11:21:03 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@1101 -- # '[' 4 -le 1 ']' 00:10:22.308 11:21:03 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@1107 -- # xtrace_disable 00:10:22.308 11:21:03 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@10 -- # set +x 00:10:22.308 ************************************ 00:10:22.308 START TEST filesystem_in_capsule_xfs 00:10:22.308 ************************************ 00:10:22.308 11:21:03 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_xfs -- common/autotest_common.sh@1125 -- # nvmf_filesystem_create xfs nvme0n1 00:10:22.308 11:21:03 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_xfs -- target/filesystem.sh@18 -- # fstype=xfs 00:10:22.308 11:21:03 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_xfs -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:10:22.308 11:21:03 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_xfs -- target/filesystem.sh@21 -- # make_filesystem xfs /dev/nvme0n1p1 00:10:22.308 11:21:03 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_xfs -- common/autotest_common.sh@926 -- # local fstype=xfs 00:10:22.308 11:21:03 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_xfs -- common/autotest_common.sh@927 -- # local dev_name=/dev/nvme0n1p1 00:10:22.308 11:21:03 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_xfs -- common/autotest_common.sh@928 -- # local i=0 00:10:22.308 11:21:03 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_xfs -- common/autotest_common.sh@929 -- # local force 00:10:22.308 11:21:03 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_xfs -- common/autotest_common.sh@931 -- # '[' xfs = ext4 ']' 00:10:22.308 11:21:03 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_xfs -- common/autotest_common.sh@934 -- # force=-f 00:10:22.308 11:21:03 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_xfs -- common/autotest_common.sh@937 -- # mkfs.xfs -f /dev/nvme0n1p1 00:10:22.308 meta-data=/dev/nvme0n1p1 isize=512 agcount=4, agsize=32640 blks 00:10:22.308 = sectsz=512 attr=2, projid32bit=1 00:10:22.308 = crc=1 finobt=1, sparse=1, rmapbt=0 00:10:22.308 = reflink=1 bigtime=1 inobtcount=1 nrext64=0 00:10:22.308 data = bsize=4096 blocks=130560, imaxpct=25 00:10:22.308 = sunit=0 swidth=0 blks 00:10:22.308 naming =version 2 bsize=4096 ascii-ci=0, ftype=1 00:10:22.308 log =internal log bsize=4096 blocks=16384, version=2 00:10:22.308 = sectsz=512 sunit=0 blks, lazy-count=1 00:10:22.308 realtime =none extsz=4096 blocks=0, rtextents=0 00:10:23.260 Discarding blocks...Done. 00:10:23.260 11:21:04 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_xfs -- common/autotest_common.sh@945 -- # return 0 00:10:23.260 11:21:04 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_xfs -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:10:25.161 11:21:06 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_xfs -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:10:25.161 11:21:06 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_xfs -- target/filesystem.sh@25 -- # sync 00:10:25.161 11:21:06 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_xfs -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:10:25.161 11:21:06 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_xfs -- target/filesystem.sh@27 -- # sync 00:10:25.161 11:21:06 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_xfs -- target/filesystem.sh@29 -- # i=0 00:10:25.161 11:21:06 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_xfs -- target/filesystem.sh@30 -- # umount /mnt/device 00:10:25.161 11:21:06 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_xfs -- target/filesystem.sh@37 -- # kill -0 72195 00:10:25.161 11:21:06 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_xfs -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:10:25.161 11:21:06 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_xfs -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:10:25.161 11:21:06 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_xfs -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:10:25.161 11:21:06 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_xfs -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:10:25.161 00:10:25.161 real 0m2.726s 00:10:25.161 user 0m0.026s 00:10:25.161 sys 0m0.053s 00:10:25.161 11:21:06 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_xfs -- common/autotest_common.sh@1126 -- # xtrace_disable 00:10:25.161 11:21:06 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule.filesystem_in_capsule_xfs -- common/autotest_common.sh@10 -- # set +x 00:10:25.161 ************************************ 00:10:25.161 END TEST filesystem_in_capsule_xfs 00:10:25.161 ************************************ 00:10:25.161 11:21:06 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- target/filesystem.sh@91 -- # flock /dev/nvme0n1 parted -s /dev/nvme0n1 rm 1 00:10:25.161 11:21:06 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- target/filesystem.sh@93 -- # sync 00:10:25.161 11:21:06 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- target/filesystem.sh@94 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:10:25.161 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:25.161 11:21:06 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- target/filesystem.sh@95 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:10:25.161 11:21:06 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@1219 -- # local i=0 00:10:25.161 11:21:06 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@1220 -- # grep -q -w SPDKISFASTANDAWESOME 00:10:25.161 11:21:06 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@1220 -- # lsblk -o NAME,SERIAL 00:10:25.161 11:21:06 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@1227 -- # lsblk -l -o NAME,SERIAL 00:10:25.161 11:21:06 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@1227 -- # grep -q -w SPDKISFASTANDAWESOME 00:10:25.161 11:21:06 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@1231 -- # return 0 00:10:25.161 11:21:06 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- target/filesystem.sh@97 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:10:25.161 11:21:06 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@561 -- # xtrace_disable 00:10:25.161 11:21:06 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@10 -- # set +x 00:10:25.161 11:21:06 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:10:25.161 11:21:06 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- target/filesystem.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:10:25.161 11:21:06 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- target/filesystem.sh@101 -- # killprocess 72195 00:10:25.161 11:21:06 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@950 -- # '[' -z 72195 ']' 00:10:25.161 11:21:06 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@954 -- # kill -0 72195 00:10:25.161 11:21:06 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@955 -- # uname 00:10:25.161 11:21:06 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:10:25.161 11:21:06 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 72195 00:10:25.161 11:21:06 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:10:25.161 11:21:06 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:10:25.161 killing process with pid 72195 00:10:25.161 11:21:06 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@968 -- # echo 'killing process with pid 72195' 00:10:25.161 11:21:06 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@969 -- # kill 72195 00:10:25.161 11:21:06 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@974 -- # wait 72195 00:10:25.738 11:21:07 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- target/filesystem.sh@102 -- # nvmfpid= 00:10:25.739 00:10:25.739 real 0m14.309s 00:10:25.739 user 0m54.263s 00:10:25.739 sys 0m2.075s 00:10:25.739 11:21:07 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@1126 -- # xtrace_disable 00:10:25.739 11:21:07 nvmf_tcp.nvmf_target_extra.nvmf_filesystem.nvmf_filesystem_in_capsule -- common/autotest_common.sh@10 -- # set +x 00:10:25.739 ************************************ 00:10:25.739 END TEST nvmf_filesystem_in_capsule 00:10:25.739 ************************************ 00:10:25.739 11:21:07 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- target/filesystem.sh@108 -- # nvmftestfini 00:10:25.739 11:21:07 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@514 -- # nvmfcleanup 00:10:25.739 11:21:07 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@121 -- # sync 00:10:25.739 11:21:07 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:10:25.739 11:21:07 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@124 -- # set +e 00:10:25.739 11:21:07 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@125 -- # for i in {1..20} 00:10:25.739 11:21:07 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:10:25.739 rmmod nvme_tcp 00:10:25.739 rmmod nvme_fabrics 00:10:25.998 rmmod nvme_keyring 00:10:25.998 11:21:07 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:10:25.998 11:21:07 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@128 -- # set -e 00:10:25.998 11:21:07 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@129 -- # return 0 00:10:25.998 11:21:07 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@515 -- # '[' -n '' ']' 00:10:25.998 11:21:07 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:10:25.998 11:21:07 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:10:25.998 11:21:07 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:10:25.998 11:21:07 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@297 -- # iptr 00:10:25.998 11:21:07 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@789 -- # iptables-save 00:10:25.998 11:21:07 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:10:25.998 11:21:07 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@789 -- # iptables-restore 00:10:25.998 11:21:07 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@298 -- # [[ nvmf_tgt_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:10:25.998 11:21:07 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@299 -- # nvmf_veth_fini 00:10:25.998 11:21:07 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@233 -- # ip link set nvmf_init_br nomaster 00:10:25.998 11:21:07 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@234 -- # ip link set nvmf_init_br2 nomaster 00:10:25.998 11:21:07 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@235 -- # ip link set nvmf_tgt_br nomaster 00:10:25.998 11:21:07 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@236 -- # ip link set nvmf_tgt_br2 nomaster 00:10:25.998 11:21:07 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@237 -- # ip link set nvmf_init_br down 00:10:25.998 11:21:07 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@238 -- # ip link set nvmf_init_br2 down 00:10:25.998 11:21:07 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@239 -- # ip link set nvmf_tgt_br down 00:10:25.998 11:21:07 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@240 -- # ip link set nvmf_tgt_br2 down 00:10:25.998 11:21:07 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@241 -- # ip link delete nvmf_br type bridge 00:10:25.998 11:21:07 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@242 -- # ip link delete nvmf_init_if 00:10:25.998 11:21:07 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@243 -- # ip link delete nvmf_init_if2 00:10:25.998 11:21:07 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@244 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:10:25.998 11:21:07 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@245 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:10:25.998 11:21:07 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@246 -- # remove_spdk_ns 00:10:25.998 11:21:07 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:10:25.998 11:21:07 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:10:25.998 11:21:07 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:10:26.258 11:21:07 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- nvmf/common.sh@300 -- # return 0 00:10:26.258 00:10:26.258 real 0m30.772s 00:10:26.258 user 1m52.236s 00:10:26.258 sys 0m4.816s 00:10:26.258 11:21:07 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@1126 -- # xtrace_disable 00:10:26.258 11:21:07 nvmf_tcp.nvmf_target_extra.nvmf_filesystem -- common/autotest_common.sh@10 -- # set +x 00:10:26.258 ************************************ 00:10:26.258 END TEST nvmf_filesystem 00:10:26.258 ************************************ 00:10:26.258 11:21:07 nvmf_tcp.nvmf_target_extra -- nvmf/nvmf_target_extra.sh@18 -- # run_test nvmf_target_discovery /home/vagrant/spdk_repo/spdk/test/nvmf/target/discovery.sh --transport=tcp 00:10:26.258 11:21:07 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:10:26.258 11:21:07 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1107 -- # xtrace_disable 00:10:26.258 11:21:07 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@10 -- # set +x 00:10:26.258 ************************************ 00:10:26.258 START TEST nvmf_target_discovery 00:10:26.258 ************************************ 00:10:26.258 11:21:07 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/nvmf/target/discovery.sh --transport=tcp 00:10:26.258 * Looking for test storage... 00:10:26.258 * Found test storage at /home/vagrant/spdk_repo/spdk/test/nvmf/target 00:10:26.258 11:21:07 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:10:26.258 11:21:07 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@1681 -- # lcov --version 00:10:26.258 11:21:07 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:10:26.258 11:21:07 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:10:26.258 11:21:07 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:10:26.258 11:21:07 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- scripts/common.sh@333 -- # local ver1 ver1_l 00:10:26.258 11:21:07 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- scripts/common.sh@334 -- # local ver2 ver2_l 00:10:26.258 11:21:07 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- scripts/common.sh@336 -- # IFS=.-: 00:10:26.258 11:21:07 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- scripts/common.sh@336 -- # read -ra ver1 00:10:26.258 11:21:07 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- scripts/common.sh@337 -- # IFS=.-: 00:10:26.258 11:21:07 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- scripts/common.sh@337 -- # read -ra ver2 00:10:26.258 11:21:07 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- scripts/common.sh@338 -- # local 'op=<' 00:10:26.258 11:21:07 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- scripts/common.sh@340 -- # ver1_l=2 00:10:26.258 11:21:07 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- scripts/common.sh@341 -- # ver2_l=1 00:10:26.258 11:21:07 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:10:26.258 11:21:07 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- scripts/common.sh@344 -- # case "$op" in 00:10:26.258 11:21:07 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- scripts/common.sh@345 -- # : 1 00:10:26.258 11:21:07 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- scripts/common.sh@364 -- # (( v = 0 )) 00:10:26.258 11:21:07 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:10:26.258 11:21:07 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- scripts/common.sh@365 -- # decimal 1 00:10:26.258 11:21:07 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- scripts/common.sh@353 -- # local d=1 00:10:26.258 11:21:07 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:10:26.258 11:21:07 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- scripts/common.sh@355 -- # echo 1 00:10:26.258 11:21:07 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- scripts/common.sh@365 -- # ver1[v]=1 00:10:26.258 11:21:07 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- scripts/common.sh@366 -- # decimal 2 00:10:26.258 11:21:07 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- scripts/common.sh@353 -- # local d=2 00:10:26.258 11:21:07 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:10:26.258 11:21:07 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- scripts/common.sh@355 -- # echo 2 00:10:26.258 11:21:07 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- scripts/common.sh@366 -- # ver2[v]=2 00:10:26.258 11:21:07 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:10:26.258 11:21:07 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:10:26.258 11:21:07 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- scripts/common.sh@368 -- # return 0 00:10:26.258 11:21:07 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:10:26.258 11:21:07 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:10:26.258 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:10:26.258 --rc genhtml_branch_coverage=1 00:10:26.258 --rc genhtml_function_coverage=1 00:10:26.258 --rc genhtml_legend=1 00:10:26.258 --rc geninfo_all_blocks=1 00:10:26.258 --rc geninfo_unexecuted_blocks=1 00:10:26.258 00:10:26.258 ' 00:10:26.258 11:21:07 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:10:26.258 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:10:26.258 --rc genhtml_branch_coverage=1 00:10:26.258 --rc genhtml_function_coverage=1 00:10:26.258 --rc genhtml_legend=1 00:10:26.258 --rc geninfo_all_blocks=1 00:10:26.258 --rc geninfo_unexecuted_blocks=1 00:10:26.258 00:10:26.258 ' 00:10:26.258 11:21:07 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:10:26.258 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:10:26.258 --rc genhtml_branch_coverage=1 00:10:26.258 --rc genhtml_function_coverage=1 00:10:26.258 --rc genhtml_legend=1 00:10:26.258 --rc geninfo_all_blocks=1 00:10:26.258 --rc geninfo_unexecuted_blocks=1 00:10:26.258 00:10:26.258 ' 00:10:26.258 11:21:07 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:10:26.258 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:10:26.258 --rc genhtml_branch_coverage=1 00:10:26.258 --rc genhtml_function_coverage=1 00:10:26.258 --rc genhtml_legend=1 00:10:26.258 --rc geninfo_all_blocks=1 00:10:26.258 --rc geninfo_unexecuted_blocks=1 00:10:26.258 00:10:26.258 ' 00:10:26.258 11:21:07 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@9 -- # source /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh 00:10:26.258 11:21:07 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@7 -- # uname -s 00:10:26.519 11:21:07 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:10:26.519 11:21:07 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:10:26.519 11:21:07 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:10:26.519 11:21:07 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:10:26.519 11:21:07 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:10:26.519 11:21:07 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:10:26.519 11:21:07 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:10:26.519 11:21:07 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:10:26.519 11:21:07 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:10:26.519 11:21:07 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:10:26.519 11:21:07 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:10:26.519 11:21:07 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@18 -- # NVME_HOSTID=3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:10:26.519 11:21:07 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:10:26.519 11:21:07 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:10:26.519 11:21:07 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@21 -- # NET_TYPE=virt 00:10:26.519 11:21:07 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:10:26.519 11:21:07 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@49 -- # source /home/vagrant/spdk_repo/spdk/scripts/common.sh 00:10:26.519 11:21:07 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- scripts/common.sh@15 -- # shopt -s extglob 00:10:26.519 11:21:07 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:10:26.519 11:21:07 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:10:26.519 11:21:07 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:10:26.519 11:21:07 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:26.519 11:21:07 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:26.519 11:21:07 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:26.519 11:21:07 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- paths/export.sh@5 -- # export PATH 00:10:26.519 11:21:07 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:26.519 11:21:07 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@51 -- # : 0 00:10:26.519 11:21:07 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:10:26.519 11:21:07 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:10:26.519 11:21:07 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:10:26.519 11:21:07 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:10:26.519 11:21:07 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:10:26.519 11:21:07 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:10:26.519 /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:10:26.520 11:21:07 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:10:26.520 11:21:07 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:10:26.520 11:21:07 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@55 -- # have_pci_nics=0 00:10:26.520 11:21:07 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@11 -- # NULL_BDEV_SIZE=102400 00:10:26.520 11:21:07 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@12 -- # NULL_BLOCK_SIZE=512 00:10:26.520 11:21:07 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@13 -- # NVMF_PORT_REFERRAL=4430 00:10:26.520 11:21:07 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@15 -- # hash nvme 00:10:26.520 11:21:07 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@20 -- # nvmftestinit 00:10:26.520 11:21:07 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:10:26.520 11:21:07 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:10:26.520 11:21:07 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@474 -- # prepare_net_devs 00:10:26.520 11:21:07 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@436 -- # local -g is_hw=no 00:10:26.520 11:21:07 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@438 -- # remove_spdk_ns 00:10:26.520 11:21:07 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:10:26.520 11:21:07 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:10:26.520 11:21:07 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:10:26.520 11:21:08 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@440 -- # [[ virt != virt ]] 00:10:26.520 11:21:08 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@442 -- # [[ no == yes ]] 00:10:26.520 11:21:08 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@449 -- # [[ virt == phy ]] 00:10:26.520 11:21:08 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@452 -- # [[ virt == phy-fallback ]] 00:10:26.520 11:21:08 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@457 -- # [[ tcp == tcp ]] 00:10:26.520 11:21:08 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@458 -- # nvmf_veth_init 00:10:26.520 11:21:08 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@145 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:10:26.520 11:21:08 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@146 -- # NVMF_SECOND_INITIATOR_IP=10.0.0.2 00:10:26.520 11:21:08 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@147 -- # NVMF_FIRST_TARGET_IP=10.0.0.3 00:10:26.520 11:21:08 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@148 -- # NVMF_SECOND_TARGET_IP=10.0.0.4 00:10:26.520 11:21:08 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@149 -- # NVMF_INITIATOR_IP=10.0.0.1 00:10:26.520 11:21:08 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@150 -- # NVMF_BRIDGE=nvmf_br 00:10:26.520 11:21:08 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@151 -- # NVMF_INITIATOR_INTERFACE=nvmf_init_if 00:10:26.520 11:21:08 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@152 -- # NVMF_INITIATOR_INTERFACE2=nvmf_init_if2 00:10:26.520 11:21:08 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@153 -- # NVMF_INITIATOR_BRIDGE=nvmf_init_br 00:10:26.520 11:21:08 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@154 -- # NVMF_INITIATOR_BRIDGE2=nvmf_init_br2 00:10:26.520 11:21:08 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@155 -- # NVMF_TARGET_NAMESPACE=nvmf_tgt_ns_spdk 00:10:26.520 11:21:08 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@156 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:10:26.520 11:21:08 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@157 -- # NVMF_TARGET_INTERFACE=nvmf_tgt_if 00:10:26.520 11:21:08 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@158 -- # NVMF_TARGET_INTERFACE2=nvmf_tgt_if2 00:10:26.520 11:21:08 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@159 -- # NVMF_TARGET_BRIDGE=nvmf_tgt_br 00:10:26.520 11:21:08 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@160 -- # NVMF_TARGET_BRIDGE2=nvmf_tgt_br2 00:10:26.520 11:21:08 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@162 -- # ip link set nvmf_init_br nomaster 00:10:26.520 Cannot find device "nvmf_init_br" 00:10:26.520 11:21:08 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@162 -- # true 00:10:26.520 11:21:08 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@163 -- # ip link set nvmf_init_br2 nomaster 00:10:26.520 Cannot find device "nvmf_init_br2" 00:10:26.520 11:21:08 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@163 -- # true 00:10:26.520 11:21:08 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@164 -- # ip link set nvmf_tgt_br nomaster 00:10:26.520 Cannot find device "nvmf_tgt_br" 00:10:26.520 11:21:08 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@164 -- # true 00:10:26.520 11:21:08 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@165 -- # ip link set nvmf_tgt_br2 nomaster 00:10:26.520 Cannot find device "nvmf_tgt_br2" 00:10:26.520 11:21:08 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@165 -- # true 00:10:26.520 11:21:08 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@166 -- # ip link set nvmf_init_br down 00:10:26.520 Cannot find device "nvmf_init_br" 00:10:26.520 11:21:08 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@166 -- # true 00:10:26.520 11:21:08 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@167 -- # ip link set nvmf_init_br2 down 00:10:26.520 Cannot find device "nvmf_init_br2" 00:10:26.520 11:21:08 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@167 -- # true 00:10:26.520 11:21:08 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@168 -- # ip link set nvmf_tgt_br down 00:10:26.520 Cannot find device "nvmf_tgt_br" 00:10:26.520 11:21:08 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@168 -- # true 00:10:26.520 11:21:08 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@169 -- # ip link set nvmf_tgt_br2 down 00:10:26.520 Cannot find device "nvmf_tgt_br2" 00:10:26.520 11:21:08 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@169 -- # true 00:10:26.520 11:21:08 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@170 -- # ip link delete nvmf_br type bridge 00:10:26.520 Cannot find device "nvmf_br" 00:10:26.520 11:21:08 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@170 -- # true 00:10:26.520 11:21:08 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@171 -- # ip link delete nvmf_init_if 00:10:26.520 Cannot find device "nvmf_init_if" 00:10:26.520 11:21:08 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@171 -- # true 00:10:26.520 11:21:08 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@172 -- # ip link delete nvmf_init_if2 00:10:26.520 Cannot find device "nvmf_init_if2" 00:10:26.520 11:21:08 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@172 -- # true 00:10:26.520 11:21:08 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@173 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:10:26.520 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:10:26.520 11:21:08 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@173 -- # true 00:10:26.520 11:21:08 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@174 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:10:26.520 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:10:26.520 11:21:08 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@174 -- # true 00:10:26.520 11:21:08 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@177 -- # ip netns add nvmf_tgt_ns_spdk 00:10:26.520 11:21:08 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@180 -- # ip link add nvmf_init_if type veth peer name nvmf_init_br 00:10:26.520 11:21:08 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@181 -- # ip link add nvmf_init_if2 type veth peer name nvmf_init_br2 00:10:26.520 11:21:08 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@182 -- # ip link add nvmf_tgt_if type veth peer name nvmf_tgt_br 00:10:26.520 11:21:08 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@183 -- # ip link add nvmf_tgt_if2 type veth peer name nvmf_tgt_br2 00:10:26.520 11:21:08 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@186 -- # ip link set nvmf_tgt_if netns nvmf_tgt_ns_spdk 00:10:26.520 11:21:08 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@187 -- # ip link set nvmf_tgt_if2 netns nvmf_tgt_ns_spdk 00:10:26.520 11:21:08 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@190 -- # ip addr add 10.0.0.1/24 dev nvmf_init_if 00:10:26.520 11:21:08 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@191 -- # ip addr add 10.0.0.2/24 dev nvmf_init_if2 00:10:26.779 11:21:08 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@192 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.3/24 dev nvmf_tgt_if 00:10:26.779 11:21:08 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@193 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.4/24 dev nvmf_tgt_if2 00:10:26.779 11:21:08 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@196 -- # ip link set nvmf_init_if up 00:10:26.779 11:21:08 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@197 -- # ip link set nvmf_init_if2 up 00:10:26.779 11:21:08 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@198 -- # ip link set nvmf_init_br up 00:10:26.779 11:21:08 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@199 -- # ip link set nvmf_init_br2 up 00:10:26.779 11:21:08 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@200 -- # ip link set nvmf_tgt_br up 00:10:26.779 11:21:08 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@201 -- # ip link set nvmf_tgt_br2 up 00:10:26.779 11:21:08 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@202 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if up 00:10:26.779 11:21:08 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@203 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if2 up 00:10:26.779 11:21:08 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@204 -- # ip netns exec nvmf_tgt_ns_spdk ip link set lo up 00:10:26.779 11:21:08 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@207 -- # ip link add nvmf_br type bridge 00:10:26.779 11:21:08 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@208 -- # ip link set nvmf_br up 00:10:26.779 11:21:08 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@211 -- # ip link set nvmf_init_br master nvmf_br 00:10:26.779 11:21:08 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@212 -- # ip link set nvmf_init_br2 master nvmf_br 00:10:26.779 11:21:08 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@213 -- # ip link set nvmf_tgt_br master nvmf_br 00:10:26.779 11:21:08 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@214 -- # ip link set nvmf_tgt_br2 master nvmf_br 00:10:26.779 11:21:08 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@217 -- # ipts -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT 00:10:26.780 11:21:08 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT' 00:10:26.780 11:21:08 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@218 -- # ipts -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT 00:10:26.780 11:21:08 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT' 00:10:26.780 11:21:08 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@219 -- # ipts -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT 00:10:26.780 11:21:08 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@788 -- # iptables -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT -m comment --comment 'SPDK_NVMF:-A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT' 00:10:26.780 11:21:08 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@222 -- # ping -c 1 10.0.0.3 00:10:26.780 PING 10.0.0.3 (10.0.0.3) 56(84) bytes of data. 00:10:26.780 64 bytes from 10.0.0.3: icmp_seq=1 ttl=64 time=0.103 ms 00:10:26.780 00:10:26.780 --- 10.0.0.3 ping statistics --- 00:10:26.780 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:10:26.780 rtt min/avg/max/mdev = 0.103/0.103/0.103/0.000 ms 00:10:26.780 11:21:08 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@223 -- # ping -c 1 10.0.0.4 00:10:26.780 PING 10.0.0.4 (10.0.0.4) 56(84) bytes of data. 00:10:26.780 64 bytes from 10.0.0.4: icmp_seq=1 ttl=64 time=0.042 ms 00:10:26.780 00:10:26.780 --- 10.0.0.4 ping statistics --- 00:10:26.780 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:10:26.780 rtt min/avg/max/mdev = 0.042/0.042/0.042/0.000 ms 00:10:26.780 11:21:08 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@224 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.1 00:10:26.780 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:10:26.780 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.024 ms 00:10:26.780 00:10:26.780 --- 10.0.0.1 ping statistics --- 00:10:26.780 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:10:26.780 rtt min/avg/max/mdev = 0.024/0.024/0.024/0.000 ms 00:10:26.780 11:21:08 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@225 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.2 00:10:26.780 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:10:26.780 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.068 ms 00:10:26.780 00:10:26.780 --- 10.0.0.2 ping statistics --- 00:10:26.780 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:10:26.780 rtt min/avg/max/mdev = 0.068/0.068/0.068/0.000 ms 00:10:26.780 11:21:08 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@227 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:10:26.780 11:21:08 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@459 -- # return 0 00:10:26.780 11:21:08 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:10:26.780 11:21:08 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:10:26.780 11:21:08 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:10:26.780 11:21:08 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:10:26.780 11:21:08 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:10:26.780 11:21:08 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:10:26.780 11:21:08 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:10:26.780 11:21:08 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@21 -- # nvmfappstart -m 0xF 00:10:26.780 11:21:08 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:10:26.780 11:21:08 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@724 -- # xtrace_disable 00:10:26.780 11:21:08 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@10 -- # set +x 00:10:26.780 11:21:08 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@507 -- # nvmfpid=72786 00:10:26.780 11:21:08 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@506 -- # ip netns exec nvmf_tgt_ns_spdk /home/vagrant/spdk_repo/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:10:26.780 11:21:08 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@508 -- # waitforlisten 72786 00:10:26.780 11:21:08 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@831 -- # '[' -z 72786 ']' 00:10:26.780 11:21:08 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:10:26.780 11:21:08 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@836 -- # local max_retries=100 00:10:26.780 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:10:26.780 11:21:08 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:10:26.780 11:21:08 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@840 -- # xtrace_disable 00:10:26.780 11:21:08 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@10 -- # set +x 00:10:26.780 [2024-10-07 11:21:08.467053] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:10:26.780 [2024-10-07 11:21:08.467825] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:10:27.039 [2024-10-07 11:21:08.605017] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 4 00:10:27.039 [2024-10-07 11:21:08.740012] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:10:27.039 [2024-10-07 11:21:08.740087] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:10:27.039 [2024-10-07 11:21:08.740103] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:10:27.039 [2024-10-07 11:21:08.740113] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:10:27.039 [2024-10-07 11:21:08.740122] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:10:27.039 [2024-10-07 11:21:08.741507] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:10:27.039 [2024-10-07 11:21:08.741636] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 3 00:10:27.039 [2024-10-07 11:21:08.741638] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:10:27.039 [2024-10-07 11:21:08.741559] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:10:27.972 11:21:09 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:10:27.972 11:21:09 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@864 -- # return 0 00:10:27.972 11:21:09 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:10:27.972 11:21:09 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@730 -- # xtrace_disable 00:10:27.972 11:21:09 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@10 -- # set +x 00:10:28.231 11:21:09 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:10:28.231 11:21:09 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@23 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:10:28.232 11:21:09 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@561 -- # xtrace_disable 00:10:28.232 11:21:09 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@10 -- # set +x 00:10:28.232 [2024-10-07 11:21:09.731909] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:10:28.232 11:21:09 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:10:28.232 11:21:09 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@26 -- # seq 1 4 00:10:28.232 11:21:09 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:10:28.232 11:21:09 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null1 102400 512 00:10:28.232 11:21:09 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@561 -- # xtrace_disable 00:10:28.232 11:21:09 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@10 -- # set +x 00:10:28.232 Null1 00:10:28.232 11:21:09 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:10:28.232 11:21:09 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:10:28.232 11:21:09 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@561 -- # xtrace_disable 00:10:28.232 11:21:09 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@10 -- # set +x 00:10:28.232 11:21:09 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:10:28.232 11:21:09 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Null1 00:10:28.232 11:21:09 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@561 -- # xtrace_disable 00:10:28.232 11:21:09 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@10 -- # set +x 00:10:28.232 11:21:09 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:10:28.232 11:21:09 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4420 00:10:28.232 11:21:09 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@561 -- # xtrace_disable 00:10:28.232 11:21:09 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@10 -- # set +x 00:10:28.232 [2024-10-07 11:21:09.780178] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:10:28.232 11:21:09 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:10:28.232 11:21:09 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:10:28.232 11:21:09 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null2 102400 512 00:10:28.232 11:21:09 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@561 -- # xtrace_disable 00:10:28.232 11:21:09 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@10 -- # set +x 00:10:28.232 Null2 00:10:28.232 11:21:09 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:10:28.232 11:21:09 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000002 00:10:28.232 11:21:09 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@561 -- # xtrace_disable 00:10:28.232 11:21:09 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@10 -- # set +x 00:10:28.232 11:21:09 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:10:28.232 11:21:09 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Null2 00:10:28.232 11:21:09 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@561 -- # xtrace_disable 00:10:28.232 11:21:09 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@10 -- # set +x 00:10:28.232 11:21:09 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:10:28.232 11:21:09 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.3 -s 4420 00:10:28.232 11:21:09 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@561 -- # xtrace_disable 00:10:28.232 11:21:09 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@10 -- # set +x 00:10:28.232 11:21:09 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:10:28.232 11:21:09 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:10:28.232 11:21:09 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null3 102400 512 00:10:28.232 11:21:09 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@561 -- # xtrace_disable 00:10:28.232 11:21:09 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@10 -- # set +x 00:10:28.232 Null3 00:10:28.232 11:21:09 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:10:28.232 11:21:09 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK00000000000003 00:10:28.232 11:21:09 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@561 -- # xtrace_disable 00:10:28.232 11:21:09 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@10 -- # set +x 00:10:28.232 11:21:09 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:10:28.232 11:21:09 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 Null3 00:10:28.232 11:21:09 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@561 -- # xtrace_disable 00:10:28.232 11:21:09 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@10 -- # set +x 00:10:28.232 11:21:09 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:10:28.232 11:21:09 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.3 -s 4420 00:10:28.232 11:21:09 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@561 -- # xtrace_disable 00:10:28.232 11:21:09 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@10 -- # set +x 00:10:28.232 11:21:09 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:10:28.232 11:21:09 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:10:28.232 11:21:09 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null4 102400 512 00:10:28.232 11:21:09 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@561 -- # xtrace_disable 00:10:28.232 11:21:09 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@10 -- # set +x 00:10:28.232 Null4 00:10:28.232 11:21:09 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:10:28.232 11:21:09 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode4 -a -s SPDK00000000000004 00:10:28.232 11:21:09 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@561 -- # xtrace_disable 00:10:28.232 11:21:09 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@10 -- # set +x 00:10:28.232 11:21:09 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:10:28.232 11:21:09 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode4 Null4 00:10:28.232 11:21:09 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@561 -- # xtrace_disable 00:10:28.232 11:21:09 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@10 -- # set +x 00:10:28.232 11:21:09 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:10:28.232 11:21:09 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode4 -t tcp -a 10.0.0.3 -s 4420 00:10:28.232 11:21:09 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@561 -- # xtrace_disable 00:10:28.232 11:21:09 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@10 -- # set +x 00:10:28.232 11:21:09 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:10:28.232 11:21:09 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@32 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.3 -s 4420 00:10:28.232 11:21:09 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@561 -- # xtrace_disable 00:10:28.232 11:21:09 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@10 -- # set +x 00:10:28.232 11:21:09 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:10:28.232 11:21:09 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@35 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 10.0.0.3 -s 4430 00:10:28.232 11:21:09 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@561 -- # xtrace_disable 00:10:28.232 11:21:09 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@10 -- # set +x 00:10:28.232 11:21:09 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:10:28.232 11:21:09 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@37 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --hostid=3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -t tcp -a 10.0.0.3 -s 4420 00:10:28.498 00:10:28.498 Discovery Log Number of Records 6, Generation counter 6 00:10:28.498 =====Discovery Log Entry 0====== 00:10:28.498 trtype: tcp 00:10:28.498 adrfam: ipv4 00:10:28.498 subtype: current discovery subsystem 00:10:28.498 treq: not required 00:10:28.498 portid: 0 00:10:28.498 trsvcid: 4420 00:10:28.498 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:10:28.498 traddr: 10.0.0.3 00:10:28.498 eflags: explicit discovery connections, duplicate discovery information 00:10:28.498 sectype: none 00:10:28.498 =====Discovery Log Entry 1====== 00:10:28.498 trtype: tcp 00:10:28.498 adrfam: ipv4 00:10:28.498 subtype: nvme subsystem 00:10:28.498 treq: not required 00:10:28.498 portid: 0 00:10:28.498 trsvcid: 4420 00:10:28.498 subnqn: nqn.2016-06.io.spdk:cnode1 00:10:28.498 traddr: 10.0.0.3 00:10:28.498 eflags: none 00:10:28.498 sectype: none 00:10:28.498 =====Discovery Log Entry 2====== 00:10:28.498 trtype: tcp 00:10:28.498 adrfam: ipv4 00:10:28.498 subtype: nvme subsystem 00:10:28.498 treq: not required 00:10:28.498 portid: 0 00:10:28.498 trsvcid: 4420 00:10:28.498 subnqn: nqn.2016-06.io.spdk:cnode2 00:10:28.498 traddr: 10.0.0.3 00:10:28.498 eflags: none 00:10:28.498 sectype: none 00:10:28.498 =====Discovery Log Entry 3====== 00:10:28.498 trtype: tcp 00:10:28.498 adrfam: ipv4 00:10:28.498 subtype: nvme subsystem 00:10:28.498 treq: not required 00:10:28.498 portid: 0 00:10:28.498 trsvcid: 4420 00:10:28.498 subnqn: nqn.2016-06.io.spdk:cnode3 00:10:28.498 traddr: 10.0.0.3 00:10:28.498 eflags: none 00:10:28.498 sectype: none 00:10:28.498 =====Discovery Log Entry 4====== 00:10:28.498 trtype: tcp 00:10:28.498 adrfam: ipv4 00:10:28.498 subtype: nvme subsystem 00:10:28.498 treq: not required 00:10:28.498 portid: 0 00:10:28.498 trsvcid: 4420 00:10:28.498 subnqn: nqn.2016-06.io.spdk:cnode4 00:10:28.498 traddr: 10.0.0.3 00:10:28.498 eflags: none 00:10:28.498 sectype: none 00:10:28.498 =====Discovery Log Entry 5====== 00:10:28.498 trtype: tcp 00:10:28.498 adrfam: ipv4 00:10:28.498 subtype: discovery subsystem referral 00:10:28.498 treq: not required 00:10:28.498 portid: 0 00:10:28.498 trsvcid: 4430 00:10:28.498 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:10:28.498 traddr: 10.0.0.3 00:10:28.498 eflags: none 00:10:28.498 sectype: none 00:10:28.498 Perform nvmf subsystem discovery via RPC 00:10:28.498 11:21:10 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@39 -- # echo 'Perform nvmf subsystem discovery via RPC' 00:10:28.498 11:21:10 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@40 -- # rpc_cmd nvmf_get_subsystems 00:10:28.498 11:21:10 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@561 -- # xtrace_disable 00:10:28.498 11:21:10 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@10 -- # set +x 00:10:28.498 [ 00:10:28.498 { 00:10:28.498 "allow_any_host": true, 00:10:28.498 "hosts": [], 00:10:28.498 "listen_addresses": [ 00:10:28.498 { 00:10:28.498 "adrfam": "IPv4", 00:10:28.498 "traddr": "10.0.0.3", 00:10:28.498 "trsvcid": "4420", 00:10:28.498 "trtype": "TCP" 00:10:28.498 } 00:10:28.498 ], 00:10:28.498 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:10:28.498 "subtype": "Discovery" 00:10:28.498 }, 00:10:28.498 { 00:10:28.498 "allow_any_host": true, 00:10:28.498 "hosts": [], 00:10:28.498 "listen_addresses": [ 00:10:28.498 { 00:10:28.498 "adrfam": "IPv4", 00:10:28.498 "traddr": "10.0.0.3", 00:10:28.498 "trsvcid": "4420", 00:10:28.498 "trtype": "TCP" 00:10:28.498 } 00:10:28.498 ], 00:10:28.498 "max_cntlid": 65519, 00:10:28.498 "max_namespaces": 32, 00:10:28.498 "min_cntlid": 1, 00:10:28.498 "model_number": "SPDK bdev Controller", 00:10:28.498 "namespaces": [ 00:10:28.498 { 00:10:28.498 "bdev_name": "Null1", 00:10:28.498 "name": "Null1", 00:10:28.498 "nguid": "661469E2ACB644AE9EC75B235352AC07", 00:10:28.498 "nsid": 1, 00:10:28.498 "uuid": "661469e2-acb6-44ae-9ec7-5b235352ac07" 00:10:28.498 } 00:10:28.498 ], 00:10:28.498 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:10:28.498 "serial_number": "SPDK00000000000001", 00:10:28.498 "subtype": "NVMe" 00:10:28.498 }, 00:10:28.498 { 00:10:28.498 "allow_any_host": true, 00:10:28.498 "hosts": [], 00:10:28.498 "listen_addresses": [ 00:10:28.498 { 00:10:28.498 "adrfam": "IPv4", 00:10:28.498 "traddr": "10.0.0.3", 00:10:28.498 "trsvcid": "4420", 00:10:28.498 "trtype": "TCP" 00:10:28.498 } 00:10:28.498 ], 00:10:28.498 "max_cntlid": 65519, 00:10:28.498 "max_namespaces": 32, 00:10:28.498 "min_cntlid": 1, 00:10:28.498 "model_number": "SPDK bdev Controller", 00:10:28.498 "namespaces": [ 00:10:28.498 { 00:10:28.498 "bdev_name": "Null2", 00:10:28.498 "name": "Null2", 00:10:28.498 "nguid": "83DA9E1A33F9410AA55069A4A448C159", 00:10:28.498 "nsid": 1, 00:10:28.498 "uuid": "83da9e1a-33f9-410a-a550-69a4a448c159" 00:10:28.498 } 00:10:28.498 ], 00:10:28.498 "nqn": "nqn.2016-06.io.spdk:cnode2", 00:10:28.498 "serial_number": "SPDK00000000000002", 00:10:28.498 "subtype": "NVMe" 00:10:28.498 }, 00:10:28.498 { 00:10:28.498 "allow_any_host": true, 00:10:28.498 "hosts": [], 00:10:28.498 "listen_addresses": [ 00:10:28.498 { 00:10:28.498 "adrfam": "IPv4", 00:10:28.498 "traddr": "10.0.0.3", 00:10:28.498 "trsvcid": "4420", 00:10:28.498 "trtype": "TCP" 00:10:28.498 } 00:10:28.498 ], 00:10:28.498 "max_cntlid": 65519, 00:10:28.498 "max_namespaces": 32, 00:10:28.498 "min_cntlid": 1, 00:10:28.498 "model_number": "SPDK bdev Controller", 00:10:28.498 "namespaces": [ 00:10:28.498 { 00:10:28.498 "bdev_name": "Null3", 00:10:28.498 "name": "Null3", 00:10:28.498 "nguid": "E8516BD3084A4EF6ADBFD18C45492C81", 00:10:28.498 "nsid": 1, 00:10:28.498 "uuid": "e8516bd3-084a-4ef6-adbf-d18c45492c81" 00:10:28.498 } 00:10:28.498 ], 00:10:28.498 "nqn": "nqn.2016-06.io.spdk:cnode3", 00:10:28.498 "serial_number": "SPDK00000000000003", 00:10:28.498 "subtype": "NVMe" 00:10:28.498 }, 00:10:28.498 { 00:10:28.498 "allow_any_host": true, 00:10:28.498 "hosts": [], 00:10:28.498 "listen_addresses": [ 00:10:28.498 { 00:10:28.498 "adrfam": "IPv4", 00:10:28.498 "traddr": "10.0.0.3", 00:10:28.498 "trsvcid": "4420", 00:10:28.498 "trtype": "TCP" 00:10:28.498 } 00:10:28.498 ], 00:10:28.498 "max_cntlid": 65519, 00:10:28.498 "max_namespaces": 32, 00:10:28.498 "min_cntlid": 1, 00:10:28.498 "model_number": "SPDK bdev Controller", 00:10:28.498 "namespaces": [ 00:10:28.498 { 00:10:28.498 "bdev_name": "Null4", 00:10:28.498 "name": "Null4", 00:10:28.498 "nguid": "5489514CB07E4D87BB472491B292329F", 00:10:28.498 "nsid": 1, 00:10:28.498 "uuid": "5489514c-b07e-4d87-bb47-2491b292329f" 00:10:28.498 } 00:10:28.498 ], 00:10:28.498 "nqn": "nqn.2016-06.io.spdk:cnode4", 00:10:28.498 "serial_number": "SPDK00000000000004", 00:10:28.498 "subtype": "NVMe" 00:10:28.498 } 00:10:28.498 ] 00:10:28.498 11:21:10 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:10:28.498 11:21:10 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@42 -- # seq 1 4 00:10:28.498 11:21:10 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:10:28.498 11:21:10 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:10:28.498 11:21:10 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@561 -- # xtrace_disable 00:10:28.498 11:21:10 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@10 -- # set +x 00:10:28.498 11:21:10 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:10:28.498 11:21:10 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null1 00:10:28.498 11:21:10 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@561 -- # xtrace_disable 00:10:28.498 11:21:10 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@10 -- # set +x 00:10:28.498 11:21:10 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:10:28.498 11:21:10 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:10:28.498 11:21:10 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:10:28.498 11:21:10 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@561 -- # xtrace_disable 00:10:28.498 11:21:10 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@10 -- # set +x 00:10:28.498 11:21:10 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:10:28.498 11:21:10 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null2 00:10:28.498 11:21:10 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@561 -- # xtrace_disable 00:10:28.498 11:21:10 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@10 -- # set +x 00:10:28.498 11:21:10 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:10:28.498 11:21:10 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:10:28.498 11:21:10 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:10:28.498 11:21:10 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@561 -- # xtrace_disable 00:10:28.498 11:21:10 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@10 -- # set +x 00:10:28.499 11:21:10 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:10:28.499 11:21:10 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null3 00:10:28.499 11:21:10 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@561 -- # xtrace_disable 00:10:28.499 11:21:10 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@10 -- # set +x 00:10:28.499 11:21:10 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:10:28.499 11:21:10 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:10:28.499 11:21:10 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode4 00:10:28.499 11:21:10 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@561 -- # xtrace_disable 00:10:28.499 11:21:10 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@10 -- # set +x 00:10:28.499 11:21:10 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:10:28.499 11:21:10 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null4 00:10:28.499 11:21:10 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@561 -- # xtrace_disable 00:10:28.499 11:21:10 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@10 -- # set +x 00:10:28.499 11:21:10 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:10:28.499 11:21:10 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@47 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 10.0.0.3 -s 4430 00:10:28.499 11:21:10 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@561 -- # xtrace_disable 00:10:28.499 11:21:10 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@10 -- # set +x 00:10:28.499 11:21:10 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:10:28.499 11:21:10 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@49 -- # rpc_cmd bdev_get_bdevs 00:10:28.499 11:21:10 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@561 -- # xtrace_disable 00:10:28.499 11:21:10 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@10 -- # set +x 00:10:28.499 11:21:10 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@49 -- # jq -r '.[].name' 00:10:28.499 11:21:10 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:10:28.499 11:21:10 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@49 -- # check_bdevs= 00:10:28.499 11:21:10 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@50 -- # '[' -n '' ']' 00:10:28.499 11:21:10 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@55 -- # trap - SIGINT SIGTERM EXIT 00:10:28.499 11:21:10 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- target/discovery.sh@57 -- # nvmftestfini 00:10:28.499 11:21:10 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@514 -- # nvmfcleanup 00:10:28.499 11:21:10 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@121 -- # sync 00:10:28.499 11:21:10 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:10:28.499 11:21:10 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@124 -- # set +e 00:10:28.499 11:21:10 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@125 -- # for i in {1..20} 00:10:28.499 11:21:10 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:10:28.757 rmmod nvme_tcp 00:10:28.757 rmmod nvme_fabrics 00:10:28.757 rmmod nvme_keyring 00:10:28.757 11:21:10 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:10:28.757 11:21:10 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@128 -- # set -e 00:10:28.757 11:21:10 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@129 -- # return 0 00:10:28.757 11:21:10 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@515 -- # '[' -n 72786 ']' 00:10:28.757 11:21:10 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@516 -- # killprocess 72786 00:10:28.757 11:21:10 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@950 -- # '[' -z 72786 ']' 00:10:28.757 11:21:10 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@954 -- # kill -0 72786 00:10:28.757 11:21:10 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@955 -- # uname 00:10:28.757 11:21:10 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:10:28.757 11:21:10 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 72786 00:10:28.757 11:21:10 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:10:28.757 11:21:10 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:10:28.757 killing process with pid 72786 00:10:28.757 11:21:10 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@968 -- # echo 'killing process with pid 72786' 00:10:28.757 11:21:10 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@969 -- # kill 72786 00:10:28.757 11:21:10 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@974 -- # wait 72786 00:10:29.016 11:21:10 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:10:29.016 11:21:10 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:10:29.016 11:21:10 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:10:29.016 11:21:10 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@297 -- # iptr 00:10:29.016 11:21:10 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@789 -- # iptables-save 00:10:29.016 11:21:10 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:10:29.016 11:21:10 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@789 -- # iptables-restore 00:10:29.016 11:21:10 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@298 -- # [[ nvmf_tgt_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:10:29.016 11:21:10 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@299 -- # nvmf_veth_fini 00:10:29.016 11:21:10 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@233 -- # ip link set nvmf_init_br nomaster 00:10:29.016 11:21:10 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@234 -- # ip link set nvmf_init_br2 nomaster 00:10:29.016 11:21:10 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@235 -- # ip link set nvmf_tgt_br nomaster 00:10:29.016 11:21:10 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@236 -- # ip link set nvmf_tgt_br2 nomaster 00:10:29.016 11:21:10 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@237 -- # ip link set nvmf_init_br down 00:10:29.016 11:21:10 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@238 -- # ip link set nvmf_init_br2 down 00:10:29.016 11:21:10 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@239 -- # ip link set nvmf_tgt_br down 00:10:29.016 11:21:10 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@240 -- # ip link set nvmf_tgt_br2 down 00:10:29.016 11:21:10 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@241 -- # ip link delete nvmf_br type bridge 00:10:29.016 11:21:10 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@242 -- # ip link delete nvmf_init_if 00:10:29.016 11:21:10 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@243 -- # ip link delete nvmf_init_if2 00:10:29.275 11:21:10 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@244 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:10:29.275 11:21:10 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@245 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:10:29.275 11:21:10 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@246 -- # remove_spdk_ns 00:10:29.275 11:21:10 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:10:29.275 11:21:10 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:10:29.275 11:21:10 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:10:29.275 11:21:10 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- nvmf/common.sh@300 -- # return 0 00:10:29.275 00:10:29.275 real 0m3.054s 00:10:29.275 user 0m7.799s 00:10:29.275 sys 0m0.835s 00:10:29.275 11:21:10 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@1126 -- # xtrace_disable 00:10:29.275 11:21:10 nvmf_tcp.nvmf_target_extra.nvmf_target_discovery -- common/autotest_common.sh@10 -- # set +x 00:10:29.275 ************************************ 00:10:29.275 END TEST nvmf_target_discovery 00:10:29.275 ************************************ 00:10:29.275 11:21:10 nvmf_tcp.nvmf_target_extra -- nvmf/nvmf_target_extra.sh@19 -- # run_test nvmf_referrals /home/vagrant/spdk_repo/spdk/test/nvmf/target/referrals.sh --transport=tcp 00:10:29.275 11:21:10 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:10:29.275 11:21:10 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1107 -- # xtrace_disable 00:10:29.275 11:21:10 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@10 -- # set +x 00:10:29.275 ************************************ 00:10:29.275 START TEST nvmf_referrals 00:10:29.275 ************************************ 00:10:29.275 11:21:10 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/nvmf/target/referrals.sh --transport=tcp 00:10:29.275 * Looking for test storage... 00:10:29.275 * Found test storage at /home/vagrant/spdk_repo/spdk/test/nvmf/target 00:10:29.275 11:21:10 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:10:29.275 11:21:10 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@1681 -- # lcov --version 00:10:29.275 11:21:10 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:10:29.534 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:10:29.534 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:10:29.534 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- scripts/common.sh@333 -- # local ver1 ver1_l 00:10:29.534 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- scripts/common.sh@334 -- # local ver2 ver2_l 00:10:29.534 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- scripts/common.sh@336 -- # IFS=.-: 00:10:29.534 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- scripts/common.sh@336 -- # read -ra ver1 00:10:29.534 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- scripts/common.sh@337 -- # IFS=.-: 00:10:29.535 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- scripts/common.sh@337 -- # read -ra ver2 00:10:29.535 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- scripts/common.sh@338 -- # local 'op=<' 00:10:29.535 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- scripts/common.sh@340 -- # ver1_l=2 00:10:29.535 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- scripts/common.sh@341 -- # ver2_l=1 00:10:29.535 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:10:29.535 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- scripts/common.sh@344 -- # case "$op" in 00:10:29.535 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- scripts/common.sh@345 -- # : 1 00:10:29.535 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- scripts/common.sh@364 -- # (( v = 0 )) 00:10:29.535 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:10:29.535 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- scripts/common.sh@365 -- # decimal 1 00:10:29.535 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- scripts/common.sh@353 -- # local d=1 00:10:29.535 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:10:29.535 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- scripts/common.sh@355 -- # echo 1 00:10:29.535 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- scripts/common.sh@365 -- # ver1[v]=1 00:10:29.535 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- scripts/common.sh@366 -- # decimal 2 00:10:29.535 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- scripts/common.sh@353 -- # local d=2 00:10:29.535 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:10:29.535 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- scripts/common.sh@355 -- # echo 2 00:10:29.535 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- scripts/common.sh@366 -- # ver2[v]=2 00:10:29.535 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:10:29.535 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:10:29.535 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- scripts/common.sh@368 -- # return 0 00:10:29.535 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:10:29.535 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:10:29.535 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:10:29.535 --rc genhtml_branch_coverage=1 00:10:29.535 --rc genhtml_function_coverage=1 00:10:29.535 --rc genhtml_legend=1 00:10:29.535 --rc geninfo_all_blocks=1 00:10:29.535 --rc geninfo_unexecuted_blocks=1 00:10:29.535 00:10:29.535 ' 00:10:29.535 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:10:29.535 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:10:29.535 --rc genhtml_branch_coverage=1 00:10:29.535 --rc genhtml_function_coverage=1 00:10:29.535 --rc genhtml_legend=1 00:10:29.535 --rc geninfo_all_blocks=1 00:10:29.535 --rc geninfo_unexecuted_blocks=1 00:10:29.535 00:10:29.535 ' 00:10:29.535 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:10:29.535 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:10:29.535 --rc genhtml_branch_coverage=1 00:10:29.535 --rc genhtml_function_coverage=1 00:10:29.535 --rc genhtml_legend=1 00:10:29.535 --rc geninfo_all_blocks=1 00:10:29.535 --rc geninfo_unexecuted_blocks=1 00:10:29.535 00:10:29.535 ' 00:10:29.535 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:10:29.535 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:10:29.535 --rc genhtml_branch_coverage=1 00:10:29.535 --rc genhtml_function_coverage=1 00:10:29.535 --rc genhtml_legend=1 00:10:29.535 --rc geninfo_all_blocks=1 00:10:29.535 --rc geninfo_unexecuted_blocks=1 00:10:29.535 00:10:29.535 ' 00:10:29.535 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@9 -- # source /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh 00:10:29.535 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@7 -- # uname -s 00:10:29.535 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:10:29.535 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:10:29.535 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:10:29.535 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:10:29.535 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:10:29.535 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:10:29.535 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:10:29.535 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:10:29.535 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:10:29.535 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:10:29.535 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:10:29.535 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@18 -- # NVME_HOSTID=3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:10:29.535 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:10:29.535 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:10:29.535 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@21 -- # NET_TYPE=virt 00:10:29.535 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:10:29.535 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@49 -- # source /home/vagrant/spdk_repo/spdk/scripts/common.sh 00:10:29.535 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- scripts/common.sh@15 -- # shopt -s extglob 00:10:29.535 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:10:29.535 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:10:29.535 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:10:29.535 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:29.535 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:29.535 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:29.535 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- paths/export.sh@5 -- # export PATH 00:10:29.535 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:29.535 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@51 -- # : 0 00:10:29.535 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:10:29.535 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:10:29.535 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:10:29.535 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:10:29.535 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:10:29.535 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:10:29.535 /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:10:29.535 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:10:29.535 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:10:29.535 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@55 -- # have_pci_nics=0 00:10:29.535 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@11 -- # NVMF_REFERRAL_IP_1=127.0.0.2 00:10:29.535 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@12 -- # NVMF_REFERRAL_IP_2=127.0.0.3 00:10:29.535 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@13 -- # NVMF_REFERRAL_IP_3=127.0.0.4 00:10:29.535 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@14 -- # NVMF_PORT_REFERRAL=4430 00:10:29.535 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@15 -- # DISCOVERY_NQN=nqn.2014-08.org.nvmexpress.discovery 00:10:29.535 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@16 -- # NQN=nqn.2016-06.io.spdk:cnode1 00:10:29.535 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@37 -- # nvmftestinit 00:10:29.535 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:10:29.535 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:10:29.536 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@474 -- # prepare_net_devs 00:10:29.536 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@436 -- # local -g is_hw=no 00:10:29.536 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@438 -- # remove_spdk_ns 00:10:29.536 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:10:29.536 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:10:29.536 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:10:29.536 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@440 -- # [[ virt != virt ]] 00:10:29.536 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@442 -- # [[ no == yes ]] 00:10:29.536 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@449 -- # [[ virt == phy ]] 00:10:29.536 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@452 -- # [[ virt == phy-fallback ]] 00:10:29.536 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@457 -- # [[ tcp == tcp ]] 00:10:29.536 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@458 -- # nvmf_veth_init 00:10:29.536 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@145 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:10:29.536 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@146 -- # NVMF_SECOND_INITIATOR_IP=10.0.0.2 00:10:29.536 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@147 -- # NVMF_FIRST_TARGET_IP=10.0.0.3 00:10:29.536 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@148 -- # NVMF_SECOND_TARGET_IP=10.0.0.4 00:10:29.536 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@149 -- # NVMF_INITIATOR_IP=10.0.0.1 00:10:29.536 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@150 -- # NVMF_BRIDGE=nvmf_br 00:10:29.536 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@151 -- # NVMF_INITIATOR_INTERFACE=nvmf_init_if 00:10:29.536 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@152 -- # NVMF_INITIATOR_INTERFACE2=nvmf_init_if2 00:10:29.536 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@153 -- # NVMF_INITIATOR_BRIDGE=nvmf_init_br 00:10:29.536 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@154 -- # NVMF_INITIATOR_BRIDGE2=nvmf_init_br2 00:10:29.536 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@155 -- # NVMF_TARGET_NAMESPACE=nvmf_tgt_ns_spdk 00:10:29.536 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@156 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:10:29.536 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@157 -- # NVMF_TARGET_INTERFACE=nvmf_tgt_if 00:10:29.536 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@158 -- # NVMF_TARGET_INTERFACE2=nvmf_tgt_if2 00:10:29.536 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@159 -- # NVMF_TARGET_BRIDGE=nvmf_tgt_br 00:10:29.536 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@160 -- # NVMF_TARGET_BRIDGE2=nvmf_tgt_br2 00:10:29.536 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@162 -- # ip link set nvmf_init_br nomaster 00:10:29.536 Cannot find device "nvmf_init_br" 00:10:29.536 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@162 -- # true 00:10:29.536 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@163 -- # ip link set nvmf_init_br2 nomaster 00:10:29.536 Cannot find device "nvmf_init_br2" 00:10:29.536 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@163 -- # true 00:10:29.536 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@164 -- # ip link set nvmf_tgt_br nomaster 00:10:29.536 Cannot find device "nvmf_tgt_br" 00:10:29.536 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@164 -- # true 00:10:29.536 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@165 -- # ip link set nvmf_tgt_br2 nomaster 00:10:29.536 Cannot find device "nvmf_tgt_br2" 00:10:29.536 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@165 -- # true 00:10:29.536 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@166 -- # ip link set nvmf_init_br down 00:10:29.536 Cannot find device "nvmf_init_br" 00:10:29.536 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@166 -- # true 00:10:29.536 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@167 -- # ip link set nvmf_init_br2 down 00:10:29.536 Cannot find device "nvmf_init_br2" 00:10:29.536 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@167 -- # true 00:10:29.536 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@168 -- # ip link set nvmf_tgt_br down 00:10:29.536 Cannot find device "nvmf_tgt_br" 00:10:29.536 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@168 -- # true 00:10:29.536 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@169 -- # ip link set nvmf_tgt_br2 down 00:10:29.536 Cannot find device "nvmf_tgt_br2" 00:10:29.536 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@169 -- # true 00:10:29.536 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@170 -- # ip link delete nvmf_br type bridge 00:10:29.536 Cannot find device "nvmf_br" 00:10:29.536 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@170 -- # true 00:10:29.536 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@171 -- # ip link delete nvmf_init_if 00:10:29.795 Cannot find device "nvmf_init_if" 00:10:29.796 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@171 -- # true 00:10:29.796 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@172 -- # ip link delete nvmf_init_if2 00:10:29.796 Cannot find device "nvmf_init_if2" 00:10:29.796 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@172 -- # true 00:10:29.796 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@173 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:10:29.796 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:10:29.796 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@173 -- # true 00:10:29.796 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@174 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:10:29.796 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:10:29.796 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@174 -- # true 00:10:29.796 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@177 -- # ip netns add nvmf_tgt_ns_spdk 00:10:29.796 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@180 -- # ip link add nvmf_init_if type veth peer name nvmf_init_br 00:10:29.796 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@181 -- # ip link add nvmf_init_if2 type veth peer name nvmf_init_br2 00:10:29.796 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@182 -- # ip link add nvmf_tgt_if type veth peer name nvmf_tgt_br 00:10:29.796 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@183 -- # ip link add nvmf_tgt_if2 type veth peer name nvmf_tgt_br2 00:10:29.796 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@186 -- # ip link set nvmf_tgt_if netns nvmf_tgt_ns_spdk 00:10:29.796 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@187 -- # ip link set nvmf_tgt_if2 netns nvmf_tgt_ns_spdk 00:10:29.796 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@190 -- # ip addr add 10.0.0.1/24 dev nvmf_init_if 00:10:29.796 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@191 -- # ip addr add 10.0.0.2/24 dev nvmf_init_if2 00:10:29.796 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@192 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.3/24 dev nvmf_tgt_if 00:10:29.796 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@193 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.4/24 dev nvmf_tgt_if2 00:10:29.796 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@196 -- # ip link set nvmf_init_if up 00:10:29.796 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@197 -- # ip link set nvmf_init_if2 up 00:10:29.796 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@198 -- # ip link set nvmf_init_br up 00:10:29.796 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@199 -- # ip link set nvmf_init_br2 up 00:10:29.796 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@200 -- # ip link set nvmf_tgt_br up 00:10:29.796 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@201 -- # ip link set nvmf_tgt_br2 up 00:10:29.796 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@202 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if up 00:10:29.796 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@203 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if2 up 00:10:29.796 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@204 -- # ip netns exec nvmf_tgt_ns_spdk ip link set lo up 00:10:29.796 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@207 -- # ip link add nvmf_br type bridge 00:10:29.796 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@208 -- # ip link set nvmf_br up 00:10:29.796 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@211 -- # ip link set nvmf_init_br master nvmf_br 00:10:30.055 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@212 -- # ip link set nvmf_init_br2 master nvmf_br 00:10:30.055 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@213 -- # ip link set nvmf_tgt_br master nvmf_br 00:10:30.055 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@214 -- # ip link set nvmf_tgt_br2 master nvmf_br 00:10:30.055 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@217 -- # ipts -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT 00:10:30.055 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT' 00:10:30.055 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@218 -- # ipts -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT 00:10:30.055 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT' 00:10:30.055 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@219 -- # ipts -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT 00:10:30.055 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@788 -- # iptables -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT -m comment --comment 'SPDK_NVMF:-A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT' 00:10:30.055 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@222 -- # ping -c 1 10.0.0.3 00:10:30.055 PING 10.0.0.3 (10.0.0.3) 56(84) bytes of data. 00:10:30.055 64 bytes from 10.0.0.3: icmp_seq=1 ttl=64 time=0.103 ms 00:10:30.055 00:10:30.055 --- 10.0.0.3 ping statistics --- 00:10:30.055 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:10:30.055 rtt min/avg/max/mdev = 0.103/0.103/0.103/0.000 ms 00:10:30.055 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@223 -- # ping -c 1 10.0.0.4 00:10:30.055 PING 10.0.0.4 (10.0.0.4) 56(84) bytes of data. 00:10:30.055 64 bytes from 10.0.0.4: icmp_seq=1 ttl=64 time=0.096 ms 00:10:30.055 00:10:30.055 --- 10.0.0.4 ping statistics --- 00:10:30.055 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:10:30.055 rtt min/avg/max/mdev = 0.096/0.096/0.096/0.000 ms 00:10:30.055 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@224 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.1 00:10:30.055 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:10:30.055 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.060 ms 00:10:30.055 00:10:30.055 --- 10.0.0.1 ping statistics --- 00:10:30.055 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:10:30.055 rtt min/avg/max/mdev = 0.060/0.060/0.060/0.000 ms 00:10:30.055 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@225 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.2 00:10:30.055 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:10:30.055 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.121 ms 00:10:30.055 00:10:30.055 --- 10.0.0.2 ping statistics --- 00:10:30.055 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:10:30.055 rtt min/avg/max/mdev = 0.121/0.121/0.121/0.000 ms 00:10:30.055 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@227 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:10:30.055 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@459 -- # return 0 00:10:30.055 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:10:30.055 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:10:30.055 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:10:30.055 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:10:30.055 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:10:30.055 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:10:30.055 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:10:30.055 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@38 -- # nvmfappstart -m 0xF 00:10:30.055 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:10:30.055 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@724 -- # xtrace_disable 00:10:30.055 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@10 -- # set +x 00:10:30.055 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@507 -- # nvmfpid=73071 00:10:30.055 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@506 -- # ip netns exec nvmf_tgt_ns_spdk /home/vagrant/spdk_repo/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:10:30.056 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@508 -- # waitforlisten 73071 00:10:30.056 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@831 -- # '[' -z 73071 ']' 00:10:30.056 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:10:30.056 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@836 -- # local max_retries=100 00:10:30.056 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:10:30.056 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:10:30.056 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@840 -- # xtrace_disable 00:10:30.056 11:21:11 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@10 -- # set +x 00:10:30.056 [2024-10-07 11:21:11.670703] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:10:30.056 [2024-10-07 11:21:11.670803] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:10:30.314 [2024-10-07 11:21:11.811546] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 4 00:10:30.314 [2024-10-07 11:21:11.929392] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:10:30.314 [2024-10-07 11:21:11.929471] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:10:30.314 [2024-10-07 11:21:11.929484] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:10:30.314 [2024-10-07 11:21:11.929493] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:10:30.314 [2024-10-07 11:21:11.929500] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:10:30.314 [2024-10-07 11:21:11.930721] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:10:30.314 [2024-10-07 11:21:11.930814] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:10:30.314 [2024-10-07 11:21:11.930949] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 3 00:10:30.314 [2024-10-07 11:21:11.931045] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:10:31.250 11:21:12 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:10:31.250 11:21:12 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@864 -- # return 0 00:10:31.250 11:21:12 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:10:31.250 11:21:12 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@730 -- # xtrace_disable 00:10:31.250 11:21:12 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@10 -- # set +x 00:10:31.250 11:21:12 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:10:31.250 11:21:12 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@40 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:10:31.250 11:21:12 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@561 -- # xtrace_disable 00:10:31.250 11:21:12 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@10 -- # set +x 00:10:31.250 [2024-10-07 11:21:12.812900] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:10:31.250 11:21:12 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:10:31.250 11:21:12 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@41 -- # rpc_cmd nvmf_subsystem_add_listener -t tcp -a 10.0.0.3 -s 8009 discovery 00:10:31.250 11:21:12 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@561 -- # xtrace_disable 00:10:31.250 11:21:12 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@10 -- # set +x 00:10:31.250 [2024-10-07 11:21:12.825406] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 8009 *** 00:10:31.250 11:21:12 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:10:31.250 11:21:12 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@44 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 00:10:31.250 11:21:12 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@561 -- # xtrace_disable 00:10:31.250 11:21:12 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@10 -- # set +x 00:10:31.250 11:21:12 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:10:31.250 11:21:12 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@45 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.3 -s 4430 00:10:31.250 11:21:12 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@561 -- # xtrace_disable 00:10:31.250 11:21:12 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@10 -- # set +x 00:10:31.250 11:21:12 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:10:31.250 11:21:12 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@46 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.4 -s 4430 00:10:31.250 11:21:12 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@561 -- # xtrace_disable 00:10:31.250 11:21:12 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@10 -- # set +x 00:10:31.250 11:21:12 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:10:31.250 11:21:12 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@48 -- # rpc_cmd nvmf_discovery_get_referrals 00:10:31.250 11:21:12 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@561 -- # xtrace_disable 00:10:31.250 11:21:12 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@48 -- # jq length 00:10:31.250 11:21:12 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@10 -- # set +x 00:10:31.250 11:21:12 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:10:31.250 11:21:12 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@48 -- # (( 3 == 3 )) 00:10:31.250 11:21:12 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@49 -- # get_referral_ips rpc 00:10:31.251 11:21:12 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:10:31.251 11:21:12 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:10:31.251 11:21:12 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:10:31.251 11:21:12 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@561 -- # xtrace_disable 00:10:31.251 11:21:12 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@21 -- # sort 00:10:31.251 11:21:12 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@10 -- # set +x 00:10:31.251 11:21:12 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:10:31.508 11:21:12 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@21 -- # echo 127.0.0.2 127.0.0.3 127.0.0.4 00:10:31.508 11:21:12 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@49 -- # [[ 127.0.0.2 127.0.0.3 127.0.0.4 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\3\ \1\2\7\.\0\.\0\.\4 ]] 00:10:31.508 11:21:12 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@50 -- # get_referral_ips nvme 00:10:31.508 11:21:12 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:10:31.508 11:21:12 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:10:31.508 11:21:12 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --hostid=3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -t tcp -a 10.0.0.3 -s 8009 -o json 00:10:31.508 11:21:12 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:10:31.508 11:21:12 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@26 -- # sort 00:10:31.508 11:21:13 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@26 -- # echo 127.0.0.2 127.0.0.3 127.0.0.4 00:10:31.508 11:21:13 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@50 -- # [[ 127.0.0.2 127.0.0.3 127.0.0.4 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\3\ \1\2\7\.\0\.\0\.\4 ]] 00:10:31.509 11:21:13 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@52 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 00:10:31.509 11:21:13 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@561 -- # xtrace_disable 00:10:31.509 11:21:13 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@10 -- # set +x 00:10:31.509 11:21:13 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:10:31.509 11:21:13 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@53 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.3 -s 4430 00:10:31.509 11:21:13 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@561 -- # xtrace_disable 00:10:31.509 11:21:13 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@10 -- # set +x 00:10:31.509 11:21:13 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:10:31.509 11:21:13 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@54 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.4 -s 4430 00:10:31.509 11:21:13 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@561 -- # xtrace_disable 00:10:31.509 11:21:13 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@10 -- # set +x 00:10:31.509 11:21:13 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:10:31.509 11:21:13 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@56 -- # rpc_cmd nvmf_discovery_get_referrals 00:10:31.509 11:21:13 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@561 -- # xtrace_disable 00:10:31.509 11:21:13 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@10 -- # set +x 00:10:31.509 11:21:13 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@56 -- # jq length 00:10:31.509 11:21:13 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:10:31.509 11:21:13 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@56 -- # (( 0 == 0 )) 00:10:31.509 11:21:13 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@57 -- # get_referral_ips nvme 00:10:31.509 11:21:13 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:10:31.509 11:21:13 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:10:31.509 11:21:13 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --hostid=3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -t tcp -a 10.0.0.3 -s 8009 -o json 00:10:31.509 11:21:13 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:10:31.509 11:21:13 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@26 -- # sort 00:10:31.767 11:21:13 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@26 -- # echo 00:10:31.767 11:21:13 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@57 -- # [[ '' == '' ]] 00:10:31.767 11:21:13 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@60 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 -n discovery 00:10:31.767 11:21:13 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@561 -- # xtrace_disable 00:10:31.767 11:21:13 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@10 -- # set +x 00:10:31.767 11:21:13 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:10:31.767 11:21:13 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@62 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2016-06.io.spdk:cnode1 00:10:31.767 11:21:13 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@561 -- # xtrace_disable 00:10:31.767 11:21:13 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@10 -- # set +x 00:10:31.767 11:21:13 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:10:31.767 11:21:13 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@65 -- # get_referral_ips rpc 00:10:31.767 11:21:13 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:10:31.767 11:21:13 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:10:31.767 11:21:13 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@561 -- # xtrace_disable 00:10:31.767 11:21:13 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@10 -- # set +x 00:10:31.767 11:21:13 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:10:31.767 11:21:13 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@21 -- # sort 00:10:31.767 11:21:13 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:10:31.767 11:21:13 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@21 -- # echo 127.0.0.2 127.0.0.2 00:10:31.767 11:21:13 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@65 -- # [[ 127.0.0.2 127.0.0.2 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\2 ]] 00:10:31.767 11:21:13 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@66 -- # get_referral_ips nvme 00:10:31.767 11:21:13 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:10:31.767 11:21:13 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:10:31.767 11:21:13 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --hostid=3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -t tcp -a 10.0.0.3 -s 8009 -o json 00:10:31.767 11:21:13 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:10:31.767 11:21:13 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@26 -- # sort 00:10:32.025 11:21:13 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@26 -- # echo 127.0.0.2 127.0.0.2 00:10:32.025 11:21:13 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@66 -- # [[ 127.0.0.2 127.0.0.2 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\2 ]] 00:10:32.025 11:21:13 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@67 -- # get_discovery_entries 'nvme subsystem' 00:10:32.025 11:21:13 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@31 -- # local 'subtype=nvme subsystem' 00:10:32.025 11:21:13 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@67 -- # jq -r .subnqn 00:10:32.025 11:21:13 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --hostid=3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -t tcp -a 10.0.0.3 -s 8009 -o json 00:10:32.025 11:21:13 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "nvme subsystem")' 00:10:32.025 11:21:13 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@67 -- # [[ nqn.2016-06.io.spdk:cnode1 == \n\q\n\.\2\0\1\6\-\0\6\.\i\o\.\s\p\d\k\:\c\n\o\d\e\1 ]] 00:10:32.025 11:21:13 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@68 -- # get_discovery_entries 'discovery subsystem referral' 00:10:32.025 11:21:13 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@31 -- # local 'subtype=discovery subsystem referral' 00:10:32.025 11:21:13 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@68 -- # jq -r .subnqn 00:10:32.025 11:21:13 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --hostid=3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -t tcp -a 10.0.0.3 -s 8009 -o json 00:10:32.025 11:21:13 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "discovery subsystem referral")' 00:10:32.283 11:21:13 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@68 -- # [[ nqn.2014-08.org.nvmexpress.discovery == \n\q\n\.\2\0\1\4\-\0\8\.\o\r\g\.\n\v\m\e\x\p\r\e\s\s\.\d\i\s\c\o\v\e\r\y ]] 00:10:32.283 11:21:13 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@71 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2016-06.io.spdk:cnode1 00:10:32.283 11:21:13 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@561 -- # xtrace_disable 00:10:32.283 11:21:13 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@10 -- # set +x 00:10:32.283 11:21:13 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:10:32.283 11:21:13 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@73 -- # get_referral_ips rpc 00:10:32.283 11:21:13 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:10:32.283 11:21:13 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:10:32.283 11:21:13 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@561 -- # xtrace_disable 00:10:32.283 11:21:13 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@10 -- # set +x 00:10:32.283 11:21:13 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@21 -- # sort 00:10:32.283 11:21:13 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:10:32.283 11:21:13 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:10:32.283 11:21:13 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@21 -- # echo 127.0.0.2 00:10:32.283 11:21:13 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@73 -- # [[ 127.0.0.2 == \1\2\7\.\0\.\0\.\2 ]] 00:10:32.283 11:21:13 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@74 -- # get_referral_ips nvme 00:10:32.283 11:21:13 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:10:32.283 11:21:13 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:10:32.283 11:21:13 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:10:32.283 11:21:13 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --hostid=3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -t tcp -a 10.0.0.3 -s 8009 -o json 00:10:32.283 11:21:13 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@26 -- # sort 00:10:32.283 11:21:13 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@26 -- # echo 127.0.0.2 00:10:32.283 11:21:13 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@74 -- # [[ 127.0.0.2 == \1\2\7\.\0\.\0\.\2 ]] 00:10:32.283 11:21:13 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@75 -- # get_discovery_entries 'nvme subsystem' 00:10:32.283 11:21:13 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@31 -- # local 'subtype=nvme subsystem' 00:10:32.283 11:21:13 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@75 -- # jq -r .subnqn 00:10:32.283 11:21:13 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --hostid=3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -t tcp -a 10.0.0.3 -s 8009 -o json 00:10:32.283 11:21:13 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "nvme subsystem")' 00:10:32.541 11:21:14 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@75 -- # [[ '' == '' ]] 00:10:32.541 11:21:14 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@76 -- # get_discovery_entries 'discovery subsystem referral' 00:10:32.541 11:21:14 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@31 -- # local 'subtype=discovery subsystem referral' 00:10:32.541 11:21:14 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@76 -- # jq -r .subnqn 00:10:32.541 11:21:14 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --hostid=3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -t tcp -a 10.0.0.3 -s 8009 -o json 00:10:32.541 11:21:14 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "discovery subsystem referral")' 00:10:32.541 11:21:14 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@76 -- # [[ nqn.2014-08.org.nvmexpress.discovery == \n\q\n\.\2\0\1\4\-\0\8\.\o\r\g\.\n\v\m\e\x\p\r\e\s\s\.\d\i\s\c\o\v\e\r\y ]] 00:10:32.541 11:21:14 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@79 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2014-08.org.nvmexpress.discovery 00:10:32.541 11:21:14 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@561 -- # xtrace_disable 00:10:32.541 11:21:14 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@10 -- # set +x 00:10:32.541 11:21:14 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:10:32.541 11:21:14 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@82 -- # rpc_cmd nvmf_discovery_get_referrals 00:10:32.541 11:21:14 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@561 -- # xtrace_disable 00:10:32.541 11:21:14 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@10 -- # set +x 00:10:32.541 11:21:14 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@82 -- # jq length 00:10:32.541 11:21:14 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:10:32.798 11:21:14 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@82 -- # (( 0 == 0 )) 00:10:32.798 11:21:14 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@83 -- # get_referral_ips nvme 00:10:32.799 11:21:14 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:10:32.799 11:21:14 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:10:32.799 11:21:14 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --hostid=3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -t tcp -a 10.0.0.3 -s 8009 -o json 00:10:32.799 11:21:14 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@26 -- # sort 00:10:32.799 11:21:14 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:10:32.799 11:21:14 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@26 -- # echo 00:10:32.799 11:21:14 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@83 -- # [[ '' == '' ]] 00:10:32.799 11:21:14 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@85 -- # trap - SIGINT SIGTERM EXIT 00:10:32.799 11:21:14 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- target/referrals.sh@86 -- # nvmftestfini 00:10:32.799 11:21:14 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@514 -- # nvmfcleanup 00:10:32.799 11:21:14 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@121 -- # sync 00:10:32.799 11:21:14 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:10:32.799 11:21:14 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@124 -- # set +e 00:10:32.799 11:21:14 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@125 -- # for i in {1..20} 00:10:32.799 11:21:14 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:10:32.799 rmmod nvme_tcp 00:10:32.799 rmmod nvme_fabrics 00:10:32.799 rmmod nvme_keyring 00:10:33.057 11:21:14 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:10:33.057 11:21:14 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@128 -- # set -e 00:10:33.057 11:21:14 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@129 -- # return 0 00:10:33.057 11:21:14 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@515 -- # '[' -n 73071 ']' 00:10:33.057 11:21:14 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@516 -- # killprocess 73071 00:10:33.057 11:21:14 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@950 -- # '[' -z 73071 ']' 00:10:33.057 11:21:14 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@954 -- # kill -0 73071 00:10:33.057 11:21:14 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@955 -- # uname 00:10:33.057 11:21:14 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:10:33.057 11:21:14 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 73071 00:10:33.057 11:21:14 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:10:33.057 11:21:14 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:10:33.057 killing process with pid 73071 00:10:33.057 11:21:14 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@968 -- # echo 'killing process with pid 73071' 00:10:33.057 11:21:14 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@969 -- # kill 73071 00:10:33.057 11:21:14 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@974 -- # wait 73071 00:10:33.315 11:21:14 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:10:33.315 11:21:14 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:10:33.315 11:21:14 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:10:33.315 11:21:14 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@297 -- # iptr 00:10:33.315 11:21:14 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@789 -- # iptables-save 00:10:33.315 11:21:14 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:10:33.315 11:21:14 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@789 -- # iptables-restore 00:10:33.315 11:21:14 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@298 -- # [[ nvmf_tgt_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:10:33.315 11:21:14 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@299 -- # nvmf_veth_fini 00:10:33.315 11:21:14 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@233 -- # ip link set nvmf_init_br nomaster 00:10:33.315 11:21:14 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@234 -- # ip link set nvmf_init_br2 nomaster 00:10:33.315 11:21:14 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@235 -- # ip link set nvmf_tgt_br nomaster 00:10:33.315 11:21:14 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@236 -- # ip link set nvmf_tgt_br2 nomaster 00:10:33.315 11:21:14 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@237 -- # ip link set nvmf_init_br down 00:10:33.315 11:21:14 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@238 -- # ip link set nvmf_init_br2 down 00:10:33.315 11:21:14 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@239 -- # ip link set nvmf_tgt_br down 00:10:33.315 11:21:14 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@240 -- # ip link set nvmf_tgt_br2 down 00:10:33.315 11:21:14 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@241 -- # ip link delete nvmf_br type bridge 00:10:33.315 11:21:14 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@242 -- # ip link delete nvmf_init_if 00:10:33.315 11:21:14 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@243 -- # ip link delete nvmf_init_if2 00:10:33.315 11:21:14 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@244 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:10:33.315 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@245 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:10:33.573 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@246 -- # remove_spdk_ns 00:10:33.573 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:10:33.573 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:10:33.573 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:10:33.573 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- nvmf/common.sh@300 -- # return 0 00:10:33.573 00:10:33.573 real 0m4.178s 00:10:33.573 user 0m12.701s 00:10:33.573 sys 0m1.088s 00:10:33.573 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@1126 -- # xtrace_disable 00:10:33.573 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_referrals -- common/autotest_common.sh@10 -- # set +x 00:10:33.573 ************************************ 00:10:33.573 END TEST nvmf_referrals 00:10:33.573 ************************************ 00:10:33.573 11:21:15 nvmf_tcp.nvmf_target_extra -- nvmf/nvmf_target_extra.sh@20 -- # run_test nvmf_connect_disconnect /home/vagrant/spdk_repo/spdk/test/nvmf/target/connect_disconnect.sh --transport=tcp 00:10:33.573 11:21:15 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:10:33.573 11:21:15 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1107 -- # xtrace_disable 00:10:33.573 11:21:15 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@10 -- # set +x 00:10:33.573 ************************************ 00:10:33.573 START TEST nvmf_connect_disconnect 00:10:33.573 ************************************ 00:10:33.573 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/nvmf/target/connect_disconnect.sh --transport=tcp 00:10:33.573 * Looking for test storage... 00:10:33.573 * Found test storage at /home/vagrant/spdk_repo/spdk/test/nvmf/target 00:10:33.573 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:10:33.573 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@1681 -- # lcov --version 00:10:33.573 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:10:33.858 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:10:33.858 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:10:33.858 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- scripts/common.sh@333 -- # local ver1 ver1_l 00:10:33.858 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- scripts/common.sh@334 -- # local ver2 ver2_l 00:10:33.858 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- scripts/common.sh@336 -- # IFS=.-: 00:10:33.858 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- scripts/common.sh@336 -- # read -ra ver1 00:10:33.858 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- scripts/common.sh@337 -- # IFS=.-: 00:10:33.858 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- scripts/common.sh@337 -- # read -ra ver2 00:10:33.858 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- scripts/common.sh@338 -- # local 'op=<' 00:10:33.858 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- scripts/common.sh@340 -- # ver1_l=2 00:10:33.858 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- scripts/common.sh@341 -- # ver2_l=1 00:10:33.858 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:10:33.858 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- scripts/common.sh@344 -- # case "$op" in 00:10:33.858 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- scripts/common.sh@345 -- # : 1 00:10:33.858 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- scripts/common.sh@364 -- # (( v = 0 )) 00:10:33.858 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:10:33.858 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- scripts/common.sh@365 -- # decimal 1 00:10:33.858 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- scripts/common.sh@353 -- # local d=1 00:10:33.858 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:10:33.858 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- scripts/common.sh@355 -- # echo 1 00:10:33.859 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- scripts/common.sh@365 -- # ver1[v]=1 00:10:33.859 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- scripts/common.sh@366 -- # decimal 2 00:10:33.859 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- scripts/common.sh@353 -- # local d=2 00:10:33.859 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:10:33.859 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- scripts/common.sh@355 -- # echo 2 00:10:33.859 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- scripts/common.sh@366 -- # ver2[v]=2 00:10:33.859 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:10:33.859 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:10:33.859 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- scripts/common.sh@368 -- # return 0 00:10:33.859 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:10:33.859 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:10:33.859 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:10:33.859 --rc genhtml_branch_coverage=1 00:10:33.859 --rc genhtml_function_coverage=1 00:10:33.859 --rc genhtml_legend=1 00:10:33.859 --rc geninfo_all_blocks=1 00:10:33.859 --rc geninfo_unexecuted_blocks=1 00:10:33.859 00:10:33.859 ' 00:10:33.859 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:10:33.859 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:10:33.859 --rc genhtml_branch_coverage=1 00:10:33.859 --rc genhtml_function_coverage=1 00:10:33.859 --rc genhtml_legend=1 00:10:33.859 --rc geninfo_all_blocks=1 00:10:33.859 --rc geninfo_unexecuted_blocks=1 00:10:33.859 00:10:33.859 ' 00:10:33.859 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:10:33.859 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:10:33.859 --rc genhtml_branch_coverage=1 00:10:33.859 --rc genhtml_function_coverage=1 00:10:33.859 --rc genhtml_legend=1 00:10:33.859 --rc geninfo_all_blocks=1 00:10:33.859 --rc geninfo_unexecuted_blocks=1 00:10:33.859 00:10:33.859 ' 00:10:33.859 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:10:33.859 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:10:33.859 --rc genhtml_branch_coverage=1 00:10:33.859 --rc genhtml_function_coverage=1 00:10:33.859 --rc genhtml_legend=1 00:10:33.859 --rc geninfo_all_blocks=1 00:10:33.859 --rc geninfo_unexecuted_blocks=1 00:10:33.859 00:10:33.859 ' 00:10:33.859 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- target/connect_disconnect.sh@9 -- # source /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh 00:10:33.859 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@7 -- # uname -s 00:10:33.859 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:10:33.859 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:10:33.859 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:10:33.859 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:10:33.859 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:10:33.859 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:10:33.859 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:10:33.859 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:10:33.859 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:10:33.859 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:10:33.859 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:10:33.859 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@18 -- # NVME_HOSTID=3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:10:33.859 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:10:33.859 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:10:33.859 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@21 -- # NET_TYPE=virt 00:10:33.859 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:10:33.859 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@49 -- # source /home/vagrant/spdk_repo/spdk/scripts/common.sh 00:10:33.859 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- scripts/common.sh@15 -- # shopt -s extglob 00:10:33.859 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:10:33.859 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:10:33.859 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:10:33.859 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:33.859 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:33.859 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:33.859 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- paths/export.sh@5 -- # export PATH 00:10:33.859 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:33.859 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@51 -- # : 0 00:10:33.859 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:10:33.859 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:10:33.859 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:10:33.859 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:10:33.859 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:10:33.859 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:10:33.859 /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:10:33.859 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:10:33.859 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:10:33.859 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@55 -- # have_pci_nics=0 00:10:33.859 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- target/connect_disconnect.sh@11 -- # MALLOC_BDEV_SIZE=64 00:10:33.859 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- target/connect_disconnect.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:10:33.859 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- target/connect_disconnect.sh@15 -- # nvmftestinit 00:10:33.859 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:10:33.859 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:10:33.859 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@474 -- # prepare_net_devs 00:10:33.859 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@436 -- # local -g is_hw=no 00:10:33.859 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@438 -- # remove_spdk_ns 00:10:33.859 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:10:33.859 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:10:33.859 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:10:33.859 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@440 -- # [[ virt != virt ]] 00:10:33.859 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@442 -- # [[ no == yes ]] 00:10:33.859 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@449 -- # [[ virt == phy ]] 00:10:33.859 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@452 -- # [[ virt == phy-fallback ]] 00:10:33.859 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@457 -- # [[ tcp == tcp ]] 00:10:33.859 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@458 -- # nvmf_veth_init 00:10:33.859 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@145 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:10:33.859 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@146 -- # NVMF_SECOND_INITIATOR_IP=10.0.0.2 00:10:33.859 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@147 -- # NVMF_FIRST_TARGET_IP=10.0.0.3 00:10:33.859 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@148 -- # NVMF_SECOND_TARGET_IP=10.0.0.4 00:10:33.859 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@149 -- # NVMF_INITIATOR_IP=10.0.0.1 00:10:33.859 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@150 -- # NVMF_BRIDGE=nvmf_br 00:10:33.859 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@151 -- # NVMF_INITIATOR_INTERFACE=nvmf_init_if 00:10:33.859 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@152 -- # NVMF_INITIATOR_INTERFACE2=nvmf_init_if2 00:10:33.860 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@153 -- # NVMF_INITIATOR_BRIDGE=nvmf_init_br 00:10:33.860 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@154 -- # NVMF_INITIATOR_BRIDGE2=nvmf_init_br2 00:10:33.860 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@155 -- # NVMF_TARGET_NAMESPACE=nvmf_tgt_ns_spdk 00:10:33.860 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@156 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:10:33.860 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@157 -- # NVMF_TARGET_INTERFACE=nvmf_tgt_if 00:10:33.860 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@158 -- # NVMF_TARGET_INTERFACE2=nvmf_tgt_if2 00:10:33.860 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@159 -- # NVMF_TARGET_BRIDGE=nvmf_tgt_br 00:10:33.860 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@160 -- # NVMF_TARGET_BRIDGE2=nvmf_tgt_br2 00:10:33.860 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@162 -- # ip link set nvmf_init_br nomaster 00:10:33.860 Cannot find device "nvmf_init_br" 00:10:33.860 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@162 -- # true 00:10:33.860 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@163 -- # ip link set nvmf_init_br2 nomaster 00:10:33.860 Cannot find device "nvmf_init_br2" 00:10:33.860 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@163 -- # true 00:10:33.860 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@164 -- # ip link set nvmf_tgt_br nomaster 00:10:33.860 Cannot find device "nvmf_tgt_br" 00:10:33.860 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@164 -- # true 00:10:33.860 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@165 -- # ip link set nvmf_tgt_br2 nomaster 00:10:33.860 Cannot find device "nvmf_tgt_br2" 00:10:33.860 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@165 -- # true 00:10:33.860 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@166 -- # ip link set nvmf_init_br down 00:10:33.860 Cannot find device "nvmf_init_br" 00:10:33.860 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@166 -- # true 00:10:33.860 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@167 -- # ip link set nvmf_init_br2 down 00:10:33.860 Cannot find device "nvmf_init_br2" 00:10:33.860 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@167 -- # true 00:10:33.860 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@168 -- # ip link set nvmf_tgt_br down 00:10:33.860 Cannot find device "nvmf_tgt_br" 00:10:33.860 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@168 -- # true 00:10:33.860 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@169 -- # ip link set nvmf_tgt_br2 down 00:10:33.860 Cannot find device "nvmf_tgt_br2" 00:10:33.860 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@169 -- # true 00:10:33.860 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@170 -- # ip link delete nvmf_br type bridge 00:10:33.860 Cannot find device "nvmf_br" 00:10:33.860 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@170 -- # true 00:10:33.860 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@171 -- # ip link delete nvmf_init_if 00:10:33.860 Cannot find device "nvmf_init_if" 00:10:33.860 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@171 -- # true 00:10:33.860 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@172 -- # ip link delete nvmf_init_if2 00:10:33.860 Cannot find device "nvmf_init_if2" 00:10:33.860 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@172 -- # true 00:10:33.860 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@173 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:10:33.860 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:10:33.860 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@173 -- # true 00:10:33.860 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@174 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:10:33.860 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:10:33.860 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@174 -- # true 00:10:33.860 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@177 -- # ip netns add nvmf_tgt_ns_spdk 00:10:33.860 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@180 -- # ip link add nvmf_init_if type veth peer name nvmf_init_br 00:10:33.860 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@181 -- # ip link add nvmf_init_if2 type veth peer name nvmf_init_br2 00:10:33.860 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@182 -- # ip link add nvmf_tgt_if type veth peer name nvmf_tgt_br 00:10:33.860 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@183 -- # ip link add nvmf_tgt_if2 type veth peer name nvmf_tgt_br2 00:10:33.860 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@186 -- # ip link set nvmf_tgt_if netns nvmf_tgt_ns_spdk 00:10:33.860 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@187 -- # ip link set nvmf_tgt_if2 netns nvmf_tgt_ns_spdk 00:10:34.120 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@190 -- # ip addr add 10.0.0.1/24 dev nvmf_init_if 00:10:34.120 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@191 -- # ip addr add 10.0.0.2/24 dev nvmf_init_if2 00:10:34.120 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@192 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.3/24 dev nvmf_tgt_if 00:10:34.120 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@193 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.4/24 dev nvmf_tgt_if2 00:10:34.120 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@196 -- # ip link set nvmf_init_if up 00:10:34.120 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@197 -- # ip link set nvmf_init_if2 up 00:10:34.120 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@198 -- # ip link set nvmf_init_br up 00:10:34.120 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@199 -- # ip link set nvmf_init_br2 up 00:10:34.120 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@200 -- # ip link set nvmf_tgt_br up 00:10:34.120 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@201 -- # ip link set nvmf_tgt_br2 up 00:10:34.120 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@202 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if up 00:10:34.120 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@203 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if2 up 00:10:34.120 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@204 -- # ip netns exec nvmf_tgt_ns_spdk ip link set lo up 00:10:34.120 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@207 -- # ip link add nvmf_br type bridge 00:10:34.120 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@208 -- # ip link set nvmf_br up 00:10:34.120 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@211 -- # ip link set nvmf_init_br master nvmf_br 00:10:34.120 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@212 -- # ip link set nvmf_init_br2 master nvmf_br 00:10:34.120 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@213 -- # ip link set nvmf_tgt_br master nvmf_br 00:10:34.120 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@214 -- # ip link set nvmf_tgt_br2 master nvmf_br 00:10:34.120 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@217 -- # ipts -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT 00:10:34.120 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT' 00:10:34.120 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@218 -- # ipts -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT 00:10:34.120 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT' 00:10:34.120 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@219 -- # ipts -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT 00:10:34.120 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@788 -- # iptables -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT -m comment --comment 'SPDK_NVMF:-A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT' 00:10:34.120 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@222 -- # ping -c 1 10.0.0.3 00:10:34.120 PING 10.0.0.3 (10.0.0.3) 56(84) bytes of data. 00:10:34.120 64 bytes from 10.0.0.3: icmp_seq=1 ttl=64 time=0.104 ms 00:10:34.120 00:10:34.120 --- 10.0.0.3 ping statistics --- 00:10:34.120 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:10:34.120 rtt min/avg/max/mdev = 0.104/0.104/0.104/0.000 ms 00:10:34.120 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@223 -- # ping -c 1 10.0.0.4 00:10:34.120 PING 10.0.0.4 (10.0.0.4) 56(84) bytes of data. 00:10:34.120 64 bytes from 10.0.0.4: icmp_seq=1 ttl=64 time=0.039 ms 00:10:34.120 00:10:34.120 --- 10.0.0.4 ping statistics --- 00:10:34.120 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:10:34.120 rtt min/avg/max/mdev = 0.039/0.039/0.039/0.000 ms 00:10:34.120 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@224 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.1 00:10:34.120 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:10:34.120 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.031 ms 00:10:34.120 00:10:34.120 --- 10.0.0.1 ping statistics --- 00:10:34.120 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:10:34.120 rtt min/avg/max/mdev = 0.031/0.031/0.031/0.000 ms 00:10:34.120 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@225 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.2 00:10:34.120 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:10:34.120 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.098 ms 00:10:34.120 00:10:34.120 --- 10.0.0.2 ping statistics --- 00:10:34.120 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:10:34.120 rtt min/avg/max/mdev = 0.098/0.098/0.098/0.000 ms 00:10:34.120 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@227 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:10:34.120 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@459 -- # return 0 00:10:34.120 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:10:34.120 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:10:34.120 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:10:34.120 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:10:34.120 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:10:34.120 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:10:34.120 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:10:34.120 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- target/connect_disconnect.sh@16 -- # nvmfappstart -m 0xF 00:10:34.120 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:10:34.120 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@724 -- # xtrace_disable 00:10:34.120 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@10 -- # set +x 00:10:34.120 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@507 -- # nvmfpid=73434 00:10:34.120 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@508 -- # waitforlisten 73434 00:10:34.120 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@506 -- # ip netns exec nvmf_tgt_ns_spdk /home/vagrant/spdk_repo/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:10:34.120 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@831 -- # '[' -z 73434 ']' 00:10:34.120 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:10:34.120 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@836 -- # local max_retries=100 00:10:34.120 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:10:34.120 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:10:34.120 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@840 -- # xtrace_disable 00:10:34.120 11:21:15 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@10 -- # set +x 00:10:34.120 [2024-10-07 11:21:15.812050] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:10:34.120 [2024-10-07 11:21:15.812162] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:10:34.377 [2024-10-07 11:21:15.949873] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 4 00:10:34.634 [2024-10-07 11:21:16.113958] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:10:34.635 [2024-10-07 11:21:16.114058] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:10:34.635 [2024-10-07 11:21:16.114074] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:10:34.635 [2024-10-07 11:21:16.114085] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:10:34.635 [2024-10-07 11:21:16.114095] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:10:34.635 [2024-10-07 11:21:16.115758] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:10:34.635 [2024-10-07 11:21:16.115905] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:10:34.635 [2024-10-07 11:21:16.116026] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 3 00:10:34.635 [2024-10-07 11:21:16.116028] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:10:35.200 11:21:16 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:10:35.200 11:21:16 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@864 -- # return 0 00:10:35.200 11:21:16 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:10:35.200 11:21:16 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@730 -- # xtrace_disable 00:10:35.200 11:21:16 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@10 -- # set +x 00:10:35.200 11:21:16 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:10:35.200 11:21:16 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- target/connect_disconnect.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 0 00:10:35.200 11:21:16 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@561 -- # xtrace_disable 00:10:35.200 11:21:16 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@10 -- # set +x 00:10:35.200 [2024-10-07 11:21:16.905474] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:10:35.459 11:21:16 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:10:35.459 11:21:16 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- target/connect_disconnect.sh@20 -- # rpc_cmd bdev_malloc_create 64 512 00:10:35.459 11:21:16 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@561 -- # xtrace_disable 00:10:35.459 11:21:16 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@10 -- # set +x 00:10:35.459 11:21:16 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:10:35.459 11:21:16 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- target/connect_disconnect.sh@20 -- # bdev=Malloc0 00:10:35.459 11:21:16 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- target/connect_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:10:35.459 11:21:16 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@561 -- # xtrace_disable 00:10:35.459 11:21:16 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@10 -- # set +x 00:10:35.459 11:21:16 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:10:35.459 11:21:16 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- target/connect_disconnect.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:10:35.459 11:21:16 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@561 -- # xtrace_disable 00:10:35.459 11:21:16 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@10 -- # set +x 00:10:35.459 11:21:16 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:10:35.459 11:21:16 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- target/connect_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4420 00:10:35.459 11:21:16 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@561 -- # xtrace_disable 00:10:35.459 11:21:16 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@10 -- # set +x 00:10:35.459 [2024-10-07 11:21:16.980013] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:10:35.459 11:21:16 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:10:35.459 11:21:16 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- target/connect_disconnect.sh@26 -- # '[' 0 -eq 1 ']' 00:10:35.459 11:21:16 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- target/connect_disconnect.sh@31 -- # num_iterations=5 00:10:35.459 11:21:16 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- target/connect_disconnect.sh@34 -- # set +x 00:10:38.024 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:39.926 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:42.483 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:44.403 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:46.958 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:46.958 11:21:28 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- target/connect_disconnect.sh@43 -- # trap - SIGINT SIGTERM EXIT 00:10:46.958 11:21:28 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- target/connect_disconnect.sh@45 -- # nvmftestfini 00:10:46.958 11:21:28 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@514 -- # nvmfcleanup 00:10:46.958 11:21:28 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@121 -- # sync 00:10:46.958 11:21:28 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:10:46.958 11:21:28 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@124 -- # set +e 00:10:46.958 11:21:28 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@125 -- # for i in {1..20} 00:10:46.958 11:21:28 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:10:46.958 rmmod nvme_tcp 00:10:46.958 rmmod nvme_fabrics 00:10:46.958 rmmod nvme_keyring 00:10:46.958 11:21:28 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:10:46.958 11:21:28 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@128 -- # set -e 00:10:46.958 11:21:28 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@129 -- # return 0 00:10:46.958 11:21:28 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@515 -- # '[' -n 73434 ']' 00:10:46.958 11:21:28 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@516 -- # killprocess 73434 00:10:46.958 11:21:28 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@950 -- # '[' -z 73434 ']' 00:10:46.958 11:21:28 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@954 -- # kill -0 73434 00:10:46.958 11:21:28 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@955 -- # uname 00:10:46.958 11:21:28 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:10:46.958 11:21:28 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 73434 00:10:46.958 killing process with pid 73434 00:10:46.958 11:21:28 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:10:46.958 11:21:28 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:10:46.958 11:21:28 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@968 -- # echo 'killing process with pid 73434' 00:10:46.958 11:21:28 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@969 -- # kill 73434 00:10:46.958 11:21:28 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@974 -- # wait 73434 00:10:47.216 11:21:28 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:10:47.216 11:21:28 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:10:47.216 11:21:28 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:10:47.216 11:21:28 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@297 -- # iptr 00:10:47.216 11:21:28 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@789 -- # iptables-save 00:10:47.216 11:21:28 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:10:47.216 11:21:28 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@789 -- # iptables-restore 00:10:47.216 11:21:28 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@298 -- # [[ nvmf_tgt_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:10:47.216 11:21:28 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@299 -- # nvmf_veth_fini 00:10:47.216 11:21:28 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@233 -- # ip link set nvmf_init_br nomaster 00:10:47.216 11:21:28 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@234 -- # ip link set nvmf_init_br2 nomaster 00:10:47.216 11:21:28 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@235 -- # ip link set nvmf_tgt_br nomaster 00:10:47.216 11:21:28 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@236 -- # ip link set nvmf_tgt_br2 nomaster 00:10:47.216 11:21:28 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@237 -- # ip link set nvmf_init_br down 00:10:47.216 11:21:28 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@238 -- # ip link set nvmf_init_br2 down 00:10:47.216 11:21:28 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@239 -- # ip link set nvmf_tgt_br down 00:10:47.216 11:21:28 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@240 -- # ip link set nvmf_tgt_br2 down 00:10:47.216 11:21:28 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@241 -- # ip link delete nvmf_br type bridge 00:10:47.216 11:21:28 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@242 -- # ip link delete nvmf_init_if 00:10:47.216 11:21:28 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@243 -- # ip link delete nvmf_init_if2 00:10:47.216 11:21:28 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@244 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:10:47.474 11:21:28 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@245 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:10:47.474 11:21:28 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@246 -- # remove_spdk_ns 00:10:47.474 11:21:28 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:10:47.474 11:21:28 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:10:47.474 11:21:28 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:10:47.474 11:21:28 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- nvmf/common.sh@300 -- # return 0 00:10:47.474 00:10:47.474 real 0m13.891s 00:10:47.474 user 0m49.653s 00:10:47.474 sys 0m1.852s 00:10:47.474 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@1126 -- # xtrace_disable 00:10:47.474 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_connect_disconnect -- common/autotest_common.sh@10 -- # set +x 00:10:47.474 ************************************ 00:10:47.474 END TEST nvmf_connect_disconnect 00:10:47.474 ************************************ 00:10:47.474 11:21:29 nvmf_tcp.nvmf_target_extra -- nvmf/nvmf_target_extra.sh@21 -- # run_test nvmf_multitarget /home/vagrant/spdk_repo/spdk/test/nvmf/target/multitarget.sh --transport=tcp 00:10:47.474 11:21:29 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:10:47.474 11:21:29 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1107 -- # xtrace_disable 00:10:47.474 11:21:29 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@10 -- # set +x 00:10:47.474 ************************************ 00:10:47.474 START TEST nvmf_multitarget 00:10:47.474 ************************************ 00:10:47.474 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/nvmf/target/multitarget.sh --transport=tcp 00:10:47.474 * Looking for test storage... 00:10:47.474 * Found test storage at /home/vagrant/spdk_repo/spdk/test/nvmf/target 00:10:47.474 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:10:47.474 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- common/autotest_common.sh@1681 -- # lcov --version 00:10:47.474 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:10:47.733 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:10:47.733 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:10:47.733 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- scripts/common.sh@333 -- # local ver1 ver1_l 00:10:47.733 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- scripts/common.sh@334 -- # local ver2 ver2_l 00:10:47.733 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- scripts/common.sh@336 -- # IFS=.-: 00:10:47.733 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- scripts/common.sh@336 -- # read -ra ver1 00:10:47.733 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- scripts/common.sh@337 -- # IFS=.-: 00:10:47.733 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- scripts/common.sh@337 -- # read -ra ver2 00:10:47.733 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- scripts/common.sh@338 -- # local 'op=<' 00:10:47.733 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- scripts/common.sh@340 -- # ver1_l=2 00:10:47.733 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- scripts/common.sh@341 -- # ver2_l=1 00:10:47.733 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:10:47.733 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- scripts/common.sh@344 -- # case "$op" in 00:10:47.733 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- scripts/common.sh@345 -- # : 1 00:10:47.733 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- scripts/common.sh@364 -- # (( v = 0 )) 00:10:47.733 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:10:47.733 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- scripts/common.sh@365 -- # decimal 1 00:10:47.733 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- scripts/common.sh@353 -- # local d=1 00:10:47.733 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:10:47.733 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- scripts/common.sh@355 -- # echo 1 00:10:47.733 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- scripts/common.sh@365 -- # ver1[v]=1 00:10:47.733 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- scripts/common.sh@366 -- # decimal 2 00:10:47.733 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- scripts/common.sh@353 -- # local d=2 00:10:47.733 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:10:47.733 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- scripts/common.sh@355 -- # echo 2 00:10:47.733 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- scripts/common.sh@366 -- # ver2[v]=2 00:10:47.733 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:10:47.733 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:10:47.733 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- scripts/common.sh@368 -- # return 0 00:10:47.733 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:10:47.733 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:10:47.733 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:10:47.733 --rc genhtml_branch_coverage=1 00:10:47.733 --rc genhtml_function_coverage=1 00:10:47.733 --rc genhtml_legend=1 00:10:47.733 --rc geninfo_all_blocks=1 00:10:47.733 --rc geninfo_unexecuted_blocks=1 00:10:47.733 00:10:47.733 ' 00:10:47.733 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:10:47.733 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:10:47.733 --rc genhtml_branch_coverage=1 00:10:47.733 --rc genhtml_function_coverage=1 00:10:47.733 --rc genhtml_legend=1 00:10:47.733 --rc geninfo_all_blocks=1 00:10:47.733 --rc geninfo_unexecuted_blocks=1 00:10:47.733 00:10:47.733 ' 00:10:47.733 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:10:47.733 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:10:47.733 --rc genhtml_branch_coverage=1 00:10:47.733 --rc genhtml_function_coverage=1 00:10:47.733 --rc genhtml_legend=1 00:10:47.733 --rc geninfo_all_blocks=1 00:10:47.733 --rc geninfo_unexecuted_blocks=1 00:10:47.733 00:10:47.733 ' 00:10:47.733 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:10:47.733 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:10:47.733 --rc genhtml_branch_coverage=1 00:10:47.733 --rc genhtml_function_coverage=1 00:10:47.733 --rc genhtml_legend=1 00:10:47.733 --rc geninfo_all_blocks=1 00:10:47.733 --rc geninfo_unexecuted_blocks=1 00:10:47.733 00:10:47.733 ' 00:10:47.733 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- target/multitarget.sh@9 -- # source /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh 00:10:47.733 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@7 -- # uname -s 00:10:47.733 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:10:47.733 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:10:47.733 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:10:47.733 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:10:47.733 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:10:47.733 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:10:47.733 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:10:47.734 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:10:47.734 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:10:47.734 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:10:47.734 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:10:47.734 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@18 -- # NVME_HOSTID=3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:10:47.734 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:10:47.734 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:10:47.734 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@21 -- # NET_TYPE=virt 00:10:47.734 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:10:47.734 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@49 -- # source /home/vagrant/spdk_repo/spdk/scripts/common.sh 00:10:47.734 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- scripts/common.sh@15 -- # shopt -s extglob 00:10:47.734 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:10:47.734 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:10:47.734 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:10:47.734 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:47.734 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:47.734 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:47.734 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- paths/export.sh@5 -- # export PATH 00:10:47.734 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:47.734 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@51 -- # : 0 00:10:47.734 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:10:47.734 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:10:47.734 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:10:47.734 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:10:47.734 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:10:47.734 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:10:47.734 /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:10:47.734 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:10:47.734 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:10:47.734 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@55 -- # have_pci_nics=0 00:10:47.734 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- target/multitarget.sh@13 -- # rpc_py=/home/vagrant/spdk_repo/spdk/test/nvmf/target/multitarget_rpc.py 00:10:47.734 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- target/multitarget.sh@15 -- # nvmftestinit 00:10:47.734 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:10:47.734 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:10:47.734 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@474 -- # prepare_net_devs 00:10:47.734 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@436 -- # local -g is_hw=no 00:10:47.734 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@438 -- # remove_spdk_ns 00:10:47.734 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:10:47.734 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:10:47.734 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:10:47.734 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@440 -- # [[ virt != virt ]] 00:10:47.734 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@442 -- # [[ no == yes ]] 00:10:47.734 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@449 -- # [[ virt == phy ]] 00:10:47.734 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@452 -- # [[ virt == phy-fallback ]] 00:10:47.734 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@457 -- # [[ tcp == tcp ]] 00:10:47.734 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@458 -- # nvmf_veth_init 00:10:47.734 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@145 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:10:47.734 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@146 -- # NVMF_SECOND_INITIATOR_IP=10.0.0.2 00:10:47.734 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@147 -- # NVMF_FIRST_TARGET_IP=10.0.0.3 00:10:47.734 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@148 -- # NVMF_SECOND_TARGET_IP=10.0.0.4 00:10:47.734 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@149 -- # NVMF_INITIATOR_IP=10.0.0.1 00:10:47.734 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@150 -- # NVMF_BRIDGE=nvmf_br 00:10:47.734 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@151 -- # NVMF_INITIATOR_INTERFACE=nvmf_init_if 00:10:47.734 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@152 -- # NVMF_INITIATOR_INTERFACE2=nvmf_init_if2 00:10:47.734 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@153 -- # NVMF_INITIATOR_BRIDGE=nvmf_init_br 00:10:47.734 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@154 -- # NVMF_INITIATOR_BRIDGE2=nvmf_init_br2 00:10:47.734 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@155 -- # NVMF_TARGET_NAMESPACE=nvmf_tgt_ns_spdk 00:10:47.734 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@156 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:10:47.734 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@157 -- # NVMF_TARGET_INTERFACE=nvmf_tgt_if 00:10:47.734 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@158 -- # NVMF_TARGET_INTERFACE2=nvmf_tgt_if2 00:10:47.734 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@159 -- # NVMF_TARGET_BRIDGE=nvmf_tgt_br 00:10:47.734 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@160 -- # NVMF_TARGET_BRIDGE2=nvmf_tgt_br2 00:10:47.734 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@162 -- # ip link set nvmf_init_br nomaster 00:10:47.734 Cannot find device "nvmf_init_br" 00:10:47.734 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@162 -- # true 00:10:47.734 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@163 -- # ip link set nvmf_init_br2 nomaster 00:10:47.734 Cannot find device "nvmf_init_br2" 00:10:47.734 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@163 -- # true 00:10:47.734 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@164 -- # ip link set nvmf_tgt_br nomaster 00:10:47.734 Cannot find device "nvmf_tgt_br" 00:10:47.734 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@164 -- # true 00:10:47.734 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@165 -- # ip link set nvmf_tgt_br2 nomaster 00:10:47.734 Cannot find device "nvmf_tgt_br2" 00:10:47.734 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@165 -- # true 00:10:47.734 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@166 -- # ip link set nvmf_init_br down 00:10:47.734 Cannot find device "nvmf_init_br" 00:10:47.734 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@166 -- # true 00:10:47.734 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@167 -- # ip link set nvmf_init_br2 down 00:10:47.734 Cannot find device "nvmf_init_br2" 00:10:47.734 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@167 -- # true 00:10:47.734 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@168 -- # ip link set nvmf_tgt_br down 00:10:47.734 Cannot find device "nvmf_tgt_br" 00:10:47.734 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@168 -- # true 00:10:47.734 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@169 -- # ip link set nvmf_tgt_br2 down 00:10:47.734 Cannot find device "nvmf_tgt_br2" 00:10:47.734 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@169 -- # true 00:10:47.734 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@170 -- # ip link delete nvmf_br type bridge 00:10:47.734 Cannot find device "nvmf_br" 00:10:47.734 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@170 -- # true 00:10:47.734 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@171 -- # ip link delete nvmf_init_if 00:10:47.734 Cannot find device "nvmf_init_if" 00:10:47.734 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@171 -- # true 00:10:47.734 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@172 -- # ip link delete nvmf_init_if2 00:10:47.734 Cannot find device "nvmf_init_if2" 00:10:47.734 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@172 -- # true 00:10:47.734 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@173 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:10:47.734 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:10:47.734 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@173 -- # true 00:10:47.734 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@174 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:10:47.734 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:10:47.734 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@174 -- # true 00:10:47.734 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@177 -- # ip netns add nvmf_tgt_ns_spdk 00:10:47.734 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@180 -- # ip link add nvmf_init_if type veth peer name nvmf_init_br 00:10:47.734 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@181 -- # ip link add nvmf_init_if2 type veth peer name nvmf_init_br2 00:10:47.735 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@182 -- # ip link add nvmf_tgt_if type veth peer name nvmf_tgt_br 00:10:47.993 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@183 -- # ip link add nvmf_tgt_if2 type veth peer name nvmf_tgt_br2 00:10:47.993 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@186 -- # ip link set nvmf_tgt_if netns nvmf_tgt_ns_spdk 00:10:47.993 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@187 -- # ip link set nvmf_tgt_if2 netns nvmf_tgt_ns_spdk 00:10:47.993 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@190 -- # ip addr add 10.0.0.1/24 dev nvmf_init_if 00:10:47.993 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@191 -- # ip addr add 10.0.0.2/24 dev nvmf_init_if2 00:10:47.993 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@192 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.3/24 dev nvmf_tgt_if 00:10:47.993 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@193 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.4/24 dev nvmf_tgt_if2 00:10:47.993 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@196 -- # ip link set nvmf_init_if up 00:10:47.993 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@197 -- # ip link set nvmf_init_if2 up 00:10:47.993 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@198 -- # ip link set nvmf_init_br up 00:10:47.993 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@199 -- # ip link set nvmf_init_br2 up 00:10:47.993 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@200 -- # ip link set nvmf_tgt_br up 00:10:47.993 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@201 -- # ip link set nvmf_tgt_br2 up 00:10:47.993 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@202 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if up 00:10:47.993 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@203 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if2 up 00:10:47.993 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@204 -- # ip netns exec nvmf_tgt_ns_spdk ip link set lo up 00:10:47.993 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@207 -- # ip link add nvmf_br type bridge 00:10:47.993 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@208 -- # ip link set nvmf_br up 00:10:47.993 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@211 -- # ip link set nvmf_init_br master nvmf_br 00:10:47.993 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@212 -- # ip link set nvmf_init_br2 master nvmf_br 00:10:47.994 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@213 -- # ip link set nvmf_tgt_br master nvmf_br 00:10:47.994 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@214 -- # ip link set nvmf_tgt_br2 master nvmf_br 00:10:47.994 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@217 -- # ipts -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT 00:10:47.994 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT' 00:10:47.994 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@218 -- # ipts -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT 00:10:47.994 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT' 00:10:47.994 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@219 -- # ipts -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT 00:10:47.994 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@788 -- # iptables -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT -m comment --comment 'SPDK_NVMF:-A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT' 00:10:47.994 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@222 -- # ping -c 1 10.0.0.3 00:10:47.994 PING 10.0.0.3 (10.0.0.3) 56(84) bytes of data. 00:10:47.994 64 bytes from 10.0.0.3: icmp_seq=1 ttl=64 time=0.148 ms 00:10:47.994 00:10:47.994 --- 10.0.0.3 ping statistics --- 00:10:47.994 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:10:47.994 rtt min/avg/max/mdev = 0.148/0.148/0.148/0.000 ms 00:10:47.994 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@223 -- # ping -c 1 10.0.0.4 00:10:47.994 PING 10.0.0.4 (10.0.0.4) 56(84) bytes of data. 00:10:47.994 64 bytes from 10.0.0.4: icmp_seq=1 ttl=64 time=0.107 ms 00:10:47.994 00:10:47.994 --- 10.0.0.4 ping statistics --- 00:10:47.994 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:10:47.994 rtt min/avg/max/mdev = 0.107/0.107/0.107/0.000 ms 00:10:47.994 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@224 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.1 00:10:47.994 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:10:47.994 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.065 ms 00:10:47.994 00:10:47.994 --- 10.0.0.1 ping statistics --- 00:10:47.994 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:10:47.994 rtt min/avg/max/mdev = 0.065/0.065/0.065/0.000 ms 00:10:47.994 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@225 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.2 00:10:47.994 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:10:47.994 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.058 ms 00:10:47.994 00:10:47.994 --- 10.0.0.2 ping statistics --- 00:10:47.994 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:10:47.994 rtt min/avg/max/mdev = 0.058/0.058/0.058/0.000 ms 00:10:47.994 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@227 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:10:47.994 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@459 -- # return 0 00:10:47.994 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:10:47.994 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:10:47.994 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:10:47.994 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:10:47.994 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:10:47.994 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:10:47.994 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:10:47.994 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- target/multitarget.sh@16 -- # nvmfappstart -m 0xF 00:10:47.994 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:10:47.994 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- common/autotest_common.sh@724 -- # xtrace_disable 00:10:47.994 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- common/autotest_common.sh@10 -- # set +x 00:10:47.994 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@507 -- # nvmfpid=73899 00:10:47.994 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@508 -- # waitforlisten 73899 00:10:47.994 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@506 -- # ip netns exec nvmf_tgt_ns_spdk /home/vagrant/spdk_repo/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:10:47.994 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- common/autotest_common.sh@831 -- # '[' -z 73899 ']' 00:10:47.994 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:10:47.994 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- common/autotest_common.sh@836 -- # local max_retries=100 00:10:47.994 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:10:47.994 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:10:47.994 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- common/autotest_common.sh@840 -- # xtrace_disable 00:10:47.994 11:21:29 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- common/autotest_common.sh@10 -- # set +x 00:10:48.252 [2024-10-07 11:21:29.750959] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:10:48.252 [2024-10-07 11:21:29.751067] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:10:48.252 [2024-10-07 11:21:29.893080] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 4 00:10:48.510 [2024-10-07 11:21:30.062360] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:10:48.510 [2024-10-07 11:21:30.062469] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:10:48.510 [2024-10-07 11:21:30.062484] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:10:48.510 [2024-10-07 11:21:30.062495] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:10:48.510 [2024-10-07 11:21:30.062505] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:10:48.510 [2024-10-07 11:21:30.064175] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:10:48.510 [2024-10-07 11:21:30.064323] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:10:48.510 [2024-10-07 11:21:30.064470] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 3 00:10:48.510 [2024-10-07 11:21:30.064789] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:10:49.444 11:21:30 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:10:49.444 11:21:30 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- common/autotest_common.sh@864 -- # return 0 00:10:49.444 11:21:30 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:10:49.444 11:21:30 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- common/autotest_common.sh@730 -- # xtrace_disable 00:10:49.444 11:21:30 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- common/autotest_common.sh@10 -- # set +x 00:10:49.444 11:21:30 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:10:49.444 11:21:30 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- target/multitarget.sh@18 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:10:49.444 11:21:30 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- target/multitarget.sh@21 -- # /home/vagrant/spdk_repo/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:10:49.444 11:21:30 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- target/multitarget.sh@21 -- # jq length 00:10:49.444 11:21:31 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- target/multitarget.sh@21 -- # '[' 1 '!=' 1 ']' 00:10:49.444 11:21:31 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- target/multitarget.sh@25 -- # /home/vagrant/spdk_repo/spdk/test/nvmf/target/multitarget_rpc.py nvmf_create_target -n nvmf_tgt_1 -s 32 00:10:49.444 "nvmf_tgt_1" 00:10:49.444 11:21:31 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- target/multitarget.sh@26 -- # /home/vagrant/spdk_repo/spdk/test/nvmf/target/multitarget_rpc.py nvmf_create_target -n nvmf_tgt_2 -s 32 00:10:49.703 "nvmf_tgt_2" 00:10:49.703 11:21:31 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- target/multitarget.sh@28 -- # /home/vagrant/spdk_repo/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:10:49.703 11:21:31 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- target/multitarget.sh@28 -- # jq length 00:10:49.962 11:21:31 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- target/multitarget.sh@28 -- # '[' 3 '!=' 3 ']' 00:10:49.962 11:21:31 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- target/multitarget.sh@32 -- # /home/vagrant/spdk_repo/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target -n nvmf_tgt_1 00:10:49.962 true 00:10:49.962 11:21:31 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- target/multitarget.sh@33 -- # /home/vagrant/spdk_repo/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target -n nvmf_tgt_2 00:10:50.222 true 00:10:50.222 11:21:31 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- target/multitarget.sh@35 -- # jq length 00:10:50.223 11:21:31 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- target/multitarget.sh@35 -- # /home/vagrant/spdk_repo/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:10:50.223 11:21:31 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- target/multitarget.sh@35 -- # '[' 1 '!=' 1 ']' 00:10:50.223 11:21:31 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- target/multitarget.sh@39 -- # trap - SIGINT SIGTERM EXIT 00:10:50.223 11:21:31 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- target/multitarget.sh@41 -- # nvmftestfini 00:10:50.223 11:21:31 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@514 -- # nvmfcleanup 00:10:50.223 11:21:31 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@121 -- # sync 00:10:50.223 11:21:31 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:10:50.223 11:21:31 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@124 -- # set +e 00:10:50.223 11:21:31 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@125 -- # for i in {1..20} 00:10:50.223 11:21:31 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:10:50.223 rmmod nvme_tcp 00:10:50.223 rmmod nvme_fabrics 00:10:50.223 rmmod nvme_keyring 00:10:50.481 11:21:31 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:10:50.481 11:21:31 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@128 -- # set -e 00:10:50.481 11:21:31 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@129 -- # return 0 00:10:50.481 11:21:31 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@515 -- # '[' -n 73899 ']' 00:10:50.481 11:21:31 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@516 -- # killprocess 73899 00:10:50.481 11:21:31 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- common/autotest_common.sh@950 -- # '[' -z 73899 ']' 00:10:50.481 11:21:31 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- common/autotest_common.sh@954 -- # kill -0 73899 00:10:50.481 11:21:31 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- common/autotest_common.sh@955 -- # uname 00:10:50.481 11:21:31 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:10:50.481 11:21:31 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 73899 00:10:50.481 killing process with pid 73899 00:10:50.481 11:21:31 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:10:50.481 11:21:31 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:10:50.481 11:21:31 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- common/autotest_common.sh@968 -- # echo 'killing process with pid 73899' 00:10:50.481 11:21:31 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- common/autotest_common.sh@969 -- # kill 73899 00:10:50.481 11:21:31 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- common/autotest_common.sh@974 -- # wait 73899 00:10:50.739 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:10:50.739 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:10:50.739 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:10:50.739 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@297 -- # iptr 00:10:50.739 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@789 -- # iptables-save 00:10:50.739 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:10:50.739 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@789 -- # iptables-restore 00:10:50.739 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@298 -- # [[ nvmf_tgt_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:10:50.739 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@299 -- # nvmf_veth_fini 00:10:50.739 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@233 -- # ip link set nvmf_init_br nomaster 00:10:50.739 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@234 -- # ip link set nvmf_init_br2 nomaster 00:10:50.739 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@235 -- # ip link set nvmf_tgt_br nomaster 00:10:50.739 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@236 -- # ip link set nvmf_tgt_br2 nomaster 00:10:50.739 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@237 -- # ip link set nvmf_init_br down 00:10:50.739 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@238 -- # ip link set nvmf_init_br2 down 00:10:50.739 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@239 -- # ip link set nvmf_tgt_br down 00:10:50.739 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@240 -- # ip link set nvmf_tgt_br2 down 00:10:50.739 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@241 -- # ip link delete nvmf_br type bridge 00:10:50.739 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@242 -- # ip link delete nvmf_init_if 00:10:50.997 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@243 -- # ip link delete nvmf_init_if2 00:10:50.997 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@244 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:10:50.997 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@245 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:10:50.997 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@246 -- # remove_spdk_ns 00:10:50.997 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:10:50.997 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:10:50.997 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:10:50.997 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- nvmf/common.sh@300 -- # return 0 00:10:50.997 ************************************ 00:10:50.997 END TEST nvmf_multitarget 00:10:50.997 ************************************ 00:10:50.997 00:10:50.997 real 0m3.514s 00:10:50.997 user 0m10.242s 00:10:50.997 sys 0m0.905s 00:10:50.997 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- common/autotest_common.sh@1126 -- # xtrace_disable 00:10:50.997 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_multitarget -- common/autotest_common.sh@10 -- # set +x 00:10:50.997 11:21:32 nvmf_tcp.nvmf_target_extra -- nvmf/nvmf_target_extra.sh@22 -- # run_test nvmf_rpc /home/vagrant/spdk_repo/spdk/test/nvmf/target/rpc.sh --transport=tcp 00:10:50.997 11:21:32 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:10:50.997 11:21:32 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1107 -- # xtrace_disable 00:10:50.997 11:21:32 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@10 -- # set +x 00:10:50.997 ************************************ 00:10:50.997 START TEST nvmf_rpc 00:10:50.997 ************************************ 00:10:50.997 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/nvmf/target/rpc.sh --transport=tcp 00:10:50.997 * Looking for test storage... 00:10:51.257 * Found test storage at /home/vagrant/spdk_repo/spdk/test/nvmf/target 00:10:51.257 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:10:51.257 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:10:51.257 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1681 -- # lcov --version 00:10:51.257 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:10:51.257 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:10:51.257 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- scripts/common.sh@333 -- # local ver1 ver1_l 00:10:51.257 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- scripts/common.sh@334 -- # local ver2 ver2_l 00:10:51.257 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- scripts/common.sh@336 -- # IFS=.-: 00:10:51.257 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- scripts/common.sh@336 -- # read -ra ver1 00:10:51.257 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- scripts/common.sh@337 -- # IFS=.-: 00:10:51.257 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- scripts/common.sh@337 -- # read -ra ver2 00:10:51.257 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- scripts/common.sh@338 -- # local 'op=<' 00:10:51.257 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- scripts/common.sh@340 -- # ver1_l=2 00:10:51.257 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- scripts/common.sh@341 -- # ver2_l=1 00:10:51.257 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:10:51.257 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- scripts/common.sh@344 -- # case "$op" in 00:10:51.257 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- scripts/common.sh@345 -- # : 1 00:10:51.257 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- scripts/common.sh@364 -- # (( v = 0 )) 00:10:51.257 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:10:51.257 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- scripts/common.sh@365 -- # decimal 1 00:10:51.257 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- scripts/common.sh@353 -- # local d=1 00:10:51.257 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:10:51.257 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- scripts/common.sh@355 -- # echo 1 00:10:51.257 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- scripts/common.sh@365 -- # ver1[v]=1 00:10:51.257 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- scripts/common.sh@366 -- # decimal 2 00:10:51.257 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- scripts/common.sh@353 -- # local d=2 00:10:51.257 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:10:51.257 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- scripts/common.sh@355 -- # echo 2 00:10:51.257 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- scripts/common.sh@366 -- # ver2[v]=2 00:10:51.257 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:10:51.257 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:10:51.257 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- scripts/common.sh@368 -- # return 0 00:10:51.257 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:10:51.257 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:10:51.257 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:10:51.257 --rc genhtml_branch_coverage=1 00:10:51.257 --rc genhtml_function_coverage=1 00:10:51.257 --rc genhtml_legend=1 00:10:51.257 --rc geninfo_all_blocks=1 00:10:51.257 --rc geninfo_unexecuted_blocks=1 00:10:51.257 00:10:51.257 ' 00:10:51.257 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:10:51.257 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:10:51.257 --rc genhtml_branch_coverage=1 00:10:51.257 --rc genhtml_function_coverage=1 00:10:51.257 --rc genhtml_legend=1 00:10:51.257 --rc geninfo_all_blocks=1 00:10:51.257 --rc geninfo_unexecuted_blocks=1 00:10:51.257 00:10:51.257 ' 00:10:51.257 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:10:51.257 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:10:51.257 --rc genhtml_branch_coverage=1 00:10:51.257 --rc genhtml_function_coverage=1 00:10:51.257 --rc genhtml_legend=1 00:10:51.257 --rc geninfo_all_blocks=1 00:10:51.257 --rc geninfo_unexecuted_blocks=1 00:10:51.257 00:10:51.257 ' 00:10:51.257 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:10:51.257 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:10:51.257 --rc genhtml_branch_coverage=1 00:10:51.257 --rc genhtml_function_coverage=1 00:10:51.257 --rc genhtml_legend=1 00:10:51.257 --rc geninfo_all_blocks=1 00:10:51.257 --rc geninfo_unexecuted_blocks=1 00:10:51.257 00:10:51.257 ' 00:10:51.257 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@9 -- # source /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh 00:10:51.257 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@7 -- # uname -s 00:10:51.257 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:10:51.257 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:10:51.257 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:10:51.257 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:10:51.257 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:10:51.257 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:10:51.257 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:10:51.257 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:10:51.257 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:10:51.257 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:10:51.257 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:10:51.257 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@18 -- # NVME_HOSTID=3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:10:51.257 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:10:51.257 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:10:51.257 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@21 -- # NET_TYPE=virt 00:10:51.257 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:10:51.257 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@49 -- # source /home/vagrant/spdk_repo/spdk/scripts/common.sh 00:10:51.257 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- scripts/common.sh@15 -- # shopt -s extglob 00:10:51.257 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:10:51.257 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:10:51.257 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:10:51.257 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:51.257 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:51.257 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:51.257 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- paths/export.sh@5 -- # export PATH 00:10:51.258 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:51.258 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@51 -- # : 0 00:10:51.258 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:10:51.258 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:10:51.258 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:10:51.258 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:10:51.258 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:10:51.258 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:10:51.258 /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:10:51.258 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:10:51.258 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:10:51.258 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@55 -- # have_pci_nics=0 00:10:51.258 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@11 -- # loops=5 00:10:51.258 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@23 -- # nvmftestinit 00:10:51.258 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:10:51.258 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:10:51.258 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@474 -- # prepare_net_devs 00:10:51.258 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@436 -- # local -g is_hw=no 00:10:51.258 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@438 -- # remove_spdk_ns 00:10:51.258 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:10:51.258 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:10:51.258 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:10:51.258 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@440 -- # [[ virt != virt ]] 00:10:51.258 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@442 -- # [[ no == yes ]] 00:10:51.258 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@449 -- # [[ virt == phy ]] 00:10:51.258 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@452 -- # [[ virt == phy-fallback ]] 00:10:51.258 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@457 -- # [[ tcp == tcp ]] 00:10:51.258 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@458 -- # nvmf_veth_init 00:10:51.258 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@145 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:10:51.258 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@146 -- # NVMF_SECOND_INITIATOR_IP=10.0.0.2 00:10:51.258 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@147 -- # NVMF_FIRST_TARGET_IP=10.0.0.3 00:10:51.258 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@148 -- # NVMF_SECOND_TARGET_IP=10.0.0.4 00:10:51.258 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@149 -- # NVMF_INITIATOR_IP=10.0.0.1 00:10:51.258 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@150 -- # NVMF_BRIDGE=nvmf_br 00:10:51.258 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@151 -- # NVMF_INITIATOR_INTERFACE=nvmf_init_if 00:10:51.258 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@152 -- # NVMF_INITIATOR_INTERFACE2=nvmf_init_if2 00:10:51.258 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@153 -- # NVMF_INITIATOR_BRIDGE=nvmf_init_br 00:10:51.258 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@154 -- # NVMF_INITIATOR_BRIDGE2=nvmf_init_br2 00:10:51.258 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@155 -- # NVMF_TARGET_NAMESPACE=nvmf_tgt_ns_spdk 00:10:51.258 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@156 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:10:51.258 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@157 -- # NVMF_TARGET_INTERFACE=nvmf_tgt_if 00:10:51.258 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@158 -- # NVMF_TARGET_INTERFACE2=nvmf_tgt_if2 00:10:51.258 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@159 -- # NVMF_TARGET_BRIDGE=nvmf_tgt_br 00:10:51.258 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@160 -- # NVMF_TARGET_BRIDGE2=nvmf_tgt_br2 00:10:51.258 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@162 -- # ip link set nvmf_init_br nomaster 00:10:51.258 Cannot find device "nvmf_init_br" 00:10:51.258 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@162 -- # true 00:10:51.258 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@163 -- # ip link set nvmf_init_br2 nomaster 00:10:51.258 Cannot find device "nvmf_init_br2" 00:10:51.258 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@163 -- # true 00:10:51.258 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@164 -- # ip link set nvmf_tgt_br nomaster 00:10:51.258 Cannot find device "nvmf_tgt_br" 00:10:51.258 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@164 -- # true 00:10:51.258 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@165 -- # ip link set nvmf_tgt_br2 nomaster 00:10:51.258 Cannot find device "nvmf_tgt_br2" 00:10:51.258 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@165 -- # true 00:10:51.258 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@166 -- # ip link set nvmf_init_br down 00:10:51.258 Cannot find device "nvmf_init_br" 00:10:51.258 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@166 -- # true 00:10:51.258 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@167 -- # ip link set nvmf_init_br2 down 00:10:51.258 Cannot find device "nvmf_init_br2" 00:10:51.258 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@167 -- # true 00:10:51.258 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@168 -- # ip link set nvmf_tgt_br down 00:10:51.258 Cannot find device "nvmf_tgt_br" 00:10:51.258 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@168 -- # true 00:10:51.258 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@169 -- # ip link set nvmf_tgt_br2 down 00:10:51.258 Cannot find device "nvmf_tgt_br2" 00:10:51.258 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@169 -- # true 00:10:51.258 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@170 -- # ip link delete nvmf_br type bridge 00:10:51.258 Cannot find device "nvmf_br" 00:10:51.258 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@170 -- # true 00:10:51.258 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@171 -- # ip link delete nvmf_init_if 00:10:51.258 Cannot find device "nvmf_init_if" 00:10:51.258 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@171 -- # true 00:10:51.258 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@172 -- # ip link delete nvmf_init_if2 00:10:51.517 Cannot find device "nvmf_init_if2" 00:10:51.517 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@172 -- # true 00:10:51.517 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@173 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:10:51.517 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:10:51.517 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@173 -- # true 00:10:51.517 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@174 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:10:51.517 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:10:51.517 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@174 -- # true 00:10:51.517 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@177 -- # ip netns add nvmf_tgt_ns_spdk 00:10:51.517 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@180 -- # ip link add nvmf_init_if type veth peer name nvmf_init_br 00:10:51.517 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@181 -- # ip link add nvmf_init_if2 type veth peer name nvmf_init_br2 00:10:51.517 11:21:32 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@182 -- # ip link add nvmf_tgt_if type veth peer name nvmf_tgt_br 00:10:51.517 11:21:33 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@183 -- # ip link add nvmf_tgt_if2 type veth peer name nvmf_tgt_br2 00:10:51.517 11:21:33 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@186 -- # ip link set nvmf_tgt_if netns nvmf_tgt_ns_spdk 00:10:51.517 11:21:33 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@187 -- # ip link set nvmf_tgt_if2 netns nvmf_tgt_ns_spdk 00:10:51.517 11:21:33 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@190 -- # ip addr add 10.0.0.1/24 dev nvmf_init_if 00:10:51.517 11:21:33 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@191 -- # ip addr add 10.0.0.2/24 dev nvmf_init_if2 00:10:51.517 11:21:33 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@192 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.3/24 dev nvmf_tgt_if 00:10:51.517 11:21:33 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@193 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.4/24 dev nvmf_tgt_if2 00:10:51.517 11:21:33 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@196 -- # ip link set nvmf_init_if up 00:10:51.517 11:21:33 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@197 -- # ip link set nvmf_init_if2 up 00:10:51.517 11:21:33 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@198 -- # ip link set nvmf_init_br up 00:10:51.517 11:21:33 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@199 -- # ip link set nvmf_init_br2 up 00:10:51.517 11:21:33 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@200 -- # ip link set nvmf_tgt_br up 00:10:51.517 11:21:33 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@201 -- # ip link set nvmf_tgt_br2 up 00:10:51.517 11:21:33 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@202 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if up 00:10:51.517 11:21:33 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@203 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if2 up 00:10:51.517 11:21:33 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@204 -- # ip netns exec nvmf_tgt_ns_spdk ip link set lo up 00:10:51.517 11:21:33 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@207 -- # ip link add nvmf_br type bridge 00:10:51.517 11:21:33 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@208 -- # ip link set nvmf_br up 00:10:51.517 11:21:33 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@211 -- # ip link set nvmf_init_br master nvmf_br 00:10:51.517 11:21:33 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@212 -- # ip link set nvmf_init_br2 master nvmf_br 00:10:51.517 11:21:33 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@213 -- # ip link set nvmf_tgt_br master nvmf_br 00:10:51.517 11:21:33 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@214 -- # ip link set nvmf_tgt_br2 master nvmf_br 00:10:51.517 11:21:33 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@217 -- # ipts -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT 00:10:51.517 11:21:33 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT' 00:10:51.517 11:21:33 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@218 -- # ipts -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT 00:10:51.517 11:21:33 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT' 00:10:51.517 11:21:33 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@219 -- # ipts -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT 00:10:51.517 11:21:33 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@788 -- # iptables -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT -m comment --comment 'SPDK_NVMF:-A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT' 00:10:51.517 11:21:33 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@222 -- # ping -c 1 10.0.0.3 00:10:51.517 PING 10.0.0.3 (10.0.0.3) 56(84) bytes of data. 00:10:51.517 64 bytes from 10.0.0.3: icmp_seq=1 ttl=64 time=0.072 ms 00:10:51.517 00:10:51.517 --- 10.0.0.3 ping statistics --- 00:10:51.517 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:10:51.517 rtt min/avg/max/mdev = 0.072/0.072/0.072/0.000 ms 00:10:51.517 11:21:33 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@223 -- # ping -c 1 10.0.0.4 00:10:51.776 PING 10.0.0.4 (10.0.0.4) 56(84) bytes of data. 00:10:51.776 64 bytes from 10.0.0.4: icmp_seq=1 ttl=64 time=0.049 ms 00:10:51.776 00:10:51.776 --- 10.0.0.4 ping statistics --- 00:10:51.776 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:10:51.776 rtt min/avg/max/mdev = 0.049/0.049/0.049/0.000 ms 00:10:51.776 11:21:33 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@224 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.1 00:10:51.776 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:10:51.776 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.028 ms 00:10:51.776 00:10:51.776 --- 10.0.0.1 ping statistics --- 00:10:51.776 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:10:51.776 rtt min/avg/max/mdev = 0.028/0.028/0.028/0.000 ms 00:10:51.776 11:21:33 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@225 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.2 00:10:51.776 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:10:51.776 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.055 ms 00:10:51.776 00:10:51.776 --- 10.0.0.2 ping statistics --- 00:10:51.776 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:10:51.776 rtt min/avg/max/mdev = 0.055/0.055/0.055/0.000 ms 00:10:51.776 11:21:33 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@227 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:10:51.776 11:21:33 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@459 -- # return 0 00:10:51.776 11:21:33 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:10:51.776 11:21:33 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:10:51.776 11:21:33 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:10:51.776 11:21:33 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:10:51.776 11:21:33 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:10:51.776 11:21:33 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:10:51.776 11:21:33 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:10:51.776 11:21:33 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@24 -- # nvmfappstart -m 0xF 00:10:51.776 11:21:33 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:10:51.776 11:21:33 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@724 -- # xtrace_disable 00:10:51.776 11:21:33 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:10:51.776 11:21:33 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@507 -- # nvmfpid=74182 00:10:51.776 11:21:33 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@506 -- # ip netns exec nvmf_tgt_ns_spdk /home/vagrant/spdk_repo/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:10:51.776 11:21:33 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@508 -- # waitforlisten 74182 00:10:51.776 11:21:33 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@831 -- # '[' -z 74182 ']' 00:10:51.776 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:10:51.776 11:21:33 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:10:51.776 11:21:33 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@836 -- # local max_retries=100 00:10:51.776 11:21:33 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:10:51.776 11:21:33 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@840 -- # xtrace_disable 00:10:51.776 11:21:33 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:10:51.776 [2024-10-07 11:21:33.333472] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:10:51.776 [2024-10-07 11:21:33.333904] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:10:51.776 [2024-10-07 11:21:33.478849] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 4 00:10:52.035 [2024-10-07 11:21:33.629752] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:10:52.035 [2024-10-07 11:21:33.630042] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:10:52.035 [2024-10-07 11:21:33.630179] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:10:52.035 [2024-10-07 11:21:33.630311] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:10:52.035 [2024-10-07 11:21:33.630348] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:10:52.035 [2024-10-07 11:21:33.631914] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:10:52.035 [2024-10-07 11:21:33.632048] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:10:52.035 [2024-10-07 11:21:33.632170] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:10:52.035 [2024-10-07 11:21:33.632170] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 3 00:10:52.995 11:21:34 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:10:52.995 11:21:34 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@864 -- # return 0 00:10:52.995 11:21:34 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:10:52.995 11:21:34 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@730 -- # xtrace_disable 00:10:52.995 11:21:34 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:10:52.995 11:21:34 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:10:52.995 11:21:34 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@26 -- # rpc_cmd nvmf_get_stats 00:10:52.995 11:21:34 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:10:52.995 11:21:34 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:10:52.995 11:21:34 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:10:52.995 11:21:34 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@26 -- # stats='{ 00:10:52.995 "poll_groups": [ 00:10:52.995 { 00:10:52.995 "admin_qpairs": 0, 00:10:52.995 "completed_nvme_io": 0, 00:10:52.995 "current_admin_qpairs": 0, 00:10:52.995 "current_io_qpairs": 0, 00:10:52.995 "io_qpairs": 0, 00:10:52.995 "name": "nvmf_tgt_poll_group_000", 00:10:52.995 "pending_bdev_io": 0, 00:10:52.995 "transports": [] 00:10:52.995 }, 00:10:52.995 { 00:10:52.995 "admin_qpairs": 0, 00:10:52.995 "completed_nvme_io": 0, 00:10:52.995 "current_admin_qpairs": 0, 00:10:52.995 "current_io_qpairs": 0, 00:10:52.995 "io_qpairs": 0, 00:10:52.995 "name": "nvmf_tgt_poll_group_001", 00:10:52.995 "pending_bdev_io": 0, 00:10:52.995 "transports": [] 00:10:52.995 }, 00:10:52.995 { 00:10:52.995 "admin_qpairs": 0, 00:10:52.995 "completed_nvme_io": 0, 00:10:52.995 "current_admin_qpairs": 0, 00:10:52.995 "current_io_qpairs": 0, 00:10:52.995 "io_qpairs": 0, 00:10:52.995 "name": "nvmf_tgt_poll_group_002", 00:10:52.995 "pending_bdev_io": 0, 00:10:52.995 "transports": [] 00:10:52.995 }, 00:10:52.995 { 00:10:52.995 "admin_qpairs": 0, 00:10:52.995 "completed_nvme_io": 0, 00:10:52.995 "current_admin_qpairs": 0, 00:10:52.995 "current_io_qpairs": 0, 00:10:52.995 "io_qpairs": 0, 00:10:52.995 "name": "nvmf_tgt_poll_group_003", 00:10:52.995 "pending_bdev_io": 0, 00:10:52.995 "transports": [] 00:10:52.995 } 00:10:52.995 ], 00:10:52.995 "tick_rate": 2200000000 00:10:52.995 }' 00:10:52.995 11:21:34 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@28 -- # jcount '.poll_groups[].name' 00:10:52.995 11:21:34 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@14 -- # local 'filter=.poll_groups[].name' 00:10:52.995 11:21:34 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@15 -- # jq '.poll_groups[].name' 00:10:52.995 11:21:34 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@15 -- # wc -l 00:10:52.995 11:21:34 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@28 -- # (( 4 == 4 )) 00:10:52.995 11:21:34 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@29 -- # jq '.poll_groups[0].transports[0]' 00:10:52.995 11:21:34 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@29 -- # [[ null == null ]] 00:10:52.995 11:21:34 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@31 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:10:52.995 11:21:34 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:10:52.995 11:21:34 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:10:52.995 [2024-10-07 11:21:34.619531] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:10:52.995 11:21:34 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:10:52.995 11:21:34 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@33 -- # rpc_cmd nvmf_get_stats 00:10:52.995 11:21:34 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:10:52.995 11:21:34 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:10:52.995 11:21:34 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:10:52.995 11:21:34 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@33 -- # stats='{ 00:10:52.995 "poll_groups": [ 00:10:52.995 { 00:10:52.995 "admin_qpairs": 0, 00:10:52.995 "completed_nvme_io": 0, 00:10:52.995 "current_admin_qpairs": 0, 00:10:52.995 "current_io_qpairs": 0, 00:10:52.995 "io_qpairs": 0, 00:10:52.995 "name": "nvmf_tgt_poll_group_000", 00:10:52.995 "pending_bdev_io": 0, 00:10:52.995 "transports": [ 00:10:52.995 { 00:10:52.995 "trtype": "TCP" 00:10:52.995 } 00:10:52.995 ] 00:10:52.995 }, 00:10:52.995 { 00:10:52.995 "admin_qpairs": 0, 00:10:52.995 "completed_nvme_io": 0, 00:10:52.995 "current_admin_qpairs": 0, 00:10:52.995 "current_io_qpairs": 0, 00:10:52.995 "io_qpairs": 0, 00:10:52.995 "name": "nvmf_tgt_poll_group_001", 00:10:52.995 "pending_bdev_io": 0, 00:10:52.995 "transports": [ 00:10:52.995 { 00:10:52.995 "trtype": "TCP" 00:10:52.995 } 00:10:52.995 ] 00:10:52.995 }, 00:10:52.995 { 00:10:52.995 "admin_qpairs": 0, 00:10:52.995 "completed_nvme_io": 0, 00:10:52.995 "current_admin_qpairs": 0, 00:10:52.995 "current_io_qpairs": 0, 00:10:52.995 "io_qpairs": 0, 00:10:52.995 "name": "nvmf_tgt_poll_group_002", 00:10:52.995 "pending_bdev_io": 0, 00:10:52.995 "transports": [ 00:10:52.995 { 00:10:52.995 "trtype": "TCP" 00:10:52.995 } 00:10:52.995 ] 00:10:52.995 }, 00:10:52.995 { 00:10:52.995 "admin_qpairs": 0, 00:10:52.995 "completed_nvme_io": 0, 00:10:52.995 "current_admin_qpairs": 0, 00:10:52.995 "current_io_qpairs": 0, 00:10:52.995 "io_qpairs": 0, 00:10:52.995 "name": "nvmf_tgt_poll_group_003", 00:10:52.995 "pending_bdev_io": 0, 00:10:52.995 "transports": [ 00:10:52.995 { 00:10:52.995 "trtype": "TCP" 00:10:52.995 } 00:10:52.995 ] 00:10:52.995 } 00:10:52.995 ], 00:10:52.995 "tick_rate": 2200000000 00:10:52.995 }' 00:10:52.995 11:21:34 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@35 -- # jsum '.poll_groups[].admin_qpairs' 00:10:52.995 11:21:34 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].admin_qpairs' 00:10:52.995 11:21:34 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@20 -- # jq '.poll_groups[].admin_qpairs' 00:10:52.995 11:21:34 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:10:53.254 11:21:34 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@35 -- # (( 0 == 0 )) 00:10:53.254 11:21:34 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@36 -- # jsum '.poll_groups[].io_qpairs' 00:10:53.254 11:21:34 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].io_qpairs' 00:10:53.254 11:21:34 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@20 -- # jq '.poll_groups[].io_qpairs' 00:10:53.254 11:21:34 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:10:53.254 11:21:34 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@36 -- # (( 0 == 0 )) 00:10:53.254 11:21:34 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@38 -- # '[' rdma == tcp ']' 00:10:53.254 11:21:34 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@46 -- # MALLOC_BDEV_SIZE=64 00:10:53.254 11:21:34 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@47 -- # MALLOC_BLOCK_SIZE=512 00:10:53.254 11:21:34 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@49 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:10:53.254 11:21:34 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:10:53.254 11:21:34 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:10:53.254 Malloc1 00:10:53.254 11:21:34 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:10:53.254 11:21:34 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@52 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:10:53.254 11:21:34 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:10:53.254 11:21:34 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:10:53.254 11:21:34 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:10:53.254 11:21:34 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@53 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:10:53.254 11:21:34 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:10:53.254 11:21:34 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:10:53.254 11:21:34 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:10:53.254 11:21:34 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@54 -- # rpc_cmd nvmf_subsystem_allow_any_host -d nqn.2016-06.io.spdk:cnode1 00:10:53.254 11:21:34 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:10:53.254 11:21:34 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:10:53.254 11:21:34 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:10:53.254 11:21:34 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@55 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4420 00:10:53.254 11:21:34 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:10:53.254 11:21:34 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:10:53.254 [2024-10-07 11:21:34.857345] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:10:53.254 11:21:34 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:10:53.254 11:21:34 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@58 -- # NOT nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --hostid=3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -a 10.0.0.3 -s 4420 00:10:53.254 11:21:34 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@650 -- # local es=0 00:10:53.254 11:21:34 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@652 -- # valid_exec_arg nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --hostid=3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -a 10.0.0.3 -s 4420 00:10:53.254 11:21:34 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@638 -- # local arg=nvme 00:10:53.254 11:21:34 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:10:53.254 11:21:34 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@642 -- # type -t nvme 00:10:53.254 11:21:34 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:10:53.254 11:21:34 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@644 -- # type -P nvme 00:10:53.254 11:21:34 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:10:53.254 11:21:34 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@644 -- # arg=/usr/sbin/nvme 00:10:53.254 11:21:34 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@644 -- # [[ -x /usr/sbin/nvme ]] 00:10:53.254 11:21:34 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@653 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --hostid=3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -a 10.0.0.3 -s 4420 00:10:53.254 [2024-10-07 11:21:34.893805] ctrlr.c: 823:nvmf_qpair_access_allowed: *ERROR*: Subsystem 'nqn.2016-06.io.spdk:cnode1' does not allow host 'nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3' 00:10:53.254 Failed to write to /dev/nvme-fabrics: Input/output error 00:10:53.254 could not add new controller: failed to write to nvme-fabrics device 00:10:53.254 11:21:34 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@653 -- # es=1 00:10:53.254 11:21:34 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:10:53.254 11:21:34 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:10:53.254 11:21:34 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:10:53.254 11:21:34 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@61 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:10:53.254 11:21:34 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:10:53.254 11:21:34 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:10:53.254 11:21:34 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:10:53.254 11:21:34 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@62 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --hostid=3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.3 -s 4420 00:10:53.512 11:21:35 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@63 -- # waitforserial SPDKISFASTANDAWESOME 00:10:53.512 11:21:35 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1198 -- # local i=0 00:10:53.512 11:21:35 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1199 -- # local nvme_device_counter=1 nvme_devices=0 00:10:53.512 11:21:35 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1200 -- # [[ -n '' ]] 00:10:53.512 11:21:35 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1205 -- # sleep 2 00:10:55.412 11:21:37 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1206 -- # (( i++ <= 15 )) 00:10:55.412 11:21:37 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1207 -- # lsblk -l -o NAME,SERIAL 00:10:55.412 11:21:37 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1207 -- # grep -c SPDKISFASTANDAWESOME 00:10:55.412 11:21:37 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1207 -- # nvme_devices=1 00:10:55.412 11:21:37 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1208 -- # (( nvme_devices == nvme_device_counter )) 00:10:55.412 11:21:37 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1208 -- # return 0 00:10:55.412 11:21:37 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@64 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:10:55.670 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:55.670 11:21:37 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@65 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:10:55.670 11:21:37 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1219 -- # local i=0 00:10:55.670 11:21:37 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1220 -- # lsblk -o NAME,SERIAL 00:10:55.670 11:21:37 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1220 -- # grep -q -w SPDKISFASTANDAWESOME 00:10:55.670 11:21:37 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1227 -- # lsblk -l -o NAME,SERIAL 00:10:55.670 11:21:37 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1227 -- # grep -q -w SPDKISFASTANDAWESOME 00:10:55.670 11:21:37 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1231 -- # return 0 00:10:55.671 11:21:37 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@68 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2016-06.io.spdk:cnode1 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:10:55.671 11:21:37 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:10:55.671 11:21:37 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:10:55.671 11:21:37 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:10:55.671 11:21:37 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@69 -- # NOT nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --hostid=3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.3 -s 4420 00:10:55.671 11:21:37 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@650 -- # local es=0 00:10:55.671 11:21:37 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@652 -- # valid_exec_arg nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --hostid=3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.3 -s 4420 00:10:55.671 11:21:37 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@638 -- # local arg=nvme 00:10:55.671 11:21:37 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:10:55.671 11:21:37 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@642 -- # type -t nvme 00:10:55.671 11:21:37 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:10:55.671 11:21:37 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@644 -- # type -P nvme 00:10:55.671 11:21:37 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:10:55.671 11:21:37 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@644 -- # arg=/usr/sbin/nvme 00:10:55.671 11:21:37 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@644 -- # [[ -x /usr/sbin/nvme ]] 00:10:55.671 11:21:37 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@653 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --hostid=3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.3 -s 4420 00:10:55.671 [2024-10-07 11:21:37.305515] ctrlr.c: 823:nvmf_qpair_access_allowed: *ERROR*: Subsystem 'nqn.2016-06.io.spdk:cnode1' does not allow host 'nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3' 00:10:55.671 Failed to write to /dev/nvme-fabrics: Input/output error 00:10:55.671 could not add new controller: failed to write to nvme-fabrics device 00:10:55.671 11:21:37 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@653 -- # es=1 00:10:55.671 11:21:37 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:10:55.671 11:21:37 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:10:55.671 11:21:37 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:10:55.671 11:21:37 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@72 -- # rpc_cmd nvmf_subsystem_allow_any_host -e nqn.2016-06.io.spdk:cnode1 00:10:55.671 11:21:37 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:10:55.671 11:21:37 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:10:55.671 11:21:37 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:10:55.671 11:21:37 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@73 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --hostid=3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.3 -s 4420 00:10:55.929 11:21:37 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@74 -- # waitforserial SPDKISFASTANDAWESOME 00:10:55.929 11:21:37 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1198 -- # local i=0 00:10:55.929 11:21:37 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1199 -- # local nvme_device_counter=1 nvme_devices=0 00:10:55.929 11:21:37 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1200 -- # [[ -n '' ]] 00:10:55.929 11:21:37 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1205 -- # sleep 2 00:10:57.831 11:21:39 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1206 -- # (( i++ <= 15 )) 00:10:57.831 11:21:39 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1207 -- # lsblk -l -o NAME,SERIAL 00:10:57.831 11:21:39 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1207 -- # grep -c SPDKISFASTANDAWESOME 00:10:57.831 11:21:39 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1207 -- # nvme_devices=1 00:10:57.831 11:21:39 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1208 -- # (( nvme_devices == nvme_device_counter )) 00:10:57.831 11:21:39 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1208 -- # return 0 00:10:57.831 11:21:39 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@75 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:10:58.123 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:58.123 11:21:39 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@76 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:10:58.123 11:21:39 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1219 -- # local i=0 00:10:58.123 11:21:39 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1220 -- # lsblk -o NAME,SERIAL 00:10:58.123 11:21:39 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1220 -- # grep -q -w SPDKISFASTANDAWESOME 00:10:58.123 11:21:39 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1227 -- # lsblk -l -o NAME,SERIAL 00:10:58.123 11:21:39 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1227 -- # grep -q -w SPDKISFASTANDAWESOME 00:10:58.123 11:21:39 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1231 -- # return 0 00:10:58.123 11:21:39 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@78 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:10:58.123 11:21:39 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:10:58.123 11:21:39 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:10:58.123 11:21:39 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:10:58.123 11:21:39 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@81 -- # seq 1 5 00:10:58.123 11:21:39 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:10:58.123 11:21:39 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:10:58.123 11:21:39 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:10:58.123 11:21:39 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:10:58.123 11:21:39 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:10:58.123 11:21:39 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4420 00:10:58.123 11:21:39 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:10:58.124 11:21:39 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:10:58.124 [2024-10-07 11:21:39.615229] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:10:58.124 11:21:39 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:10:58.124 11:21:39 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:10:58.124 11:21:39 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:10:58.124 11:21:39 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:10:58.124 11:21:39 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:10:58.124 11:21:39 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:10:58.124 11:21:39 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:10:58.124 11:21:39 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:10:58.124 11:21:39 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:10:58.124 11:21:39 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --hostid=3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.3 -s 4420 00:10:58.412 11:21:39 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:10:58.412 11:21:39 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1198 -- # local i=0 00:10:58.412 11:21:39 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1199 -- # local nvme_device_counter=1 nvme_devices=0 00:10:58.412 11:21:39 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1200 -- # [[ -n '' ]] 00:10:58.412 11:21:39 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1205 -- # sleep 2 00:11:00.311 11:21:41 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1206 -- # (( i++ <= 15 )) 00:11:00.311 11:21:41 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1207 -- # lsblk -l -o NAME,SERIAL 00:11:00.311 11:21:41 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1207 -- # grep -c SPDKISFASTANDAWESOME 00:11:00.312 11:21:41 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1207 -- # nvme_devices=1 00:11:00.312 11:21:41 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1208 -- # (( nvme_devices == nvme_device_counter )) 00:11:00.312 11:21:41 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1208 -- # return 0 00:11:00.312 11:21:41 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:11:00.312 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:00.312 11:21:41 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:11:00.312 11:21:41 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1219 -- # local i=0 00:11:00.312 11:21:41 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1220 -- # lsblk -o NAME,SERIAL 00:11:00.312 11:21:41 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1220 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:00.312 11:21:41 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1227 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:00.312 11:21:41 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1227 -- # lsblk -l -o NAME,SERIAL 00:11:00.312 11:21:41 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1231 -- # return 0 00:11:00.312 11:21:41 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:11:00.312 11:21:41 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:00.312 11:21:41 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:11:00.312 11:21:41 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:00.312 11:21:41 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:11:00.312 11:21:41 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:00.312 11:21:41 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:11:00.312 11:21:41 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:00.312 11:21:41 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:11:00.312 11:21:41 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:11:00.312 11:21:41 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:00.312 11:21:41 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:11:00.312 11:21:41 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:00.312 11:21:41 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4420 00:11:00.312 11:21:41 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:00.312 11:21:41 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:11:00.312 [2024-10-07 11:21:41.926223] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:11:00.312 11:21:41 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:00.312 11:21:41 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:11:00.312 11:21:41 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:00.312 11:21:41 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:11:00.312 11:21:41 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:00.312 11:21:41 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:11:00.312 11:21:41 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:00.312 11:21:41 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:11:00.312 11:21:41 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:00.312 11:21:41 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --hostid=3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.3 -s 4420 00:11:00.570 11:21:42 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:11:00.570 11:21:42 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1198 -- # local i=0 00:11:00.570 11:21:42 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1199 -- # local nvme_device_counter=1 nvme_devices=0 00:11:00.570 11:21:42 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1200 -- # [[ -n '' ]] 00:11:00.570 11:21:42 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1205 -- # sleep 2 00:11:02.503 11:21:44 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1206 -- # (( i++ <= 15 )) 00:11:02.503 11:21:44 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1207 -- # lsblk -l -o NAME,SERIAL 00:11:02.503 11:21:44 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1207 -- # grep -c SPDKISFASTANDAWESOME 00:11:02.503 11:21:44 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1207 -- # nvme_devices=1 00:11:02.503 11:21:44 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1208 -- # (( nvme_devices == nvme_device_counter )) 00:11:02.503 11:21:44 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1208 -- # return 0 00:11:02.503 11:21:44 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:11:02.503 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:02.503 11:21:44 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:11:02.503 11:21:44 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1219 -- # local i=0 00:11:02.503 11:21:44 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1220 -- # lsblk -o NAME,SERIAL 00:11:02.503 11:21:44 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1220 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:02.503 11:21:44 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1227 -- # lsblk -l -o NAME,SERIAL 00:11:02.503 11:21:44 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1227 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:02.762 11:21:44 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1231 -- # return 0 00:11:02.762 11:21:44 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:11:02.762 11:21:44 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:02.762 11:21:44 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:11:02.762 11:21:44 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:02.762 11:21:44 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:11:02.762 11:21:44 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:02.762 11:21:44 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:11:02.762 11:21:44 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:02.762 11:21:44 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:11:02.762 11:21:44 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:11:02.762 11:21:44 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:02.762 11:21:44 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:11:02.762 11:21:44 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:02.762 11:21:44 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4420 00:11:02.762 11:21:44 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:02.762 11:21:44 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:11:02.762 [2024-10-07 11:21:44.249481] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:11:02.762 11:21:44 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:02.762 11:21:44 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:11:02.762 11:21:44 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:02.762 11:21:44 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:11:02.762 11:21:44 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:02.762 11:21:44 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:11:02.762 11:21:44 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:02.762 11:21:44 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:11:02.762 11:21:44 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:02.762 11:21:44 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --hostid=3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.3 -s 4420 00:11:02.762 11:21:44 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:11:02.762 11:21:44 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1198 -- # local i=0 00:11:02.762 11:21:44 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1199 -- # local nvme_device_counter=1 nvme_devices=0 00:11:02.762 11:21:44 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1200 -- # [[ -n '' ]] 00:11:02.762 11:21:44 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1205 -- # sleep 2 00:11:05.293 11:21:46 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1206 -- # (( i++ <= 15 )) 00:11:05.293 11:21:46 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1207 -- # lsblk -l -o NAME,SERIAL 00:11:05.293 11:21:46 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1207 -- # grep -c SPDKISFASTANDAWESOME 00:11:05.293 11:21:46 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1207 -- # nvme_devices=1 00:11:05.293 11:21:46 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1208 -- # (( nvme_devices == nvme_device_counter )) 00:11:05.293 11:21:46 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1208 -- # return 0 00:11:05.293 11:21:46 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:11:05.293 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:05.293 11:21:46 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:11:05.293 11:21:46 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1219 -- # local i=0 00:11:05.293 11:21:46 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1220 -- # lsblk -o NAME,SERIAL 00:11:05.293 11:21:46 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1220 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:05.293 11:21:46 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1227 -- # lsblk -l -o NAME,SERIAL 00:11:05.293 11:21:46 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1227 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:05.293 11:21:46 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1231 -- # return 0 00:11:05.293 11:21:46 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:11:05.293 11:21:46 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:05.293 11:21:46 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:11:05.293 11:21:46 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:05.293 11:21:46 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:11:05.293 11:21:46 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:05.293 11:21:46 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:11:05.293 11:21:46 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:05.293 11:21:46 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:11:05.293 11:21:46 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:11:05.293 11:21:46 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:05.293 11:21:46 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:11:05.293 11:21:46 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:05.293 11:21:46 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4420 00:11:05.293 11:21:46 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:05.293 11:21:46 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:11:05.293 [2024-10-07 11:21:46.569194] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:11:05.293 11:21:46 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:05.293 11:21:46 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:11:05.293 11:21:46 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:05.293 11:21:46 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:11:05.293 11:21:46 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:05.293 11:21:46 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:11:05.293 11:21:46 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:05.293 11:21:46 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:11:05.293 11:21:46 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:05.294 11:21:46 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --hostid=3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.3 -s 4420 00:11:05.294 11:21:46 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:11:05.294 11:21:46 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1198 -- # local i=0 00:11:05.294 11:21:46 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1199 -- # local nvme_device_counter=1 nvme_devices=0 00:11:05.294 11:21:46 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1200 -- # [[ -n '' ]] 00:11:05.294 11:21:46 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1205 -- # sleep 2 00:11:07.194 11:21:48 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1206 -- # (( i++ <= 15 )) 00:11:07.194 11:21:48 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1207 -- # lsblk -l -o NAME,SERIAL 00:11:07.194 11:21:48 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1207 -- # grep -c SPDKISFASTANDAWESOME 00:11:07.194 11:21:48 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1207 -- # nvme_devices=1 00:11:07.194 11:21:48 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1208 -- # (( nvme_devices == nvme_device_counter )) 00:11:07.194 11:21:48 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1208 -- # return 0 00:11:07.194 11:21:48 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:11:07.194 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:07.194 11:21:48 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:11:07.194 11:21:48 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1219 -- # local i=0 00:11:07.194 11:21:48 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1220 -- # lsblk -o NAME,SERIAL 00:11:07.194 11:21:48 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1220 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:07.194 11:21:48 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1227 -- # lsblk -l -o NAME,SERIAL 00:11:07.194 11:21:48 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1227 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:07.194 11:21:48 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1231 -- # return 0 00:11:07.194 11:21:48 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:11:07.194 11:21:48 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:07.194 11:21:48 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:11:07.194 11:21:48 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:07.194 11:21:48 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:11:07.194 11:21:48 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:07.194 11:21:48 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:11:07.194 11:21:48 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:07.194 11:21:48 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:11:07.194 11:21:48 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:11:07.194 11:21:48 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:07.195 11:21:48 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:11:07.195 11:21:48 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:07.195 11:21:48 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4420 00:11:07.195 11:21:48 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:07.195 11:21:48 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:11:07.195 [2024-10-07 11:21:48.881232] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:11:07.195 11:21:48 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:07.195 11:21:48 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:11:07.195 11:21:48 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:07.195 11:21:48 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:11:07.195 11:21:48 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:07.195 11:21:48 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:11:07.195 11:21:48 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:07.195 11:21:48 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:11:07.195 11:21:48 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:07.195 11:21:48 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --hostid=3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.3 -s 4420 00:11:07.476 11:21:49 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:11:07.476 11:21:49 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1198 -- # local i=0 00:11:07.476 11:21:49 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1199 -- # local nvme_device_counter=1 nvme_devices=0 00:11:07.476 11:21:49 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1200 -- # [[ -n '' ]] 00:11:07.476 11:21:49 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1205 -- # sleep 2 00:11:10.002 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1206 -- # (( i++ <= 15 )) 00:11:10.002 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1207 -- # lsblk -l -o NAME,SERIAL 00:11:10.002 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1207 -- # grep -c SPDKISFASTANDAWESOME 00:11:10.002 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1207 -- # nvme_devices=1 00:11:10.002 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1208 -- # (( nvme_devices == nvme_device_counter )) 00:11:10.002 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1208 -- # return 0 00:11:10.002 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:11:10.002 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:10.002 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:11:10.002 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1219 -- # local i=0 00:11:10.002 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1220 -- # lsblk -o NAME,SERIAL 00:11:10.002 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1220 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:10.002 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1227 -- # lsblk -l -o NAME,SERIAL 00:11:10.002 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1227 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:10.002 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1231 -- # return 0 00:11:10.002 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:11:10.002 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:10.002 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:11:10.002 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:10.002 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:11:10.002 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:10.002 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:11:10.002 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:10.002 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@99 -- # seq 1 5 00:11:10.002 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:11:10.002 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:11:10.002 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:10.002 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:11:10.002 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:10.002 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4420 00:11:10.002 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:10.002 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:11:10.002 [2024-10-07 11:21:51.208780] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:11:10.002 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:10.002 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:11:10.002 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:10.002 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:11:10.002 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:10.002 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:11:10.002 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:10.002 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:11:10.002 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:10.002 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:11:10.002 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:10.002 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:11:10.002 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:10.002 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:11:10.002 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:10.002 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:11:10.002 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:10.002 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:11:10.002 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:11:10.002 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:10.002 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:11:10.002 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:10.002 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4420 00:11:10.002 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:10.002 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:11:10.002 [2024-10-07 11:21:51.264873] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:11:10.002 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:10.002 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:11:10.002 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:10.002 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:11:10.002 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:10.002 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:11:10.002 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:10.002 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:11:10.002 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:10.003 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:11:10.003 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:10.003 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:11:10.003 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:10.003 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:11:10.003 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:10.003 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:11:10.003 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:10.003 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:11:10.003 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:11:10.003 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:10.003 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:11:10.003 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:10.003 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4420 00:11:10.003 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:10.003 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:11:10.003 [2024-10-07 11:21:51.316927] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:11:10.003 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:10.003 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:11:10.003 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:10.003 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:11:10.003 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:10.003 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:11:10.003 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:10.003 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:11:10.003 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:10.003 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:11:10.003 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:10.003 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:11:10.003 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:10.003 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:11:10.003 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:10.003 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:11:10.003 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:10.003 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:11:10.003 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:11:10.003 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:10.003 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:11:10.003 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:10.003 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4420 00:11:10.003 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:10.003 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:11:10.003 [2024-10-07 11:21:51.373040] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:11:10.003 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:10.003 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:11:10.003 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:10.003 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:11:10.003 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:10.003 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:11:10.003 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:10.003 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:11:10.003 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:10.003 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:11:10.003 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:10.003 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:11:10.003 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:10.003 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:11:10.003 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:10.003 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:11:10.003 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:10.003 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:11:10.003 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:11:10.003 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:10.003 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:11:10.003 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:10.003 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4420 00:11:10.003 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:10.003 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:11:10.003 [2024-10-07 11:21:51.425065] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:11:10.003 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:10.003 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:11:10.003 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:10.003 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:11:10.003 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:10.003 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:11:10.003 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:10.003 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:11:10.003 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:10.003 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:11:10.003 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:10.003 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:11:10.003 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:10.003 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:11:10.003 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:10.003 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:11:10.003 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:10.003 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@110 -- # rpc_cmd nvmf_get_stats 00:11:10.003 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:10.003 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:11:10.003 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:10.003 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@110 -- # stats='{ 00:11:10.003 "poll_groups": [ 00:11:10.003 { 00:11:10.003 "admin_qpairs": 2, 00:11:10.003 "completed_nvme_io": 115, 00:11:10.003 "current_admin_qpairs": 0, 00:11:10.003 "current_io_qpairs": 0, 00:11:10.003 "io_qpairs": 16, 00:11:10.003 "name": "nvmf_tgt_poll_group_000", 00:11:10.003 "pending_bdev_io": 0, 00:11:10.003 "transports": [ 00:11:10.003 { 00:11:10.003 "trtype": "TCP" 00:11:10.003 } 00:11:10.003 ] 00:11:10.003 }, 00:11:10.003 { 00:11:10.003 "admin_qpairs": 3, 00:11:10.003 "completed_nvme_io": 167, 00:11:10.003 "current_admin_qpairs": 0, 00:11:10.003 "current_io_qpairs": 0, 00:11:10.003 "io_qpairs": 17, 00:11:10.003 "name": "nvmf_tgt_poll_group_001", 00:11:10.003 "pending_bdev_io": 0, 00:11:10.003 "transports": [ 00:11:10.003 { 00:11:10.003 "trtype": "TCP" 00:11:10.003 } 00:11:10.003 ] 00:11:10.003 }, 00:11:10.003 { 00:11:10.003 "admin_qpairs": 1, 00:11:10.003 "completed_nvme_io": 70, 00:11:10.003 "current_admin_qpairs": 0, 00:11:10.003 "current_io_qpairs": 0, 00:11:10.003 "io_qpairs": 19, 00:11:10.003 "name": "nvmf_tgt_poll_group_002", 00:11:10.003 "pending_bdev_io": 0, 00:11:10.003 "transports": [ 00:11:10.003 { 00:11:10.003 "trtype": "TCP" 00:11:10.003 } 00:11:10.003 ] 00:11:10.003 }, 00:11:10.003 { 00:11:10.003 "admin_qpairs": 1, 00:11:10.003 "completed_nvme_io": 68, 00:11:10.003 "current_admin_qpairs": 0, 00:11:10.003 "current_io_qpairs": 0, 00:11:10.003 "io_qpairs": 18, 00:11:10.003 "name": "nvmf_tgt_poll_group_003", 00:11:10.003 "pending_bdev_io": 0, 00:11:10.003 "transports": [ 00:11:10.003 { 00:11:10.003 "trtype": "TCP" 00:11:10.003 } 00:11:10.003 ] 00:11:10.003 } 00:11:10.003 ], 00:11:10.003 "tick_rate": 2200000000 00:11:10.003 }' 00:11:10.003 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@112 -- # jsum '.poll_groups[].admin_qpairs' 00:11:10.003 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].admin_qpairs' 00:11:10.003 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@20 -- # jq '.poll_groups[].admin_qpairs' 00:11:10.004 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:11:10.004 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@112 -- # (( 7 > 0 )) 00:11:10.004 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@113 -- # jsum '.poll_groups[].io_qpairs' 00:11:10.004 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].io_qpairs' 00:11:10.004 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@20 -- # jq '.poll_groups[].io_qpairs' 00:11:10.004 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:11:10.004 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@113 -- # (( 70 > 0 )) 00:11:10.004 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@115 -- # '[' rdma == tcp ']' 00:11:10.004 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@121 -- # trap - SIGINT SIGTERM EXIT 00:11:10.004 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- target/rpc.sh@123 -- # nvmftestfini 00:11:10.004 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@514 -- # nvmfcleanup 00:11:10.004 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@121 -- # sync 00:11:10.004 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:11:10.004 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@124 -- # set +e 00:11:10.004 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@125 -- # for i in {1..20} 00:11:10.004 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:11:10.004 rmmod nvme_tcp 00:11:10.004 rmmod nvme_fabrics 00:11:10.004 rmmod nvme_keyring 00:11:10.004 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:11:10.004 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@128 -- # set -e 00:11:10.004 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@129 -- # return 0 00:11:10.004 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@515 -- # '[' -n 74182 ']' 00:11:10.004 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@516 -- # killprocess 74182 00:11:10.004 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@950 -- # '[' -z 74182 ']' 00:11:10.004 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@954 -- # kill -0 74182 00:11:10.004 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@955 -- # uname 00:11:10.004 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:11:10.004 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 74182 00:11:10.261 killing process with pid 74182 00:11:10.261 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:11:10.261 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:11:10.261 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@968 -- # echo 'killing process with pid 74182' 00:11:10.261 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@969 -- # kill 74182 00:11:10.261 11:21:51 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@974 -- # wait 74182 00:11:10.519 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:11:10.519 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:11:10.519 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:11:10.519 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@297 -- # iptr 00:11:10.519 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:11:10.519 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@789 -- # iptables-save 00:11:10.519 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@789 -- # iptables-restore 00:11:10.519 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@298 -- # [[ nvmf_tgt_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:11:10.519 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@299 -- # nvmf_veth_fini 00:11:10.519 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@233 -- # ip link set nvmf_init_br nomaster 00:11:10.519 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@234 -- # ip link set nvmf_init_br2 nomaster 00:11:10.519 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@235 -- # ip link set nvmf_tgt_br nomaster 00:11:10.519 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@236 -- # ip link set nvmf_tgt_br2 nomaster 00:11:10.519 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@237 -- # ip link set nvmf_init_br down 00:11:10.519 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@238 -- # ip link set nvmf_init_br2 down 00:11:10.519 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@239 -- # ip link set nvmf_tgt_br down 00:11:10.519 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@240 -- # ip link set nvmf_tgt_br2 down 00:11:10.519 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@241 -- # ip link delete nvmf_br type bridge 00:11:10.777 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@242 -- # ip link delete nvmf_init_if 00:11:10.777 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@243 -- # ip link delete nvmf_init_if2 00:11:10.777 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@244 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:11:10.777 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@245 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:11:10.777 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@246 -- # remove_spdk_ns 00:11:10.777 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:10.777 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:11:10.777 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:10.777 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- nvmf/common.sh@300 -- # return 0 00:11:10.777 00:11:10.777 real 0m19.711s 00:11:10.777 user 1m12.785s 00:11:10.777 sys 0m2.786s 00:11:10.777 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@1126 -- # xtrace_disable 00:11:10.777 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_rpc -- common/autotest_common.sh@10 -- # set +x 00:11:10.777 ************************************ 00:11:10.777 END TEST nvmf_rpc 00:11:10.777 ************************************ 00:11:10.777 11:21:52 nvmf_tcp.nvmf_target_extra -- nvmf/nvmf_target_extra.sh@23 -- # run_test nvmf_invalid /home/vagrant/spdk_repo/spdk/test/nvmf/target/invalid.sh --transport=tcp 00:11:10.777 11:21:52 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:11:10.777 11:21:52 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1107 -- # xtrace_disable 00:11:10.777 11:21:52 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@10 -- # set +x 00:11:10.777 ************************************ 00:11:10.777 START TEST nvmf_invalid 00:11:10.777 ************************************ 00:11:10.777 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/nvmf/target/invalid.sh --transport=tcp 00:11:10.777 * Looking for test storage... 00:11:10.777 * Found test storage at /home/vagrant/spdk_repo/spdk/test/nvmf/target 00:11:10.777 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:11:10.777 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- common/autotest_common.sh@1681 -- # lcov --version 00:11:10.777 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:11:11.035 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:11:11.035 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:11:11.035 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- scripts/common.sh@333 -- # local ver1 ver1_l 00:11:11.035 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- scripts/common.sh@334 -- # local ver2 ver2_l 00:11:11.035 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- scripts/common.sh@336 -- # IFS=.-: 00:11:11.035 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- scripts/common.sh@336 -- # read -ra ver1 00:11:11.035 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- scripts/common.sh@337 -- # IFS=.-: 00:11:11.035 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- scripts/common.sh@337 -- # read -ra ver2 00:11:11.035 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- scripts/common.sh@338 -- # local 'op=<' 00:11:11.035 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- scripts/common.sh@340 -- # ver1_l=2 00:11:11.035 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- scripts/common.sh@341 -- # ver2_l=1 00:11:11.035 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:11:11.035 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- scripts/common.sh@344 -- # case "$op" in 00:11:11.035 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- scripts/common.sh@345 -- # : 1 00:11:11.035 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- scripts/common.sh@364 -- # (( v = 0 )) 00:11:11.035 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:11:11.035 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- scripts/common.sh@365 -- # decimal 1 00:11:11.035 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- scripts/common.sh@353 -- # local d=1 00:11:11.035 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:11:11.035 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- scripts/common.sh@355 -- # echo 1 00:11:11.035 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- scripts/common.sh@365 -- # ver1[v]=1 00:11:11.035 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- scripts/common.sh@366 -- # decimal 2 00:11:11.035 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- scripts/common.sh@353 -- # local d=2 00:11:11.035 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:11:11.036 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- scripts/common.sh@355 -- # echo 2 00:11:11.036 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- scripts/common.sh@366 -- # ver2[v]=2 00:11:11.036 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:11:11.036 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:11:11.036 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- scripts/common.sh@368 -- # return 0 00:11:11.036 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:11:11.036 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:11:11.036 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:11.036 --rc genhtml_branch_coverage=1 00:11:11.036 --rc genhtml_function_coverage=1 00:11:11.036 --rc genhtml_legend=1 00:11:11.036 --rc geninfo_all_blocks=1 00:11:11.036 --rc geninfo_unexecuted_blocks=1 00:11:11.036 00:11:11.036 ' 00:11:11.036 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:11:11.036 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:11.036 --rc genhtml_branch_coverage=1 00:11:11.036 --rc genhtml_function_coverage=1 00:11:11.036 --rc genhtml_legend=1 00:11:11.036 --rc geninfo_all_blocks=1 00:11:11.036 --rc geninfo_unexecuted_blocks=1 00:11:11.036 00:11:11.036 ' 00:11:11.036 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:11:11.036 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:11.036 --rc genhtml_branch_coverage=1 00:11:11.036 --rc genhtml_function_coverage=1 00:11:11.036 --rc genhtml_legend=1 00:11:11.036 --rc geninfo_all_blocks=1 00:11:11.036 --rc geninfo_unexecuted_blocks=1 00:11:11.036 00:11:11.036 ' 00:11:11.036 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:11:11.036 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:11.036 --rc genhtml_branch_coverage=1 00:11:11.036 --rc genhtml_function_coverage=1 00:11:11.036 --rc genhtml_legend=1 00:11:11.036 --rc geninfo_all_blocks=1 00:11:11.036 --rc geninfo_unexecuted_blocks=1 00:11:11.036 00:11:11.036 ' 00:11:11.036 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@9 -- # source /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh 00:11:11.036 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@7 -- # uname -s 00:11:11.036 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:11:11.036 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:11:11.036 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:11:11.036 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:11:11.036 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:11:11.036 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:11:11.036 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:11:11.036 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:11:11.036 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:11:11.036 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:11:11.036 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:11:11.036 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@18 -- # NVME_HOSTID=3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:11:11.036 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:11:11.036 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:11:11.036 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@21 -- # NET_TYPE=virt 00:11:11.036 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:11:11.036 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@49 -- # source /home/vagrant/spdk_repo/spdk/scripts/common.sh 00:11:11.036 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- scripts/common.sh@15 -- # shopt -s extglob 00:11:11.036 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:11:11.036 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:11:11.036 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:11:11.036 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:11.036 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:11.036 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:11.036 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- paths/export.sh@5 -- # export PATH 00:11:11.036 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:11.036 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@51 -- # : 0 00:11:11.036 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:11:11.036 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:11:11.036 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:11:11.036 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:11:11.036 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:11:11.036 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:11:11.036 /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:11:11.036 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:11:11.036 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:11:11.036 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@55 -- # have_pci_nics=0 00:11:11.036 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@11 -- # multi_target_rpc=/home/vagrant/spdk_repo/spdk/test/nvmf/target/multitarget_rpc.py 00:11:11.036 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@12 -- # rpc=/home/vagrant/spdk_repo/spdk/scripts/rpc.py 00:11:11.036 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@13 -- # nqn=nqn.2016-06.io.spdk:cnode 00:11:11.036 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@14 -- # target=foobar 00:11:11.036 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@16 -- # RANDOM=0 00:11:11.036 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@34 -- # nvmftestinit 00:11:11.036 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:11:11.036 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:11:11.036 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@474 -- # prepare_net_devs 00:11:11.036 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@436 -- # local -g is_hw=no 00:11:11.036 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@438 -- # remove_spdk_ns 00:11:11.036 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:11.036 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:11:11.036 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:11.036 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@440 -- # [[ virt != virt ]] 00:11:11.036 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@442 -- # [[ no == yes ]] 00:11:11.036 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@449 -- # [[ virt == phy ]] 00:11:11.036 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@452 -- # [[ virt == phy-fallback ]] 00:11:11.036 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@457 -- # [[ tcp == tcp ]] 00:11:11.036 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@458 -- # nvmf_veth_init 00:11:11.036 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@145 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:11:11.036 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@146 -- # NVMF_SECOND_INITIATOR_IP=10.0.0.2 00:11:11.036 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@147 -- # NVMF_FIRST_TARGET_IP=10.0.0.3 00:11:11.036 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@148 -- # NVMF_SECOND_TARGET_IP=10.0.0.4 00:11:11.036 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@149 -- # NVMF_INITIATOR_IP=10.0.0.1 00:11:11.036 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@150 -- # NVMF_BRIDGE=nvmf_br 00:11:11.036 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@151 -- # NVMF_INITIATOR_INTERFACE=nvmf_init_if 00:11:11.036 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@152 -- # NVMF_INITIATOR_INTERFACE2=nvmf_init_if2 00:11:11.036 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@153 -- # NVMF_INITIATOR_BRIDGE=nvmf_init_br 00:11:11.036 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@154 -- # NVMF_INITIATOR_BRIDGE2=nvmf_init_br2 00:11:11.036 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@155 -- # NVMF_TARGET_NAMESPACE=nvmf_tgt_ns_spdk 00:11:11.036 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@156 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:11:11.036 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@157 -- # NVMF_TARGET_INTERFACE=nvmf_tgt_if 00:11:11.036 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@158 -- # NVMF_TARGET_INTERFACE2=nvmf_tgt_if2 00:11:11.036 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@159 -- # NVMF_TARGET_BRIDGE=nvmf_tgt_br 00:11:11.037 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@160 -- # NVMF_TARGET_BRIDGE2=nvmf_tgt_br2 00:11:11.037 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@162 -- # ip link set nvmf_init_br nomaster 00:11:11.037 Cannot find device "nvmf_init_br" 00:11:11.037 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@162 -- # true 00:11:11.037 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@163 -- # ip link set nvmf_init_br2 nomaster 00:11:11.037 Cannot find device "nvmf_init_br2" 00:11:11.037 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@163 -- # true 00:11:11.037 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@164 -- # ip link set nvmf_tgt_br nomaster 00:11:11.037 Cannot find device "nvmf_tgt_br" 00:11:11.037 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@164 -- # true 00:11:11.037 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@165 -- # ip link set nvmf_tgt_br2 nomaster 00:11:11.037 Cannot find device "nvmf_tgt_br2" 00:11:11.037 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@165 -- # true 00:11:11.037 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@166 -- # ip link set nvmf_init_br down 00:11:11.037 Cannot find device "nvmf_init_br" 00:11:11.037 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@166 -- # true 00:11:11.037 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@167 -- # ip link set nvmf_init_br2 down 00:11:11.037 Cannot find device "nvmf_init_br2" 00:11:11.037 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@167 -- # true 00:11:11.037 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@168 -- # ip link set nvmf_tgt_br down 00:11:11.037 Cannot find device "nvmf_tgt_br" 00:11:11.037 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@168 -- # true 00:11:11.037 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@169 -- # ip link set nvmf_tgt_br2 down 00:11:11.037 Cannot find device "nvmf_tgt_br2" 00:11:11.037 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@169 -- # true 00:11:11.037 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@170 -- # ip link delete nvmf_br type bridge 00:11:11.037 Cannot find device "nvmf_br" 00:11:11.037 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@170 -- # true 00:11:11.037 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@171 -- # ip link delete nvmf_init_if 00:11:11.037 Cannot find device "nvmf_init_if" 00:11:11.037 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@171 -- # true 00:11:11.037 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@172 -- # ip link delete nvmf_init_if2 00:11:11.294 Cannot find device "nvmf_init_if2" 00:11:11.294 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@172 -- # true 00:11:11.294 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@173 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:11:11.294 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:11:11.294 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@173 -- # true 00:11:11.294 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@174 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:11:11.294 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:11:11.294 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@174 -- # true 00:11:11.294 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@177 -- # ip netns add nvmf_tgt_ns_spdk 00:11:11.294 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@180 -- # ip link add nvmf_init_if type veth peer name nvmf_init_br 00:11:11.294 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@181 -- # ip link add nvmf_init_if2 type veth peer name nvmf_init_br2 00:11:11.294 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@182 -- # ip link add nvmf_tgt_if type veth peer name nvmf_tgt_br 00:11:11.294 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@183 -- # ip link add nvmf_tgt_if2 type veth peer name nvmf_tgt_br2 00:11:11.294 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@186 -- # ip link set nvmf_tgt_if netns nvmf_tgt_ns_spdk 00:11:11.294 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@187 -- # ip link set nvmf_tgt_if2 netns nvmf_tgt_ns_spdk 00:11:11.294 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@190 -- # ip addr add 10.0.0.1/24 dev nvmf_init_if 00:11:11.294 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@191 -- # ip addr add 10.0.0.2/24 dev nvmf_init_if2 00:11:11.294 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@192 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.3/24 dev nvmf_tgt_if 00:11:11.294 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@193 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.4/24 dev nvmf_tgt_if2 00:11:11.294 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@196 -- # ip link set nvmf_init_if up 00:11:11.294 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@197 -- # ip link set nvmf_init_if2 up 00:11:11.294 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@198 -- # ip link set nvmf_init_br up 00:11:11.294 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@199 -- # ip link set nvmf_init_br2 up 00:11:11.294 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@200 -- # ip link set nvmf_tgt_br up 00:11:11.294 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@201 -- # ip link set nvmf_tgt_br2 up 00:11:11.294 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@202 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if up 00:11:11.294 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@203 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if2 up 00:11:11.294 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@204 -- # ip netns exec nvmf_tgt_ns_spdk ip link set lo up 00:11:11.294 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@207 -- # ip link add nvmf_br type bridge 00:11:11.294 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@208 -- # ip link set nvmf_br up 00:11:11.294 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@211 -- # ip link set nvmf_init_br master nvmf_br 00:11:11.294 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@212 -- # ip link set nvmf_init_br2 master nvmf_br 00:11:11.294 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@213 -- # ip link set nvmf_tgt_br master nvmf_br 00:11:11.294 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@214 -- # ip link set nvmf_tgt_br2 master nvmf_br 00:11:11.294 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@217 -- # ipts -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT 00:11:11.295 11:21:52 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT' 00:11:11.295 11:21:53 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@218 -- # ipts -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT 00:11:11.295 11:21:53 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT' 00:11:11.552 11:21:53 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@219 -- # ipts -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT 00:11:11.552 11:21:53 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@788 -- # iptables -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT -m comment --comment 'SPDK_NVMF:-A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT' 00:11:11.552 11:21:53 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@222 -- # ping -c 1 10.0.0.3 00:11:11.552 PING 10.0.0.3 (10.0.0.3) 56(84) bytes of data. 00:11:11.552 64 bytes from 10.0.0.3: icmp_seq=1 ttl=64 time=0.125 ms 00:11:11.552 00:11:11.552 --- 10.0.0.3 ping statistics --- 00:11:11.552 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:11.552 rtt min/avg/max/mdev = 0.125/0.125/0.125/0.000 ms 00:11:11.552 11:21:53 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@223 -- # ping -c 1 10.0.0.4 00:11:11.552 PING 10.0.0.4 (10.0.0.4) 56(84) bytes of data. 00:11:11.552 64 bytes from 10.0.0.4: icmp_seq=1 ttl=64 time=0.111 ms 00:11:11.552 00:11:11.552 --- 10.0.0.4 ping statistics --- 00:11:11.552 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:11.552 rtt min/avg/max/mdev = 0.111/0.111/0.111/0.000 ms 00:11:11.552 11:21:53 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@224 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.1 00:11:11.552 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:11:11.552 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.032 ms 00:11:11.552 00:11:11.552 --- 10.0.0.1 ping statistics --- 00:11:11.552 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:11.552 rtt min/avg/max/mdev = 0.032/0.032/0.032/0.000 ms 00:11:11.552 11:21:53 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@225 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.2 00:11:11.552 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:11:11.552 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.092 ms 00:11:11.552 00:11:11.552 --- 10.0.0.2 ping statistics --- 00:11:11.552 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:11.552 rtt min/avg/max/mdev = 0.092/0.092/0.092/0.000 ms 00:11:11.552 11:21:53 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@227 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:11:11.552 11:21:53 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@459 -- # return 0 00:11:11.552 11:21:53 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:11:11.553 11:21:53 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:11:11.553 11:21:53 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:11:11.553 11:21:53 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:11:11.553 11:21:53 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:11:11.553 11:21:53 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:11:11.553 11:21:53 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:11:11.553 11:21:53 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@35 -- # nvmfappstart -m 0xF 00:11:11.553 11:21:53 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:11:11.553 11:21:53 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- common/autotest_common.sh@724 -- # xtrace_disable 00:11:11.553 11:21:53 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- common/autotest_common.sh@10 -- # set +x 00:11:11.553 11:21:53 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@507 -- # nvmfpid=74760 00:11:11.553 11:21:53 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@506 -- # ip netns exec nvmf_tgt_ns_spdk /home/vagrant/spdk_repo/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:11:11.553 11:21:53 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@508 -- # waitforlisten 74760 00:11:11.553 11:21:53 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- common/autotest_common.sh@831 -- # '[' -z 74760 ']' 00:11:11.553 11:21:53 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:11:11.553 11:21:53 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- common/autotest_common.sh@836 -- # local max_retries=100 00:11:11.553 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:11:11.553 11:21:53 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:11:11.553 11:21:53 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- common/autotest_common.sh@840 -- # xtrace_disable 00:11:11.553 11:21:53 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- common/autotest_common.sh@10 -- # set +x 00:11:11.553 [2024-10-07 11:21:53.128756] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:11:11.553 [2024-10-07 11:21:53.128888] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:11:11.810 [2024-10-07 11:21:53.272131] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 4 00:11:11.810 [2024-10-07 11:21:53.425494] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:11:11.810 [2024-10-07 11:21:53.425569] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:11:11.810 [2024-10-07 11:21:53.425582] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:11:11.810 [2024-10-07 11:21:53.425594] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:11:11.810 [2024-10-07 11:21:53.425604] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:11:11.810 [2024-10-07 11:21:53.427864] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:11:11.810 [2024-10-07 11:21:53.428032] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:11:11.810 [2024-10-07 11:21:53.428242] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 3 00:11:11.810 [2024-10-07 11:21:53.428247] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:11:12.796 11:21:54 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:11:12.796 11:21:54 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- common/autotest_common.sh@864 -- # return 0 00:11:12.796 11:21:54 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:11:12.796 11:21:54 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- common/autotest_common.sh@730 -- # xtrace_disable 00:11:12.796 11:21:54 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- common/autotest_common.sh@10 -- # set +x 00:11:12.796 11:21:54 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:11:12.796 11:21:54 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@37 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:11:12.796 11:21:54 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@40 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_create_subsystem -t foobar nqn.2016-06.io.spdk:cnode31347 00:11:12.796 [2024-10-07 11:21:54.450311] nvmf_rpc.c: 396:rpc_nvmf_create_subsystem: *ERROR*: Unable to find target foobar 00:11:12.796 11:21:54 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@40 -- # out='2024/10/07 11:21:54 error on JSON-RPC call, method: nvmf_create_subsystem, params: map[nqn:nqn.2016-06.io.spdk:cnode31347 tgt_name:foobar], err: error received for nvmf_create_subsystem method, err: Code=-32603 Msg=Unable to find target foobar 00:11:12.796 request: 00:11:12.796 { 00:11:12.796 "method": "nvmf_create_subsystem", 00:11:12.796 "params": { 00:11:12.796 "nqn": "nqn.2016-06.io.spdk:cnode31347", 00:11:12.796 "tgt_name": "foobar" 00:11:12.796 } 00:11:12.796 } 00:11:12.796 Got JSON-RPC error response 00:11:12.796 GoRPCClient: error on JSON-RPC call' 00:11:12.796 11:21:54 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@41 -- # [[ 2024/10/07 11:21:54 error on JSON-RPC call, method: nvmf_create_subsystem, params: map[nqn:nqn.2016-06.io.spdk:cnode31347 tgt_name:foobar], err: error received for nvmf_create_subsystem method, err: Code=-32603 Msg=Unable to find target foobar 00:11:12.796 request: 00:11:12.796 { 00:11:12.796 "method": "nvmf_create_subsystem", 00:11:12.796 "params": { 00:11:12.796 "nqn": "nqn.2016-06.io.spdk:cnode31347", 00:11:12.796 "tgt_name": "foobar" 00:11:12.796 } 00:11:12.796 } 00:11:12.796 Got JSON-RPC error response 00:11:12.796 GoRPCClient: error on JSON-RPC call == *\U\n\a\b\l\e\ \t\o\ \f\i\n\d\ \t\a\r\g\e\t* ]] 00:11:12.796 11:21:54 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@45 -- # echo -e '\x1f' 00:11:12.797 11:21:54 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@45 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_create_subsystem -s $'SPDKISFASTANDAWESOME\037' nqn.2016-06.io.spdk:cnode15385 00:11:13.123 [2024-10-07 11:21:54.722629] nvmf_rpc.c: 413:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode15385: invalid serial number 'SPDKISFASTANDAWESOME' 00:11:13.123 11:21:54 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@45 -- # out='2024/10/07 11:21:54 error on JSON-RPC call, method: nvmf_create_subsystem, params: map[nqn:nqn.2016-06.io.spdk:cnode15385 serial_number:SPDKISFASTANDAWESOME], err: error received for nvmf_create_subsystem method, err: Code=-32602 Msg=Invalid SN SPDKISFASTANDAWESOME 00:11:13.123 request: 00:11:13.123 { 00:11:13.123 "method": "nvmf_create_subsystem", 00:11:13.123 "params": { 00:11:13.123 "nqn": "nqn.2016-06.io.spdk:cnode15385", 00:11:13.123 "serial_number": "SPDKISFASTANDAWESOME\u001f" 00:11:13.123 } 00:11:13.123 } 00:11:13.123 Got JSON-RPC error response 00:11:13.123 GoRPCClient: error on JSON-RPC call' 00:11:13.123 11:21:54 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@46 -- # [[ 2024/10/07 11:21:54 error on JSON-RPC call, method: nvmf_create_subsystem, params: map[nqn:nqn.2016-06.io.spdk:cnode15385 serial_number:SPDKISFASTANDAWESOME], err: error received for nvmf_create_subsystem method, err: Code=-32602 Msg=Invalid SN SPDKISFASTANDAWESOME 00:11:13.123 request: 00:11:13.123 { 00:11:13.123 "method": "nvmf_create_subsystem", 00:11:13.123 "params": { 00:11:13.123 "nqn": "nqn.2016-06.io.spdk:cnode15385", 00:11:13.123 "serial_number": "SPDKISFASTANDAWESOME\u001f" 00:11:13.123 } 00:11:13.123 } 00:11:13.123 Got JSON-RPC error response 00:11:13.123 GoRPCClient: error on JSON-RPC call == *\I\n\v\a\l\i\d\ \S\N* ]] 00:11:13.123 11:21:54 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@50 -- # echo -e '\x1f' 00:11:13.123 11:21:54 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@50 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_create_subsystem -d $'SPDK_Controller\037' nqn.2016-06.io.spdk:cnode26819 00:11:13.382 [2024-10-07 11:21:55.006907] nvmf_rpc.c: 422:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode26819: invalid model number 'SPDK_Controller' 00:11:13.382 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@50 -- # out='2024/10/07 11:21:55 error on JSON-RPC call, method: nvmf_create_subsystem, params: map[model_number:SPDK_Controller nqn:nqn.2016-06.io.spdk:cnode26819], err: error received for nvmf_create_subsystem method, err: Code=-32602 Msg=Invalid MN SPDK_Controller 00:11:13.382 request: 00:11:13.382 { 00:11:13.382 "method": "nvmf_create_subsystem", 00:11:13.382 "params": { 00:11:13.382 "nqn": "nqn.2016-06.io.spdk:cnode26819", 00:11:13.382 "model_number": "SPDK_Controller\u001f" 00:11:13.382 } 00:11:13.382 } 00:11:13.382 Got JSON-RPC error response 00:11:13.382 GoRPCClient: error on JSON-RPC call' 00:11:13.382 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@51 -- # [[ 2024/10/07 11:21:55 error on JSON-RPC call, method: nvmf_create_subsystem, params: map[model_number:SPDK_Controller nqn:nqn.2016-06.io.spdk:cnode26819], err: error received for nvmf_create_subsystem method, err: Code=-32602 Msg=Invalid MN SPDK_Controller 00:11:13.382 request: 00:11:13.382 { 00:11:13.382 "method": "nvmf_create_subsystem", 00:11:13.382 "params": { 00:11:13.382 "nqn": "nqn.2016-06.io.spdk:cnode26819", 00:11:13.382 "model_number": "SPDK_Controller\u001f" 00:11:13.382 } 00:11:13.382 } 00:11:13.382 Got JSON-RPC error response 00:11:13.383 GoRPCClient: error on JSON-RPC call == *\I\n\v\a\l\i\d\ \M\N* ]] 00:11:13.383 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@54 -- # gen_random_s 21 00:11:13.383 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@19 -- # local length=21 ll 00:11:13.383 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@21 -- # chars=('32' '33' '34' '35' '36' '37' '38' '39' '40' '41' '42' '43' '44' '45' '46' '47' '48' '49' '50' '51' '52' '53' '54' '55' '56' '57' '58' '59' '60' '61' '62' '63' '64' '65' '66' '67' '68' '69' '70' '71' '72' '73' '74' '75' '76' '77' '78' '79' '80' '81' '82' '83' '84' '85' '86' '87' '88' '89' '90' '91' '92' '93' '94' '95' '96' '97' '98' '99' '100' '101' '102' '103' '104' '105' '106' '107' '108' '109' '110' '111' '112' '113' '114' '115' '116' '117' '118' '119' '120' '121' '122' '123' '124' '125' '126' '127') 00:11:13.383 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@21 -- # local chars 00:11:13.383 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@22 -- # local string 00:11:13.383 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll = 0 )) 00:11:13.383 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:11:13.383 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 32 00:11:13.383 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x20' 00:11:13.383 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=' ' 00:11:13.383 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:11:13.383 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:11:13.383 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 117 00:11:13.383 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x75' 00:11:13.383 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=u 00:11:13.383 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:11:13.383 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:11:13.383 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 104 00:11:13.383 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x68' 00:11:13.383 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=h 00:11:13.383 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:11:13.383 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:11:13.383 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 90 00:11:13.383 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x5a' 00:11:13.383 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=Z 00:11:13.383 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:11:13.383 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:11:13.383 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 105 00:11:13.383 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x69' 00:11:13.383 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=i 00:11:13.383 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:11:13.383 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:11:13.383 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 56 00:11:13.383 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x38' 00:11:13.383 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=8 00:11:13.383 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:11:13.383 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:11:13.383 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 117 00:11:13.383 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x75' 00:11:13.383 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=u 00:11:13.383 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:11:13.383 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:11:13.383 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 118 00:11:13.383 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x76' 00:11:13.383 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=v 00:11:13.383 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:11:13.383 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:11:13.383 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 71 00:11:13.383 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x47' 00:11:13.383 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=G 00:11:13.383 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:11:13.383 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:11:13.383 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 50 00:11:13.383 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x32' 00:11:13.383 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=2 00:11:13.383 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:11:13.383 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:11:13.383 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 60 00:11:13.383 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x3c' 00:11:13.383 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+='<' 00:11:13.383 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:11:13.383 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:11:13.383 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 62 00:11:13.383 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x3e' 00:11:13.383 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+='>' 00:11:13.383 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:11:13.383 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:11:13.641 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 113 00:11:13.641 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x71' 00:11:13.641 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=q 00:11:13.641 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:11:13.641 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:11:13.641 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 123 00:11:13.641 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x7b' 00:11:13.641 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+='{' 00:11:13.641 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:11:13.641 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:11:13.641 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 32 00:11:13.641 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x20' 00:11:13.641 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=' ' 00:11:13.641 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:11:13.641 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:11:13.641 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 72 00:11:13.641 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x48' 00:11:13.641 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=H 00:11:13.641 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:11:13.641 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:11:13.641 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 82 00:11:13.641 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x52' 00:11:13.641 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=R 00:11:13.641 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:11:13.641 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:11:13.641 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 74 00:11:13.641 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x4a' 00:11:13.641 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=J 00:11:13.641 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:11:13.641 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:11:13.641 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 84 00:11:13.641 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x54' 00:11:13.641 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=T 00:11:13.641 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:11:13.641 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:11:13.641 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 79 00:11:13.641 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x4f' 00:11:13.641 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=O 00:11:13.641 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:11:13.641 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:11:13.641 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 46 00:11:13.641 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x2e' 00:11:13.641 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=. 00:11:13.641 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:11:13.641 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:11:13.641 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@28 -- # [[ == \- ]] 00:11:13.641 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@31 -- # echo ' uhZi8uvG2<>q{ HRJTO.' 00:11:13.641 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@54 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_create_subsystem -s ' uhZi8uvG2<>q{ HRJTO.' nqn.2016-06.io.spdk:cnode16373 00:11:13.900 [2024-10-07 11:21:55.379244] nvmf_rpc.c: 413:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode16373: invalid serial number ' uhZi8uvG2<>q{ HRJTO.' 00:11:13.900 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@54 -- # out='2024/10/07 11:21:55 error on JSON-RPC call, method: nvmf_create_subsystem, params: map[nqn:nqn.2016-06.io.spdk:cnode16373 serial_number: uhZi8uvG2<>q{ HRJTO.], err: error received for nvmf_create_subsystem method, err: Code=-32602 Msg=Invalid SN uhZi8uvG2<>q{ HRJTO. 00:11:13.900 request: 00:11:13.900 { 00:11:13.900 "method": "nvmf_create_subsystem", 00:11:13.900 "params": { 00:11:13.900 "nqn": "nqn.2016-06.io.spdk:cnode16373", 00:11:13.900 "serial_number": " uhZi8uvG2<>q{ HRJTO." 00:11:13.900 } 00:11:13.900 } 00:11:13.900 Got JSON-RPC error response 00:11:13.900 GoRPCClient: error on JSON-RPC call' 00:11:13.900 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@55 -- # [[ 2024/10/07 11:21:55 error on JSON-RPC call, method: nvmf_create_subsystem, params: map[nqn:nqn.2016-06.io.spdk:cnode16373 serial_number: uhZi8uvG2<>q{ HRJTO.], err: error received for nvmf_create_subsystem method, err: Code=-32602 Msg=Invalid SN uhZi8uvG2<>q{ HRJTO. 00:11:13.900 request: 00:11:13.900 { 00:11:13.900 "method": "nvmf_create_subsystem", 00:11:13.900 "params": { 00:11:13.900 "nqn": "nqn.2016-06.io.spdk:cnode16373", 00:11:13.900 "serial_number": " uhZi8uvG2<>q{ HRJTO." 00:11:13.900 } 00:11:13.900 } 00:11:13.900 Got JSON-RPC error response 00:11:13.900 GoRPCClient: error on JSON-RPC call == *\I\n\v\a\l\i\d\ \S\N* ]] 00:11:13.900 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@58 -- # gen_random_s 41 00:11:13.900 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@19 -- # local length=41 ll 00:11:13.900 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@21 -- # chars=('32' '33' '34' '35' '36' '37' '38' '39' '40' '41' '42' '43' '44' '45' '46' '47' '48' '49' '50' '51' '52' '53' '54' '55' '56' '57' '58' '59' '60' '61' '62' '63' '64' '65' '66' '67' '68' '69' '70' '71' '72' '73' '74' '75' '76' '77' '78' '79' '80' '81' '82' '83' '84' '85' '86' '87' '88' '89' '90' '91' '92' '93' '94' '95' '96' '97' '98' '99' '100' '101' '102' '103' '104' '105' '106' '107' '108' '109' '110' '111' '112' '113' '114' '115' '116' '117' '118' '119' '120' '121' '122' '123' '124' '125' '126' '127') 00:11:13.900 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@21 -- # local chars 00:11:13.900 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@22 -- # local string 00:11:13.900 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll = 0 )) 00:11:13.900 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:11:13.900 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 115 00:11:13.900 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x73' 00:11:13.900 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=s 00:11:13.900 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:11:13.900 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:11:13.900 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 112 00:11:13.900 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x70' 00:11:13.900 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=p 00:11:13.900 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:11:13.900 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:11:13.900 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 39 00:11:13.900 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x27' 00:11:13.900 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=\' 00:11:13.900 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:11:13.900 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:11:13.900 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 105 00:11:13.900 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x69' 00:11:13.900 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=i 00:11:13.900 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:11:13.900 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:11:13.900 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 63 00:11:13.900 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x3f' 00:11:13.900 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+='?' 00:11:13.900 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:11:13.900 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:11:13.900 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 107 00:11:13.900 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x6b' 00:11:13.900 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=k 00:11:13.900 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:11:13.900 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:11:13.900 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 96 00:11:13.900 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x60' 00:11:13.900 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+='`' 00:11:13.900 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:11:13.900 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:11:13.900 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 46 00:11:13.900 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x2e' 00:11:13.900 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=. 00:11:13.900 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:11:13.900 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:11:13.900 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 106 00:11:13.900 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x6a' 00:11:13.900 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=j 00:11:13.900 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:11:13.900 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:11:13.900 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 79 00:11:13.900 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x4f' 00:11:13.900 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=O 00:11:13.900 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:11:13.900 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:11:13.900 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 104 00:11:13.900 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x68' 00:11:13.900 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=h 00:11:13.900 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:11:13.900 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:11:13.900 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 89 00:11:13.900 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x59' 00:11:13.900 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=Y 00:11:13.900 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:11:13.900 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:11:13.900 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 85 00:11:13.900 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x55' 00:11:13.900 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=U 00:11:13.900 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:11:13.900 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:11:13.900 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 54 00:11:13.900 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x36' 00:11:13.900 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=6 00:11:13.900 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:11:13.900 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:11:13.900 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 99 00:11:13.900 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x63' 00:11:13.900 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=c 00:11:13.900 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:11:13.900 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:11:13.900 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 70 00:11:13.900 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x46' 00:11:13.900 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=F 00:11:13.900 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:11:13.900 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:11:13.900 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 65 00:11:13.900 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x41' 00:11:13.900 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=A 00:11:13.900 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:11:13.900 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:11:13.900 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 77 00:11:13.900 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x4d' 00:11:13.900 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=M 00:11:13.900 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:11:13.900 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:11:13.900 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 106 00:11:13.900 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x6a' 00:11:13.900 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=j 00:11:13.900 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:11:13.900 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:11:13.900 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 35 00:11:13.900 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x23' 00:11:13.900 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+='#' 00:11:13.901 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:11:13.901 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:11:13.901 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 64 00:11:13.901 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x40' 00:11:13.901 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=@ 00:11:13.901 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:11:13.901 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:11:13.901 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 97 00:11:13.901 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x61' 00:11:13.901 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=a 00:11:13.901 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:11:13.901 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:11:13.901 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 113 00:11:13.901 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x71' 00:11:13.901 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=q 00:11:13.901 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:11:13.901 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:11:13.901 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 122 00:11:13.901 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x7a' 00:11:13.901 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=z 00:11:13.901 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:11:13.901 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:11:13.901 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 74 00:11:13.901 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x4a' 00:11:13.901 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=J 00:11:13.901 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:11:13.901 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:11:13.901 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 63 00:11:13.901 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x3f' 00:11:13.901 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+='?' 00:11:13.901 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:11:13.901 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:11:13.901 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 82 00:11:13.901 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x52' 00:11:13.901 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=R 00:11:13.901 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:11:13.901 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:11:13.901 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 86 00:11:13.901 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x56' 00:11:13.901 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=V 00:11:13.901 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:11:13.901 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:11:13.901 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 48 00:11:13.901 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x30' 00:11:13.901 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=0 00:11:13.901 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:11:13.901 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:11:13.901 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 55 00:11:13.901 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x37' 00:11:13.901 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=7 00:11:13.901 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:11:13.901 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:11:13.901 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 127 00:11:13.901 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x7f' 00:11:13.901 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=$'\177' 00:11:13.901 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:11:13.901 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:11:13.901 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 111 00:11:13.901 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x6f' 00:11:13.901 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=o 00:11:13.901 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:11:13.901 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:11:13.901 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 110 00:11:13.901 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x6e' 00:11:13.901 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=n 00:11:13.901 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:11:13.901 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:11:13.901 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 84 00:11:13.901 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x54' 00:11:13.901 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=T 00:11:13.901 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:11:13.901 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:11:13.901 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 49 00:11:13.901 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x31' 00:11:13.901 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=1 00:11:13.901 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:11:13.901 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:11:13.901 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 127 00:11:13.901 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x7f' 00:11:13.901 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=$'\177' 00:11:13.901 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:11:13.901 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:11:13.901 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 90 00:11:13.901 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x5a' 00:11:13.901 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=Z 00:11:13.901 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:11:13.901 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:11:14.159 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 75 00:11:14.159 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x4b' 00:11:14.159 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=K 00:11:14.159 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:11:14.159 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:11:14.159 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 65 00:11:14.159 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x41' 00:11:14.160 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=A 00:11:14.160 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:11:14.160 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:11:14.160 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 48 00:11:14.160 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x30' 00:11:14.160 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=0 00:11:14.160 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:11:14.160 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:11:14.160 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # printf %x 86 00:11:14.160 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # echo -e '\x56' 00:11:14.160 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@25 -- # string+=V 00:11:14.160 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll++ )) 00:11:14.160 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@24 -- # (( ll < length )) 00:11:14.160 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@28 -- # [[ s == \- ]] 00:11:14.160 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@31 -- # echo 'sp'\''i?k`.jOhYU6cFAMj#@aqzJ?RV07onT1ZKA0V' 00:11:14.160 11:21:55 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@58 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_create_subsystem -d 'sp'\''i?k`.jOhYU6cFAMj#@aqzJ?RV07onT1ZKA0V' nqn.2016-06.io.spdk:cnode27223 00:11:14.417 [2024-10-07 11:21:55.983781] nvmf_rpc.c: 422:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode27223: invalid model number 'sp'i?k`.jOhYU6cFAMj#@aqzJ?RV07onT1ZKA0V' 00:11:14.417 11:21:56 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@58 -- # out='2024/10/07 11:21:55 error on JSON-RPC call, method: nvmf_create_subsystem, params: map[model_number:sp'\''i?k`.jOhYU6cFAMj#@aqzJ?RV07onT1ZKA0V nqn:nqn.2016-06.io.spdk:cnode27223], err: error received for nvmf_create_subsystem method, err: Code=-32602 Msg=Invalid MN sp'\''i?k`.jOhYU6cFAMj#@aqzJ?RV07onT1ZKA0V 00:11:14.417 request: 00:11:14.417 { 00:11:14.417 "method": "nvmf_create_subsystem", 00:11:14.417 "params": { 00:11:14.417 "nqn": "nqn.2016-06.io.spdk:cnode27223", 00:11:14.417 "model_number": "sp'\''i?k`.jOhYU6cFAMj#@aqzJ?RV07\u007fonT1\u007fZKA0V" 00:11:14.417 } 00:11:14.417 } 00:11:14.417 Got JSON-RPC error response 00:11:14.417 GoRPCClient: error on JSON-RPC call' 00:11:14.417 11:21:56 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@59 -- # [[ 2024/10/07 11:21:55 error on JSON-RPC call, method: nvmf_create_subsystem, params: map[model_number:sp'i?k`.jOhYU6cFAMj#@aqzJ?RV07onT1ZKA0V nqn:nqn.2016-06.io.spdk:cnode27223], err: error received for nvmf_create_subsystem method, err: Code=-32602 Msg=Invalid MN sp'i?k`.jOhYU6cFAMj#@aqzJ?RV07onT1ZKA0V 00:11:14.417 request: 00:11:14.417 { 00:11:14.417 "method": "nvmf_create_subsystem", 00:11:14.417 "params": { 00:11:14.417 "nqn": "nqn.2016-06.io.spdk:cnode27223", 00:11:14.417 "model_number": "sp'i?k`.jOhYU6cFAMj#@aqzJ?RV07\u007fonT1\u007fZKA0V" 00:11:14.417 } 00:11:14.417 } 00:11:14.417 Got JSON-RPC error response 00:11:14.417 GoRPCClient: error on JSON-RPC call == *\I\n\v\a\l\i\d\ \M\N* ]] 00:11:14.417 11:21:56 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@62 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_create_transport --trtype tcp 00:11:14.675 [2024-10-07 11:21:56.316123] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:11:14.675 11:21:56 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@63 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode -s SPDK001 -a 00:11:15.242 11:21:56 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@64 -- # [[ tcp == \T\C\P ]] 00:11:15.242 11:21:56 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@67 -- # echo '' 00:11:15.242 11:21:56 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@67 -- # head -n 1 00:11:15.242 11:21:56 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@67 -- # IP= 00:11:15.242 11:21:56 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@69 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode -t tcp -a '' -s 4421 00:11:15.500 [2024-10-07 11:21:56.996817] nvmf_rpc.c: 783:nvmf_rpc_listen_paused: *ERROR*: Unable to remove listener, rc -2 00:11:15.500 11:21:57 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@69 -- # out='2024/10/07 11:21:57 error on JSON-RPC call, method: nvmf_subsystem_remove_listener, params: map[listen_address:map[traddr: trsvcid:4421 trtype:tcp] nqn:nqn.2016-06.io.spdk:cnode], err: error received for nvmf_subsystem_remove_listener method, err: Code=-32602 Msg=Invalid parameters 00:11:15.500 request: 00:11:15.500 { 00:11:15.500 "method": "nvmf_subsystem_remove_listener", 00:11:15.500 "params": { 00:11:15.500 "nqn": "nqn.2016-06.io.spdk:cnode", 00:11:15.500 "listen_address": { 00:11:15.500 "trtype": "tcp", 00:11:15.500 "traddr": "", 00:11:15.500 "trsvcid": "4421" 00:11:15.500 } 00:11:15.500 } 00:11:15.500 } 00:11:15.500 Got JSON-RPC error response 00:11:15.500 GoRPCClient: error on JSON-RPC call' 00:11:15.500 11:21:57 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@70 -- # [[ 2024/10/07 11:21:57 error on JSON-RPC call, method: nvmf_subsystem_remove_listener, params: map[listen_address:map[traddr: trsvcid:4421 trtype:tcp] nqn:nqn.2016-06.io.spdk:cnode], err: error received for nvmf_subsystem_remove_listener method, err: Code=-32602 Msg=Invalid parameters 00:11:15.500 request: 00:11:15.500 { 00:11:15.500 "method": "nvmf_subsystem_remove_listener", 00:11:15.500 "params": { 00:11:15.500 "nqn": "nqn.2016-06.io.spdk:cnode", 00:11:15.500 "listen_address": { 00:11:15.500 "trtype": "tcp", 00:11:15.500 "traddr": "", 00:11:15.500 "trsvcid": "4421" 00:11:15.500 } 00:11:15.500 } 00:11:15.500 } 00:11:15.500 Got JSON-RPC error response 00:11:15.500 GoRPCClient: error on JSON-RPC call != *\U\n\a\b\l\e\ \t\o\ \s\t\o\p\ \l\i\s\t\e\n\e\r\.* ]] 00:11:15.500 11:21:57 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@73 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode12820 -i 0 00:11:15.758 [2024-10-07 11:21:57.329088] nvmf_rpc.c: 434:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode12820: invalid cntlid range [0-65519] 00:11:15.758 11:21:57 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@73 -- # out='2024/10/07 11:21:57 error on JSON-RPC call, method: nvmf_create_subsystem, params: map[min_cntlid:0 nqn:nqn.2016-06.io.spdk:cnode12820], err: error received for nvmf_create_subsystem method, err: Code=-32602 Msg=Invalid cntlid range [0-65519] 00:11:15.758 request: 00:11:15.758 { 00:11:15.758 "method": "nvmf_create_subsystem", 00:11:15.758 "params": { 00:11:15.758 "nqn": "nqn.2016-06.io.spdk:cnode12820", 00:11:15.758 "min_cntlid": 0 00:11:15.758 } 00:11:15.758 } 00:11:15.758 Got JSON-RPC error response 00:11:15.758 GoRPCClient: error on JSON-RPC call' 00:11:15.758 11:21:57 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@74 -- # [[ 2024/10/07 11:21:57 error on JSON-RPC call, method: nvmf_create_subsystem, params: map[min_cntlid:0 nqn:nqn.2016-06.io.spdk:cnode12820], err: error received for nvmf_create_subsystem method, err: Code=-32602 Msg=Invalid cntlid range [0-65519] 00:11:15.758 request: 00:11:15.758 { 00:11:15.758 "method": "nvmf_create_subsystem", 00:11:15.758 "params": { 00:11:15.758 "nqn": "nqn.2016-06.io.spdk:cnode12820", 00:11:15.758 "min_cntlid": 0 00:11:15.758 } 00:11:15.758 } 00:11:15.758 Got JSON-RPC error response 00:11:15.758 GoRPCClient: error on JSON-RPC call == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:11:15.758 11:21:57 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@75 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3695 -i 65520 00:11:16.017 [2024-10-07 11:21:57.601310] nvmf_rpc.c: 434:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode3695: invalid cntlid range [65520-65519] 00:11:16.017 11:21:57 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@75 -- # out='2024/10/07 11:21:57 error on JSON-RPC call, method: nvmf_create_subsystem, params: map[min_cntlid:65520 nqn:nqn.2016-06.io.spdk:cnode3695], err: error received for nvmf_create_subsystem method, err: Code=-32602 Msg=Invalid cntlid range [65520-65519] 00:11:16.017 request: 00:11:16.017 { 00:11:16.017 "method": "nvmf_create_subsystem", 00:11:16.017 "params": { 00:11:16.017 "nqn": "nqn.2016-06.io.spdk:cnode3695", 00:11:16.017 "min_cntlid": 65520 00:11:16.017 } 00:11:16.017 } 00:11:16.017 Got JSON-RPC error response 00:11:16.017 GoRPCClient: error on JSON-RPC call' 00:11:16.017 11:21:57 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@76 -- # [[ 2024/10/07 11:21:57 error on JSON-RPC call, method: nvmf_create_subsystem, params: map[min_cntlid:65520 nqn:nqn.2016-06.io.spdk:cnode3695], err: error received for nvmf_create_subsystem method, err: Code=-32602 Msg=Invalid cntlid range [65520-65519] 00:11:16.017 request: 00:11:16.017 { 00:11:16.017 "method": "nvmf_create_subsystem", 00:11:16.017 "params": { 00:11:16.017 "nqn": "nqn.2016-06.io.spdk:cnode3695", 00:11:16.017 "min_cntlid": 65520 00:11:16.017 } 00:11:16.017 } 00:11:16.017 Got JSON-RPC error response 00:11:16.017 GoRPCClient: error on JSON-RPC call == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:11:16.017 11:21:57 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@77 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode17173 -I 0 00:11:16.275 [2024-10-07 11:21:57.869568] nvmf_rpc.c: 434:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode17173: invalid cntlid range [1-0] 00:11:16.275 11:21:57 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@77 -- # out='2024/10/07 11:21:57 error on JSON-RPC call, method: nvmf_create_subsystem, params: map[max_cntlid:0 nqn:nqn.2016-06.io.spdk:cnode17173], err: error received for nvmf_create_subsystem method, err: Code=-32602 Msg=Invalid cntlid range [1-0] 00:11:16.275 request: 00:11:16.275 { 00:11:16.275 "method": "nvmf_create_subsystem", 00:11:16.275 "params": { 00:11:16.275 "nqn": "nqn.2016-06.io.spdk:cnode17173", 00:11:16.275 "max_cntlid": 0 00:11:16.275 } 00:11:16.275 } 00:11:16.275 Got JSON-RPC error response 00:11:16.275 GoRPCClient: error on JSON-RPC call' 00:11:16.275 11:21:57 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@78 -- # [[ 2024/10/07 11:21:57 error on JSON-RPC call, method: nvmf_create_subsystem, params: map[max_cntlid:0 nqn:nqn.2016-06.io.spdk:cnode17173], err: error received for nvmf_create_subsystem method, err: Code=-32602 Msg=Invalid cntlid range [1-0] 00:11:16.275 request: 00:11:16.275 { 00:11:16.275 "method": "nvmf_create_subsystem", 00:11:16.275 "params": { 00:11:16.275 "nqn": "nqn.2016-06.io.spdk:cnode17173", 00:11:16.275 "max_cntlid": 0 00:11:16.275 } 00:11:16.275 } 00:11:16.275 Got JSON-RPC error response 00:11:16.275 GoRPCClient: error on JSON-RPC call == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:11:16.275 11:21:57 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@79 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode22679 -I 65520 00:11:16.534 [2024-10-07 11:21:58.189857] nvmf_rpc.c: 434:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode22679: invalid cntlid range [1-65520] 00:11:16.534 11:21:58 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@79 -- # out='2024/10/07 11:21:58 error on JSON-RPC call, method: nvmf_create_subsystem, params: map[max_cntlid:65520 nqn:nqn.2016-06.io.spdk:cnode22679], err: error received for nvmf_create_subsystem method, err: Code=-32602 Msg=Invalid cntlid range [1-65520] 00:11:16.534 request: 00:11:16.534 { 00:11:16.534 "method": "nvmf_create_subsystem", 00:11:16.534 "params": { 00:11:16.534 "nqn": "nqn.2016-06.io.spdk:cnode22679", 00:11:16.534 "max_cntlid": 65520 00:11:16.534 } 00:11:16.534 } 00:11:16.534 Got JSON-RPC error response 00:11:16.534 GoRPCClient: error on JSON-RPC call' 00:11:16.534 11:21:58 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@80 -- # [[ 2024/10/07 11:21:58 error on JSON-RPC call, method: nvmf_create_subsystem, params: map[max_cntlid:65520 nqn:nqn.2016-06.io.spdk:cnode22679], err: error received for nvmf_create_subsystem method, err: Code=-32602 Msg=Invalid cntlid range [1-65520] 00:11:16.534 request: 00:11:16.534 { 00:11:16.534 "method": "nvmf_create_subsystem", 00:11:16.534 "params": { 00:11:16.534 "nqn": "nqn.2016-06.io.spdk:cnode22679", 00:11:16.534 "max_cntlid": 65520 00:11:16.534 } 00:11:16.534 } 00:11:16.534 Got JSON-RPC error response 00:11:16.534 GoRPCClient: error on JSON-RPC call == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:11:16.534 11:21:58 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@83 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode30413 -i 6 -I 5 00:11:17.099 [2024-10-07 11:21:58.554170] nvmf_rpc.c: 434:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode30413: invalid cntlid range [6-5] 00:11:17.099 11:21:58 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@83 -- # out='2024/10/07 11:21:58 error on JSON-RPC call, method: nvmf_create_subsystem, params: map[max_cntlid:5 min_cntlid:6 nqn:nqn.2016-06.io.spdk:cnode30413], err: error received for nvmf_create_subsystem method, err: Code=-32602 Msg=Invalid cntlid range [6-5] 00:11:17.099 request: 00:11:17.099 { 00:11:17.099 "method": "nvmf_create_subsystem", 00:11:17.099 "params": { 00:11:17.099 "nqn": "nqn.2016-06.io.spdk:cnode30413", 00:11:17.099 "min_cntlid": 6, 00:11:17.099 "max_cntlid": 5 00:11:17.099 } 00:11:17.099 } 00:11:17.099 Got JSON-RPC error response 00:11:17.099 GoRPCClient: error on JSON-RPC call' 00:11:17.099 11:21:58 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@84 -- # [[ 2024/10/07 11:21:58 error on JSON-RPC call, method: nvmf_create_subsystem, params: map[max_cntlid:5 min_cntlid:6 nqn:nqn.2016-06.io.spdk:cnode30413], err: error received for nvmf_create_subsystem method, err: Code=-32602 Msg=Invalid cntlid range [6-5] 00:11:17.099 request: 00:11:17.099 { 00:11:17.099 "method": "nvmf_create_subsystem", 00:11:17.099 "params": { 00:11:17.099 "nqn": "nqn.2016-06.io.spdk:cnode30413", 00:11:17.099 "min_cntlid": 6, 00:11:17.099 "max_cntlid": 5 00:11:17.099 } 00:11:17.099 } 00:11:17.099 Got JSON-RPC error response 00:11:17.099 GoRPCClient: error on JSON-RPC call == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:11:17.099 11:21:58 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@87 -- # /home/vagrant/spdk_repo/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target --name foobar 00:11:17.099 11:21:58 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@87 -- # out='request: 00:11:17.099 { 00:11:17.099 "name": "foobar", 00:11:17.099 "method": "nvmf_delete_target", 00:11:17.099 "req_id": 1 00:11:17.099 } 00:11:17.099 Got JSON-RPC error response 00:11:17.099 response: 00:11:17.099 { 00:11:17.099 "code": -32602, 00:11:17.099 "message": "The specified target doesn'\''t exist, cannot delete it." 00:11:17.099 }' 00:11:17.099 11:21:58 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@88 -- # [[ request: 00:11:17.099 { 00:11:17.099 "name": "foobar", 00:11:17.099 "method": "nvmf_delete_target", 00:11:17.099 "req_id": 1 00:11:17.099 } 00:11:17.099 Got JSON-RPC error response 00:11:17.099 response: 00:11:17.099 { 00:11:17.099 "code": -32602, 00:11:17.099 "message": "The specified target doesn't exist, cannot delete it." 00:11:17.099 } == *\T\h\e\ \s\p\e\c\i\f\i\e\d\ \t\a\r\g\e\t\ \d\o\e\s\n\'\t\ \e\x\i\s\t\,\ \c\a\n\n\o\t\ \d\e\l\e\t\e\ \i\t\.* ]] 00:11:17.099 11:21:58 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@90 -- # trap - SIGINT SIGTERM EXIT 00:11:17.099 11:21:58 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- target/invalid.sh@91 -- # nvmftestfini 00:11:17.099 11:21:58 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@514 -- # nvmfcleanup 00:11:17.099 11:21:58 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@121 -- # sync 00:11:17.099 11:21:58 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:11:17.099 11:21:58 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@124 -- # set +e 00:11:17.099 11:21:58 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@125 -- # for i in {1..20} 00:11:17.099 11:21:58 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:11:17.099 rmmod nvme_tcp 00:11:17.099 rmmod nvme_fabrics 00:11:17.099 rmmod nvme_keyring 00:11:17.099 11:21:58 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:11:17.099 11:21:58 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@128 -- # set -e 00:11:17.099 11:21:58 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@129 -- # return 0 00:11:17.099 11:21:58 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@515 -- # '[' -n 74760 ']' 00:11:17.099 11:21:58 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@516 -- # killprocess 74760 00:11:17.100 11:21:58 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- common/autotest_common.sh@950 -- # '[' -z 74760 ']' 00:11:17.100 11:21:58 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- common/autotest_common.sh@954 -- # kill -0 74760 00:11:17.100 11:21:58 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- common/autotest_common.sh@955 -- # uname 00:11:17.100 11:21:58 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:11:17.100 11:21:58 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 74760 00:11:17.358 11:21:58 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:11:17.358 11:21:58 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:11:17.358 killing process with pid 74760 00:11:17.358 11:21:58 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- common/autotest_common.sh@968 -- # echo 'killing process with pid 74760' 00:11:17.358 11:21:58 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- common/autotest_common.sh@969 -- # kill 74760 00:11:17.358 11:21:58 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- common/autotest_common.sh@974 -- # wait 74760 00:11:17.617 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:11:17.617 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:11:17.617 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:11:17.617 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@297 -- # iptr 00:11:17.617 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@789 -- # iptables-save 00:11:17.617 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:11:17.617 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@789 -- # iptables-restore 00:11:17.617 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@298 -- # [[ nvmf_tgt_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:11:17.617 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@299 -- # nvmf_veth_fini 00:11:17.617 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@233 -- # ip link set nvmf_init_br nomaster 00:11:17.617 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@234 -- # ip link set nvmf_init_br2 nomaster 00:11:17.617 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@235 -- # ip link set nvmf_tgt_br nomaster 00:11:17.617 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@236 -- # ip link set nvmf_tgt_br2 nomaster 00:11:17.617 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@237 -- # ip link set nvmf_init_br down 00:11:17.617 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@238 -- # ip link set nvmf_init_br2 down 00:11:17.617 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@239 -- # ip link set nvmf_tgt_br down 00:11:17.617 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@240 -- # ip link set nvmf_tgt_br2 down 00:11:17.617 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@241 -- # ip link delete nvmf_br type bridge 00:11:17.617 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@242 -- # ip link delete nvmf_init_if 00:11:17.617 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@243 -- # ip link delete nvmf_init_if2 00:11:17.875 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@244 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:11:17.875 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@245 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:11:17.875 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@246 -- # remove_spdk_ns 00:11:17.875 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:17.875 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:11:17.875 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:17.875 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- nvmf/common.sh@300 -- # return 0 00:11:17.875 00:11:17.875 real 0m7.020s 00:11:17.875 user 0m26.650s 00:11:17.875 sys 0m1.577s 00:11:17.875 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- common/autotest_common.sh@1126 -- # xtrace_disable 00:11:17.875 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_invalid -- common/autotest_common.sh@10 -- # set +x 00:11:17.875 ************************************ 00:11:17.875 END TEST nvmf_invalid 00:11:17.875 ************************************ 00:11:17.875 11:21:59 nvmf_tcp.nvmf_target_extra -- nvmf/nvmf_target_extra.sh@24 -- # run_test nvmf_connect_stress /home/vagrant/spdk_repo/spdk/test/nvmf/target/connect_stress.sh --transport=tcp 00:11:17.875 11:21:59 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:11:17.875 11:21:59 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1107 -- # xtrace_disable 00:11:17.875 11:21:59 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@10 -- # set +x 00:11:17.875 ************************************ 00:11:17.875 START TEST nvmf_connect_stress 00:11:17.875 ************************************ 00:11:17.875 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/nvmf/target/connect_stress.sh --transport=tcp 00:11:17.875 * Looking for test storage... 00:11:17.875 * Found test storage at /home/vagrant/spdk_repo/spdk/test/nvmf/target 00:11:17.875 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:11:17.875 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@1681 -- # lcov --version 00:11:17.875 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:11:18.162 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:11:18.162 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:11:18.162 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- scripts/common.sh@333 -- # local ver1 ver1_l 00:11:18.162 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- scripts/common.sh@334 -- # local ver2 ver2_l 00:11:18.162 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- scripts/common.sh@336 -- # IFS=.-: 00:11:18.162 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- scripts/common.sh@336 -- # read -ra ver1 00:11:18.162 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- scripts/common.sh@337 -- # IFS=.-: 00:11:18.162 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- scripts/common.sh@337 -- # read -ra ver2 00:11:18.162 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- scripts/common.sh@338 -- # local 'op=<' 00:11:18.162 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- scripts/common.sh@340 -- # ver1_l=2 00:11:18.162 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- scripts/common.sh@341 -- # ver2_l=1 00:11:18.162 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:11:18.162 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- scripts/common.sh@344 -- # case "$op" in 00:11:18.162 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- scripts/common.sh@345 -- # : 1 00:11:18.162 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- scripts/common.sh@364 -- # (( v = 0 )) 00:11:18.162 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:11:18.162 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- scripts/common.sh@365 -- # decimal 1 00:11:18.162 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- scripts/common.sh@353 -- # local d=1 00:11:18.162 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:11:18.162 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- scripts/common.sh@355 -- # echo 1 00:11:18.162 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- scripts/common.sh@365 -- # ver1[v]=1 00:11:18.162 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- scripts/common.sh@366 -- # decimal 2 00:11:18.162 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- scripts/common.sh@353 -- # local d=2 00:11:18.162 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:11:18.162 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- scripts/common.sh@355 -- # echo 2 00:11:18.162 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- scripts/common.sh@366 -- # ver2[v]=2 00:11:18.162 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:11:18.162 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:11:18.162 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- scripts/common.sh@368 -- # return 0 00:11:18.162 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:11:18.162 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:11:18.162 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:18.162 --rc genhtml_branch_coverage=1 00:11:18.162 --rc genhtml_function_coverage=1 00:11:18.162 --rc genhtml_legend=1 00:11:18.162 --rc geninfo_all_blocks=1 00:11:18.162 --rc geninfo_unexecuted_blocks=1 00:11:18.162 00:11:18.162 ' 00:11:18.162 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:11:18.162 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:18.162 --rc genhtml_branch_coverage=1 00:11:18.162 --rc genhtml_function_coverage=1 00:11:18.162 --rc genhtml_legend=1 00:11:18.162 --rc geninfo_all_blocks=1 00:11:18.162 --rc geninfo_unexecuted_blocks=1 00:11:18.162 00:11:18.162 ' 00:11:18.162 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:11:18.162 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:18.162 --rc genhtml_branch_coverage=1 00:11:18.162 --rc genhtml_function_coverage=1 00:11:18.162 --rc genhtml_legend=1 00:11:18.162 --rc geninfo_all_blocks=1 00:11:18.162 --rc geninfo_unexecuted_blocks=1 00:11:18.162 00:11:18.162 ' 00:11:18.162 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:11:18.162 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:18.162 --rc genhtml_branch_coverage=1 00:11:18.162 --rc genhtml_function_coverage=1 00:11:18.162 --rc genhtml_legend=1 00:11:18.162 --rc geninfo_all_blocks=1 00:11:18.162 --rc geninfo_unexecuted_blocks=1 00:11:18.162 00:11:18.162 ' 00:11:18.162 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@10 -- # source /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh 00:11:18.162 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@7 -- # uname -s 00:11:18.162 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:11:18.162 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:11:18.162 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:11:18.162 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:11:18.162 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:11:18.162 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:11:18.162 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:11:18.162 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:11:18.162 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:11:18.162 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:11:18.162 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:11:18.162 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@18 -- # NVME_HOSTID=3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:11:18.162 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:11:18.162 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:11:18.162 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@21 -- # NET_TYPE=virt 00:11:18.162 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:11:18.162 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@49 -- # source /home/vagrant/spdk_repo/spdk/scripts/common.sh 00:11:18.162 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- scripts/common.sh@15 -- # shopt -s extglob 00:11:18.162 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:11:18.162 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:11:18.162 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:11:18.162 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:18.162 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:18.162 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:18.162 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- paths/export.sh@5 -- # export PATH 00:11:18.162 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:18.162 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@51 -- # : 0 00:11:18.162 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:11:18.162 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:11:18.162 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:11:18.162 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:11:18.162 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:11:18.162 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:11:18.162 /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:11:18.163 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:11:18.163 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:11:18.163 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@55 -- # have_pci_nics=0 00:11:18.163 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@12 -- # nvmftestinit 00:11:18.163 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:11:18.163 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:11:18.163 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@474 -- # prepare_net_devs 00:11:18.163 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@436 -- # local -g is_hw=no 00:11:18.163 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@438 -- # remove_spdk_ns 00:11:18.163 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:18.163 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:11:18.163 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:18.163 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@440 -- # [[ virt != virt ]] 00:11:18.163 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@442 -- # [[ no == yes ]] 00:11:18.163 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@449 -- # [[ virt == phy ]] 00:11:18.163 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@452 -- # [[ virt == phy-fallback ]] 00:11:18.163 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@457 -- # [[ tcp == tcp ]] 00:11:18.163 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@458 -- # nvmf_veth_init 00:11:18.163 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@145 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:11:18.163 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@146 -- # NVMF_SECOND_INITIATOR_IP=10.0.0.2 00:11:18.163 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@147 -- # NVMF_FIRST_TARGET_IP=10.0.0.3 00:11:18.163 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@148 -- # NVMF_SECOND_TARGET_IP=10.0.0.4 00:11:18.163 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@149 -- # NVMF_INITIATOR_IP=10.0.0.1 00:11:18.163 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@150 -- # NVMF_BRIDGE=nvmf_br 00:11:18.163 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@151 -- # NVMF_INITIATOR_INTERFACE=nvmf_init_if 00:11:18.163 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@152 -- # NVMF_INITIATOR_INTERFACE2=nvmf_init_if2 00:11:18.163 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@153 -- # NVMF_INITIATOR_BRIDGE=nvmf_init_br 00:11:18.163 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@154 -- # NVMF_INITIATOR_BRIDGE2=nvmf_init_br2 00:11:18.163 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@155 -- # NVMF_TARGET_NAMESPACE=nvmf_tgt_ns_spdk 00:11:18.163 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@156 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:11:18.163 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@157 -- # NVMF_TARGET_INTERFACE=nvmf_tgt_if 00:11:18.163 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@158 -- # NVMF_TARGET_INTERFACE2=nvmf_tgt_if2 00:11:18.163 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@159 -- # NVMF_TARGET_BRIDGE=nvmf_tgt_br 00:11:18.163 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@160 -- # NVMF_TARGET_BRIDGE2=nvmf_tgt_br2 00:11:18.163 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@162 -- # ip link set nvmf_init_br nomaster 00:11:18.163 Cannot find device "nvmf_init_br" 00:11:18.163 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@162 -- # true 00:11:18.163 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@163 -- # ip link set nvmf_init_br2 nomaster 00:11:18.163 Cannot find device "nvmf_init_br2" 00:11:18.163 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@163 -- # true 00:11:18.163 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@164 -- # ip link set nvmf_tgt_br nomaster 00:11:18.163 Cannot find device "nvmf_tgt_br" 00:11:18.163 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@164 -- # true 00:11:18.163 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@165 -- # ip link set nvmf_tgt_br2 nomaster 00:11:18.163 Cannot find device "nvmf_tgt_br2" 00:11:18.163 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@165 -- # true 00:11:18.163 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@166 -- # ip link set nvmf_init_br down 00:11:18.163 Cannot find device "nvmf_init_br" 00:11:18.163 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@166 -- # true 00:11:18.163 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@167 -- # ip link set nvmf_init_br2 down 00:11:18.163 Cannot find device "nvmf_init_br2" 00:11:18.163 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@167 -- # true 00:11:18.163 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@168 -- # ip link set nvmf_tgt_br down 00:11:18.163 Cannot find device "nvmf_tgt_br" 00:11:18.163 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@168 -- # true 00:11:18.163 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@169 -- # ip link set nvmf_tgt_br2 down 00:11:18.163 Cannot find device "nvmf_tgt_br2" 00:11:18.163 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@169 -- # true 00:11:18.163 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@170 -- # ip link delete nvmf_br type bridge 00:11:18.163 Cannot find device "nvmf_br" 00:11:18.163 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@170 -- # true 00:11:18.163 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@171 -- # ip link delete nvmf_init_if 00:11:18.163 Cannot find device "nvmf_init_if" 00:11:18.163 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@171 -- # true 00:11:18.163 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@172 -- # ip link delete nvmf_init_if2 00:11:18.163 Cannot find device "nvmf_init_if2" 00:11:18.163 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@172 -- # true 00:11:18.163 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@173 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:11:18.163 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:11:18.163 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@173 -- # true 00:11:18.163 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@174 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:11:18.163 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:11:18.163 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@174 -- # true 00:11:18.163 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@177 -- # ip netns add nvmf_tgt_ns_spdk 00:11:18.163 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@180 -- # ip link add nvmf_init_if type veth peer name nvmf_init_br 00:11:18.163 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@181 -- # ip link add nvmf_init_if2 type veth peer name nvmf_init_br2 00:11:18.163 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@182 -- # ip link add nvmf_tgt_if type veth peer name nvmf_tgt_br 00:11:18.163 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@183 -- # ip link add nvmf_tgt_if2 type veth peer name nvmf_tgt_br2 00:11:18.163 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@186 -- # ip link set nvmf_tgt_if netns nvmf_tgt_ns_spdk 00:11:18.422 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@187 -- # ip link set nvmf_tgt_if2 netns nvmf_tgt_ns_spdk 00:11:18.422 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@190 -- # ip addr add 10.0.0.1/24 dev nvmf_init_if 00:11:18.422 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@191 -- # ip addr add 10.0.0.2/24 dev nvmf_init_if2 00:11:18.422 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@192 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.3/24 dev nvmf_tgt_if 00:11:18.422 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@193 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.4/24 dev nvmf_tgt_if2 00:11:18.422 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@196 -- # ip link set nvmf_init_if up 00:11:18.422 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@197 -- # ip link set nvmf_init_if2 up 00:11:18.422 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@198 -- # ip link set nvmf_init_br up 00:11:18.422 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@199 -- # ip link set nvmf_init_br2 up 00:11:18.422 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@200 -- # ip link set nvmf_tgt_br up 00:11:18.422 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@201 -- # ip link set nvmf_tgt_br2 up 00:11:18.422 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@202 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if up 00:11:18.422 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@203 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if2 up 00:11:18.422 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@204 -- # ip netns exec nvmf_tgt_ns_spdk ip link set lo up 00:11:18.422 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@207 -- # ip link add nvmf_br type bridge 00:11:18.422 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@208 -- # ip link set nvmf_br up 00:11:18.422 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@211 -- # ip link set nvmf_init_br master nvmf_br 00:11:18.422 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@212 -- # ip link set nvmf_init_br2 master nvmf_br 00:11:18.422 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@213 -- # ip link set nvmf_tgt_br master nvmf_br 00:11:18.422 11:21:59 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@214 -- # ip link set nvmf_tgt_br2 master nvmf_br 00:11:18.422 11:22:00 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@217 -- # ipts -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT 00:11:18.422 11:22:00 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT' 00:11:18.422 11:22:00 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@218 -- # ipts -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT 00:11:18.423 11:22:00 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT' 00:11:18.423 11:22:00 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@219 -- # ipts -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT 00:11:18.423 11:22:00 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@788 -- # iptables -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT -m comment --comment 'SPDK_NVMF:-A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT' 00:11:18.423 11:22:00 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@222 -- # ping -c 1 10.0.0.3 00:11:18.423 PING 10.0.0.3 (10.0.0.3) 56(84) bytes of data. 00:11:18.423 64 bytes from 10.0.0.3: icmp_seq=1 ttl=64 time=0.110 ms 00:11:18.423 00:11:18.423 --- 10.0.0.3 ping statistics --- 00:11:18.423 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:18.423 rtt min/avg/max/mdev = 0.110/0.110/0.110/0.000 ms 00:11:18.423 11:22:00 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@223 -- # ping -c 1 10.0.0.4 00:11:18.423 PING 10.0.0.4 (10.0.0.4) 56(84) bytes of data. 00:11:18.423 64 bytes from 10.0.0.4: icmp_seq=1 ttl=64 time=0.048 ms 00:11:18.423 00:11:18.423 --- 10.0.0.4 ping statistics --- 00:11:18.423 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:18.423 rtt min/avg/max/mdev = 0.048/0.048/0.048/0.000 ms 00:11:18.423 11:22:00 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@224 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.1 00:11:18.423 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:11:18.423 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.030 ms 00:11:18.423 00:11:18.423 --- 10.0.0.1 ping statistics --- 00:11:18.423 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:18.423 rtt min/avg/max/mdev = 0.030/0.030/0.030/0.000 ms 00:11:18.423 11:22:00 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@225 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.2 00:11:18.423 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:11:18.423 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.058 ms 00:11:18.423 00:11:18.423 --- 10.0.0.2 ping statistics --- 00:11:18.423 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:18.423 rtt min/avg/max/mdev = 0.058/0.058/0.058/0.000 ms 00:11:18.423 11:22:00 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@227 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:11:18.423 11:22:00 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@459 -- # return 0 00:11:18.423 11:22:00 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:11:18.423 11:22:00 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:11:18.423 11:22:00 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:11:18.423 11:22:00 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:11:18.423 11:22:00 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:11:18.423 11:22:00 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:11:18.423 11:22:00 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:11:18.423 11:22:00 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@13 -- # nvmfappstart -m 0xE 00:11:18.423 11:22:00 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:11:18.423 11:22:00 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@724 -- # xtrace_disable 00:11:18.423 11:22:00 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@10 -- # set +x 00:11:18.423 11:22:00 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@506 -- # ip netns exec nvmf_tgt_ns_spdk /home/vagrant/spdk_repo/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:11:18.423 11:22:00 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@507 -- # nvmfpid=75336 00:11:18.423 11:22:00 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@508 -- # waitforlisten 75336 00:11:18.423 11:22:00 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@831 -- # '[' -z 75336 ']' 00:11:18.423 11:22:00 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:11:18.423 11:22:00 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@836 -- # local max_retries=100 00:11:18.423 11:22:00 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:11:18.423 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:11:18.423 11:22:00 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@840 -- # xtrace_disable 00:11:18.423 11:22:00 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@10 -- # set +x 00:11:18.683 [2024-10-07 11:22:00.160769] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:11:18.683 [2024-10-07 11:22:00.160892] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:11:18.683 [2024-10-07 11:22:00.303035] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 3 00:11:18.941 [2024-10-07 11:22:00.463488] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:11:18.941 [2024-10-07 11:22:00.463563] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:11:18.941 [2024-10-07 11:22:00.463577] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:11:18.941 [2024-10-07 11:22:00.463588] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:11:18.941 [2024-10-07 11:22:00.463599] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:11:18.941 [2024-10-07 11:22:00.464316] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:11:18.941 [2024-10-07 11:22:00.464384] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 3 00:11:18.941 [2024-10-07 11:22:00.464389] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:11:19.874 11:22:01 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:11:19.874 11:22:01 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@864 -- # return 0 00:11:19.874 11:22:01 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:11:19.874 11:22:01 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@730 -- # xtrace_disable 00:11:19.874 11:22:01 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@10 -- # set +x 00:11:19.874 11:22:01 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:11:19.874 11:22:01 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:11:19.874 11:22:01 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:19.874 11:22:01 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@10 -- # set +x 00:11:19.874 [2024-10-07 11:22:01.283386] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:11:19.874 11:22:01 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:19.874 11:22:01 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:11:19.874 11:22:01 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:19.874 11:22:01 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@10 -- # set +x 00:11:19.874 11:22:01 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:19.874 11:22:01 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4420 00:11:19.874 11:22:01 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:19.874 11:22:01 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@10 -- # set +x 00:11:19.874 [2024-10-07 11:22:01.311940] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:11:19.874 11:22:01 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:19.874 11:22:01 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:11:19.874 11:22:01 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:19.874 11:22:01 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@10 -- # set +x 00:11:19.874 NULL1 00:11:19.874 11:22:01 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:19.874 11:22:01 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@21 -- # PERF_PID=75388 00:11:19.874 11:22:01 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@23 -- # rpcs=/home/vagrant/spdk_repo/spdk/test/nvmf/target/rpc.txt 00:11:19.874 11:22:01 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@20 -- # /home/vagrant/spdk_repo/spdk/test/nvme/connect_stress/connect_stress -c 0x1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.3 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -t 10 00:11:19.874 11:22:01 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@25 -- # rm -f /home/vagrant/spdk_repo/spdk/test/nvmf/target/rpc.txt 00:11:19.874 11:22:01 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@27 -- # seq 1 20 00:11:19.874 11:22:01 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:11:19.874 11:22:01 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@28 -- # cat 00:11:19.874 11:22:01 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:11:19.874 11:22:01 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@28 -- # cat 00:11:19.874 11:22:01 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:11:19.874 11:22:01 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@28 -- # cat 00:11:19.874 11:22:01 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:11:19.874 11:22:01 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@28 -- # cat 00:11:19.874 11:22:01 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:11:19.874 11:22:01 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@28 -- # cat 00:11:19.874 11:22:01 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:11:19.874 11:22:01 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@28 -- # cat 00:11:19.874 11:22:01 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:11:19.874 11:22:01 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@28 -- # cat 00:11:19.874 11:22:01 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:11:19.875 11:22:01 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@28 -- # cat 00:11:19.875 11:22:01 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:11:19.875 11:22:01 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@28 -- # cat 00:11:19.875 11:22:01 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:11:19.875 11:22:01 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@28 -- # cat 00:11:19.875 11:22:01 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:11:19.875 11:22:01 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@28 -- # cat 00:11:19.875 11:22:01 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:11:19.875 11:22:01 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@28 -- # cat 00:11:19.875 11:22:01 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:11:19.875 11:22:01 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@28 -- # cat 00:11:19.875 11:22:01 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:11:19.875 11:22:01 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@28 -- # cat 00:11:19.875 11:22:01 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:11:19.875 11:22:01 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@28 -- # cat 00:11:19.875 11:22:01 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:11:19.875 11:22:01 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@28 -- # cat 00:11:19.875 11:22:01 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:11:19.875 11:22:01 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@28 -- # cat 00:11:19.875 11:22:01 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:11:19.875 11:22:01 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@28 -- # cat 00:11:19.875 11:22:01 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:11:19.875 11:22:01 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@28 -- # cat 00:11:19.875 11:22:01 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:11:19.875 11:22:01 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@28 -- # cat 00:11:19.875 11:22:01 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@34 -- # kill -0 75388 00:11:19.875 11:22:01 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@35 -- # rpc_cmd 00:11:19.875 11:22:01 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:19.875 11:22:01 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@10 -- # set +x 00:11:20.133 11:22:01 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:20.133 11:22:01 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@34 -- # kill -0 75388 00:11:20.133 11:22:01 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@35 -- # rpc_cmd 00:11:20.133 11:22:01 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:20.133 11:22:01 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@10 -- # set +x 00:11:20.393 11:22:02 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:20.393 11:22:02 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@34 -- # kill -0 75388 00:11:20.393 11:22:02 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@35 -- # rpc_cmd 00:11:20.393 11:22:02 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:20.393 11:22:02 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@10 -- # set +x 00:11:20.656 11:22:02 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:20.656 11:22:02 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@34 -- # kill -0 75388 00:11:20.656 11:22:02 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@35 -- # rpc_cmd 00:11:20.656 11:22:02 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:20.656 11:22:02 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@10 -- # set +x 00:11:21.228 11:22:02 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:21.228 11:22:02 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@34 -- # kill -0 75388 00:11:21.228 11:22:02 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@35 -- # rpc_cmd 00:11:21.228 11:22:02 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:21.228 11:22:02 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@10 -- # set +x 00:11:21.486 11:22:03 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:21.486 11:22:03 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@34 -- # kill -0 75388 00:11:21.486 11:22:03 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@35 -- # rpc_cmd 00:11:21.486 11:22:03 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:21.486 11:22:03 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@10 -- # set +x 00:11:21.745 11:22:03 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:21.745 11:22:03 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@34 -- # kill -0 75388 00:11:21.745 11:22:03 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@35 -- # rpc_cmd 00:11:21.745 11:22:03 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:21.745 11:22:03 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@10 -- # set +x 00:11:22.003 11:22:03 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:22.004 11:22:03 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@34 -- # kill -0 75388 00:11:22.004 11:22:03 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@35 -- # rpc_cmd 00:11:22.004 11:22:03 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:22.004 11:22:03 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@10 -- # set +x 00:11:22.261 11:22:03 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:22.261 11:22:03 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@34 -- # kill -0 75388 00:11:22.261 11:22:03 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@35 -- # rpc_cmd 00:11:22.261 11:22:03 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:22.261 11:22:03 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@10 -- # set +x 00:11:22.827 11:22:04 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:22.827 11:22:04 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@34 -- # kill -0 75388 00:11:22.827 11:22:04 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@35 -- # rpc_cmd 00:11:22.827 11:22:04 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:22.827 11:22:04 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@10 -- # set +x 00:11:23.085 11:22:04 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:23.085 11:22:04 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@34 -- # kill -0 75388 00:11:23.085 11:22:04 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@35 -- # rpc_cmd 00:11:23.085 11:22:04 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:23.085 11:22:04 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@10 -- # set +x 00:11:23.343 11:22:04 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:23.343 11:22:04 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@34 -- # kill -0 75388 00:11:23.343 11:22:04 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@35 -- # rpc_cmd 00:11:23.343 11:22:04 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:23.343 11:22:04 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@10 -- # set +x 00:11:23.602 11:22:05 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:23.602 11:22:05 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@34 -- # kill -0 75388 00:11:23.602 11:22:05 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@35 -- # rpc_cmd 00:11:23.602 11:22:05 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:23.602 11:22:05 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@10 -- # set +x 00:11:24.169 11:22:05 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:24.169 11:22:05 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@34 -- # kill -0 75388 00:11:24.169 11:22:05 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@35 -- # rpc_cmd 00:11:24.169 11:22:05 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:24.169 11:22:05 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@10 -- # set +x 00:11:24.428 11:22:05 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:24.428 11:22:05 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@34 -- # kill -0 75388 00:11:24.428 11:22:05 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@35 -- # rpc_cmd 00:11:24.428 11:22:05 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:24.428 11:22:05 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@10 -- # set +x 00:11:24.687 11:22:06 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:24.687 11:22:06 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@34 -- # kill -0 75388 00:11:24.687 11:22:06 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@35 -- # rpc_cmd 00:11:24.687 11:22:06 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:24.687 11:22:06 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@10 -- # set +x 00:11:24.945 11:22:06 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:24.945 11:22:06 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@34 -- # kill -0 75388 00:11:24.945 11:22:06 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@35 -- # rpc_cmd 00:11:24.945 11:22:06 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:24.945 11:22:06 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@10 -- # set +x 00:11:25.203 11:22:06 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:25.203 11:22:06 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@34 -- # kill -0 75388 00:11:25.203 11:22:06 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@35 -- # rpc_cmd 00:11:25.203 11:22:06 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:25.203 11:22:06 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@10 -- # set +x 00:11:25.769 11:22:07 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:25.769 11:22:07 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@34 -- # kill -0 75388 00:11:25.769 11:22:07 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@35 -- # rpc_cmd 00:11:25.769 11:22:07 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:25.769 11:22:07 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@10 -- # set +x 00:11:26.027 11:22:07 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:26.027 11:22:07 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@34 -- # kill -0 75388 00:11:26.027 11:22:07 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@35 -- # rpc_cmd 00:11:26.027 11:22:07 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:26.027 11:22:07 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@10 -- # set +x 00:11:26.285 11:22:07 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:26.285 11:22:07 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@34 -- # kill -0 75388 00:11:26.285 11:22:07 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@35 -- # rpc_cmd 00:11:26.286 11:22:07 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:26.286 11:22:07 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@10 -- # set +x 00:11:26.544 11:22:08 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:26.544 11:22:08 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@34 -- # kill -0 75388 00:11:26.544 11:22:08 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@35 -- # rpc_cmd 00:11:26.544 11:22:08 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:26.544 11:22:08 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@10 -- # set +x 00:11:26.803 11:22:08 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:26.803 11:22:08 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@34 -- # kill -0 75388 00:11:26.803 11:22:08 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@35 -- # rpc_cmd 00:11:26.803 11:22:08 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:26.803 11:22:08 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@10 -- # set +x 00:11:27.371 11:22:08 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:27.371 11:22:08 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@34 -- # kill -0 75388 00:11:27.371 11:22:08 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@35 -- # rpc_cmd 00:11:27.371 11:22:08 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:27.371 11:22:08 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@10 -- # set +x 00:11:27.629 11:22:09 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:27.629 11:22:09 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@34 -- # kill -0 75388 00:11:27.629 11:22:09 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@35 -- # rpc_cmd 00:11:27.629 11:22:09 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:27.629 11:22:09 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@10 -- # set +x 00:11:27.888 11:22:09 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:27.888 11:22:09 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@34 -- # kill -0 75388 00:11:27.888 11:22:09 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@35 -- # rpc_cmd 00:11:27.888 11:22:09 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:27.888 11:22:09 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@10 -- # set +x 00:11:28.146 11:22:09 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:28.146 11:22:09 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@34 -- # kill -0 75388 00:11:28.146 11:22:09 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@35 -- # rpc_cmd 00:11:28.146 11:22:09 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:28.146 11:22:09 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@10 -- # set +x 00:11:28.407 11:22:10 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:28.407 11:22:10 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@34 -- # kill -0 75388 00:11:28.407 11:22:10 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@35 -- # rpc_cmd 00:11:28.407 11:22:10 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:28.407 11:22:10 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@10 -- # set +x 00:11:28.980 11:22:10 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:28.980 11:22:10 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@34 -- # kill -0 75388 00:11:28.980 11:22:10 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@35 -- # rpc_cmd 00:11:28.980 11:22:10 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:28.980 11:22:10 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@10 -- # set +x 00:11:29.272 11:22:10 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:29.272 11:22:10 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@34 -- # kill -0 75388 00:11:29.272 11:22:10 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@35 -- # rpc_cmd 00:11:29.272 11:22:10 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:29.272 11:22:10 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@10 -- # set +x 00:11:29.532 11:22:11 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:29.532 11:22:11 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@34 -- # kill -0 75388 00:11:29.532 11:22:11 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@35 -- # rpc_cmd 00:11:29.532 11:22:11 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:29.532 11:22:11 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@10 -- # set +x 00:11:29.791 11:22:11 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:29.791 11:22:11 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@34 -- # kill -0 75388 00:11:29.791 11:22:11 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@35 -- # rpc_cmd 00:11:29.791 11:22:11 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:29.791 11:22:11 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@10 -- # set +x 00:11:30.083 Testing NVMe over Fabrics controller at 10.0.0.3:4420: nqn.2016-06.io.spdk:cnode1 00:11:30.083 11:22:11 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:30.083 11:22:11 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@34 -- # kill -0 75388 00:11:30.083 /home/vagrant/spdk_repo/spdk/test/nvmf/target/connect_stress.sh: line 34: kill: (75388) - No such process 00:11:30.083 11:22:11 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@38 -- # wait 75388 00:11:30.083 11:22:11 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@39 -- # rm -f /home/vagrant/spdk_repo/spdk/test/nvmf/target/rpc.txt 00:11:30.083 11:22:11 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@41 -- # trap - SIGINT SIGTERM EXIT 00:11:30.083 11:22:11 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- target/connect_stress.sh@43 -- # nvmftestfini 00:11:30.083 11:22:11 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@514 -- # nvmfcleanup 00:11:30.083 11:22:11 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@121 -- # sync 00:11:30.347 11:22:11 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:11:30.347 11:22:11 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@124 -- # set +e 00:11:30.347 11:22:11 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@125 -- # for i in {1..20} 00:11:30.347 11:22:11 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:11:30.347 rmmod nvme_tcp 00:11:30.347 rmmod nvme_fabrics 00:11:30.347 rmmod nvme_keyring 00:11:30.347 11:22:11 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:11:30.347 11:22:11 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@128 -- # set -e 00:11:30.347 11:22:11 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@129 -- # return 0 00:11:30.347 11:22:11 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@515 -- # '[' -n 75336 ']' 00:11:30.347 11:22:11 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@516 -- # killprocess 75336 00:11:30.347 11:22:11 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@950 -- # '[' -z 75336 ']' 00:11:30.347 11:22:11 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@954 -- # kill -0 75336 00:11:30.347 11:22:11 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@955 -- # uname 00:11:30.347 11:22:11 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:11:30.347 11:22:11 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 75336 00:11:30.347 killing process with pid 75336 00:11:30.347 11:22:11 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@956 -- # process_name=reactor_1 00:11:30.347 11:22:11 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@960 -- # '[' reactor_1 = sudo ']' 00:11:30.347 11:22:11 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@968 -- # echo 'killing process with pid 75336' 00:11:30.347 11:22:11 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@969 -- # kill 75336 00:11:30.347 11:22:11 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@974 -- # wait 75336 00:11:30.606 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:11:30.606 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:11:30.606 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:11:30.606 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@297 -- # iptr 00:11:30.606 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@789 -- # iptables-save 00:11:30.606 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:11:30.606 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@789 -- # iptables-restore 00:11:30.606 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@298 -- # [[ nvmf_tgt_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:11:30.606 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@299 -- # nvmf_veth_fini 00:11:30.606 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@233 -- # ip link set nvmf_init_br nomaster 00:11:30.606 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@234 -- # ip link set nvmf_init_br2 nomaster 00:11:30.606 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@235 -- # ip link set nvmf_tgt_br nomaster 00:11:30.606 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@236 -- # ip link set nvmf_tgt_br2 nomaster 00:11:30.606 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@237 -- # ip link set nvmf_init_br down 00:11:30.606 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@238 -- # ip link set nvmf_init_br2 down 00:11:30.606 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@239 -- # ip link set nvmf_tgt_br down 00:11:30.606 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@240 -- # ip link set nvmf_tgt_br2 down 00:11:30.606 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@241 -- # ip link delete nvmf_br type bridge 00:11:30.864 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@242 -- # ip link delete nvmf_init_if 00:11:30.864 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@243 -- # ip link delete nvmf_init_if2 00:11:30.864 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@244 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:11:30.864 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@245 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:11:30.864 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@246 -- # remove_spdk_ns 00:11:30.864 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:30.864 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:11:30.864 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:30.864 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- nvmf/common.sh@300 -- # return 0 00:11:30.864 00:11:30.864 real 0m12.992s 00:11:30.864 user 0m41.655s 00:11:30.864 sys 0m3.595s 00:11:30.864 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@1126 -- # xtrace_disable 00:11:30.864 ************************************ 00:11:30.864 END TEST nvmf_connect_stress 00:11:30.864 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_connect_stress -- common/autotest_common.sh@10 -- # set +x 00:11:30.864 ************************************ 00:11:30.864 11:22:12 nvmf_tcp.nvmf_target_extra -- nvmf/nvmf_target_extra.sh@25 -- # run_test nvmf_fused_ordering /home/vagrant/spdk_repo/spdk/test/nvmf/target/fused_ordering.sh --transport=tcp 00:11:30.864 11:22:12 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:11:30.864 11:22:12 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1107 -- # xtrace_disable 00:11:30.864 11:22:12 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@10 -- # set +x 00:11:30.864 ************************************ 00:11:30.864 START TEST nvmf_fused_ordering 00:11:30.864 ************************************ 00:11:30.865 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/nvmf/target/fused_ordering.sh --transport=tcp 00:11:31.124 * Looking for test storage... 00:11:31.124 * Found test storage at /home/vagrant/spdk_repo/spdk/test/nvmf/target 00:11:31.124 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:11:31.124 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@1681 -- # lcov --version 00:11:31.124 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:11:31.124 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:11:31.124 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:11:31.124 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- scripts/common.sh@333 -- # local ver1 ver1_l 00:11:31.124 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- scripts/common.sh@334 -- # local ver2 ver2_l 00:11:31.124 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- scripts/common.sh@336 -- # IFS=.-: 00:11:31.124 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- scripts/common.sh@336 -- # read -ra ver1 00:11:31.124 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- scripts/common.sh@337 -- # IFS=.-: 00:11:31.124 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- scripts/common.sh@337 -- # read -ra ver2 00:11:31.124 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- scripts/common.sh@338 -- # local 'op=<' 00:11:31.124 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- scripts/common.sh@340 -- # ver1_l=2 00:11:31.124 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- scripts/common.sh@341 -- # ver2_l=1 00:11:31.124 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:11:31.124 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- scripts/common.sh@344 -- # case "$op" in 00:11:31.124 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- scripts/common.sh@345 -- # : 1 00:11:31.124 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- scripts/common.sh@364 -- # (( v = 0 )) 00:11:31.124 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:11:31.124 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- scripts/common.sh@365 -- # decimal 1 00:11:31.124 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- scripts/common.sh@353 -- # local d=1 00:11:31.124 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:11:31.124 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- scripts/common.sh@355 -- # echo 1 00:11:31.124 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- scripts/common.sh@365 -- # ver1[v]=1 00:11:31.124 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- scripts/common.sh@366 -- # decimal 2 00:11:31.124 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- scripts/common.sh@353 -- # local d=2 00:11:31.124 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:11:31.124 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- scripts/common.sh@355 -- # echo 2 00:11:31.124 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- scripts/common.sh@366 -- # ver2[v]=2 00:11:31.124 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:11:31.124 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:11:31.124 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- scripts/common.sh@368 -- # return 0 00:11:31.124 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:11:31.124 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:11:31.124 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:31.124 --rc genhtml_branch_coverage=1 00:11:31.124 --rc genhtml_function_coverage=1 00:11:31.124 --rc genhtml_legend=1 00:11:31.124 --rc geninfo_all_blocks=1 00:11:31.124 --rc geninfo_unexecuted_blocks=1 00:11:31.124 00:11:31.124 ' 00:11:31.124 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:11:31.124 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:31.124 --rc genhtml_branch_coverage=1 00:11:31.124 --rc genhtml_function_coverage=1 00:11:31.124 --rc genhtml_legend=1 00:11:31.124 --rc geninfo_all_blocks=1 00:11:31.124 --rc geninfo_unexecuted_blocks=1 00:11:31.124 00:11:31.124 ' 00:11:31.124 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:11:31.124 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:31.124 --rc genhtml_branch_coverage=1 00:11:31.124 --rc genhtml_function_coverage=1 00:11:31.124 --rc genhtml_legend=1 00:11:31.124 --rc geninfo_all_blocks=1 00:11:31.124 --rc geninfo_unexecuted_blocks=1 00:11:31.124 00:11:31.124 ' 00:11:31.124 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:11:31.124 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:31.124 --rc genhtml_branch_coverage=1 00:11:31.124 --rc genhtml_function_coverage=1 00:11:31.124 --rc genhtml_legend=1 00:11:31.124 --rc geninfo_all_blocks=1 00:11:31.124 --rc geninfo_unexecuted_blocks=1 00:11:31.124 00:11:31.124 ' 00:11:31.124 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- target/fused_ordering.sh@10 -- # source /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh 00:11:31.124 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@7 -- # uname -s 00:11:31.124 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:11:31.124 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:11:31.124 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:11:31.124 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:11:31.124 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:11:31.124 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:11:31.124 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:11:31.124 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:11:31.124 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:11:31.124 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:11:31.124 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:11:31.124 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@18 -- # NVME_HOSTID=3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:11:31.124 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:11:31.124 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:11:31.124 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@21 -- # NET_TYPE=virt 00:11:31.124 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:11:31.124 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@49 -- # source /home/vagrant/spdk_repo/spdk/scripts/common.sh 00:11:31.124 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- scripts/common.sh@15 -- # shopt -s extglob 00:11:31.124 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:11:31.124 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:11:31.124 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:11:31.124 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:31.124 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:31.125 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:31.125 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- paths/export.sh@5 -- # export PATH 00:11:31.125 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:31.125 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@51 -- # : 0 00:11:31.125 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:11:31.125 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:11:31.125 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:11:31.125 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:11:31.125 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:11:31.125 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:11:31.125 /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:11:31.125 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:11:31.125 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:11:31.125 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@55 -- # have_pci_nics=0 00:11:31.125 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- target/fused_ordering.sh@12 -- # nvmftestinit 00:11:31.125 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:11:31.125 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:11:31.125 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@474 -- # prepare_net_devs 00:11:31.125 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@436 -- # local -g is_hw=no 00:11:31.125 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@438 -- # remove_spdk_ns 00:11:31.125 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:31.125 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:11:31.125 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:31.125 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@440 -- # [[ virt != virt ]] 00:11:31.125 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@442 -- # [[ no == yes ]] 00:11:31.125 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@449 -- # [[ virt == phy ]] 00:11:31.125 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@452 -- # [[ virt == phy-fallback ]] 00:11:31.125 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@457 -- # [[ tcp == tcp ]] 00:11:31.125 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@458 -- # nvmf_veth_init 00:11:31.125 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@145 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:11:31.125 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@146 -- # NVMF_SECOND_INITIATOR_IP=10.0.0.2 00:11:31.125 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@147 -- # NVMF_FIRST_TARGET_IP=10.0.0.3 00:11:31.125 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@148 -- # NVMF_SECOND_TARGET_IP=10.0.0.4 00:11:31.125 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@149 -- # NVMF_INITIATOR_IP=10.0.0.1 00:11:31.125 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@150 -- # NVMF_BRIDGE=nvmf_br 00:11:31.125 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@151 -- # NVMF_INITIATOR_INTERFACE=nvmf_init_if 00:11:31.125 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@152 -- # NVMF_INITIATOR_INTERFACE2=nvmf_init_if2 00:11:31.125 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@153 -- # NVMF_INITIATOR_BRIDGE=nvmf_init_br 00:11:31.125 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@154 -- # NVMF_INITIATOR_BRIDGE2=nvmf_init_br2 00:11:31.125 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@155 -- # NVMF_TARGET_NAMESPACE=nvmf_tgt_ns_spdk 00:11:31.125 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@156 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:11:31.125 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@157 -- # NVMF_TARGET_INTERFACE=nvmf_tgt_if 00:11:31.125 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@158 -- # NVMF_TARGET_INTERFACE2=nvmf_tgt_if2 00:11:31.125 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@159 -- # NVMF_TARGET_BRIDGE=nvmf_tgt_br 00:11:31.125 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@160 -- # NVMF_TARGET_BRIDGE2=nvmf_tgt_br2 00:11:31.125 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@162 -- # ip link set nvmf_init_br nomaster 00:11:31.125 Cannot find device "nvmf_init_br" 00:11:31.125 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@162 -- # true 00:11:31.125 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@163 -- # ip link set nvmf_init_br2 nomaster 00:11:31.125 Cannot find device "nvmf_init_br2" 00:11:31.125 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@163 -- # true 00:11:31.125 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@164 -- # ip link set nvmf_tgt_br nomaster 00:11:31.125 Cannot find device "nvmf_tgt_br" 00:11:31.125 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@164 -- # true 00:11:31.125 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@165 -- # ip link set nvmf_tgt_br2 nomaster 00:11:31.125 Cannot find device "nvmf_tgt_br2" 00:11:31.125 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@165 -- # true 00:11:31.125 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@166 -- # ip link set nvmf_init_br down 00:11:31.384 Cannot find device "nvmf_init_br" 00:11:31.384 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@166 -- # true 00:11:31.384 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@167 -- # ip link set nvmf_init_br2 down 00:11:31.384 Cannot find device "nvmf_init_br2" 00:11:31.384 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@167 -- # true 00:11:31.384 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@168 -- # ip link set nvmf_tgt_br down 00:11:31.384 Cannot find device "nvmf_tgt_br" 00:11:31.384 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@168 -- # true 00:11:31.384 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@169 -- # ip link set nvmf_tgt_br2 down 00:11:31.384 Cannot find device "nvmf_tgt_br2" 00:11:31.384 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@169 -- # true 00:11:31.384 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@170 -- # ip link delete nvmf_br type bridge 00:11:31.384 Cannot find device "nvmf_br" 00:11:31.384 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@170 -- # true 00:11:31.384 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@171 -- # ip link delete nvmf_init_if 00:11:31.384 Cannot find device "nvmf_init_if" 00:11:31.384 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@171 -- # true 00:11:31.384 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@172 -- # ip link delete nvmf_init_if2 00:11:31.384 Cannot find device "nvmf_init_if2" 00:11:31.384 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@172 -- # true 00:11:31.384 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@173 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:11:31.384 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:11:31.384 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@173 -- # true 00:11:31.384 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@174 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:11:31.384 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:11:31.384 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@174 -- # true 00:11:31.384 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@177 -- # ip netns add nvmf_tgt_ns_spdk 00:11:31.384 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@180 -- # ip link add nvmf_init_if type veth peer name nvmf_init_br 00:11:31.384 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@181 -- # ip link add nvmf_init_if2 type veth peer name nvmf_init_br2 00:11:31.384 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@182 -- # ip link add nvmf_tgt_if type veth peer name nvmf_tgt_br 00:11:31.384 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@183 -- # ip link add nvmf_tgt_if2 type veth peer name nvmf_tgt_br2 00:11:31.384 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@186 -- # ip link set nvmf_tgt_if netns nvmf_tgt_ns_spdk 00:11:31.384 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@187 -- # ip link set nvmf_tgt_if2 netns nvmf_tgt_ns_spdk 00:11:31.384 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@190 -- # ip addr add 10.0.0.1/24 dev nvmf_init_if 00:11:31.384 11:22:12 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@191 -- # ip addr add 10.0.0.2/24 dev nvmf_init_if2 00:11:31.384 11:22:13 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@192 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.3/24 dev nvmf_tgt_if 00:11:31.384 11:22:13 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@193 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.4/24 dev nvmf_tgt_if2 00:11:31.384 11:22:13 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@196 -- # ip link set nvmf_init_if up 00:11:31.384 11:22:13 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@197 -- # ip link set nvmf_init_if2 up 00:11:31.384 11:22:13 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@198 -- # ip link set nvmf_init_br up 00:11:31.384 11:22:13 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@199 -- # ip link set nvmf_init_br2 up 00:11:31.384 11:22:13 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@200 -- # ip link set nvmf_tgt_br up 00:11:31.384 11:22:13 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@201 -- # ip link set nvmf_tgt_br2 up 00:11:31.384 11:22:13 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@202 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if up 00:11:31.384 11:22:13 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@203 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if2 up 00:11:31.384 11:22:13 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@204 -- # ip netns exec nvmf_tgt_ns_spdk ip link set lo up 00:11:31.384 11:22:13 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@207 -- # ip link add nvmf_br type bridge 00:11:31.384 11:22:13 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@208 -- # ip link set nvmf_br up 00:11:31.384 11:22:13 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@211 -- # ip link set nvmf_init_br master nvmf_br 00:11:31.384 11:22:13 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@212 -- # ip link set nvmf_init_br2 master nvmf_br 00:11:31.642 11:22:13 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@213 -- # ip link set nvmf_tgt_br master nvmf_br 00:11:31.642 11:22:13 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@214 -- # ip link set nvmf_tgt_br2 master nvmf_br 00:11:31.642 11:22:13 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@217 -- # ipts -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT 00:11:31.642 11:22:13 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT' 00:11:31.642 11:22:13 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@218 -- # ipts -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT 00:11:31.642 11:22:13 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT' 00:11:31.642 11:22:13 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@219 -- # ipts -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT 00:11:31.642 11:22:13 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@788 -- # iptables -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT -m comment --comment 'SPDK_NVMF:-A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT' 00:11:31.642 11:22:13 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@222 -- # ping -c 1 10.0.0.3 00:11:31.642 PING 10.0.0.3 (10.0.0.3) 56(84) bytes of data. 00:11:31.642 64 bytes from 10.0.0.3: icmp_seq=1 ttl=64 time=0.106 ms 00:11:31.642 00:11:31.642 --- 10.0.0.3 ping statistics --- 00:11:31.642 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:31.642 rtt min/avg/max/mdev = 0.106/0.106/0.106/0.000 ms 00:11:31.642 11:22:13 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@223 -- # ping -c 1 10.0.0.4 00:11:31.642 PING 10.0.0.4 (10.0.0.4) 56(84) bytes of data. 00:11:31.642 64 bytes from 10.0.0.4: icmp_seq=1 ttl=64 time=0.071 ms 00:11:31.642 00:11:31.642 --- 10.0.0.4 ping statistics --- 00:11:31.642 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:31.642 rtt min/avg/max/mdev = 0.071/0.071/0.071/0.000 ms 00:11:31.642 11:22:13 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@224 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.1 00:11:31.642 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:11:31.642 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.051 ms 00:11:31.642 00:11:31.642 --- 10.0.0.1 ping statistics --- 00:11:31.642 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:31.642 rtt min/avg/max/mdev = 0.051/0.051/0.051/0.000 ms 00:11:31.642 11:22:13 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@225 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.2 00:11:31.642 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:11:31.642 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.067 ms 00:11:31.642 00:11:31.642 --- 10.0.0.2 ping statistics --- 00:11:31.642 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:31.642 rtt min/avg/max/mdev = 0.067/0.067/0.067/0.000 ms 00:11:31.642 11:22:13 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@227 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:11:31.642 11:22:13 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@459 -- # return 0 00:11:31.642 11:22:13 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:11:31.642 11:22:13 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:11:31.642 11:22:13 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:11:31.642 11:22:13 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:11:31.642 11:22:13 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:11:31.642 11:22:13 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:11:31.642 11:22:13 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:11:31.642 11:22:13 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- target/fused_ordering.sh@13 -- # nvmfappstart -m 0x2 00:11:31.642 11:22:13 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:11:31.642 11:22:13 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@724 -- # xtrace_disable 00:11:31.642 11:22:13 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@10 -- # set +x 00:11:31.642 11:22:13 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@507 -- # nvmfpid=75771 00:11:31.642 11:22:13 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@506 -- # ip netns exec nvmf_tgt_ns_spdk /home/vagrant/spdk_repo/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:11:31.642 11:22:13 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@508 -- # waitforlisten 75771 00:11:31.642 11:22:13 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@831 -- # '[' -z 75771 ']' 00:11:31.642 11:22:13 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:11:31.642 11:22:13 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@836 -- # local max_retries=100 00:11:31.642 11:22:13 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:11:31.642 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:11:31.642 11:22:13 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@840 -- # xtrace_disable 00:11:31.642 11:22:13 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@10 -- # set +x 00:11:31.643 [2024-10-07 11:22:13.259507] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:11:31.643 [2024-10-07 11:22:13.259609] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:11:31.900 [2024-10-07 11:22:13.395435] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:11:31.900 [2024-10-07 11:22:13.556000] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:11:31.900 [2024-10-07 11:22:13.556071] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:11:31.900 [2024-10-07 11:22:13.556083] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:11:31.900 [2024-10-07 11:22:13.556093] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:11:31.900 [2024-10-07 11:22:13.556101] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:11:31.900 [2024-10-07 11:22:13.556594] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:11:32.849 11:22:14 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:11:32.849 11:22:14 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@864 -- # return 0 00:11:32.849 11:22:14 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:11:32.849 11:22:14 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@730 -- # xtrace_disable 00:11:32.849 11:22:14 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@10 -- # set +x 00:11:32.849 11:22:14 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:11:32.849 11:22:14 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- target/fused_ordering.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:11:32.849 11:22:14 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:32.849 11:22:14 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@10 -- # set +x 00:11:32.849 [2024-10-07 11:22:14.479176] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:11:32.849 11:22:14 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:32.849 11:22:14 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- target/fused_ordering.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:11:32.849 11:22:14 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:32.849 11:22:14 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@10 -- # set +x 00:11:32.849 11:22:14 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:32.849 11:22:14 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- target/fused_ordering.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4420 00:11:32.849 11:22:14 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:32.849 11:22:14 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@10 -- # set +x 00:11:32.849 [2024-10-07 11:22:14.495314] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:11:32.850 11:22:14 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:32.850 11:22:14 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- target/fused_ordering.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:11:32.850 11:22:14 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:32.850 11:22:14 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@10 -- # set +x 00:11:32.850 NULL1 00:11:32.850 11:22:14 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:32.850 11:22:14 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- target/fused_ordering.sh@19 -- # rpc_cmd bdev_wait_for_examine 00:11:32.850 11:22:14 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:32.850 11:22:14 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@10 -- # set +x 00:11:32.850 11:22:14 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:32.850 11:22:14 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- target/fused_ordering.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 NULL1 00:11:32.850 11:22:14 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:32.850 11:22:14 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@10 -- # set +x 00:11:32.850 11:22:14 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:32.850 11:22:14 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- target/fused_ordering.sh@22 -- # /home/vagrant/spdk_repo/spdk/test/nvme/fused_ordering/fused_ordering -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.3 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:11:32.850 [2024-10-07 11:22:14.550786] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:11:32.850 [2024-10-07 11:22:14.550864] [ DPDK EAL parameters: fused_ordering --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid75827 ] 00:11:33.415 Attached to nqn.2016-06.io.spdk:cnode1 00:11:33.415 Namespace ID: 1 size: 1GB 00:11:33.415 fused_ordering(0) 00:11:33.415 fused_ordering(1) 00:11:33.415 fused_ordering(2) 00:11:33.415 fused_ordering(3) 00:11:33.415 fused_ordering(4) 00:11:33.415 fused_ordering(5) 00:11:33.415 fused_ordering(6) 00:11:33.415 fused_ordering(7) 00:11:33.415 fused_ordering(8) 00:11:33.415 fused_ordering(9) 00:11:33.415 fused_ordering(10) 00:11:33.415 fused_ordering(11) 00:11:33.415 fused_ordering(12) 00:11:33.415 fused_ordering(13) 00:11:33.415 fused_ordering(14) 00:11:33.415 fused_ordering(15) 00:11:33.415 fused_ordering(16) 00:11:33.415 fused_ordering(17) 00:11:33.415 fused_ordering(18) 00:11:33.415 fused_ordering(19) 00:11:33.415 fused_ordering(20) 00:11:33.415 fused_ordering(21) 00:11:33.415 fused_ordering(22) 00:11:33.415 fused_ordering(23) 00:11:33.415 fused_ordering(24) 00:11:33.415 fused_ordering(25) 00:11:33.415 fused_ordering(26) 00:11:33.415 fused_ordering(27) 00:11:33.415 fused_ordering(28) 00:11:33.415 fused_ordering(29) 00:11:33.415 fused_ordering(30) 00:11:33.415 fused_ordering(31) 00:11:33.415 fused_ordering(32) 00:11:33.415 fused_ordering(33) 00:11:33.415 fused_ordering(34) 00:11:33.415 fused_ordering(35) 00:11:33.415 fused_ordering(36) 00:11:33.415 fused_ordering(37) 00:11:33.415 fused_ordering(38) 00:11:33.415 fused_ordering(39) 00:11:33.415 fused_ordering(40) 00:11:33.415 fused_ordering(41) 00:11:33.415 fused_ordering(42) 00:11:33.415 fused_ordering(43) 00:11:33.415 fused_ordering(44) 00:11:33.415 fused_ordering(45) 00:11:33.415 fused_ordering(46) 00:11:33.415 fused_ordering(47) 00:11:33.415 fused_ordering(48) 00:11:33.415 fused_ordering(49) 00:11:33.415 fused_ordering(50) 00:11:33.415 fused_ordering(51) 00:11:33.415 fused_ordering(52) 00:11:33.415 fused_ordering(53) 00:11:33.415 fused_ordering(54) 00:11:33.415 fused_ordering(55) 00:11:33.415 fused_ordering(56) 00:11:33.415 fused_ordering(57) 00:11:33.415 fused_ordering(58) 00:11:33.415 fused_ordering(59) 00:11:33.415 fused_ordering(60) 00:11:33.415 fused_ordering(61) 00:11:33.415 fused_ordering(62) 00:11:33.415 fused_ordering(63) 00:11:33.415 fused_ordering(64) 00:11:33.415 fused_ordering(65) 00:11:33.415 fused_ordering(66) 00:11:33.415 fused_ordering(67) 00:11:33.415 fused_ordering(68) 00:11:33.415 fused_ordering(69) 00:11:33.415 fused_ordering(70) 00:11:33.415 fused_ordering(71) 00:11:33.415 fused_ordering(72) 00:11:33.415 fused_ordering(73) 00:11:33.415 fused_ordering(74) 00:11:33.415 fused_ordering(75) 00:11:33.415 fused_ordering(76) 00:11:33.415 fused_ordering(77) 00:11:33.415 fused_ordering(78) 00:11:33.415 fused_ordering(79) 00:11:33.415 fused_ordering(80) 00:11:33.415 fused_ordering(81) 00:11:33.415 fused_ordering(82) 00:11:33.415 fused_ordering(83) 00:11:33.415 fused_ordering(84) 00:11:33.415 fused_ordering(85) 00:11:33.415 fused_ordering(86) 00:11:33.415 fused_ordering(87) 00:11:33.415 fused_ordering(88) 00:11:33.415 fused_ordering(89) 00:11:33.415 fused_ordering(90) 00:11:33.415 fused_ordering(91) 00:11:33.415 fused_ordering(92) 00:11:33.415 fused_ordering(93) 00:11:33.415 fused_ordering(94) 00:11:33.415 fused_ordering(95) 00:11:33.415 fused_ordering(96) 00:11:33.415 fused_ordering(97) 00:11:33.415 fused_ordering(98) 00:11:33.415 fused_ordering(99) 00:11:33.415 fused_ordering(100) 00:11:33.415 fused_ordering(101) 00:11:33.415 fused_ordering(102) 00:11:33.415 fused_ordering(103) 00:11:33.415 fused_ordering(104) 00:11:33.415 fused_ordering(105) 00:11:33.415 fused_ordering(106) 00:11:33.415 fused_ordering(107) 00:11:33.415 fused_ordering(108) 00:11:33.415 fused_ordering(109) 00:11:33.415 fused_ordering(110) 00:11:33.415 fused_ordering(111) 00:11:33.415 fused_ordering(112) 00:11:33.415 fused_ordering(113) 00:11:33.415 fused_ordering(114) 00:11:33.415 fused_ordering(115) 00:11:33.415 fused_ordering(116) 00:11:33.415 fused_ordering(117) 00:11:33.415 fused_ordering(118) 00:11:33.415 fused_ordering(119) 00:11:33.415 fused_ordering(120) 00:11:33.415 fused_ordering(121) 00:11:33.415 fused_ordering(122) 00:11:33.415 fused_ordering(123) 00:11:33.415 fused_ordering(124) 00:11:33.415 fused_ordering(125) 00:11:33.415 fused_ordering(126) 00:11:33.415 fused_ordering(127) 00:11:33.415 fused_ordering(128) 00:11:33.415 fused_ordering(129) 00:11:33.415 fused_ordering(130) 00:11:33.415 fused_ordering(131) 00:11:33.415 fused_ordering(132) 00:11:33.415 fused_ordering(133) 00:11:33.415 fused_ordering(134) 00:11:33.415 fused_ordering(135) 00:11:33.415 fused_ordering(136) 00:11:33.415 fused_ordering(137) 00:11:33.415 fused_ordering(138) 00:11:33.415 fused_ordering(139) 00:11:33.415 fused_ordering(140) 00:11:33.415 fused_ordering(141) 00:11:33.415 fused_ordering(142) 00:11:33.415 fused_ordering(143) 00:11:33.415 fused_ordering(144) 00:11:33.415 fused_ordering(145) 00:11:33.415 fused_ordering(146) 00:11:33.415 fused_ordering(147) 00:11:33.415 fused_ordering(148) 00:11:33.415 fused_ordering(149) 00:11:33.415 fused_ordering(150) 00:11:33.415 fused_ordering(151) 00:11:33.415 fused_ordering(152) 00:11:33.415 fused_ordering(153) 00:11:33.415 fused_ordering(154) 00:11:33.415 fused_ordering(155) 00:11:33.415 fused_ordering(156) 00:11:33.415 fused_ordering(157) 00:11:33.415 fused_ordering(158) 00:11:33.415 fused_ordering(159) 00:11:33.415 fused_ordering(160) 00:11:33.415 fused_ordering(161) 00:11:33.415 fused_ordering(162) 00:11:33.415 fused_ordering(163) 00:11:33.415 fused_ordering(164) 00:11:33.415 fused_ordering(165) 00:11:33.415 fused_ordering(166) 00:11:33.415 fused_ordering(167) 00:11:33.415 fused_ordering(168) 00:11:33.415 fused_ordering(169) 00:11:33.415 fused_ordering(170) 00:11:33.415 fused_ordering(171) 00:11:33.415 fused_ordering(172) 00:11:33.415 fused_ordering(173) 00:11:33.415 fused_ordering(174) 00:11:33.415 fused_ordering(175) 00:11:33.415 fused_ordering(176) 00:11:33.415 fused_ordering(177) 00:11:33.415 fused_ordering(178) 00:11:33.415 fused_ordering(179) 00:11:33.415 fused_ordering(180) 00:11:33.415 fused_ordering(181) 00:11:33.415 fused_ordering(182) 00:11:33.415 fused_ordering(183) 00:11:33.415 fused_ordering(184) 00:11:33.415 fused_ordering(185) 00:11:33.415 fused_ordering(186) 00:11:33.415 fused_ordering(187) 00:11:33.415 fused_ordering(188) 00:11:33.415 fused_ordering(189) 00:11:33.415 fused_ordering(190) 00:11:33.415 fused_ordering(191) 00:11:33.415 fused_ordering(192) 00:11:33.415 fused_ordering(193) 00:11:33.415 fused_ordering(194) 00:11:33.415 fused_ordering(195) 00:11:33.415 fused_ordering(196) 00:11:33.415 fused_ordering(197) 00:11:33.415 fused_ordering(198) 00:11:33.415 fused_ordering(199) 00:11:33.415 fused_ordering(200) 00:11:33.415 fused_ordering(201) 00:11:33.415 fused_ordering(202) 00:11:33.415 fused_ordering(203) 00:11:33.415 fused_ordering(204) 00:11:33.415 fused_ordering(205) 00:11:33.675 fused_ordering(206) 00:11:33.675 fused_ordering(207) 00:11:33.675 fused_ordering(208) 00:11:33.675 fused_ordering(209) 00:11:33.675 fused_ordering(210) 00:11:33.675 fused_ordering(211) 00:11:33.675 fused_ordering(212) 00:11:33.675 fused_ordering(213) 00:11:33.675 fused_ordering(214) 00:11:33.675 fused_ordering(215) 00:11:33.675 fused_ordering(216) 00:11:33.675 fused_ordering(217) 00:11:33.675 fused_ordering(218) 00:11:33.675 fused_ordering(219) 00:11:33.675 fused_ordering(220) 00:11:33.675 fused_ordering(221) 00:11:33.675 fused_ordering(222) 00:11:33.675 fused_ordering(223) 00:11:33.675 fused_ordering(224) 00:11:33.675 fused_ordering(225) 00:11:33.675 fused_ordering(226) 00:11:33.675 fused_ordering(227) 00:11:33.675 fused_ordering(228) 00:11:33.675 fused_ordering(229) 00:11:33.675 fused_ordering(230) 00:11:33.675 fused_ordering(231) 00:11:33.675 fused_ordering(232) 00:11:33.675 fused_ordering(233) 00:11:33.675 fused_ordering(234) 00:11:33.675 fused_ordering(235) 00:11:33.675 fused_ordering(236) 00:11:33.675 fused_ordering(237) 00:11:33.675 fused_ordering(238) 00:11:33.675 fused_ordering(239) 00:11:33.675 fused_ordering(240) 00:11:33.675 fused_ordering(241) 00:11:33.675 fused_ordering(242) 00:11:33.675 fused_ordering(243) 00:11:33.675 fused_ordering(244) 00:11:33.675 fused_ordering(245) 00:11:33.675 fused_ordering(246) 00:11:33.675 fused_ordering(247) 00:11:33.675 fused_ordering(248) 00:11:33.675 fused_ordering(249) 00:11:33.675 fused_ordering(250) 00:11:33.675 fused_ordering(251) 00:11:33.675 fused_ordering(252) 00:11:33.675 fused_ordering(253) 00:11:33.675 fused_ordering(254) 00:11:33.675 fused_ordering(255) 00:11:33.675 fused_ordering(256) 00:11:33.675 fused_ordering(257) 00:11:33.675 fused_ordering(258) 00:11:33.675 fused_ordering(259) 00:11:33.675 fused_ordering(260) 00:11:33.675 fused_ordering(261) 00:11:33.675 fused_ordering(262) 00:11:33.675 fused_ordering(263) 00:11:33.675 fused_ordering(264) 00:11:33.675 fused_ordering(265) 00:11:33.675 fused_ordering(266) 00:11:33.675 fused_ordering(267) 00:11:33.675 fused_ordering(268) 00:11:33.675 fused_ordering(269) 00:11:33.675 fused_ordering(270) 00:11:33.675 fused_ordering(271) 00:11:33.675 fused_ordering(272) 00:11:33.675 fused_ordering(273) 00:11:33.675 fused_ordering(274) 00:11:33.675 fused_ordering(275) 00:11:33.675 fused_ordering(276) 00:11:33.675 fused_ordering(277) 00:11:33.675 fused_ordering(278) 00:11:33.675 fused_ordering(279) 00:11:33.675 fused_ordering(280) 00:11:33.675 fused_ordering(281) 00:11:33.675 fused_ordering(282) 00:11:33.675 fused_ordering(283) 00:11:33.675 fused_ordering(284) 00:11:33.675 fused_ordering(285) 00:11:33.675 fused_ordering(286) 00:11:33.675 fused_ordering(287) 00:11:33.675 fused_ordering(288) 00:11:33.675 fused_ordering(289) 00:11:33.675 fused_ordering(290) 00:11:33.675 fused_ordering(291) 00:11:33.675 fused_ordering(292) 00:11:33.675 fused_ordering(293) 00:11:33.675 fused_ordering(294) 00:11:33.675 fused_ordering(295) 00:11:33.675 fused_ordering(296) 00:11:33.675 fused_ordering(297) 00:11:33.675 fused_ordering(298) 00:11:33.675 fused_ordering(299) 00:11:33.675 fused_ordering(300) 00:11:33.675 fused_ordering(301) 00:11:33.675 fused_ordering(302) 00:11:33.675 fused_ordering(303) 00:11:33.675 fused_ordering(304) 00:11:33.675 fused_ordering(305) 00:11:33.675 fused_ordering(306) 00:11:33.675 fused_ordering(307) 00:11:33.675 fused_ordering(308) 00:11:33.675 fused_ordering(309) 00:11:33.675 fused_ordering(310) 00:11:33.675 fused_ordering(311) 00:11:33.675 fused_ordering(312) 00:11:33.675 fused_ordering(313) 00:11:33.675 fused_ordering(314) 00:11:33.675 fused_ordering(315) 00:11:33.675 fused_ordering(316) 00:11:33.675 fused_ordering(317) 00:11:33.675 fused_ordering(318) 00:11:33.675 fused_ordering(319) 00:11:33.675 fused_ordering(320) 00:11:33.675 fused_ordering(321) 00:11:33.675 fused_ordering(322) 00:11:33.675 fused_ordering(323) 00:11:33.675 fused_ordering(324) 00:11:33.675 fused_ordering(325) 00:11:33.675 fused_ordering(326) 00:11:33.675 fused_ordering(327) 00:11:33.675 fused_ordering(328) 00:11:33.675 fused_ordering(329) 00:11:33.675 fused_ordering(330) 00:11:33.675 fused_ordering(331) 00:11:33.675 fused_ordering(332) 00:11:33.675 fused_ordering(333) 00:11:33.675 fused_ordering(334) 00:11:33.675 fused_ordering(335) 00:11:33.675 fused_ordering(336) 00:11:33.675 fused_ordering(337) 00:11:33.675 fused_ordering(338) 00:11:33.675 fused_ordering(339) 00:11:33.675 fused_ordering(340) 00:11:33.675 fused_ordering(341) 00:11:33.675 fused_ordering(342) 00:11:33.675 fused_ordering(343) 00:11:33.675 fused_ordering(344) 00:11:33.675 fused_ordering(345) 00:11:33.675 fused_ordering(346) 00:11:33.675 fused_ordering(347) 00:11:33.675 fused_ordering(348) 00:11:33.675 fused_ordering(349) 00:11:33.675 fused_ordering(350) 00:11:33.675 fused_ordering(351) 00:11:33.675 fused_ordering(352) 00:11:33.675 fused_ordering(353) 00:11:33.675 fused_ordering(354) 00:11:33.675 fused_ordering(355) 00:11:33.675 fused_ordering(356) 00:11:33.675 fused_ordering(357) 00:11:33.675 fused_ordering(358) 00:11:33.675 fused_ordering(359) 00:11:33.675 fused_ordering(360) 00:11:33.675 fused_ordering(361) 00:11:33.675 fused_ordering(362) 00:11:33.675 fused_ordering(363) 00:11:33.675 fused_ordering(364) 00:11:33.675 fused_ordering(365) 00:11:33.675 fused_ordering(366) 00:11:33.675 fused_ordering(367) 00:11:33.675 fused_ordering(368) 00:11:33.675 fused_ordering(369) 00:11:33.675 fused_ordering(370) 00:11:33.675 fused_ordering(371) 00:11:33.675 fused_ordering(372) 00:11:33.675 fused_ordering(373) 00:11:33.675 fused_ordering(374) 00:11:33.675 fused_ordering(375) 00:11:33.675 fused_ordering(376) 00:11:33.675 fused_ordering(377) 00:11:33.675 fused_ordering(378) 00:11:33.675 fused_ordering(379) 00:11:33.675 fused_ordering(380) 00:11:33.675 fused_ordering(381) 00:11:33.675 fused_ordering(382) 00:11:33.675 fused_ordering(383) 00:11:33.675 fused_ordering(384) 00:11:33.675 fused_ordering(385) 00:11:33.675 fused_ordering(386) 00:11:33.675 fused_ordering(387) 00:11:33.675 fused_ordering(388) 00:11:33.675 fused_ordering(389) 00:11:33.675 fused_ordering(390) 00:11:33.675 fused_ordering(391) 00:11:33.675 fused_ordering(392) 00:11:33.675 fused_ordering(393) 00:11:33.675 fused_ordering(394) 00:11:33.675 fused_ordering(395) 00:11:33.675 fused_ordering(396) 00:11:33.675 fused_ordering(397) 00:11:33.675 fused_ordering(398) 00:11:33.675 fused_ordering(399) 00:11:33.675 fused_ordering(400) 00:11:33.675 fused_ordering(401) 00:11:33.675 fused_ordering(402) 00:11:33.675 fused_ordering(403) 00:11:33.675 fused_ordering(404) 00:11:33.675 fused_ordering(405) 00:11:33.675 fused_ordering(406) 00:11:33.675 fused_ordering(407) 00:11:33.675 fused_ordering(408) 00:11:33.675 fused_ordering(409) 00:11:33.675 fused_ordering(410) 00:11:33.934 fused_ordering(411) 00:11:33.934 fused_ordering(412) 00:11:33.934 fused_ordering(413) 00:11:33.934 fused_ordering(414) 00:11:33.934 fused_ordering(415) 00:11:33.934 fused_ordering(416) 00:11:33.934 fused_ordering(417) 00:11:33.934 fused_ordering(418) 00:11:33.934 fused_ordering(419) 00:11:33.934 fused_ordering(420) 00:11:33.934 fused_ordering(421) 00:11:33.934 fused_ordering(422) 00:11:33.934 fused_ordering(423) 00:11:33.934 fused_ordering(424) 00:11:33.934 fused_ordering(425) 00:11:33.934 fused_ordering(426) 00:11:33.934 fused_ordering(427) 00:11:33.934 fused_ordering(428) 00:11:33.934 fused_ordering(429) 00:11:33.934 fused_ordering(430) 00:11:33.934 fused_ordering(431) 00:11:33.934 fused_ordering(432) 00:11:33.934 fused_ordering(433) 00:11:33.934 fused_ordering(434) 00:11:33.934 fused_ordering(435) 00:11:33.934 fused_ordering(436) 00:11:33.934 fused_ordering(437) 00:11:33.934 fused_ordering(438) 00:11:33.934 fused_ordering(439) 00:11:33.934 fused_ordering(440) 00:11:33.934 fused_ordering(441) 00:11:33.934 fused_ordering(442) 00:11:33.934 fused_ordering(443) 00:11:33.934 fused_ordering(444) 00:11:33.934 fused_ordering(445) 00:11:33.934 fused_ordering(446) 00:11:33.934 fused_ordering(447) 00:11:33.934 fused_ordering(448) 00:11:33.934 fused_ordering(449) 00:11:33.934 fused_ordering(450) 00:11:33.934 fused_ordering(451) 00:11:33.934 fused_ordering(452) 00:11:33.934 fused_ordering(453) 00:11:33.934 fused_ordering(454) 00:11:33.934 fused_ordering(455) 00:11:33.934 fused_ordering(456) 00:11:33.934 fused_ordering(457) 00:11:33.934 fused_ordering(458) 00:11:33.934 fused_ordering(459) 00:11:33.934 fused_ordering(460) 00:11:33.934 fused_ordering(461) 00:11:33.934 fused_ordering(462) 00:11:33.934 fused_ordering(463) 00:11:33.934 fused_ordering(464) 00:11:33.934 fused_ordering(465) 00:11:33.934 fused_ordering(466) 00:11:33.934 fused_ordering(467) 00:11:33.934 fused_ordering(468) 00:11:33.934 fused_ordering(469) 00:11:33.934 fused_ordering(470) 00:11:33.934 fused_ordering(471) 00:11:33.934 fused_ordering(472) 00:11:33.934 fused_ordering(473) 00:11:33.934 fused_ordering(474) 00:11:33.934 fused_ordering(475) 00:11:33.934 fused_ordering(476) 00:11:33.934 fused_ordering(477) 00:11:33.934 fused_ordering(478) 00:11:33.934 fused_ordering(479) 00:11:33.934 fused_ordering(480) 00:11:33.934 fused_ordering(481) 00:11:33.934 fused_ordering(482) 00:11:33.934 fused_ordering(483) 00:11:33.934 fused_ordering(484) 00:11:33.934 fused_ordering(485) 00:11:33.934 fused_ordering(486) 00:11:33.934 fused_ordering(487) 00:11:33.934 fused_ordering(488) 00:11:33.934 fused_ordering(489) 00:11:33.934 fused_ordering(490) 00:11:33.934 fused_ordering(491) 00:11:33.934 fused_ordering(492) 00:11:33.934 fused_ordering(493) 00:11:33.934 fused_ordering(494) 00:11:33.934 fused_ordering(495) 00:11:33.934 fused_ordering(496) 00:11:33.934 fused_ordering(497) 00:11:33.934 fused_ordering(498) 00:11:33.934 fused_ordering(499) 00:11:33.934 fused_ordering(500) 00:11:33.934 fused_ordering(501) 00:11:33.934 fused_ordering(502) 00:11:33.934 fused_ordering(503) 00:11:33.934 fused_ordering(504) 00:11:33.934 fused_ordering(505) 00:11:33.934 fused_ordering(506) 00:11:33.934 fused_ordering(507) 00:11:33.934 fused_ordering(508) 00:11:33.934 fused_ordering(509) 00:11:33.934 fused_ordering(510) 00:11:33.934 fused_ordering(511) 00:11:33.934 fused_ordering(512) 00:11:33.934 fused_ordering(513) 00:11:33.934 fused_ordering(514) 00:11:33.934 fused_ordering(515) 00:11:33.934 fused_ordering(516) 00:11:33.934 fused_ordering(517) 00:11:33.934 fused_ordering(518) 00:11:33.934 fused_ordering(519) 00:11:33.934 fused_ordering(520) 00:11:33.934 fused_ordering(521) 00:11:33.934 fused_ordering(522) 00:11:33.934 fused_ordering(523) 00:11:33.934 fused_ordering(524) 00:11:33.934 fused_ordering(525) 00:11:33.934 fused_ordering(526) 00:11:33.934 fused_ordering(527) 00:11:33.934 fused_ordering(528) 00:11:33.934 fused_ordering(529) 00:11:33.934 fused_ordering(530) 00:11:33.934 fused_ordering(531) 00:11:33.934 fused_ordering(532) 00:11:33.934 fused_ordering(533) 00:11:33.934 fused_ordering(534) 00:11:33.934 fused_ordering(535) 00:11:33.934 fused_ordering(536) 00:11:33.934 fused_ordering(537) 00:11:33.934 fused_ordering(538) 00:11:33.934 fused_ordering(539) 00:11:33.934 fused_ordering(540) 00:11:33.934 fused_ordering(541) 00:11:33.934 fused_ordering(542) 00:11:33.934 fused_ordering(543) 00:11:33.934 fused_ordering(544) 00:11:33.934 fused_ordering(545) 00:11:33.934 fused_ordering(546) 00:11:33.934 fused_ordering(547) 00:11:33.934 fused_ordering(548) 00:11:33.934 fused_ordering(549) 00:11:33.934 fused_ordering(550) 00:11:33.934 fused_ordering(551) 00:11:33.934 fused_ordering(552) 00:11:33.934 fused_ordering(553) 00:11:33.934 fused_ordering(554) 00:11:33.934 fused_ordering(555) 00:11:33.934 fused_ordering(556) 00:11:33.934 fused_ordering(557) 00:11:33.934 fused_ordering(558) 00:11:33.934 fused_ordering(559) 00:11:33.934 fused_ordering(560) 00:11:33.934 fused_ordering(561) 00:11:33.934 fused_ordering(562) 00:11:33.934 fused_ordering(563) 00:11:33.934 fused_ordering(564) 00:11:33.934 fused_ordering(565) 00:11:33.935 fused_ordering(566) 00:11:33.935 fused_ordering(567) 00:11:33.935 fused_ordering(568) 00:11:33.935 fused_ordering(569) 00:11:33.935 fused_ordering(570) 00:11:33.935 fused_ordering(571) 00:11:33.935 fused_ordering(572) 00:11:33.935 fused_ordering(573) 00:11:33.935 fused_ordering(574) 00:11:33.935 fused_ordering(575) 00:11:33.935 fused_ordering(576) 00:11:33.935 fused_ordering(577) 00:11:33.935 fused_ordering(578) 00:11:33.935 fused_ordering(579) 00:11:33.935 fused_ordering(580) 00:11:33.935 fused_ordering(581) 00:11:33.935 fused_ordering(582) 00:11:33.935 fused_ordering(583) 00:11:33.935 fused_ordering(584) 00:11:33.935 fused_ordering(585) 00:11:33.935 fused_ordering(586) 00:11:33.935 fused_ordering(587) 00:11:33.935 fused_ordering(588) 00:11:33.935 fused_ordering(589) 00:11:33.935 fused_ordering(590) 00:11:33.935 fused_ordering(591) 00:11:33.935 fused_ordering(592) 00:11:33.935 fused_ordering(593) 00:11:33.935 fused_ordering(594) 00:11:33.935 fused_ordering(595) 00:11:33.935 fused_ordering(596) 00:11:33.935 fused_ordering(597) 00:11:33.935 fused_ordering(598) 00:11:33.935 fused_ordering(599) 00:11:33.935 fused_ordering(600) 00:11:33.935 fused_ordering(601) 00:11:33.935 fused_ordering(602) 00:11:33.935 fused_ordering(603) 00:11:33.935 fused_ordering(604) 00:11:33.935 fused_ordering(605) 00:11:33.935 fused_ordering(606) 00:11:33.935 fused_ordering(607) 00:11:33.935 fused_ordering(608) 00:11:33.935 fused_ordering(609) 00:11:33.935 fused_ordering(610) 00:11:33.935 fused_ordering(611) 00:11:33.935 fused_ordering(612) 00:11:33.935 fused_ordering(613) 00:11:33.935 fused_ordering(614) 00:11:33.935 fused_ordering(615) 00:11:34.502 fused_ordering(616) 00:11:34.502 fused_ordering(617) 00:11:34.502 fused_ordering(618) 00:11:34.502 fused_ordering(619) 00:11:34.502 fused_ordering(620) 00:11:34.502 fused_ordering(621) 00:11:34.502 fused_ordering(622) 00:11:34.502 fused_ordering(623) 00:11:34.502 fused_ordering(624) 00:11:34.502 fused_ordering(625) 00:11:34.502 fused_ordering(626) 00:11:34.502 fused_ordering(627) 00:11:34.502 fused_ordering(628) 00:11:34.502 fused_ordering(629) 00:11:34.502 fused_ordering(630) 00:11:34.502 fused_ordering(631) 00:11:34.502 fused_ordering(632) 00:11:34.502 fused_ordering(633) 00:11:34.502 fused_ordering(634) 00:11:34.502 fused_ordering(635) 00:11:34.502 fused_ordering(636) 00:11:34.502 fused_ordering(637) 00:11:34.502 fused_ordering(638) 00:11:34.502 fused_ordering(639) 00:11:34.502 fused_ordering(640) 00:11:34.502 fused_ordering(641) 00:11:34.502 fused_ordering(642) 00:11:34.502 fused_ordering(643) 00:11:34.502 fused_ordering(644) 00:11:34.502 fused_ordering(645) 00:11:34.502 fused_ordering(646) 00:11:34.502 fused_ordering(647) 00:11:34.502 fused_ordering(648) 00:11:34.502 fused_ordering(649) 00:11:34.502 fused_ordering(650) 00:11:34.502 fused_ordering(651) 00:11:34.502 fused_ordering(652) 00:11:34.502 fused_ordering(653) 00:11:34.502 fused_ordering(654) 00:11:34.502 fused_ordering(655) 00:11:34.502 fused_ordering(656) 00:11:34.502 fused_ordering(657) 00:11:34.502 fused_ordering(658) 00:11:34.502 fused_ordering(659) 00:11:34.502 fused_ordering(660) 00:11:34.502 fused_ordering(661) 00:11:34.502 fused_ordering(662) 00:11:34.502 fused_ordering(663) 00:11:34.502 fused_ordering(664) 00:11:34.502 fused_ordering(665) 00:11:34.502 fused_ordering(666) 00:11:34.502 fused_ordering(667) 00:11:34.502 fused_ordering(668) 00:11:34.502 fused_ordering(669) 00:11:34.502 fused_ordering(670) 00:11:34.502 fused_ordering(671) 00:11:34.502 fused_ordering(672) 00:11:34.502 fused_ordering(673) 00:11:34.502 fused_ordering(674) 00:11:34.502 fused_ordering(675) 00:11:34.502 fused_ordering(676) 00:11:34.502 fused_ordering(677) 00:11:34.502 fused_ordering(678) 00:11:34.502 fused_ordering(679) 00:11:34.502 fused_ordering(680) 00:11:34.502 fused_ordering(681) 00:11:34.502 fused_ordering(682) 00:11:34.502 fused_ordering(683) 00:11:34.502 fused_ordering(684) 00:11:34.502 fused_ordering(685) 00:11:34.502 fused_ordering(686) 00:11:34.502 fused_ordering(687) 00:11:34.502 fused_ordering(688) 00:11:34.502 fused_ordering(689) 00:11:34.502 fused_ordering(690) 00:11:34.502 fused_ordering(691) 00:11:34.502 fused_ordering(692) 00:11:34.502 fused_ordering(693) 00:11:34.502 fused_ordering(694) 00:11:34.502 fused_ordering(695) 00:11:34.502 fused_ordering(696) 00:11:34.502 fused_ordering(697) 00:11:34.502 fused_ordering(698) 00:11:34.502 fused_ordering(699) 00:11:34.502 fused_ordering(700) 00:11:34.502 fused_ordering(701) 00:11:34.502 fused_ordering(702) 00:11:34.502 fused_ordering(703) 00:11:34.502 fused_ordering(704) 00:11:34.502 fused_ordering(705) 00:11:34.502 fused_ordering(706) 00:11:34.502 fused_ordering(707) 00:11:34.502 fused_ordering(708) 00:11:34.502 fused_ordering(709) 00:11:34.502 fused_ordering(710) 00:11:34.502 fused_ordering(711) 00:11:34.502 fused_ordering(712) 00:11:34.502 fused_ordering(713) 00:11:34.502 fused_ordering(714) 00:11:34.502 fused_ordering(715) 00:11:34.502 fused_ordering(716) 00:11:34.502 fused_ordering(717) 00:11:34.502 fused_ordering(718) 00:11:34.502 fused_ordering(719) 00:11:34.502 fused_ordering(720) 00:11:34.502 fused_ordering(721) 00:11:34.502 fused_ordering(722) 00:11:34.502 fused_ordering(723) 00:11:34.502 fused_ordering(724) 00:11:34.502 fused_ordering(725) 00:11:34.502 fused_ordering(726) 00:11:34.502 fused_ordering(727) 00:11:34.502 fused_ordering(728) 00:11:34.502 fused_ordering(729) 00:11:34.502 fused_ordering(730) 00:11:34.502 fused_ordering(731) 00:11:34.502 fused_ordering(732) 00:11:34.502 fused_ordering(733) 00:11:34.502 fused_ordering(734) 00:11:34.502 fused_ordering(735) 00:11:34.502 fused_ordering(736) 00:11:34.502 fused_ordering(737) 00:11:34.502 fused_ordering(738) 00:11:34.502 fused_ordering(739) 00:11:34.502 fused_ordering(740) 00:11:34.502 fused_ordering(741) 00:11:34.502 fused_ordering(742) 00:11:34.502 fused_ordering(743) 00:11:34.502 fused_ordering(744) 00:11:34.502 fused_ordering(745) 00:11:34.502 fused_ordering(746) 00:11:34.502 fused_ordering(747) 00:11:34.502 fused_ordering(748) 00:11:34.502 fused_ordering(749) 00:11:34.502 fused_ordering(750) 00:11:34.502 fused_ordering(751) 00:11:34.502 fused_ordering(752) 00:11:34.502 fused_ordering(753) 00:11:34.502 fused_ordering(754) 00:11:34.502 fused_ordering(755) 00:11:34.502 fused_ordering(756) 00:11:34.502 fused_ordering(757) 00:11:34.502 fused_ordering(758) 00:11:34.502 fused_ordering(759) 00:11:34.502 fused_ordering(760) 00:11:34.502 fused_ordering(761) 00:11:34.502 fused_ordering(762) 00:11:34.502 fused_ordering(763) 00:11:34.502 fused_ordering(764) 00:11:34.502 fused_ordering(765) 00:11:34.502 fused_ordering(766) 00:11:34.502 fused_ordering(767) 00:11:34.502 fused_ordering(768) 00:11:34.502 fused_ordering(769) 00:11:34.502 fused_ordering(770) 00:11:34.502 fused_ordering(771) 00:11:34.502 fused_ordering(772) 00:11:34.502 fused_ordering(773) 00:11:34.502 fused_ordering(774) 00:11:34.502 fused_ordering(775) 00:11:34.502 fused_ordering(776) 00:11:34.502 fused_ordering(777) 00:11:34.502 fused_ordering(778) 00:11:34.502 fused_ordering(779) 00:11:34.502 fused_ordering(780) 00:11:34.502 fused_ordering(781) 00:11:34.502 fused_ordering(782) 00:11:34.502 fused_ordering(783) 00:11:34.502 fused_ordering(784) 00:11:34.502 fused_ordering(785) 00:11:34.502 fused_ordering(786) 00:11:34.502 fused_ordering(787) 00:11:34.502 fused_ordering(788) 00:11:34.502 fused_ordering(789) 00:11:34.502 fused_ordering(790) 00:11:34.502 fused_ordering(791) 00:11:34.502 fused_ordering(792) 00:11:34.502 fused_ordering(793) 00:11:34.502 fused_ordering(794) 00:11:34.502 fused_ordering(795) 00:11:34.502 fused_ordering(796) 00:11:34.502 fused_ordering(797) 00:11:34.502 fused_ordering(798) 00:11:34.502 fused_ordering(799) 00:11:34.502 fused_ordering(800) 00:11:34.502 fused_ordering(801) 00:11:34.502 fused_ordering(802) 00:11:34.502 fused_ordering(803) 00:11:34.502 fused_ordering(804) 00:11:34.502 fused_ordering(805) 00:11:34.502 fused_ordering(806) 00:11:34.502 fused_ordering(807) 00:11:34.502 fused_ordering(808) 00:11:34.502 fused_ordering(809) 00:11:34.502 fused_ordering(810) 00:11:34.502 fused_ordering(811) 00:11:34.502 fused_ordering(812) 00:11:34.502 fused_ordering(813) 00:11:34.502 fused_ordering(814) 00:11:34.502 fused_ordering(815) 00:11:34.502 fused_ordering(816) 00:11:34.502 fused_ordering(817) 00:11:34.502 fused_ordering(818) 00:11:34.502 fused_ordering(819) 00:11:34.502 fused_ordering(820) 00:11:35.069 fused_ordering(821) 00:11:35.069 fused_ordering(822) 00:11:35.069 fused_ordering(823) 00:11:35.069 fused_ordering(824) 00:11:35.069 fused_ordering(825) 00:11:35.069 fused_ordering(826) 00:11:35.069 fused_ordering(827) 00:11:35.069 fused_ordering(828) 00:11:35.069 fused_ordering(829) 00:11:35.069 fused_ordering(830) 00:11:35.069 fused_ordering(831) 00:11:35.069 fused_ordering(832) 00:11:35.069 fused_ordering(833) 00:11:35.069 fused_ordering(834) 00:11:35.069 fused_ordering(835) 00:11:35.069 fused_ordering(836) 00:11:35.069 fused_ordering(837) 00:11:35.069 fused_ordering(838) 00:11:35.069 fused_ordering(839) 00:11:35.069 fused_ordering(840) 00:11:35.069 fused_ordering(841) 00:11:35.069 fused_ordering(842) 00:11:35.069 fused_ordering(843) 00:11:35.069 fused_ordering(844) 00:11:35.069 fused_ordering(845) 00:11:35.069 fused_ordering(846) 00:11:35.069 fused_ordering(847) 00:11:35.069 fused_ordering(848) 00:11:35.069 fused_ordering(849) 00:11:35.069 fused_ordering(850) 00:11:35.069 fused_ordering(851) 00:11:35.069 fused_ordering(852) 00:11:35.069 fused_ordering(853) 00:11:35.069 fused_ordering(854) 00:11:35.069 fused_ordering(855) 00:11:35.069 fused_ordering(856) 00:11:35.069 fused_ordering(857) 00:11:35.069 fused_ordering(858) 00:11:35.069 fused_ordering(859) 00:11:35.069 fused_ordering(860) 00:11:35.069 fused_ordering(861) 00:11:35.069 fused_ordering(862) 00:11:35.069 fused_ordering(863) 00:11:35.069 fused_ordering(864) 00:11:35.069 fused_ordering(865) 00:11:35.069 fused_ordering(866) 00:11:35.069 fused_ordering(867) 00:11:35.069 fused_ordering(868) 00:11:35.069 fused_ordering(869) 00:11:35.069 fused_ordering(870) 00:11:35.069 fused_ordering(871) 00:11:35.069 fused_ordering(872) 00:11:35.069 fused_ordering(873) 00:11:35.069 fused_ordering(874) 00:11:35.069 fused_ordering(875) 00:11:35.069 fused_ordering(876) 00:11:35.069 fused_ordering(877) 00:11:35.069 fused_ordering(878) 00:11:35.069 fused_ordering(879) 00:11:35.069 fused_ordering(880) 00:11:35.069 fused_ordering(881) 00:11:35.069 fused_ordering(882) 00:11:35.069 fused_ordering(883) 00:11:35.069 fused_ordering(884) 00:11:35.069 fused_ordering(885) 00:11:35.069 fused_ordering(886) 00:11:35.069 fused_ordering(887) 00:11:35.069 fused_ordering(888) 00:11:35.069 fused_ordering(889) 00:11:35.069 fused_ordering(890) 00:11:35.069 fused_ordering(891) 00:11:35.069 fused_ordering(892) 00:11:35.069 fused_ordering(893) 00:11:35.069 fused_ordering(894) 00:11:35.069 fused_ordering(895) 00:11:35.069 fused_ordering(896) 00:11:35.069 fused_ordering(897) 00:11:35.069 fused_ordering(898) 00:11:35.069 fused_ordering(899) 00:11:35.069 fused_ordering(900) 00:11:35.069 fused_ordering(901) 00:11:35.069 fused_ordering(902) 00:11:35.069 fused_ordering(903) 00:11:35.069 fused_ordering(904) 00:11:35.069 fused_ordering(905) 00:11:35.069 fused_ordering(906) 00:11:35.069 fused_ordering(907) 00:11:35.069 fused_ordering(908) 00:11:35.069 fused_ordering(909) 00:11:35.069 fused_ordering(910) 00:11:35.069 fused_ordering(911) 00:11:35.069 fused_ordering(912) 00:11:35.069 fused_ordering(913) 00:11:35.069 fused_ordering(914) 00:11:35.069 fused_ordering(915) 00:11:35.069 fused_ordering(916) 00:11:35.069 fused_ordering(917) 00:11:35.069 fused_ordering(918) 00:11:35.069 fused_ordering(919) 00:11:35.069 fused_ordering(920) 00:11:35.069 fused_ordering(921) 00:11:35.069 fused_ordering(922) 00:11:35.069 fused_ordering(923) 00:11:35.069 fused_ordering(924) 00:11:35.069 fused_ordering(925) 00:11:35.069 fused_ordering(926) 00:11:35.069 fused_ordering(927) 00:11:35.069 fused_ordering(928) 00:11:35.069 fused_ordering(929) 00:11:35.069 fused_ordering(930) 00:11:35.069 fused_ordering(931) 00:11:35.069 fused_ordering(932) 00:11:35.069 fused_ordering(933) 00:11:35.069 fused_ordering(934) 00:11:35.069 fused_ordering(935) 00:11:35.069 fused_ordering(936) 00:11:35.069 fused_ordering(937) 00:11:35.069 fused_ordering(938) 00:11:35.069 fused_ordering(939) 00:11:35.069 fused_ordering(940) 00:11:35.069 fused_ordering(941) 00:11:35.069 fused_ordering(942) 00:11:35.069 fused_ordering(943) 00:11:35.069 fused_ordering(944) 00:11:35.069 fused_ordering(945) 00:11:35.069 fused_ordering(946) 00:11:35.069 fused_ordering(947) 00:11:35.069 fused_ordering(948) 00:11:35.069 fused_ordering(949) 00:11:35.069 fused_ordering(950) 00:11:35.069 fused_ordering(951) 00:11:35.069 fused_ordering(952) 00:11:35.069 fused_ordering(953) 00:11:35.069 fused_ordering(954) 00:11:35.069 fused_ordering(955) 00:11:35.069 fused_ordering(956) 00:11:35.069 fused_ordering(957) 00:11:35.069 fused_ordering(958) 00:11:35.069 fused_ordering(959) 00:11:35.069 fused_ordering(960) 00:11:35.069 fused_ordering(961) 00:11:35.069 fused_ordering(962) 00:11:35.069 fused_ordering(963) 00:11:35.069 fused_ordering(964) 00:11:35.069 fused_ordering(965) 00:11:35.069 fused_ordering(966) 00:11:35.069 fused_ordering(967) 00:11:35.069 fused_ordering(968) 00:11:35.069 fused_ordering(969) 00:11:35.069 fused_ordering(970) 00:11:35.069 fused_ordering(971) 00:11:35.069 fused_ordering(972) 00:11:35.069 fused_ordering(973) 00:11:35.069 fused_ordering(974) 00:11:35.069 fused_ordering(975) 00:11:35.069 fused_ordering(976) 00:11:35.069 fused_ordering(977) 00:11:35.069 fused_ordering(978) 00:11:35.069 fused_ordering(979) 00:11:35.069 fused_ordering(980) 00:11:35.069 fused_ordering(981) 00:11:35.069 fused_ordering(982) 00:11:35.069 fused_ordering(983) 00:11:35.069 fused_ordering(984) 00:11:35.069 fused_ordering(985) 00:11:35.069 fused_ordering(986) 00:11:35.069 fused_ordering(987) 00:11:35.069 fused_ordering(988) 00:11:35.069 fused_ordering(989) 00:11:35.069 fused_ordering(990) 00:11:35.069 fused_ordering(991) 00:11:35.069 fused_ordering(992) 00:11:35.070 fused_ordering(993) 00:11:35.070 fused_ordering(994) 00:11:35.070 fused_ordering(995) 00:11:35.070 fused_ordering(996) 00:11:35.070 fused_ordering(997) 00:11:35.070 fused_ordering(998) 00:11:35.070 fused_ordering(999) 00:11:35.070 fused_ordering(1000) 00:11:35.070 fused_ordering(1001) 00:11:35.070 fused_ordering(1002) 00:11:35.070 fused_ordering(1003) 00:11:35.070 fused_ordering(1004) 00:11:35.070 fused_ordering(1005) 00:11:35.070 fused_ordering(1006) 00:11:35.070 fused_ordering(1007) 00:11:35.070 fused_ordering(1008) 00:11:35.070 fused_ordering(1009) 00:11:35.070 fused_ordering(1010) 00:11:35.070 fused_ordering(1011) 00:11:35.070 fused_ordering(1012) 00:11:35.070 fused_ordering(1013) 00:11:35.070 fused_ordering(1014) 00:11:35.070 fused_ordering(1015) 00:11:35.070 fused_ordering(1016) 00:11:35.070 fused_ordering(1017) 00:11:35.070 fused_ordering(1018) 00:11:35.070 fused_ordering(1019) 00:11:35.070 fused_ordering(1020) 00:11:35.070 fused_ordering(1021) 00:11:35.070 fused_ordering(1022) 00:11:35.070 fused_ordering(1023) 00:11:35.070 11:22:16 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- target/fused_ordering.sh@23 -- # trap - SIGINT SIGTERM EXIT 00:11:35.070 11:22:16 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- target/fused_ordering.sh@25 -- # nvmftestfini 00:11:35.070 11:22:16 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@514 -- # nvmfcleanup 00:11:35.070 11:22:16 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@121 -- # sync 00:11:35.070 11:22:16 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:11:35.070 11:22:16 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@124 -- # set +e 00:11:35.070 11:22:16 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@125 -- # for i in {1..20} 00:11:35.070 11:22:16 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:11:35.070 rmmod nvme_tcp 00:11:35.070 rmmod nvme_fabrics 00:11:35.328 rmmod nvme_keyring 00:11:35.328 11:22:16 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:11:35.328 11:22:16 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@128 -- # set -e 00:11:35.328 11:22:16 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@129 -- # return 0 00:11:35.328 11:22:16 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@515 -- # '[' -n 75771 ']' 00:11:35.328 11:22:16 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@516 -- # killprocess 75771 00:11:35.328 11:22:16 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@950 -- # '[' -z 75771 ']' 00:11:35.328 11:22:16 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@954 -- # kill -0 75771 00:11:35.328 11:22:16 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@955 -- # uname 00:11:35.328 11:22:16 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:11:35.328 11:22:16 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 75771 00:11:35.328 11:22:16 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@956 -- # process_name=reactor_1 00:11:35.328 11:22:16 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@960 -- # '[' reactor_1 = sudo ']' 00:11:35.328 killing process with pid 75771 00:11:35.328 11:22:16 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@968 -- # echo 'killing process with pid 75771' 00:11:35.328 11:22:16 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@969 -- # kill 75771 00:11:35.328 11:22:16 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@974 -- # wait 75771 00:11:35.587 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:11:35.587 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:11:35.587 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:11:35.587 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@297 -- # iptr 00:11:35.587 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@789 -- # iptables-save 00:11:35.587 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:11:35.587 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@789 -- # iptables-restore 00:11:35.587 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@298 -- # [[ nvmf_tgt_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:11:35.587 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@299 -- # nvmf_veth_fini 00:11:35.587 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@233 -- # ip link set nvmf_init_br nomaster 00:11:35.587 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@234 -- # ip link set nvmf_init_br2 nomaster 00:11:35.587 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@235 -- # ip link set nvmf_tgt_br nomaster 00:11:35.587 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@236 -- # ip link set nvmf_tgt_br2 nomaster 00:11:35.587 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@237 -- # ip link set nvmf_init_br down 00:11:35.587 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@238 -- # ip link set nvmf_init_br2 down 00:11:35.587 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@239 -- # ip link set nvmf_tgt_br down 00:11:35.587 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@240 -- # ip link set nvmf_tgt_br2 down 00:11:35.587 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@241 -- # ip link delete nvmf_br type bridge 00:11:35.845 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@242 -- # ip link delete nvmf_init_if 00:11:35.845 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@243 -- # ip link delete nvmf_init_if2 00:11:35.845 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@244 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:11:35.845 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@245 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:11:35.845 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@246 -- # remove_spdk_ns 00:11:35.845 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:35.845 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:11:35.845 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:35.845 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- nvmf/common.sh@300 -- # return 0 00:11:35.845 00:11:35.845 real 0m4.913s 00:11:35.845 user 0m5.629s 00:11:35.845 sys 0m1.571s 00:11:35.845 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@1126 -- # xtrace_disable 00:11:35.845 ************************************ 00:11:35.845 END TEST nvmf_fused_ordering 00:11:35.845 ************************************ 00:11:35.845 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_fused_ordering -- common/autotest_common.sh@10 -- # set +x 00:11:35.845 11:22:17 nvmf_tcp.nvmf_target_extra -- nvmf/nvmf_target_extra.sh@26 -- # run_test nvmf_ns_masking test/nvmf/target/ns_masking.sh --transport=tcp 00:11:35.845 11:22:17 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:11:35.845 11:22:17 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1107 -- # xtrace_disable 00:11:35.845 11:22:17 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@10 -- # set +x 00:11:35.845 ************************************ 00:11:35.845 START TEST nvmf_ns_masking 00:11:35.845 ************************************ 00:11:35.846 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@1125 -- # test/nvmf/target/ns_masking.sh --transport=tcp 00:11:36.103 * Looking for test storage... 00:11:36.103 * Found test storage at /home/vagrant/spdk_repo/spdk/test/nvmf/target 00:11:36.103 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:11:36.103 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@1681 -- # lcov --version 00:11:36.103 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:11:36.103 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:11:36.103 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:11:36.103 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- scripts/common.sh@333 -- # local ver1 ver1_l 00:11:36.103 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- scripts/common.sh@334 -- # local ver2 ver2_l 00:11:36.103 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- scripts/common.sh@336 -- # IFS=.-: 00:11:36.103 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- scripts/common.sh@336 -- # read -ra ver1 00:11:36.103 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- scripts/common.sh@337 -- # IFS=.-: 00:11:36.103 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- scripts/common.sh@337 -- # read -ra ver2 00:11:36.103 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- scripts/common.sh@338 -- # local 'op=<' 00:11:36.103 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- scripts/common.sh@340 -- # ver1_l=2 00:11:36.103 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- scripts/common.sh@341 -- # ver2_l=1 00:11:36.103 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:11:36.103 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- scripts/common.sh@344 -- # case "$op" in 00:11:36.103 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- scripts/common.sh@345 -- # : 1 00:11:36.103 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- scripts/common.sh@364 -- # (( v = 0 )) 00:11:36.103 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:11:36.103 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- scripts/common.sh@365 -- # decimal 1 00:11:36.103 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- scripts/common.sh@353 -- # local d=1 00:11:36.103 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:11:36.103 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- scripts/common.sh@355 -- # echo 1 00:11:36.103 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- scripts/common.sh@365 -- # ver1[v]=1 00:11:36.103 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- scripts/common.sh@366 -- # decimal 2 00:11:36.103 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- scripts/common.sh@353 -- # local d=2 00:11:36.103 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:11:36.103 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- scripts/common.sh@355 -- # echo 2 00:11:36.103 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- scripts/common.sh@366 -- # ver2[v]=2 00:11:36.103 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:11:36.103 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:11:36.103 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- scripts/common.sh@368 -- # return 0 00:11:36.103 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:11:36.103 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:11:36.103 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:36.103 --rc genhtml_branch_coverage=1 00:11:36.103 --rc genhtml_function_coverage=1 00:11:36.103 --rc genhtml_legend=1 00:11:36.103 --rc geninfo_all_blocks=1 00:11:36.103 --rc geninfo_unexecuted_blocks=1 00:11:36.103 00:11:36.103 ' 00:11:36.103 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:11:36.103 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:36.103 --rc genhtml_branch_coverage=1 00:11:36.103 --rc genhtml_function_coverage=1 00:11:36.103 --rc genhtml_legend=1 00:11:36.103 --rc geninfo_all_blocks=1 00:11:36.103 --rc geninfo_unexecuted_blocks=1 00:11:36.103 00:11:36.103 ' 00:11:36.103 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:11:36.103 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:36.103 --rc genhtml_branch_coverage=1 00:11:36.103 --rc genhtml_function_coverage=1 00:11:36.103 --rc genhtml_legend=1 00:11:36.103 --rc geninfo_all_blocks=1 00:11:36.103 --rc geninfo_unexecuted_blocks=1 00:11:36.103 00:11:36.103 ' 00:11:36.103 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:11:36.103 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:36.103 --rc genhtml_branch_coverage=1 00:11:36.103 --rc genhtml_function_coverage=1 00:11:36.103 --rc genhtml_legend=1 00:11:36.103 --rc geninfo_all_blocks=1 00:11:36.103 --rc geninfo_unexecuted_blocks=1 00:11:36.103 00:11:36.103 ' 00:11:36.103 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@8 -- # source /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh 00:11:36.103 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@7 -- # uname -s 00:11:36.103 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:11:36.103 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:11:36.103 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:11:36.103 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:11:36.103 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:11:36.103 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:11:36.103 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:11:36.103 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:11:36.103 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:11:36.103 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:11:36.103 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:11:36.103 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@18 -- # NVME_HOSTID=3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:11:36.103 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:11:36.103 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:11:36.103 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@21 -- # NET_TYPE=virt 00:11:36.103 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:11:36.103 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@49 -- # source /home/vagrant/spdk_repo/spdk/scripts/common.sh 00:11:36.103 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- scripts/common.sh@15 -- # shopt -s extglob 00:11:36.103 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:11:36.103 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:11:36.103 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:11:36.103 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:36.103 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:36.103 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:36.103 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- paths/export.sh@5 -- # export PATH 00:11:36.103 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:36.103 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@51 -- # : 0 00:11:36.103 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:11:36.103 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:11:36.103 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:11:36.103 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:11:36.103 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:11:36.103 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:11:36.103 /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:11:36.103 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:11:36.103 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:11:36.103 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@55 -- # have_pci_nics=0 00:11:36.103 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@10 -- # rpc_py=/home/vagrant/spdk_repo/spdk/scripts/rpc.py 00:11:36.103 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@11 -- # hostsock=/var/tmp/host.sock 00:11:36.103 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@12 -- # loops=5 00:11:36.103 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@13 -- # uuidgen 00:11:36.103 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@13 -- # ns1uuid=d7b51dce-1523-4f40-8fc1-fd9dc2afc084 00:11:36.103 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@14 -- # uuidgen 00:11:36.103 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@14 -- # ns2uuid=d0e3073c-8a2f-4e8a-8914-7f7f4faff17e 00:11:36.103 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@16 -- # SUBSYSNQN=nqn.2016-06.io.spdk:cnode1 00:11:36.103 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@17 -- # HOSTNQN1=nqn.2016-06.io.spdk:host1 00:11:36.103 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@18 -- # HOSTNQN2=nqn.2016-06.io.spdk:host2 00:11:36.103 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@19 -- # uuidgen 00:11:36.103 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@19 -- # HOSTID=23cbe69d-1d5d-474e-9751-c5d80c1ef9bf 00:11:36.103 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@50 -- # nvmftestinit 00:11:36.103 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:11:36.103 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:11:36.103 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@474 -- # prepare_net_devs 00:11:36.103 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@436 -- # local -g is_hw=no 00:11:36.103 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@438 -- # remove_spdk_ns 00:11:36.103 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:36.103 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:11:36.103 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:36.103 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@440 -- # [[ virt != virt ]] 00:11:36.103 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@442 -- # [[ no == yes ]] 00:11:36.103 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@449 -- # [[ virt == phy ]] 00:11:36.103 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@452 -- # [[ virt == phy-fallback ]] 00:11:36.103 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@457 -- # [[ tcp == tcp ]] 00:11:36.103 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@458 -- # nvmf_veth_init 00:11:36.103 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@145 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:11:36.103 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@146 -- # NVMF_SECOND_INITIATOR_IP=10.0.0.2 00:11:36.103 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@147 -- # NVMF_FIRST_TARGET_IP=10.0.0.3 00:11:36.103 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@148 -- # NVMF_SECOND_TARGET_IP=10.0.0.4 00:11:36.103 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@149 -- # NVMF_INITIATOR_IP=10.0.0.1 00:11:36.103 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@150 -- # NVMF_BRIDGE=nvmf_br 00:11:36.103 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@151 -- # NVMF_INITIATOR_INTERFACE=nvmf_init_if 00:11:36.103 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@152 -- # NVMF_INITIATOR_INTERFACE2=nvmf_init_if2 00:11:36.103 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@153 -- # NVMF_INITIATOR_BRIDGE=nvmf_init_br 00:11:36.103 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@154 -- # NVMF_INITIATOR_BRIDGE2=nvmf_init_br2 00:11:36.103 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@155 -- # NVMF_TARGET_NAMESPACE=nvmf_tgt_ns_spdk 00:11:36.103 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@156 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:11:36.103 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@157 -- # NVMF_TARGET_INTERFACE=nvmf_tgt_if 00:11:36.103 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@158 -- # NVMF_TARGET_INTERFACE2=nvmf_tgt_if2 00:11:36.103 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@159 -- # NVMF_TARGET_BRIDGE=nvmf_tgt_br 00:11:36.103 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@160 -- # NVMF_TARGET_BRIDGE2=nvmf_tgt_br2 00:11:36.103 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@162 -- # ip link set nvmf_init_br nomaster 00:11:36.103 Cannot find device "nvmf_init_br" 00:11:36.103 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@162 -- # true 00:11:36.103 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@163 -- # ip link set nvmf_init_br2 nomaster 00:11:36.361 Cannot find device "nvmf_init_br2" 00:11:36.361 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@163 -- # true 00:11:36.361 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@164 -- # ip link set nvmf_tgt_br nomaster 00:11:36.361 Cannot find device "nvmf_tgt_br" 00:11:36.361 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@164 -- # true 00:11:36.361 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@165 -- # ip link set nvmf_tgt_br2 nomaster 00:11:36.361 Cannot find device "nvmf_tgt_br2" 00:11:36.361 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@165 -- # true 00:11:36.361 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@166 -- # ip link set nvmf_init_br down 00:11:36.361 Cannot find device "nvmf_init_br" 00:11:36.361 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@166 -- # true 00:11:36.361 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@167 -- # ip link set nvmf_init_br2 down 00:11:36.361 Cannot find device "nvmf_init_br2" 00:11:36.361 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@167 -- # true 00:11:36.361 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@168 -- # ip link set nvmf_tgt_br down 00:11:36.361 Cannot find device "nvmf_tgt_br" 00:11:36.361 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@168 -- # true 00:11:36.361 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@169 -- # ip link set nvmf_tgt_br2 down 00:11:36.361 Cannot find device "nvmf_tgt_br2" 00:11:36.361 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@169 -- # true 00:11:36.361 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@170 -- # ip link delete nvmf_br type bridge 00:11:36.361 Cannot find device "nvmf_br" 00:11:36.361 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@170 -- # true 00:11:36.361 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@171 -- # ip link delete nvmf_init_if 00:11:36.361 Cannot find device "nvmf_init_if" 00:11:36.361 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@171 -- # true 00:11:36.361 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@172 -- # ip link delete nvmf_init_if2 00:11:36.361 Cannot find device "nvmf_init_if2" 00:11:36.361 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@172 -- # true 00:11:36.361 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@173 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:11:36.361 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:11:36.361 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@173 -- # true 00:11:36.361 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@174 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:11:36.361 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:11:36.361 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@174 -- # true 00:11:36.361 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@177 -- # ip netns add nvmf_tgt_ns_spdk 00:11:36.361 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@180 -- # ip link add nvmf_init_if type veth peer name nvmf_init_br 00:11:36.361 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@181 -- # ip link add nvmf_init_if2 type veth peer name nvmf_init_br2 00:11:36.361 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@182 -- # ip link add nvmf_tgt_if type veth peer name nvmf_tgt_br 00:11:36.361 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@183 -- # ip link add nvmf_tgt_if2 type veth peer name nvmf_tgt_br2 00:11:36.361 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@186 -- # ip link set nvmf_tgt_if netns nvmf_tgt_ns_spdk 00:11:36.361 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@187 -- # ip link set nvmf_tgt_if2 netns nvmf_tgt_ns_spdk 00:11:36.361 11:22:17 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@190 -- # ip addr add 10.0.0.1/24 dev nvmf_init_if 00:11:36.361 11:22:18 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@191 -- # ip addr add 10.0.0.2/24 dev nvmf_init_if2 00:11:36.361 11:22:18 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@192 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.3/24 dev nvmf_tgt_if 00:11:36.361 11:22:18 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@193 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.4/24 dev nvmf_tgt_if2 00:11:36.361 11:22:18 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@196 -- # ip link set nvmf_init_if up 00:11:36.361 11:22:18 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@197 -- # ip link set nvmf_init_if2 up 00:11:36.361 11:22:18 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@198 -- # ip link set nvmf_init_br up 00:11:36.361 11:22:18 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@199 -- # ip link set nvmf_init_br2 up 00:11:36.361 11:22:18 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@200 -- # ip link set nvmf_tgt_br up 00:11:36.361 11:22:18 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@201 -- # ip link set nvmf_tgt_br2 up 00:11:36.361 11:22:18 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@202 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if up 00:11:36.361 11:22:18 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@203 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if2 up 00:11:36.625 11:22:18 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@204 -- # ip netns exec nvmf_tgt_ns_spdk ip link set lo up 00:11:36.625 11:22:18 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@207 -- # ip link add nvmf_br type bridge 00:11:36.625 11:22:18 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@208 -- # ip link set nvmf_br up 00:11:36.625 11:22:18 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@211 -- # ip link set nvmf_init_br master nvmf_br 00:11:36.625 11:22:18 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@212 -- # ip link set nvmf_init_br2 master nvmf_br 00:11:36.625 11:22:18 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@213 -- # ip link set nvmf_tgt_br master nvmf_br 00:11:36.625 11:22:18 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@214 -- # ip link set nvmf_tgt_br2 master nvmf_br 00:11:36.625 11:22:18 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@217 -- # ipts -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT 00:11:36.625 11:22:18 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT' 00:11:36.625 11:22:18 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@218 -- # ipts -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT 00:11:36.625 11:22:18 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT' 00:11:36.625 11:22:18 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@219 -- # ipts -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT 00:11:36.625 11:22:18 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@788 -- # iptables -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT -m comment --comment 'SPDK_NVMF:-A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT' 00:11:36.625 11:22:18 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@222 -- # ping -c 1 10.0.0.3 00:11:36.625 PING 10.0.0.3 (10.0.0.3) 56(84) bytes of data. 00:11:36.625 64 bytes from 10.0.0.3: icmp_seq=1 ttl=64 time=0.095 ms 00:11:36.625 00:11:36.625 --- 10.0.0.3 ping statistics --- 00:11:36.625 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:36.625 rtt min/avg/max/mdev = 0.095/0.095/0.095/0.000 ms 00:11:36.625 11:22:18 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@223 -- # ping -c 1 10.0.0.4 00:11:36.625 PING 10.0.0.4 (10.0.0.4) 56(84) bytes of data. 00:11:36.625 64 bytes from 10.0.0.4: icmp_seq=1 ttl=64 time=0.063 ms 00:11:36.625 00:11:36.625 --- 10.0.0.4 ping statistics --- 00:11:36.625 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:36.625 rtt min/avg/max/mdev = 0.063/0.063/0.063/0.000 ms 00:11:36.625 11:22:18 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@224 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.1 00:11:36.625 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:11:36.625 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.026 ms 00:11:36.625 00:11:36.625 --- 10.0.0.1 ping statistics --- 00:11:36.625 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:36.625 rtt min/avg/max/mdev = 0.026/0.026/0.026/0.000 ms 00:11:36.625 11:22:18 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@225 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.2 00:11:36.625 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:11:36.625 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.065 ms 00:11:36.625 00:11:36.625 --- 10.0.0.2 ping statistics --- 00:11:36.625 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:36.625 rtt min/avg/max/mdev = 0.065/0.065/0.065/0.000 ms 00:11:36.625 11:22:18 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@227 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:11:36.625 11:22:18 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@459 -- # return 0 00:11:36.625 11:22:18 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:11:36.625 11:22:18 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:11:36.625 11:22:18 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:11:36.625 11:22:18 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:11:36.625 11:22:18 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:11:36.625 11:22:18 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:11:36.625 11:22:18 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:11:36.625 11:22:18 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@51 -- # nvmfappstart 00:11:36.625 11:22:18 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:11:36.625 11:22:18 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@724 -- # xtrace_disable 00:11:36.625 11:22:18 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@10 -- # set +x 00:11:36.625 11:22:18 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@507 -- # nvmfpid=76096 00:11:36.625 11:22:18 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@506 -- # ip netns exec nvmf_tgt_ns_spdk /home/vagrant/spdk_repo/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF 00:11:36.625 11:22:18 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@508 -- # waitforlisten 76096 00:11:36.625 11:22:18 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@831 -- # '[' -z 76096 ']' 00:11:36.625 11:22:18 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:11:36.625 11:22:18 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@836 -- # local max_retries=100 00:11:36.625 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:11:36.625 11:22:18 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:11:36.625 11:22:18 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@840 -- # xtrace_disable 00:11:36.625 11:22:18 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@10 -- # set +x 00:11:36.625 [2024-10-07 11:22:18.295254] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:11:36.626 [2024-10-07 11:22:18.295439] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:11:36.914 [2024-10-07 11:22:18.438476] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:11:36.914 [2024-10-07 11:22:18.606756] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:11:36.914 [2024-10-07 11:22:18.606850] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:11:36.914 [2024-10-07 11:22:18.606876] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:11:36.914 [2024-10-07 11:22:18.606887] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:11:36.914 [2024-10-07 11:22:18.606897] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:11:36.914 [2024-10-07 11:22:18.607461] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:11:37.848 11:22:19 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:11:37.848 11:22:19 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@864 -- # return 0 00:11:37.848 11:22:19 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:11:37.848 11:22:19 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@730 -- # xtrace_disable 00:11:37.848 11:22:19 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@10 -- # set +x 00:11:37.848 11:22:19 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:11:37.848 11:22:19 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@53 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:11:38.106 [2024-10-07 11:22:19.749202] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:11:38.106 11:22:19 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@55 -- # MALLOC_BDEV_SIZE=64 00:11:38.106 11:22:19 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@56 -- # MALLOC_BLOCK_SIZE=512 00:11:38.106 11:22:19 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@58 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc1 00:11:38.674 Malloc1 00:11:38.674 11:22:20 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@59 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc2 00:11:38.932 Malloc2 00:11:38.932 11:22:20 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@62 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:11:39.190 11:22:20 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@63 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 1 00:11:39.449 11:22:21 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@64 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4420 00:11:39.739 [2024-10-07 11:22:21.397870] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:11:39.739 11:22:21 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@67 -- # connect 00:11:39.739 11:22:21 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@22 -- # nvme connect -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 -I 23cbe69d-1d5d-474e-9751-c5d80c1ef9bf -a 10.0.0.3 -s 4420 -i 4 00:11:39.997 11:22:21 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@24 -- # waitforserial SPDKISFASTANDAWESOME 00:11:39.997 11:22:21 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@1198 -- # local i=0 00:11:39.997 11:22:21 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@1199 -- # local nvme_device_counter=1 nvme_devices=0 00:11:39.997 11:22:21 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@1200 -- # [[ -n '' ]] 00:11:39.997 11:22:21 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@1205 -- # sleep 2 00:11:41.898 11:22:23 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@1206 -- # (( i++ <= 15 )) 00:11:41.898 11:22:23 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@1207 -- # lsblk -l -o NAME,SERIAL 00:11:41.898 11:22:23 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@1207 -- # grep -c SPDKISFASTANDAWESOME 00:11:41.898 11:22:23 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@1207 -- # nvme_devices=1 00:11:41.898 11:22:23 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@1208 -- # (( nvme_devices == nvme_device_counter )) 00:11:41.898 11:22:23 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@1208 -- # return 0 00:11:41.898 11:22:23 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@26 -- # nvme list-subsys -o json 00:11:41.898 11:22:23 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@26 -- # jq -r '.[].Subsystems[] | select(.NQN=="nqn.2016-06.io.spdk:cnode1") | .Paths[0].Name' 00:11:42.157 11:22:23 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@26 -- # ctrl_id=nvme0 00:11:42.157 11:22:23 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@27 -- # [[ -z nvme0 ]] 00:11:42.157 11:22:23 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@68 -- # ns_is_visible 0x1 00:11:42.157 11:22:23 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@43 -- # nvme list-ns /dev/nvme0 00:11:42.157 11:22:23 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@43 -- # grep 0x1 00:11:42.157 [ 0]:0x1 00:11:42.157 11:22:23 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # nvme id-ns /dev/nvme0 -n 0x1 -o json 00:11:42.157 11:22:23 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # jq -r .nguid 00:11:42.157 11:22:23 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # nguid=f701062f287d4048b5ddaa3d14c9f1d7 00:11:42.157 11:22:23 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@45 -- # [[ f701062f287d4048b5ddaa3d14c9f1d7 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:11:42.157 11:22:23 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@71 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc2 -n 2 00:11:42.418 11:22:24 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@72 -- # ns_is_visible 0x1 00:11:42.418 11:22:24 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@43 -- # nvme list-ns /dev/nvme0 00:11:42.418 11:22:24 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@43 -- # grep 0x1 00:11:42.418 [ 0]:0x1 00:11:42.418 11:22:24 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # jq -r .nguid 00:11:42.418 11:22:24 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # nvme id-ns /dev/nvme0 -n 0x1 -o json 00:11:42.418 11:22:24 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # nguid=f701062f287d4048b5ddaa3d14c9f1d7 00:11:42.418 11:22:24 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@45 -- # [[ f701062f287d4048b5ddaa3d14c9f1d7 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:11:42.418 11:22:24 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@73 -- # ns_is_visible 0x2 00:11:42.418 11:22:24 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@43 -- # nvme list-ns /dev/nvme0 00:11:42.418 11:22:24 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@43 -- # grep 0x2 00:11:42.418 [ 1]:0x2 00:11:42.418 11:22:24 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # nvme id-ns /dev/nvme0 -n 0x2 -o json 00:11:42.418 11:22:24 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # jq -r .nguid 00:11:42.418 11:22:24 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # nguid=63c2e80a7490455f8d9e03c5f15605e2 00:11:42.418 11:22:24 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@45 -- # [[ 63c2e80a7490455f8d9e03c5f15605e2 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:11:42.418 11:22:24 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@75 -- # disconnect 00:11:42.418 11:22:24 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:11:42.704 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:42.704 11:22:24 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@79 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:11:42.962 11:22:24 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@80 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 1 --no-auto-visible 00:11:43.221 11:22:24 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@83 -- # connect 1 00:11:43.221 11:22:24 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@22 -- # nvme connect -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 -I 23cbe69d-1d5d-474e-9751-c5d80c1ef9bf -a 10.0.0.3 -s 4420 -i 4 00:11:43.221 11:22:24 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@24 -- # waitforserial SPDKISFASTANDAWESOME 1 00:11:43.221 11:22:24 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@1198 -- # local i=0 00:11:43.221 11:22:24 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@1199 -- # local nvme_device_counter=1 nvme_devices=0 00:11:43.221 11:22:24 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@1200 -- # [[ -n 1 ]] 00:11:43.221 11:22:24 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@1201 -- # nvme_device_counter=1 00:11:43.221 11:22:24 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@1205 -- # sleep 2 00:11:45.785 11:22:26 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@1206 -- # (( i++ <= 15 )) 00:11:45.785 11:22:26 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@1207 -- # lsblk -l -o NAME,SERIAL 00:11:45.785 11:22:26 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@1207 -- # grep -c SPDKISFASTANDAWESOME 00:11:45.785 11:22:26 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@1207 -- # nvme_devices=1 00:11:45.785 11:22:26 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@1208 -- # (( nvme_devices == nvme_device_counter )) 00:11:45.785 11:22:26 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@1208 -- # return 0 00:11:45.785 11:22:26 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@26 -- # nvme list-subsys -o json 00:11:45.785 11:22:26 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@26 -- # jq -r '.[].Subsystems[] | select(.NQN=="nqn.2016-06.io.spdk:cnode1") | .Paths[0].Name' 00:11:45.785 11:22:26 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@26 -- # ctrl_id=nvme0 00:11:45.785 11:22:26 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@27 -- # [[ -z nvme0 ]] 00:11:45.785 11:22:26 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@84 -- # NOT ns_is_visible 0x1 00:11:45.785 11:22:26 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@650 -- # local es=0 00:11:45.785 11:22:26 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@652 -- # valid_exec_arg ns_is_visible 0x1 00:11:45.785 11:22:26 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@638 -- # local arg=ns_is_visible 00:11:45.785 11:22:26 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:11:45.785 11:22:26 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@642 -- # type -t ns_is_visible 00:11:45.785 11:22:26 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:11:45.785 11:22:26 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@653 -- # ns_is_visible 0x1 00:11:45.785 11:22:26 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@43 -- # nvme list-ns /dev/nvme0 00:11:45.785 11:22:26 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@43 -- # grep 0x1 00:11:45.785 11:22:26 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # jq -r .nguid 00:11:45.785 11:22:26 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # nvme id-ns /dev/nvme0 -n 0x1 -o json 00:11:45.785 11:22:27 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # nguid=00000000000000000000000000000000 00:11:45.785 11:22:27 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@45 -- # [[ 00000000000000000000000000000000 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:11:45.785 11:22:27 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@653 -- # es=1 00:11:45.785 11:22:27 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:11:45.785 11:22:27 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:11:45.785 11:22:27 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:11:45.785 11:22:27 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@85 -- # ns_is_visible 0x2 00:11:45.785 11:22:27 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@43 -- # nvme list-ns /dev/nvme0 00:11:45.785 11:22:27 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@43 -- # grep 0x2 00:11:45.785 [ 0]:0x2 00:11:45.785 11:22:27 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # nvme id-ns /dev/nvme0 -n 0x2 -o json 00:11:45.785 11:22:27 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # jq -r .nguid 00:11:45.785 11:22:27 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # nguid=63c2e80a7490455f8d9e03c5f15605e2 00:11:45.785 11:22:27 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@45 -- # [[ 63c2e80a7490455f8d9e03c5f15605e2 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:11:45.786 11:22:27 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@88 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_ns_add_host nqn.2016-06.io.spdk:cnode1 1 nqn.2016-06.io.spdk:host1 00:11:45.786 11:22:27 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@89 -- # ns_is_visible 0x1 00:11:45.786 11:22:27 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@43 -- # nvme list-ns /dev/nvme0 00:11:45.786 11:22:27 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@43 -- # grep 0x1 00:11:45.786 [ 0]:0x1 00:11:45.786 11:22:27 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # nvme id-ns /dev/nvme0 -n 0x1 -o json 00:11:45.786 11:22:27 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # jq -r .nguid 00:11:45.786 11:22:27 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # nguid=f701062f287d4048b5ddaa3d14c9f1d7 00:11:45.786 11:22:27 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@45 -- # [[ f701062f287d4048b5ddaa3d14c9f1d7 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:11:45.786 11:22:27 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@90 -- # ns_is_visible 0x2 00:11:45.786 11:22:27 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@43 -- # nvme list-ns /dev/nvme0 00:11:45.786 11:22:27 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@43 -- # grep 0x2 00:11:45.786 [ 1]:0x2 00:11:45.786 11:22:27 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # nvme id-ns /dev/nvme0 -n 0x2 -o json 00:11:45.786 11:22:27 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # jq -r .nguid 00:11:46.043 11:22:27 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # nguid=63c2e80a7490455f8d9e03c5f15605e2 00:11:46.043 11:22:27 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@45 -- # [[ 63c2e80a7490455f8d9e03c5f15605e2 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:11:46.043 11:22:27 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@93 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_ns_remove_host nqn.2016-06.io.spdk:cnode1 1 nqn.2016-06.io.spdk:host1 00:11:46.301 11:22:27 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@94 -- # NOT ns_is_visible 0x1 00:11:46.301 11:22:27 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@650 -- # local es=0 00:11:46.301 11:22:27 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@652 -- # valid_exec_arg ns_is_visible 0x1 00:11:46.301 11:22:27 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@638 -- # local arg=ns_is_visible 00:11:46.301 11:22:27 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:11:46.301 11:22:27 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@642 -- # type -t ns_is_visible 00:11:46.301 11:22:27 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:11:46.301 11:22:27 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@653 -- # ns_is_visible 0x1 00:11:46.301 11:22:27 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@43 -- # nvme list-ns /dev/nvme0 00:11:46.302 11:22:27 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@43 -- # grep 0x1 00:11:46.302 11:22:27 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # nvme id-ns /dev/nvme0 -n 0x1 -o json 00:11:46.302 11:22:27 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # jq -r .nguid 00:11:46.302 11:22:27 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # nguid=00000000000000000000000000000000 00:11:46.302 11:22:27 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@45 -- # [[ 00000000000000000000000000000000 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:11:46.302 11:22:27 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@653 -- # es=1 00:11:46.302 11:22:27 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:11:46.302 11:22:27 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:11:46.302 11:22:27 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:11:46.302 11:22:27 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@95 -- # ns_is_visible 0x2 00:11:46.302 11:22:27 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@43 -- # nvme list-ns /dev/nvme0 00:11:46.302 11:22:27 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@43 -- # grep 0x2 00:11:46.302 [ 0]:0x2 00:11:46.302 11:22:27 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # nvme id-ns /dev/nvme0 -n 0x2 -o json 00:11:46.302 11:22:27 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # jq -r .nguid 00:11:46.302 11:22:27 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # nguid=63c2e80a7490455f8d9e03c5f15605e2 00:11:46.302 11:22:27 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@45 -- # [[ 63c2e80a7490455f8d9e03c5f15605e2 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:11:46.302 11:22:27 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@97 -- # disconnect 00:11:46.302 11:22:27 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:11:46.302 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:46.302 11:22:27 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@100 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_ns_add_host nqn.2016-06.io.spdk:cnode1 1 nqn.2016-06.io.spdk:host1 00:11:46.560 11:22:28 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@101 -- # connect 2 00:11:46.560 11:22:28 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@22 -- # nvme connect -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 -I 23cbe69d-1d5d-474e-9751-c5d80c1ef9bf -a 10.0.0.3 -s 4420 -i 4 00:11:46.817 11:22:28 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@24 -- # waitforserial SPDKISFASTANDAWESOME 2 00:11:46.817 11:22:28 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@1198 -- # local i=0 00:11:46.817 11:22:28 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@1199 -- # local nvme_device_counter=1 nvme_devices=0 00:11:46.817 11:22:28 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@1200 -- # [[ -n 2 ]] 00:11:46.817 11:22:28 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@1201 -- # nvme_device_counter=2 00:11:46.817 11:22:28 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@1205 -- # sleep 2 00:11:48.718 11:22:30 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@1206 -- # (( i++ <= 15 )) 00:11:48.718 11:22:30 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@1207 -- # lsblk -l -o NAME,SERIAL 00:11:48.718 11:22:30 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@1207 -- # grep -c SPDKISFASTANDAWESOME 00:11:48.718 11:22:30 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@1207 -- # nvme_devices=2 00:11:48.718 11:22:30 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@1208 -- # (( nvme_devices == nvme_device_counter )) 00:11:48.718 11:22:30 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@1208 -- # return 0 00:11:48.718 11:22:30 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@26 -- # nvme list-subsys -o json 00:11:48.718 11:22:30 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@26 -- # jq -r '.[].Subsystems[] | select(.NQN=="nqn.2016-06.io.spdk:cnode1") | .Paths[0].Name' 00:11:48.977 11:22:30 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@26 -- # ctrl_id=nvme0 00:11:48.977 11:22:30 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@27 -- # [[ -z nvme0 ]] 00:11:48.977 11:22:30 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@102 -- # ns_is_visible 0x1 00:11:48.977 11:22:30 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@43 -- # nvme list-ns /dev/nvme0 00:11:48.977 11:22:30 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@43 -- # grep 0x1 00:11:48.977 [ 0]:0x1 00:11:48.977 11:22:30 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # nvme id-ns /dev/nvme0 -n 0x1 -o json 00:11:48.977 11:22:30 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # jq -r .nguid 00:11:48.977 11:22:30 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # nguid=f701062f287d4048b5ddaa3d14c9f1d7 00:11:48.977 11:22:30 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@45 -- # [[ f701062f287d4048b5ddaa3d14c9f1d7 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:11:48.977 11:22:30 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@103 -- # ns_is_visible 0x2 00:11:48.977 11:22:30 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@43 -- # grep 0x2 00:11:48.977 11:22:30 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@43 -- # nvme list-ns /dev/nvme0 00:11:48.977 [ 1]:0x2 00:11:48.977 11:22:30 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # nvme id-ns /dev/nvme0 -n 0x2 -o json 00:11:48.977 11:22:30 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # jq -r .nguid 00:11:48.977 11:22:30 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # nguid=63c2e80a7490455f8d9e03c5f15605e2 00:11:48.977 11:22:30 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@45 -- # [[ 63c2e80a7490455f8d9e03c5f15605e2 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:11:48.977 11:22:30 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@106 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_ns_remove_host nqn.2016-06.io.spdk:cnode1 1 nqn.2016-06.io.spdk:host1 00:11:49.236 11:22:30 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@107 -- # NOT ns_is_visible 0x1 00:11:49.236 11:22:30 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@650 -- # local es=0 00:11:49.236 11:22:30 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@652 -- # valid_exec_arg ns_is_visible 0x1 00:11:49.237 11:22:30 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@638 -- # local arg=ns_is_visible 00:11:49.237 11:22:30 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:11:49.237 11:22:30 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@642 -- # type -t ns_is_visible 00:11:49.237 11:22:30 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:11:49.237 11:22:30 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@653 -- # ns_is_visible 0x1 00:11:49.237 11:22:30 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@43 -- # nvme list-ns /dev/nvme0 00:11:49.237 11:22:30 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@43 -- # grep 0x1 00:11:49.237 11:22:30 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # nvme id-ns /dev/nvme0 -n 0x1 -o json 00:11:49.237 11:22:30 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # jq -r .nguid 00:11:49.237 11:22:30 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # nguid=00000000000000000000000000000000 00:11:49.237 11:22:30 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@45 -- # [[ 00000000000000000000000000000000 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:11:49.237 11:22:30 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@653 -- # es=1 00:11:49.237 11:22:30 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:11:49.237 11:22:30 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:11:49.237 11:22:30 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:11:49.237 11:22:30 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@108 -- # ns_is_visible 0x2 00:11:49.237 11:22:30 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@43 -- # grep 0x2 00:11:49.497 11:22:30 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@43 -- # nvme list-ns /dev/nvme0 00:11:49.497 [ 0]:0x2 00:11:49.497 11:22:30 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # jq -r .nguid 00:11:49.497 11:22:30 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # nvme id-ns /dev/nvme0 -n 0x2 -o json 00:11:49.497 11:22:31 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # nguid=63c2e80a7490455f8d9e03c5f15605e2 00:11:49.497 11:22:31 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@45 -- # [[ 63c2e80a7490455f8d9e03c5f15605e2 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:11:49.497 11:22:31 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@111 -- # NOT /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_ns_remove_host nqn.2016-06.io.spdk:cnode1 2 nqn.2016-06.io.spdk:host1 00:11:49.497 11:22:31 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@650 -- # local es=0 00:11:49.497 11:22:31 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@652 -- # valid_exec_arg /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_ns_remove_host nqn.2016-06.io.spdk:cnode1 2 nqn.2016-06.io.spdk:host1 00:11:49.497 11:22:31 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@638 -- # local arg=/home/vagrant/spdk_repo/spdk/scripts/rpc.py 00:11:49.497 11:22:31 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:11:49.497 11:22:31 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@642 -- # type -t /home/vagrant/spdk_repo/spdk/scripts/rpc.py 00:11:49.497 11:22:31 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:11:49.497 11:22:31 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@644 -- # type -P /home/vagrant/spdk_repo/spdk/scripts/rpc.py 00:11:49.497 11:22:31 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:11:49.497 11:22:31 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@644 -- # arg=/home/vagrant/spdk_repo/spdk/scripts/rpc.py 00:11:49.497 11:22:31 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@644 -- # [[ -x /home/vagrant/spdk_repo/spdk/scripts/rpc.py ]] 00:11:49.497 11:22:31 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@653 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_ns_remove_host nqn.2016-06.io.spdk:cnode1 2 nqn.2016-06.io.spdk:host1 00:11:49.756 [2024-10-07 11:22:31.266340] nvmf_rpc.c:1870:nvmf_rpc_ns_visible_paused: *ERROR*: Unable to add/remove nqn.2016-06.io.spdk:host1 to namespace ID 2 00:11:49.756 2024/10/07 11:22:31 error on JSON-RPC call, method: nvmf_ns_remove_host, params: map[host:nqn.2016-06.io.spdk:host1 nqn:nqn.2016-06.io.spdk:cnode1 nsid:2], err: error received for nvmf_ns_remove_host method, err: Code=-32602 Msg=Invalid parameters 00:11:49.756 request: 00:11:49.756 { 00:11:49.756 "method": "nvmf_ns_remove_host", 00:11:49.756 "params": { 00:11:49.756 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:11:49.756 "nsid": 2, 00:11:49.756 "host": "nqn.2016-06.io.spdk:host1" 00:11:49.756 } 00:11:49.756 } 00:11:49.756 Got JSON-RPC error response 00:11:49.756 GoRPCClient: error on JSON-RPC call 00:11:49.756 11:22:31 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@653 -- # es=1 00:11:49.756 11:22:31 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:11:49.756 11:22:31 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:11:49.756 11:22:31 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:11:49.756 11:22:31 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@112 -- # NOT ns_is_visible 0x1 00:11:49.756 11:22:31 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@650 -- # local es=0 00:11:49.756 11:22:31 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@652 -- # valid_exec_arg ns_is_visible 0x1 00:11:49.756 11:22:31 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@638 -- # local arg=ns_is_visible 00:11:49.756 11:22:31 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:11:49.756 11:22:31 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@642 -- # type -t ns_is_visible 00:11:49.756 11:22:31 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:11:49.756 11:22:31 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@653 -- # ns_is_visible 0x1 00:11:49.756 11:22:31 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@43 -- # nvme list-ns /dev/nvme0 00:11:49.756 11:22:31 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@43 -- # grep 0x1 00:11:49.756 11:22:31 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # jq -r .nguid 00:11:49.756 11:22:31 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # nvme id-ns /dev/nvme0 -n 0x1 -o json 00:11:49.756 11:22:31 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # nguid=00000000000000000000000000000000 00:11:49.756 11:22:31 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@45 -- # [[ 00000000000000000000000000000000 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:11:49.756 11:22:31 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@653 -- # es=1 00:11:49.756 11:22:31 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:11:49.756 11:22:31 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:11:49.756 11:22:31 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:11:49.756 11:22:31 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@113 -- # ns_is_visible 0x2 00:11:49.756 11:22:31 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@43 -- # grep 0x2 00:11:49.756 11:22:31 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@43 -- # nvme list-ns /dev/nvme0 00:11:49.756 [ 0]:0x2 00:11:49.756 11:22:31 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # nvme id-ns /dev/nvme0 -n 0x2 -o json 00:11:49.756 11:22:31 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # jq -r .nguid 00:11:49.756 11:22:31 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@44 -- # nguid=63c2e80a7490455f8d9e03c5f15605e2 00:11:49.756 11:22:31 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@45 -- # [[ 63c2e80a7490455f8d9e03c5f15605e2 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:11:49.756 11:22:31 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@114 -- # disconnect 00:11:49.756 11:22:31 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:11:50.015 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:50.015 11:22:31 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@118 -- # hostpid=76490 00:11:50.015 11:22:31 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@117 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_tgt -r /var/tmp/host.sock -m 2 00:11:50.015 11:22:31 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@119 -- # trap 'killprocess $hostpid; nvmftestfini' SIGINT SIGTERM EXIT 00:11:50.015 11:22:31 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@121 -- # waitforlisten 76490 /var/tmp/host.sock 00:11:50.015 11:22:31 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@831 -- # '[' -z 76490 ']' 00:11:50.015 11:22:31 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/host.sock 00:11:50.015 11:22:31 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@836 -- # local max_retries=100 00:11:50.015 Waiting for process to start up and listen on UNIX domain socket /var/tmp/host.sock... 00:11:50.015 11:22:31 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/host.sock...' 00:11:50.015 11:22:31 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@840 -- # xtrace_disable 00:11:50.016 11:22:31 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@10 -- # set +x 00:11:50.016 [2024-10-07 11:22:31.545507] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:11:50.016 [2024-10-07 11:22:31.545630] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid76490 ] 00:11:50.016 [2024-10-07 11:22:31.683638] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:11:50.274 [2024-10-07 11:22:31.837379] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:11:51.210 11:22:32 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:11:51.210 11:22:32 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@864 -- # return 0 00:11:51.210 11:22:32 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@122 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:11:51.468 11:22:32 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@123 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:11:51.727 11:22:33 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@124 -- # uuid2nguid d7b51dce-1523-4f40-8fc1-fd9dc2afc084 00:11:51.727 11:22:33 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@785 -- # tr -d - 00:11:51.727 11:22:33 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@124 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 1 -g D7B51DCE15234F408FC1FD9DC2AFC084 -i 00:11:51.985 11:22:33 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@125 -- # uuid2nguid d0e3073c-8a2f-4e8a-8914-7f7f4faff17e 00:11:51.985 11:22:33 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@785 -- # tr -d - 00:11:51.985 11:22:33 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@125 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc2 -n 2 -g D0E3073C8A2F4E8A89147F7F4FAFF17E -i 00:11:52.243 11:22:33 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@126 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_ns_add_host nqn.2016-06.io.spdk:cnode1 1 nqn.2016-06.io.spdk:host1 00:11:52.502 11:22:34 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@127 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_ns_add_host nqn.2016-06.io.spdk:cnode1 2 nqn.2016-06.io.spdk:host2 00:11:52.759 11:22:34 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@129 -- # hostrpc bdev_nvme_attach_controller -t tcp -a 10.0.0.3 -f ipv4 -s 4420 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 -b nvme0 00:11:52.759 11:22:34 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@48 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -a 10.0.0.3 -f ipv4 -s 4420 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 -b nvme0 00:11:53.365 nvme0n1 00:11:53.365 11:22:34 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@131 -- # hostrpc bdev_nvme_attach_controller -t tcp -a 10.0.0.3 -f ipv4 -s 4420 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host2 -b nvme1 00:11:53.365 11:22:34 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@48 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -a 10.0.0.3 -f ipv4 -s 4420 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host2 -b nvme1 00:11:53.623 nvme1n2 00:11:53.623 11:22:35 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@134 -- # sort 00:11:53.623 11:22:35 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@134 -- # hostrpc bdev_get_bdevs 00:11:53.623 11:22:35 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@134 -- # jq -r '.[].name' 00:11:53.623 11:22:35 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@48 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_get_bdevs 00:11:53.623 11:22:35 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@134 -- # xargs 00:11:53.880 11:22:35 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@134 -- # [[ nvme0n1 nvme1n2 == \n\v\m\e\0\n\1\ \n\v\m\e\1\n\2 ]] 00:11:53.880 11:22:35 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@135 -- # hostrpc bdev_get_bdevs -b nvme0n1 00:11:53.880 11:22:35 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@48 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_get_bdevs -b nvme0n1 00:11:53.880 11:22:35 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@135 -- # jq -r '.[].uuid' 00:11:54.138 11:22:35 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@135 -- # [[ d7b51dce-1523-4f40-8fc1-fd9dc2afc084 == \d\7\b\5\1\d\c\e\-\1\5\2\3\-\4\f\4\0\-\8\f\c\1\-\f\d\9\d\c\2\a\f\c\0\8\4 ]] 00:11:54.138 11:22:35 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@136 -- # hostrpc bdev_get_bdevs -b nvme1n2 00:11:54.138 11:22:35 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@48 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_get_bdevs -b nvme1n2 00:11:54.138 11:22:35 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@136 -- # jq -r '.[].uuid' 00:11:54.395 11:22:36 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@136 -- # [[ d0e3073c-8a2f-4e8a-8914-7f7f4faff17e == \d\0\e\3\0\7\3\c\-\8\a\2\f\-\4\e\8\a\-\8\9\1\4\-\7\f\7\f\4\f\a\f\f\1\7\e ]] 00:11:54.395 11:22:36 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@138 -- # killprocess 76490 00:11:54.395 11:22:36 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@950 -- # '[' -z 76490 ']' 00:11:54.395 11:22:36 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@954 -- # kill -0 76490 00:11:54.395 11:22:36 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@955 -- # uname 00:11:54.653 11:22:36 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:11:54.653 11:22:36 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 76490 00:11:54.653 killing process with pid 76490 00:11:54.653 11:22:36 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@956 -- # process_name=reactor_1 00:11:54.653 11:22:36 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@960 -- # '[' reactor_1 = sudo ']' 00:11:54.653 11:22:36 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@968 -- # echo 'killing process with pid 76490' 00:11:54.653 11:22:36 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@969 -- # kill 76490 00:11:54.653 11:22:36 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@974 -- # wait 76490 00:11:55.219 11:22:36 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@139 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:11:55.477 11:22:37 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@141 -- # trap - SIGINT SIGTERM EXIT 00:11:55.477 11:22:37 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- target/ns_masking.sh@142 -- # nvmftestfini 00:11:55.477 11:22:37 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@514 -- # nvmfcleanup 00:11:55.477 11:22:37 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@121 -- # sync 00:11:55.477 11:22:37 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:11:55.477 11:22:37 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@124 -- # set +e 00:11:55.477 11:22:37 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@125 -- # for i in {1..20} 00:11:55.477 11:22:37 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:11:55.477 rmmod nvme_tcp 00:11:55.477 rmmod nvme_fabrics 00:11:55.734 rmmod nvme_keyring 00:11:55.734 11:22:37 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:11:55.735 11:22:37 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@128 -- # set -e 00:11:55.735 11:22:37 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@129 -- # return 0 00:11:55.735 11:22:37 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@515 -- # '[' -n 76096 ']' 00:11:55.735 11:22:37 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@516 -- # killprocess 76096 00:11:55.735 11:22:37 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@950 -- # '[' -z 76096 ']' 00:11:55.735 11:22:37 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@954 -- # kill -0 76096 00:11:55.735 11:22:37 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@955 -- # uname 00:11:55.735 11:22:37 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:11:55.735 11:22:37 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 76096 00:11:55.735 killing process with pid 76096 00:11:55.735 11:22:37 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:11:55.735 11:22:37 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:11:55.735 11:22:37 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@968 -- # echo 'killing process with pid 76096' 00:11:55.735 11:22:37 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@969 -- # kill 76096 00:11:55.735 11:22:37 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@974 -- # wait 76096 00:11:55.992 11:22:37 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:11:55.992 11:22:37 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:11:55.992 11:22:37 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:11:55.992 11:22:37 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@297 -- # iptr 00:11:55.992 11:22:37 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@789 -- # iptables-save 00:11:55.992 11:22:37 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@789 -- # iptables-restore 00:11:55.992 11:22:37 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:11:55.992 11:22:37 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@298 -- # [[ nvmf_tgt_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:11:55.992 11:22:37 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@299 -- # nvmf_veth_fini 00:11:55.992 11:22:37 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@233 -- # ip link set nvmf_init_br nomaster 00:11:55.992 11:22:37 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@234 -- # ip link set nvmf_init_br2 nomaster 00:11:55.992 11:22:37 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@235 -- # ip link set nvmf_tgt_br nomaster 00:11:56.250 11:22:37 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@236 -- # ip link set nvmf_tgt_br2 nomaster 00:11:56.250 11:22:37 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@237 -- # ip link set nvmf_init_br down 00:11:56.250 11:22:37 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@238 -- # ip link set nvmf_init_br2 down 00:11:56.250 11:22:37 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@239 -- # ip link set nvmf_tgt_br down 00:11:56.250 11:22:37 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@240 -- # ip link set nvmf_tgt_br2 down 00:11:56.250 11:22:37 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@241 -- # ip link delete nvmf_br type bridge 00:11:56.250 11:22:37 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@242 -- # ip link delete nvmf_init_if 00:11:56.250 11:22:37 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@243 -- # ip link delete nvmf_init_if2 00:11:56.250 11:22:37 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@244 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:11:56.250 11:22:37 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@245 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:11:56.250 11:22:37 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@246 -- # remove_spdk_ns 00:11:56.250 11:22:37 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:56.250 11:22:37 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:11:56.250 11:22:37 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:56.250 11:22:37 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- nvmf/common.sh@300 -- # return 0 00:11:56.250 00:11:56.250 real 0m20.393s 00:11:56.250 user 0m32.523s 00:11:56.250 sys 0m3.429s 00:11:56.250 11:22:37 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@1126 -- # xtrace_disable 00:11:56.250 11:22:37 nvmf_tcp.nvmf_target_extra.nvmf_ns_masking -- common/autotest_common.sh@10 -- # set +x 00:11:56.250 ************************************ 00:11:56.250 END TEST nvmf_ns_masking 00:11:56.250 ************************************ 00:11:56.250 11:22:37 nvmf_tcp.nvmf_target_extra -- nvmf/nvmf_target_extra.sh@27 -- # [[ 0 -eq 1 ]] 00:11:56.250 11:22:37 nvmf_tcp.nvmf_target_extra -- nvmf/nvmf_target_extra.sh@30 -- # [[ 0 -eq 1 ]] 00:11:56.250 11:22:37 nvmf_tcp.nvmf_target_extra -- nvmf/nvmf_target_extra.sh@37 -- # run_test nvmf_auth_target /home/vagrant/spdk_repo/spdk/test/nvmf/target/auth.sh --transport=tcp 00:11:56.250 11:22:37 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:11:56.250 11:22:37 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1107 -- # xtrace_disable 00:11:56.250 11:22:37 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@10 -- # set +x 00:11:56.250 ************************************ 00:11:56.250 START TEST nvmf_auth_target 00:11:56.250 ************************************ 00:11:56.250 11:22:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/nvmf/target/auth.sh --transport=tcp 00:11:56.509 * Looking for test storage... 00:11:56.509 * Found test storage at /home/vagrant/spdk_repo/spdk/test/nvmf/target 00:11:56.509 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:11:56.509 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@1681 -- # lcov --version 00:11:56.509 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:11:56.509 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:11:56.509 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:11:56.509 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- scripts/common.sh@333 -- # local ver1 ver1_l 00:11:56.509 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- scripts/common.sh@334 -- # local ver2 ver2_l 00:11:56.509 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- scripts/common.sh@336 -- # IFS=.-: 00:11:56.509 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- scripts/common.sh@336 -- # read -ra ver1 00:11:56.509 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- scripts/common.sh@337 -- # IFS=.-: 00:11:56.509 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- scripts/common.sh@337 -- # read -ra ver2 00:11:56.509 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- scripts/common.sh@338 -- # local 'op=<' 00:11:56.509 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- scripts/common.sh@340 -- # ver1_l=2 00:11:56.509 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- scripts/common.sh@341 -- # ver2_l=1 00:11:56.509 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:11:56.509 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- scripts/common.sh@344 -- # case "$op" in 00:11:56.509 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- scripts/common.sh@345 -- # : 1 00:11:56.509 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- scripts/common.sh@364 -- # (( v = 0 )) 00:11:56.509 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:11:56.509 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- scripts/common.sh@365 -- # decimal 1 00:11:56.509 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- scripts/common.sh@353 -- # local d=1 00:11:56.509 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:11:56.509 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- scripts/common.sh@355 -- # echo 1 00:11:56.509 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- scripts/common.sh@365 -- # ver1[v]=1 00:11:56.509 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- scripts/common.sh@366 -- # decimal 2 00:11:56.509 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- scripts/common.sh@353 -- # local d=2 00:11:56.509 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:11:56.509 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- scripts/common.sh@355 -- # echo 2 00:11:56.509 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- scripts/common.sh@366 -- # ver2[v]=2 00:11:56.509 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:11:56.509 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:11:56.509 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- scripts/common.sh@368 -- # return 0 00:11:56.509 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:11:56.509 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:11:56.509 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:56.509 --rc genhtml_branch_coverage=1 00:11:56.509 --rc genhtml_function_coverage=1 00:11:56.509 --rc genhtml_legend=1 00:11:56.509 --rc geninfo_all_blocks=1 00:11:56.509 --rc geninfo_unexecuted_blocks=1 00:11:56.509 00:11:56.509 ' 00:11:56.509 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:11:56.509 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:56.509 --rc genhtml_branch_coverage=1 00:11:56.509 --rc genhtml_function_coverage=1 00:11:56.509 --rc genhtml_legend=1 00:11:56.510 --rc geninfo_all_blocks=1 00:11:56.510 --rc geninfo_unexecuted_blocks=1 00:11:56.510 00:11:56.510 ' 00:11:56.510 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:11:56.510 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:56.510 --rc genhtml_branch_coverage=1 00:11:56.510 --rc genhtml_function_coverage=1 00:11:56.510 --rc genhtml_legend=1 00:11:56.510 --rc geninfo_all_blocks=1 00:11:56.510 --rc geninfo_unexecuted_blocks=1 00:11:56.510 00:11:56.510 ' 00:11:56.510 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:11:56.510 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:56.510 --rc genhtml_branch_coverage=1 00:11:56.510 --rc genhtml_function_coverage=1 00:11:56.510 --rc genhtml_legend=1 00:11:56.510 --rc geninfo_all_blocks=1 00:11:56.510 --rc geninfo_unexecuted_blocks=1 00:11:56.510 00:11:56.510 ' 00:11:56.510 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@10 -- # source /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh 00:11:56.510 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@7 -- # uname -s 00:11:56.510 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:11:56.510 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:11:56.510 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:11:56.510 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:11:56.510 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:11:56.510 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:11:56.510 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:11:56.510 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:11:56.510 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:11:56.510 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:11:56.510 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:11:56.510 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@18 -- # NVME_HOSTID=3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:11:56.510 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:11:56.510 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:11:56.510 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@21 -- # NET_TYPE=virt 00:11:56.510 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:11:56.510 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@49 -- # source /home/vagrant/spdk_repo/spdk/scripts/common.sh 00:11:56.510 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- scripts/common.sh@15 -- # shopt -s extglob 00:11:56.510 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:11:56.510 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:11:56.510 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:11:56.510 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:56.510 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:56.510 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:56.510 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- paths/export.sh@5 -- # export PATH 00:11:56.510 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:56.510 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@51 -- # : 0 00:11:56.510 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:11:56.510 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:11:56.510 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:11:56.510 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:11:56.510 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:11:56.510 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:11:56.510 /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:11:56.510 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:11:56.510 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:11:56.510 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@55 -- # have_pci_nics=0 00:11:56.510 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@13 -- # digests=("sha256" "sha384" "sha512") 00:11:56.510 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@14 -- # dhgroups=("null" "ffdhe2048" "ffdhe3072" "ffdhe4096" "ffdhe6144" "ffdhe8192") 00:11:56.510 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@15 -- # subnqn=nqn.2024-03.io.spdk:cnode0 00:11:56.510 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@16 -- # hostnqn=nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:11:56.510 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@17 -- # hostsock=/var/tmp/host.sock 00:11:56.510 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@18 -- # keys=() 00:11:56.510 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@18 -- # ckeys=() 00:11:56.510 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@86 -- # nvmftestinit 00:11:56.510 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:11:56.510 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:11:56.510 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@474 -- # prepare_net_devs 00:11:56.510 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@436 -- # local -g is_hw=no 00:11:56.510 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@438 -- # remove_spdk_ns 00:11:56.510 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:56.510 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:11:56.510 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:56.510 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@440 -- # [[ virt != virt ]] 00:11:56.510 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@442 -- # [[ no == yes ]] 00:11:56.510 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@449 -- # [[ virt == phy ]] 00:11:56.510 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@452 -- # [[ virt == phy-fallback ]] 00:11:56.510 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@457 -- # [[ tcp == tcp ]] 00:11:56.510 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@458 -- # nvmf_veth_init 00:11:56.510 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@145 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:11:56.510 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@146 -- # NVMF_SECOND_INITIATOR_IP=10.0.0.2 00:11:56.510 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@147 -- # NVMF_FIRST_TARGET_IP=10.0.0.3 00:11:56.510 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@148 -- # NVMF_SECOND_TARGET_IP=10.0.0.4 00:11:56.510 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@149 -- # NVMF_INITIATOR_IP=10.0.0.1 00:11:56.510 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@150 -- # NVMF_BRIDGE=nvmf_br 00:11:56.510 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@151 -- # NVMF_INITIATOR_INTERFACE=nvmf_init_if 00:11:56.510 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@152 -- # NVMF_INITIATOR_INTERFACE2=nvmf_init_if2 00:11:56.510 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@153 -- # NVMF_INITIATOR_BRIDGE=nvmf_init_br 00:11:56.510 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@154 -- # NVMF_INITIATOR_BRIDGE2=nvmf_init_br2 00:11:56.510 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@155 -- # NVMF_TARGET_NAMESPACE=nvmf_tgt_ns_spdk 00:11:56.510 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@156 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:11:56.510 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@157 -- # NVMF_TARGET_INTERFACE=nvmf_tgt_if 00:11:56.510 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@158 -- # NVMF_TARGET_INTERFACE2=nvmf_tgt_if2 00:11:56.510 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@159 -- # NVMF_TARGET_BRIDGE=nvmf_tgt_br 00:11:56.510 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@160 -- # NVMF_TARGET_BRIDGE2=nvmf_tgt_br2 00:11:56.510 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@162 -- # ip link set nvmf_init_br nomaster 00:11:56.510 Cannot find device "nvmf_init_br" 00:11:56.510 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@162 -- # true 00:11:56.510 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@163 -- # ip link set nvmf_init_br2 nomaster 00:11:56.510 Cannot find device "nvmf_init_br2" 00:11:56.510 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@163 -- # true 00:11:56.511 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@164 -- # ip link set nvmf_tgt_br nomaster 00:11:56.511 Cannot find device "nvmf_tgt_br" 00:11:56.511 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@164 -- # true 00:11:56.511 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@165 -- # ip link set nvmf_tgt_br2 nomaster 00:11:56.511 Cannot find device "nvmf_tgt_br2" 00:11:56.511 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@165 -- # true 00:11:56.511 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@166 -- # ip link set nvmf_init_br down 00:11:56.511 Cannot find device "nvmf_init_br" 00:11:56.511 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@166 -- # true 00:11:56.511 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@167 -- # ip link set nvmf_init_br2 down 00:11:56.769 Cannot find device "nvmf_init_br2" 00:11:56.769 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@167 -- # true 00:11:56.769 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@168 -- # ip link set nvmf_tgt_br down 00:11:56.769 Cannot find device "nvmf_tgt_br" 00:11:56.769 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@168 -- # true 00:11:56.769 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@169 -- # ip link set nvmf_tgt_br2 down 00:11:56.769 Cannot find device "nvmf_tgt_br2" 00:11:56.769 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@169 -- # true 00:11:56.769 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@170 -- # ip link delete nvmf_br type bridge 00:11:56.769 Cannot find device "nvmf_br" 00:11:56.769 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@170 -- # true 00:11:56.769 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@171 -- # ip link delete nvmf_init_if 00:11:56.769 Cannot find device "nvmf_init_if" 00:11:56.769 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@171 -- # true 00:11:56.769 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@172 -- # ip link delete nvmf_init_if2 00:11:56.769 Cannot find device "nvmf_init_if2" 00:11:56.769 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@172 -- # true 00:11:56.769 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@173 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:11:56.769 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:11:56.769 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@173 -- # true 00:11:56.769 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@174 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:11:56.769 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:11:56.769 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@174 -- # true 00:11:56.769 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@177 -- # ip netns add nvmf_tgt_ns_spdk 00:11:56.769 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@180 -- # ip link add nvmf_init_if type veth peer name nvmf_init_br 00:11:56.769 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@181 -- # ip link add nvmf_init_if2 type veth peer name nvmf_init_br2 00:11:56.769 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@182 -- # ip link add nvmf_tgt_if type veth peer name nvmf_tgt_br 00:11:56.769 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@183 -- # ip link add nvmf_tgt_if2 type veth peer name nvmf_tgt_br2 00:11:56.769 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@186 -- # ip link set nvmf_tgt_if netns nvmf_tgt_ns_spdk 00:11:56.769 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@187 -- # ip link set nvmf_tgt_if2 netns nvmf_tgt_ns_spdk 00:11:56.769 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@190 -- # ip addr add 10.0.0.1/24 dev nvmf_init_if 00:11:56.769 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@191 -- # ip addr add 10.0.0.2/24 dev nvmf_init_if2 00:11:56.769 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@192 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.3/24 dev nvmf_tgt_if 00:11:56.769 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@193 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.4/24 dev nvmf_tgt_if2 00:11:56.769 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@196 -- # ip link set nvmf_init_if up 00:11:56.769 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@197 -- # ip link set nvmf_init_if2 up 00:11:56.769 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@198 -- # ip link set nvmf_init_br up 00:11:56.769 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@199 -- # ip link set nvmf_init_br2 up 00:11:56.769 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@200 -- # ip link set nvmf_tgt_br up 00:11:56.769 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@201 -- # ip link set nvmf_tgt_br2 up 00:11:56.769 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@202 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if up 00:11:56.769 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@203 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if2 up 00:11:56.769 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@204 -- # ip netns exec nvmf_tgt_ns_spdk ip link set lo up 00:11:56.769 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@207 -- # ip link add nvmf_br type bridge 00:11:56.769 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@208 -- # ip link set nvmf_br up 00:11:56.769 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@211 -- # ip link set nvmf_init_br master nvmf_br 00:11:57.027 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@212 -- # ip link set nvmf_init_br2 master nvmf_br 00:11:57.027 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@213 -- # ip link set nvmf_tgt_br master nvmf_br 00:11:57.027 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@214 -- # ip link set nvmf_tgt_br2 master nvmf_br 00:11:57.027 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@217 -- # ipts -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT 00:11:57.027 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT' 00:11:57.027 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@218 -- # ipts -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT 00:11:57.028 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT' 00:11:57.028 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@219 -- # ipts -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT 00:11:57.028 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@788 -- # iptables -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT -m comment --comment 'SPDK_NVMF:-A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT' 00:11:57.028 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@222 -- # ping -c 1 10.0.0.3 00:11:57.028 PING 10.0.0.3 (10.0.0.3) 56(84) bytes of data. 00:11:57.028 64 bytes from 10.0.0.3: icmp_seq=1 ttl=64 time=0.109 ms 00:11:57.028 00:11:57.028 --- 10.0.0.3 ping statistics --- 00:11:57.028 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:57.028 rtt min/avg/max/mdev = 0.109/0.109/0.109/0.000 ms 00:11:57.028 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@223 -- # ping -c 1 10.0.0.4 00:11:57.028 PING 10.0.0.4 (10.0.0.4) 56(84) bytes of data. 00:11:57.028 64 bytes from 10.0.0.4: icmp_seq=1 ttl=64 time=0.054 ms 00:11:57.028 00:11:57.028 --- 10.0.0.4 ping statistics --- 00:11:57.028 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:57.028 rtt min/avg/max/mdev = 0.054/0.054/0.054/0.000 ms 00:11:57.028 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@224 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.1 00:11:57.028 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:11:57.028 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.026 ms 00:11:57.028 00:11:57.028 --- 10.0.0.1 ping statistics --- 00:11:57.028 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:57.028 rtt min/avg/max/mdev = 0.026/0.026/0.026/0.000 ms 00:11:57.028 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@225 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.2 00:11:57.028 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:11:57.028 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.058 ms 00:11:57.028 00:11:57.028 --- 10.0.0.2 ping statistics --- 00:11:57.028 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:57.028 rtt min/avg/max/mdev = 0.058/0.058/0.058/0.000 ms 00:11:57.028 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@227 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:11:57.028 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@459 -- # return 0 00:11:57.028 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:11:57.028 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:11:57.028 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:11:57.028 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:11:57.028 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:11:57.028 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:11:57.028 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:11:57.028 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@87 -- # nvmfappstart -L nvmf_auth 00:11:57.028 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:11:57.028 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@724 -- # xtrace_disable 00:11:57.028 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:11:57.028 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@507 -- # nvmfpid=76912 00:11:57.028 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@506 -- # ip netns exec nvmf_tgt_ns_spdk /home/vagrant/spdk_repo/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -L nvmf_auth 00:11:57.028 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@508 -- # waitforlisten 76912 00:11:57.028 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@831 -- # '[' -z 76912 ']' 00:11:57.028 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:11:57.028 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@836 -- # local max_retries=100 00:11:57.028 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:11:57.028 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@840 -- # xtrace_disable 00:11:57.028 11:22:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:11:58.404 11:22:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:11:58.404 11:22:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@864 -- # return 0 00:11:58.404 11:22:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:11:58.404 11:22:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@730 -- # xtrace_disable 00:11:58.404 11:22:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:11:58.404 11:22:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:11:58.404 11:22:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@89 -- # hostpid=76956 00:11:58.404 11:22:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@88 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_tgt -m 2 -r /var/tmp/host.sock -L nvme_auth 00:11:58.404 11:22:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@91 -- # trap 'dumplogs; cleanup' SIGINT SIGTERM EXIT 00:11:58.404 11:22:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@94 -- # gen_dhchap_key null 48 00:11:58.404 11:22:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@749 -- # local digest len file key 00:11:58.404 11:22:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@750 -- # digests=(['null']='0' ['sha256']='1' ['sha384']='2' ['sha512']='3') 00:11:58.404 11:22:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@750 -- # local -A digests 00:11:58.404 11:22:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@752 -- # digest=null 00:11:58.404 11:22:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@752 -- # len=48 00:11:58.404 11:22:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@753 -- # xxd -p -c0 -l 24 /dev/urandom 00:11:58.404 11:22:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@753 -- # key=b44ed363c143bfd02d3afc221122f40a10005d9ef64a660c 00:11:58.404 11:22:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@754 -- # mktemp -t spdk.key-null.XXX 00:11:58.404 11:22:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@754 -- # file=/tmp/spdk.key-null.93D 00:11:58.404 11:22:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@755 -- # format_dhchap_key b44ed363c143bfd02d3afc221122f40a10005d9ef64a660c 0 00:11:58.404 11:22:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@745 -- # format_key DHHC-1 b44ed363c143bfd02d3afc221122f40a10005d9ef64a660c 0 00:11:58.404 11:22:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@728 -- # local prefix key digest 00:11:58.404 11:22:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@730 -- # prefix=DHHC-1 00:11:58.404 11:22:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@730 -- # key=b44ed363c143bfd02d3afc221122f40a10005d9ef64a660c 00:11:58.404 11:22:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@730 -- # digest=0 00:11:58.404 11:22:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@731 -- # python - 00:11:58.404 11:22:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@756 -- # chmod 0600 /tmp/spdk.key-null.93D 00:11:58.404 11:22:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@758 -- # echo /tmp/spdk.key-null.93D 00:11:58.404 11:22:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@94 -- # keys[0]=/tmp/spdk.key-null.93D 00:11:58.404 11:22:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@94 -- # gen_dhchap_key sha512 64 00:11:58.404 11:22:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@749 -- # local digest len file key 00:11:58.404 11:22:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@750 -- # digests=(['null']='0' ['sha256']='1' ['sha384']='2' ['sha512']='3') 00:11:58.404 11:22:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@750 -- # local -A digests 00:11:58.404 11:22:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@752 -- # digest=sha512 00:11:58.404 11:22:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@752 -- # len=64 00:11:58.404 11:22:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@753 -- # xxd -p -c0 -l 32 /dev/urandom 00:11:58.404 11:22:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@753 -- # key=430dbcef9ea303181521e9c2092a3ec04b97dc602e04891a5e02223a8dec1e9c 00:11:58.404 11:22:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@754 -- # mktemp -t spdk.key-sha512.XXX 00:11:58.404 11:22:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@754 -- # file=/tmp/spdk.key-sha512.CCs 00:11:58.404 11:22:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@755 -- # format_dhchap_key 430dbcef9ea303181521e9c2092a3ec04b97dc602e04891a5e02223a8dec1e9c 3 00:11:58.405 11:22:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@745 -- # format_key DHHC-1 430dbcef9ea303181521e9c2092a3ec04b97dc602e04891a5e02223a8dec1e9c 3 00:11:58.405 11:22:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@728 -- # local prefix key digest 00:11:58.405 11:22:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@730 -- # prefix=DHHC-1 00:11:58.405 11:22:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@730 -- # key=430dbcef9ea303181521e9c2092a3ec04b97dc602e04891a5e02223a8dec1e9c 00:11:58.405 11:22:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@730 -- # digest=3 00:11:58.405 11:22:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@731 -- # python - 00:11:58.405 11:22:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@756 -- # chmod 0600 /tmp/spdk.key-sha512.CCs 00:11:58.405 11:22:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@758 -- # echo /tmp/spdk.key-sha512.CCs 00:11:58.405 11:22:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@94 -- # ckeys[0]=/tmp/spdk.key-sha512.CCs 00:11:58.405 11:22:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@95 -- # gen_dhchap_key sha256 32 00:11:58.405 11:22:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@749 -- # local digest len file key 00:11:58.405 11:22:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@750 -- # digests=(['null']='0' ['sha256']='1' ['sha384']='2' ['sha512']='3') 00:11:58.405 11:22:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@750 -- # local -A digests 00:11:58.405 11:22:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@752 -- # digest=sha256 00:11:58.405 11:22:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@752 -- # len=32 00:11:58.405 11:22:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@753 -- # xxd -p -c0 -l 16 /dev/urandom 00:11:58.405 11:22:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@753 -- # key=7ed1748805d1e345999600956d9da7c1 00:11:58.405 11:22:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@754 -- # mktemp -t spdk.key-sha256.XXX 00:11:58.405 11:22:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@754 -- # file=/tmp/spdk.key-sha256.t6V 00:11:58.405 11:22:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@755 -- # format_dhchap_key 7ed1748805d1e345999600956d9da7c1 1 00:11:58.405 11:22:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@745 -- # format_key DHHC-1 7ed1748805d1e345999600956d9da7c1 1 00:11:58.405 11:22:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@728 -- # local prefix key digest 00:11:58.405 11:22:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@730 -- # prefix=DHHC-1 00:11:58.405 11:22:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@730 -- # key=7ed1748805d1e345999600956d9da7c1 00:11:58.405 11:22:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@730 -- # digest=1 00:11:58.405 11:22:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@731 -- # python - 00:11:58.405 11:22:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@756 -- # chmod 0600 /tmp/spdk.key-sha256.t6V 00:11:58.405 11:22:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@758 -- # echo /tmp/spdk.key-sha256.t6V 00:11:58.405 11:22:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@95 -- # keys[1]=/tmp/spdk.key-sha256.t6V 00:11:58.405 11:22:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@95 -- # gen_dhchap_key sha384 48 00:11:58.405 11:22:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@749 -- # local digest len file key 00:11:58.405 11:22:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@750 -- # digests=(['null']='0' ['sha256']='1' ['sha384']='2' ['sha512']='3') 00:11:58.405 11:22:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@750 -- # local -A digests 00:11:58.405 11:22:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@752 -- # digest=sha384 00:11:58.405 11:22:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@752 -- # len=48 00:11:58.405 11:22:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@753 -- # xxd -p -c0 -l 24 /dev/urandom 00:11:58.405 11:22:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@753 -- # key=328641b5658e1697f7080bc4021d662ed8d24047c35bed3b 00:11:58.405 11:22:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@754 -- # mktemp -t spdk.key-sha384.XXX 00:11:58.405 11:22:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@754 -- # file=/tmp/spdk.key-sha384.PMi 00:11:58.405 11:22:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@755 -- # format_dhchap_key 328641b5658e1697f7080bc4021d662ed8d24047c35bed3b 2 00:11:58.405 11:22:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@745 -- # format_key DHHC-1 328641b5658e1697f7080bc4021d662ed8d24047c35bed3b 2 00:11:58.405 11:22:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@728 -- # local prefix key digest 00:11:58.405 11:22:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@730 -- # prefix=DHHC-1 00:11:58.405 11:22:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@730 -- # key=328641b5658e1697f7080bc4021d662ed8d24047c35bed3b 00:11:58.405 11:22:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@730 -- # digest=2 00:11:58.405 11:22:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@731 -- # python - 00:11:58.405 11:22:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@756 -- # chmod 0600 /tmp/spdk.key-sha384.PMi 00:11:58.405 11:22:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@758 -- # echo /tmp/spdk.key-sha384.PMi 00:11:58.405 11:22:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@95 -- # ckeys[1]=/tmp/spdk.key-sha384.PMi 00:11:58.405 11:22:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@96 -- # gen_dhchap_key sha384 48 00:11:58.405 11:22:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@749 -- # local digest len file key 00:11:58.405 11:22:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@750 -- # digests=(['null']='0' ['sha256']='1' ['sha384']='2' ['sha512']='3') 00:11:58.405 11:22:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@750 -- # local -A digests 00:11:58.405 11:22:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@752 -- # digest=sha384 00:11:58.405 11:22:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@752 -- # len=48 00:11:58.405 11:22:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@753 -- # xxd -p -c0 -l 24 /dev/urandom 00:11:58.405 11:22:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@753 -- # key=8a006fc97a899b4fbeb5b6b6bd37ebb6b88b138213cfebe3 00:11:58.405 11:22:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@754 -- # mktemp -t spdk.key-sha384.XXX 00:11:58.663 11:22:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@754 -- # file=/tmp/spdk.key-sha384.F4n 00:11:58.663 11:22:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@755 -- # format_dhchap_key 8a006fc97a899b4fbeb5b6b6bd37ebb6b88b138213cfebe3 2 00:11:58.663 11:22:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@745 -- # format_key DHHC-1 8a006fc97a899b4fbeb5b6b6bd37ebb6b88b138213cfebe3 2 00:11:58.664 11:22:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@728 -- # local prefix key digest 00:11:58.664 11:22:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@730 -- # prefix=DHHC-1 00:11:58.664 11:22:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@730 -- # key=8a006fc97a899b4fbeb5b6b6bd37ebb6b88b138213cfebe3 00:11:58.664 11:22:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@730 -- # digest=2 00:11:58.664 11:22:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@731 -- # python - 00:11:58.664 11:22:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@756 -- # chmod 0600 /tmp/spdk.key-sha384.F4n 00:11:58.664 11:22:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@758 -- # echo /tmp/spdk.key-sha384.F4n 00:11:58.664 11:22:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@96 -- # keys[2]=/tmp/spdk.key-sha384.F4n 00:11:58.664 11:22:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@96 -- # gen_dhchap_key sha256 32 00:11:58.664 11:22:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@749 -- # local digest len file key 00:11:58.664 11:22:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@750 -- # digests=(['null']='0' ['sha256']='1' ['sha384']='2' ['sha512']='3') 00:11:58.664 11:22:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@750 -- # local -A digests 00:11:58.664 11:22:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@752 -- # digest=sha256 00:11:58.664 11:22:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@752 -- # len=32 00:11:58.664 11:22:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@753 -- # xxd -p -c0 -l 16 /dev/urandom 00:11:58.664 11:22:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@753 -- # key=17162fe87a31bf2d04baacd43f78d078 00:11:58.664 11:22:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@754 -- # mktemp -t spdk.key-sha256.XXX 00:11:58.664 11:22:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@754 -- # file=/tmp/spdk.key-sha256.PKN 00:11:58.664 11:22:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@755 -- # format_dhchap_key 17162fe87a31bf2d04baacd43f78d078 1 00:11:58.664 11:22:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@745 -- # format_key DHHC-1 17162fe87a31bf2d04baacd43f78d078 1 00:11:58.664 11:22:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@728 -- # local prefix key digest 00:11:58.664 11:22:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@730 -- # prefix=DHHC-1 00:11:58.664 11:22:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@730 -- # key=17162fe87a31bf2d04baacd43f78d078 00:11:58.664 11:22:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@730 -- # digest=1 00:11:58.664 11:22:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@731 -- # python - 00:11:58.664 11:22:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@756 -- # chmod 0600 /tmp/spdk.key-sha256.PKN 00:11:58.664 11:22:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@758 -- # echo /tmp/spdk.key-sha256.PKN 00:11:58.664 11:22:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@96 -- # ckeys[2]=/tmp/spdk.key-sha256.PKN 00:11:58.664 11:22:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@97 -- # gen_dhchap_key sha512 64 00:11:58.664 11:22:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@749 -- # local digest len file key 00:11:58.664 11:22:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@750 -- # digests=(['null']='0' ['sha256']='1' ['sha384']='2' ['sha512']='3') 00:11:58.664 11:22:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@750 -- # local -A digests 00:11:58.664 11:22:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@752 -- # digest=sha512 00:11:58.664 11:22:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@752 -- # len=64 00:11:58.664 11:22:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@753 -- # xxd -p -c0 -l 32 /dev/urandom 00:11:58.664 11:22:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@753 -- # key=7e5aa4dd8bdd56cad41641c694302dda2d4cb31baa958b5c1ea0bdc8e2f770de 00:11:58.664 11:22:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@754 -- # mktemp -t spdk.key-sha512.XXX 00:11:58.664 11:22:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@754 -- # file=/tmp/spdk.key-sha512.sgX 00:11:58.664 11:22:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@755 -- # format_dhchap_key 7e5aa4dd8bdd56cad41641c694302dda2d4cb31baa958b5c1ea0bdc8e2f770de 3 00:11:58.664 11:22:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@745 -- # format_key DHHC-1 7e5aa4dd8bdd56cad41641c694302dda2d4cb31baa958b5c1ea0bdc8e2f770de 3 00:11:58.664 11:22:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@728 -- # local prefix key digest 00:11:58.664 11:22:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@730 -- # prefix=DHHC-1 00:11:58.664 11:22:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@730 -- # key=7e5aa4dd8bdd56cad41641c694302dda2d4cb31baa958b5c1ea0bdc8e2f770de 00:11:58.664 11:22:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@730 -- # digest=3 00:11:58.664 11:22:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@731 -- # python - 00:11:58.664 11:22:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@756 -- # chmod 0600 /tmp/spdk.key-sha512.sgX 00:11:58.664 11:22:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@758 -- # echo /tmp/spdk.key-sha512.sgX 00:11:58.664 11:22:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@97 -- # keys[3]=/tmp/spdk.key-sha512.sgX 00:11:58.664 11:22:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@97 -- # ckeys[3]= 00:11:58.664 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:11:58.664 11:22:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@99 -- # waitforlisten 76912 00:11:58.664 11:22:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@831 -- # '[' -z 76912 ']' 00:11:58.664 11:22:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:11:58.664 11:22:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@836 -- # local max_retries=100 00:11:58.664 11:22:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:11:58.664 11:22:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@840 -- # xtrace_disable 00:11:58.664 11:22:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:11:59.230 11:22:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:11:59.230 11:22:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@864 -- # return 0 00:11:59.230 11:22:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@100 -- # waitforlisten 76956 /var/tmp/host.sock 00:11:59.230 11:22:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@831 -- # '[' -z 76956 ']' 00:11:59.230 11:22:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/host.sock 00:11:59.231 11:22:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@836 -- # local max_retries=100 00:11:59.231 11:22:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/host.sock...' 00:11:59.231 Waiting for process to start up and listen on UNIX domain socket /var/tmp/host.sock... 00:11:59.231 11:22:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@840 -- # xtrace_disable 00:11:59.231 11:22:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:11:59.231 11:22:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:11:59.231 11:22:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@864 -- # return 0 00:11:59.231 11:22:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@101 -- # rpc_cmd 00:11:59.231 11:22:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:59.231 11:22:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:11:59.488 11:22:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:59.488 11:22:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@108 -- # for i in "${!keys[@]}" 00:11:59.488 11:22:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@109 -- # rpc_cmd keyring_file_add_key key0 /tmp/spdk.key-null.93D 00:11:59.488 11:22:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:59.488 11:22:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:11:59.488 11:22:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:59.488 11:22:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@110 -- # hostrpc keyring_file_add_key key0 /tmp/spdk.key-null.93D 00:11:59.488 11:22:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock keyring_file_add_key key0 /tmp/spdk.key-null.93D 00:11:59.746 11:22:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@111 -- # [[ -n /tmp/spdk.key-sha512.CCs ]] 00:11:59.747 11:22:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@112 -- # rpc_cmd keyring_file_add_key ckey0 /tmp/spdk.key-sha512.CCs 00:11:59.747 11:22:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:11:59.747 11:22:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:11:59.747 11:22:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:11:59.747 11:22:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@113 -- # hostrpc keyring_file_add_key ckey0 /tmp/spdk.key-sha512.CCs 00:11:59.747 11:22:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock keyring_file_add_key ckey0 /tmp/spdk.key-sha512.CCs 00:12:00.005 11:22:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@108 -- # for i in "${!keys[@]}" 00:12:00.005 11:22:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@109 -- # rpc_cmd keyring_file_add_key key1 /tmp/spdk.key-sha256.t6V 00:12:00.005 11:22:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:00.005 11:22:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:00.005 11:22:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:00.005 11:22:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@110 -- # hostrpc keyring_file_add_key key1 /tmp/spdk.key-sha256.t6V 00:12:00.005 11:22:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock keyring_file_add_key key1 /tmp/spdk.key-sha256.t6V 00:12:00.263 11:22:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@111 -- # [[ -n /tmp/spdk.key-sha384.PMi ]] 00:12:00.263 11:22:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@112 -- # rpc_cmd keyring_file_add_key ckey1 /tmp/spdk.key-sha384.PMi 00:12:00.263 11:22:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:00.263 11:22:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:00.263 11:22:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:00.263 11:22:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@113 -- # hostrpc keyring_file_add_key ckey1 /tmp/spdk.key-sha384.PMi 00:12:00.263 11:22:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock keyring_file_add_key ckey1 /tmp/spdk.key-sha384.PMi 00:12:00.522 11:22:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@108 -- # for i in "${!keys[@]}" 00:12:00.522 11:22:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@109 -- # rpc_cmd keyring_file_add_key key2 /tmp/spdk.key-sha384.F4n 00:12:00.522 11:22:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:00.522 11:22:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:00.522 11:22:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:00.522 11:22:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@110 -- # hostrpc keyring_file_add_key key2 /tmp/spdk.key-sha384.F4n 00:12:00.522 11:22:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock keyring_file_add_key key2 /tmp/spdk.key-sha384.F4n 00:12:01.089 11:22:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@111 -- # [[ -n /tmp/spdk.key-sha256.PKN ]] 00:12:01.089 11:22:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@112 -- # rpc_cmd keyring_file_add_key ckey2 /tmp/spdk.key-sha256.PKN 00:12:01.089 11:22:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:01.089 11:22:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:01.089 11:22:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:01.089 11:22:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@113 -- # hostrpc keyring_file_add_key ckey2 /tmp/spdk.key-sha256.PKN 00:12:01.089 11:22:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock keyring_file_add_key ckey2 /tmp/spdk.key-sha256.PKN 00:12:01.089 11:22:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@108 -- # for i in "${!keys[@]}" 00:12:01.089 11:22:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@109 -- # rpc_cmd keyring_file_add_key key3 /tmp/spdk.key-sha512.sgX 00:12:01.089 11:22:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:01.089 11:22:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:01.354 11:22:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:01.354 11:22:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@110 -- # hostrpc keyring_file_add_key key3 /tmp/spdk.key-sha512.sgX 00:12:01.354 11:22:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock keyring_file_add_key key3 /tmp/spdk.key-sha512.sgX 00:12:01.613 11:22:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@111 -- # [[ -n '' ]] 00:12:01.613 11:22:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@118 -- # for digest in "${digests[@]}" 00:12:01.613 11:22:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@119 -- # for dhgroup in "${dhgroups[@]}" 00:12:01.613 11:22:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:12:01.613 11:22:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups null 00:12:01.613 11:22:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups null 00:12:01.871 11:22:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha256 null 0 00:12:01.871 11:22:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:12:01.871 11:22:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha256 00:12:01.871 11:22:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=null 00:12:01.871 11:22:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key0 00:12:01.871 11:22:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:12:01.871 11:22:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:12:01.871 11:22:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:01.871 11:22:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:01.871 11:22:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:01.871 11:22:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:12:01.871 11:22:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:12:01.871 11:22:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:12:02.128 00:12:02.128 11:22:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:12:02.128 11:22:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:12:02.128 11:22:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:12:02.695 11:22:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:12:02.695 11:22:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:12:02.695 11:22:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:02.695 11:22:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:02.695 11:22:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:02.695 11:22:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:12:02.695 { 00:12:02.695 "auth": { 00:12:02.695 "dhgroup": "null", 00:12:02.695 "digest": "sha256", 00:12:02.695 "state": "completed" 00:12:02.695 }, 00:12:02.695 "cntlid": 1, 00:12:02.695 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3", 00:12:02.695 "listen_address": { 00:12:02.695 "adrfam": "IPv4", 00:12:02.695 "traddr": "10.0.0.3", 00:12:02.695 "trsvcid": "4420", 00:12:02.695 "trtype": "TCP" 00:12:02.695 }, 00:12:02.695 "peer_address": { 00:12:02.695 "adrfam": "IPv4", 00:12:02.695 "traddr": "10.0.0.1", 00:12:02.695 "trsvcid": "38882", 00:12:02.695 "trtype": "TCP" 00:12:02.695 }, 00:12:02.695 "qid": 0, 00:12:02.695 "state": "enabled", 00:12:02.695 "thread": "nvmf_tgt_poll_group_000" 00:12:02.695 } 00:12:02.695 ]' 00:12:02.695 11:22:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:12:02.695 11:22:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha256 == \s\h\a\2\5\6 ]] 00:12:02.695 11:22:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:12:02.695 11:22:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ null == \n\u\l\l ]] 00:12:02.695 11:22:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:12:02.695 11:22:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:12:02.695 11:22:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:12:02.695 11:22:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:12:02.953 11:22:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:00:YjQ0ZWQzNjNjMTQzYmZkMDJkM2FmYzIyMTEyMmY0MGExMDAwNWQ5ZWY2NGE2NjBjPhDLOQ==: --dhchap-ctrl-secret DHHC-1:03:NDMwZGJjZWY5ZWEzMDMxODE1MjFlOWMyMDkyYTNlYzA0Yjk3ZGM2MDJlMDQ4OTFhNWUwMjIyM2E4ZGVjMWU5Y1IEScw=: 00:12:02.953 11:22:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --hostid 3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -l 0 --dhchap-secret DHHC-1:00:YjQ0ZWQzNjNjMTQzYmZkMDJkM2FmYzIyMTEyMmY0MGExMDAwNWQ5ZWY2NGE2NjBjPhDLOQ==: --dhchap-ctrl-secret DHHC-1:03:NDMwZGJjZWY5ZWEzMDMxODE1MjFlOWMyMDkyYTNlYzA0Yjk3ZGM2MDJlMDQ4OTFhNWUwMjIyM2E4ZGVjMWU5Y1IEScw=: 00:12:08.218 11:22:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:12:08.218 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:12:08.218 11:22:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:12:08.218 11:22:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:08.219 11:22:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:08.219 11:22:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:08.219 11:22:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:12:08.219 11:22:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups null 00:12:08.219 11:22:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups null 00:12:08.219 11:22:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha256 null 1 00:12:08.219 11:22:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:12:08.219 11:22:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha256 00:12:08.219 11:22:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=null 00:12:08.219 11:22:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key1 00:12:08.219 11:22:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:12:08.219 11:22:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:12:08.219 11:22:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:08.219 11:22:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:08.219 11:22:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:08.219 11:22:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:12:08.219 11:22:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:12:08.219 11:22:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:12:08.219 00:12:08.219 11:22:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:12:08.219 11:22:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:12:08.219 11:22:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:12:08.475 11:22:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:12:08.475 11:22:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:12:08.475 11:22:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:08.475 11:22:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:08.741 11:22:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:08.741 11:22:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:12:08.741 { 00:12:08.741 "auth": { 00:12:08.741 "dhgroup": "null", 00:12:08.741 "digest": "sha256", 00:12:08.741 "state": "completed" 00:12:08.741 }, 00:12:08.741 "cntlid": 3, 00:12:08.741 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3", 00:12:08.741 "listen_address": { 00:12:08.741 "adrfam": "IPv4", 00:12:08.741 "traddr": "10.0.0.3", 00:12:08.741 "trsvcid": "4420", 00:12:08.741 "trtype": "TCP" 00:12:08.741 }, 00:12:08.741 "peer_address": { 00:12:08.741 "adrfam": "IPv4", 00:12:08.741 "traddr": "10.0.0.1", 00:12:08.741 "trsvcid": "38904", 00:12:08.741 "trtype": "TCP" 00:12:08.741 }, 00:12:08.741 "qid": 0, 00:12:08.741 "state": "enabled", 00:12:08.741 "thread": "nvmf_tgt_poll_group_000" 00:12:08.741 } 00:12:08.741 ]' 00:12:08.741 11:22:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:12:08.741 11:22:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha256 == \s\h\a\2\5\6 ]] 00:12:08.741 11:22:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:12:08.741 11:22:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ null == \n\u\l\l ]] 00:12:08.741 11:22:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:12:08.741 11:22:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:12:08.741 11:22:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:12:08.741 11:22:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:12:08.999 11:22:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:01:N2VkMTc0ODgwNWQxZTM0NTk5OTYwMDk1NmQ5ZGE3YzEKeI3L: --dhchap-ctrl-secret DHHC-1:02:MzI4NjQxYjU2NThlMTY5N2Y3MDgwYmM0MDIxZDY2MmVkOGQyNDA0N2MzNWJlZDNicraO3Q==: 00:12:08.999 11:22:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --hostid 3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -l 0 --dhchap-secret DHHC-1:01:N2VkMTc0ODgwNWQxZTM0NTk5OTYwMDk1NmQ5ZGE3YzEKeI3L: --dhchap-ctrl-secret DHHC-1:02:MzI4NjQxYjU2NThlMTY5N2Y3MDgwYmM0MDIxZDY2MmVkOGQyNDA0N2MzNWJlZDNicraO3Q==: 00:12:09.932 11:22:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:12:09.932 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:12:09.932 11:22:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:12:09.932 11:22:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:09.932 11:22:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:09.932 11:22:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:09.932 11:22:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:12:09.932 11:22:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups null 00:12:09.932 11:22:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups null 00:12:10.189 11:22:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha256 null 2 00:12:10.189 11:22:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:12:10.189 11:22:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha256 00:12:10.189 11:22:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=null 00:12:10.189 11:22:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key2 00:12:10.189 11:22:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:12:10.189 11:22:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:12:10.189 11:22:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:10.189 11:22:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:10.189 11:22:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:10.189 11:22:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:12:10.189 11:22:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:12:10.189 11:22:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:12:10.447 00:12:10.447 11:22:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:12:10.447 11:22:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:12:10.447 11:22:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:12:10.704 11:22:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:12:10.704 11:22:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:12:10.704 11:22:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:10.704 11:22:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:10.704 11:22:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:10.704 11:22:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:12:10.704 { 00:12:10.704 "auth": { 00:12:10.704 "dhgroup": "null", 00:12:10.704 "digest": "sha256", 00:12:10.704 "state": "completed" 00:12:10.704 }, 00:12:10.704 "cntlid": 5, 00:12:10.704 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3", 00:12:10.704 "listen_address": { 00:12:10.704 "adrfam": "IPv4", 00:12:10.704 "traddr": "10.0.0.3", 00:12:10.704 "trsvcid": "4420", 00:12:10.704 "trtype": "TCP" 00:12:10.704 }, 00:12:10.704 "peer_address": { 00:12:10.704 "adrfam": "IPv4", 00:12:10.704 "traddr": "10.0.0.1", 00:12:10.704 "trsvcid": "50504", 00:12:10.704 "trtype": "TCP" 00:12:10.704 }, 00:12:10.704 "qid": 0, 00:12:10.704 "state": "enabled", 00:12:10.704 "thread": "nvmf_tgt_poll_group_000" 00:12:10.704 } 00:12:10.704 ]' 00:12:10.704 11:22:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:12:10.962 11:22:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha256 == \s\h\a\2\5\6 ]] 00:12:10.962 11:22:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:12:10.962 11:22:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ null == \n\u\l\l ]] 00:12:10.962 11:22:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:12:10.962 11:22:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:12:10.962 11:22:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:12:10.962 11:22:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:12:11.219 11:22:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:02:OGEwMDZmYzk3YTg5OWI0ZmJlYjViNmI2YmQzN2ViYjZiODhiMTM4MjEzY2ZlYmUzuaS9rg==: --dhchap-ctrl-secret DHHC-1:01:MTcxNjJmZTg3YTMxYmYyZDA0YmFhY2Q0M2Y3OGQwNzhGAzMl: 00:12:11.220 11:22:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --hostid 3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -l 0 --dhchap-secret DHHC-1:02:OGEwMDZmYzk3YTg5OWI0ZmJlYjViNmI2YmQzN2ViYjZiODhiMTM4MjEzY2ZlYmUzuaS9rg==: --dhchap-ctrl-secret DHHC-1:01:MTcxNjJmZTg3YTMxYmYyZDA0YmFhY2Q0M2Y3OGQwNzhGAzMl: 00:12:12.153 11:22:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:12:12.153 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:12:12.153 11:22:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:12:12.153 11:22:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:12.153 11:22:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:12.153 11:22:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:12.153 11:22:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:12:12.153 11:22:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups null 00:12:12.153 11:22:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups null 00:12:12.411 11:22:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha256 null 3 00:12:12.411 11:22:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:12:12.411 11:22:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha256 00:12:12.411 11:22:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=null 00:12:12.411 11:22:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key3 00:12:12.411 11:22:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:12:12.411 11:22:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --dhchap-key key3 00:12:12.411 11:22:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:12.411 11:22:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:12.411 11:22:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:12.411 11:22:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key3 00:12:12.411 11:22:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:12:12.411 11:22:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:12:12.669 00:12:12.669 11:22:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:12:12.669 11:22:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:12:12.669 11:22:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:12:12.927 11:22:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:12:12.927 11:22:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:12:12.927 11:22:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:12.927 11:22:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:12.927 11:22:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:12.927 11:22:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:12:12.927 { 00:12:12.927 "auth": { 00:12:12.927 "dhgroup": "null", 00:12:12.927 "digest": "sha256", 00:12:12.927 "state": "completed" 00:12:12.927 }, 00:12:12.927 "cntlid": 7, 00:12:12.927 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3", 00:12:12.927 "listen_address": { 00:12:12.927 "adrfam": "IPv4", 00:12:12.927 "traddr": "10.0.0.3", 00:12:12.927 "trsvcid": "4420", 00:12:12.927 "trtype": "TCP" 00:12:12.927 }, 00:12:12.927 "peer_address": { 00:12:12.927 "adrfam": "IPv4", 00:12:12.927 "traddr": "10.0.0.1", 00:12:12.927 "trsvcid": "50534", 00:12:12.927 "trtype": "TCP" 00:12:12.927 }, 00:12:12.927 "qid": 0, 00:12:12.927 "state": "enabled", 00:12:12.927 "thread": "nvmf_tgt_poll_group_000" 00:12:12.927 } 00:12:12.927 ]' 00:12:13.185 11:22:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:12:13.185 11:22:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha256 == \s\h\a\2\5\6 ]] 00:12:13.185 11:22:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:12:13.185 11:22:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ null == \n\u\l\l ]] 00:12:13.185 11:22:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:12:13.185 11:22:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:12:13.185 11:22:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:12:13.185 11:22:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:12:13.442 11:22:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:03:N2U1YWE0ZGQ4YmRkNTZjYWQ0MTY0MWM2OTQzMDJkZGEyZDRjYjMxYmFhOTU4YjVjMWVhMGJkYzhlMmY3NzBkZSCeOpc=: 00:12:13.442 11:22:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --hostid 3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -l 0 --dhchap-secret DHHC-1:03:N2U1YWE0ZGQ4YmRkNTZjYWQ0MTY0MWM2OTQzMDJkZGEyZDRjYjMxYmFhOTU4YjVjMWVhMGJkYzhlMmY3NzBkZSCeOpc=: 00:12:14.375 11:22:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:12:14.375 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:12:14.375 11:22:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:12:14.375 11:22:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:14.375 11:22:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:14.375 11:22:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:14.375 11:22:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@119 -- # for dhgroup in "${dhgroups[@]}" 00:12:14.375 11:22:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:12:14.375 11:22:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe2048 00:12:14.375 11:22:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe2048 00:12:14.633 11:22:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha256 ffdhe2048 0 00:12:14.633 11:22:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:12:14.633 11:22:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha256 00:12:14.633 11:22:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe2048 00:12:14.633 11:22:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key0 00:12:14.633 11:22:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:12:14.633 11:22:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:12:14.633 11:22:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:14.633 11:22:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:14.633 11:22:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:14.633 11:22:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:12:14.633 11:22:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:12:14.633 11:22:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:12:14.890 00:12:15.147 11:22:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:12:15.147 11:22:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:12:15.147 11:22:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:12:15.405 11:22:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:12:15.405 11:22:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:12:15.405 11:22:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:15.405 11:22:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:15.405 11:22:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:15.405 11:22:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:12:15.405 { 00:12:15.405 "auth": { 00:12:15.405 "dhgroup": "ffdhe2048", 00:12:15.405 "digest": "sha256", 00:12:15.405 "state": "completed" 00:12:15.405 }, 00:12:15.405 "cntlid": 9, 00:12:15.405 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3", 00:12:15.405 "listen_address": { 00:12:15.405 "adrfam": "IPv4", 00:12:15.405 "traddr": "10.0.0.3", 00:12:15.405 "trsvcid": "4420", 00:12:15.405 "trtype": "TCP" 00:12:15.405 }, 00:12:15.405 "peer_address": { 00:12:15.405 "adrfam": "IPv4", 00:12:15.405 "traddr": "10.0.0.1", 00:12:15.405 "trsvcid": "50548", 00:12:15.405 "trtype": "TCP" 00:12:15.405 }, 00:12:15.405 "qid": 0, 00:12:15.405 "state": "enabled", 00:12:15.405 "thread": "nvmf_tgt_poll_group_000" 00:12:15.405 } 00:12:15.405 ]' 00:12:15.405 11:22:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:12:15.405 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha256 == \s\h\a\2\5\6 ]] 00:12:15.405 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:12:15.405 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe2048 == \f\f\d\h\e\2\0\4\8 ]] 00:12:15.405 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:12:15.663 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:12:15.663 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:12:15.663 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:12:15.921 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:00:YjQ0ZWQzNjNjMTQzYmZkMDJkM2FmYzIyMTEyMmY0MGExMDAwNWQ5ZWY2NGE2NjBjPhDLOQ==: --dhchap-ctrl-secret DHHC-1:03:NDMwZGJjZWY5ZWEzMDMxODE1MjFlOWMyMDkyYTNlYzA0Yjk3ZGM2MDJlMDQ4OTFhNWUwMjIyM2E4ZGVjMWU5Y1IEScw=: 00:12:15.921 11:22:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --hostid 3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -l 0 --dhchap-secret DHHC-1:00:YjQ0ZWQzNjNjMTQzYmZkMDJkM2FmYzIyMTEyMmY0MGExMDAwNWQ5ZWY2NGE2NjBjPhDLOQ==: --dhchap-ctrl-secret DHHC-1:03:NDMwZGJjZWY5ZWEzMDMxODE1MjFlOWMyMDkyYTNlYzA0Yjk3ZGM2MDJlMDQ4OTFhNWUwMjIyM2E4ZGVjMWU5Y1IEScw=: 00:12:16.586 11:22:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:12:16.586 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:12:16.586 11:22:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:12:16.586 11:22:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:16.586 11:22:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:16.586 11:22:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:16.586 11:22:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:12:16.586 11:22:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe2048 00:12:16.586 11:22:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe2048 00:12:16.843 11:22:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha256 ffdhe2048 1 00:12:16.843 11:22:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:12:16.843 11:22:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha256 00:12:16.843 11:22:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe2048 00:12:16.843 11:22:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key1 00:12:16.843 11:22:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:12:16.843 11:22:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:12:16.843 11:22:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:16.843 11:22:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:16.843 11:22:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:16.843 11:22:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:12:16.843 11:22:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:12:16.843 11:22:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:12:17.407 00:12:17.407 11:22:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:12:17.408 11:22:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:12:17.408 11:22:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:12:17.666 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:12:17.666 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:12:17.666 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:17.666 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:17.666 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:17.666 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:12:17.666 { 00:12:17.666 "auth": { 00:12:17.666 "dhgroup": "ffdhe2048", 00:12:17.666 "digest": "sha256", 00:12:17.666 "state": "completed" 00:12:17.666 }, 00:12:17.666 "cntlid": 11, 00:12:17.666 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3", 00:12:17.666 "listen_address": { 00:12:17.666 "adrfam": "IPv4", 00:12:17.666 "traddr": "10.0.0.3", 00:12:17.666 "trsvcid": "4420", 00:12:17.666 "trtype": "TCP" 00:12:17.666 }, 00:12:17.666 "peer_address": { 00:12:17.666 "adrfam": "IPv4", 00:12:17.666 "traddr": "10.0.0.1", 00:12:17.666 "trsvcid": "50568", 00:12:17.666 "trtype": "TCP" 00:12:17.666 }, 00:12:17.666 "qid": 0, 00:12:17.666 "state": "enabled", 00:12:17.666 "thread": "nvmf_tgt_poll_group_000" 00:12:17.666 } 00:12:17.666 ]' 00:12:17.666 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:12:17.924 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha256 == \s\h\a\2\5\6 ]] 00:12:17.924 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:12:17.924 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe2048 == \f\f\d\h\e\2\0\4\8 ]] 00:12:17.924 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:12:17.924 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:12:17.924 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:12:17.924 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:12:18.182 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:01:N2VkMTc0ODgwNWQxZTM0NTk5OTYwMDk1NmQ5ZGE3YzEKeI3L: --dhchap-ctrl-secret DHHC-1:02:MzI4NjQxYjU2NThlMTY5N2Y3MDgwYmM0MDIxZDY2MmVkOGQyNDA0N2MzNWJlZDNicraO3Q==: 00:12:18.182 11:22:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --hostid 3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -l 0 --dhchap-secret DHHC-1:01:N2VkMTc0ODgwNWQxZTM0NTk5OTYwMDk1NmQ5ZGE3YzEKeI3L: --dhchap-ctrl-secret DHHC-1:02:MzI4NjQxYjU2NThlMTY5N2Y3MDgwYmM0MDIxZDY2MmVkOGQyNDA0N2MzNWJlZDNicraO3Q==: 00:12:19.115 11:23:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:12:19.115 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:12:19.115 11:23:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:12:19.115 11:23:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:19.115 11:23:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:19.115 11:23:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:19.115 11:23:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:12:19.115 11:23:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe2048 00:12:19.115 11:23:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe2048 00:12:19.373 11:23:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha256 ffdhe2048 2 00:12:19.373 11:23:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:12:19.373 11:23:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha256 00:12:19.373 11:23:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe2048 00:12:19.373 11:23:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key2 00:12:19.373 11:23:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:12:19.373 11:23:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:12:19.373 11:23:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:19.373 11:23:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:19.373 11:23:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:19.373 11:23:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:12:19.373 11:23:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:12:19.373 11:23:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:12:19.630 00:12:19.888 11:23:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:12:19.888 11:23:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:12:19.888 11:23:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:12:20.146 11:23:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:12:20.146 11:23:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:12:20.146 11:23:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:20.146 11:23:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:20.146 11:23:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:20.146 11:23:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:12:20.146 { 00:12:20.146 "auth": { 00:12:20.146 "dhgroup": "ffdhe2048", 00:12:20.146 "digest": "sha256", 00:12:20.146 "state": "completed" 00:12:20.147 }, 00:12:20.147 "cntlid": 13, 00:12:20.147 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3", 00:12:20.147 "listen_address": { 00:12:20.147 "adrfam": "IPv4", 00:12:20.147 "traddr": "10.0.0.3", 00:12:20.147 "trsvcid": "4420", 00:12:20.147 "trtype": "TCP" 00:12:20.147 }, 00:12:20.147 "peer_address": { 00:12:20.147 "adrfam": "IPv4", 00:12:20.147 "traddr": "10.0.0.1", 00:12:20.147 "trsvcid": "59268", 00:12:20.147 "trtype": "TCP" 00:12:20.147 }, 00:12:20.147 "qid": 0, 00:12:20.147 "state": "enabled", 00:12:20.147 "thread": "nvmf_tgt_poll_group_000" 00:12:20.147 } 00:12:20.147 ]' 00:12:20.147 11:23:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:12:20.147 11:23:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha256 == \s\h\a\2\5\6 ]] 00:12:20.147 11:23:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:12:20.147 11:23:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe2048 == \f\f\d\h\e\2\0\4\8 ]] 00:12:20.147 11:23:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:12:20.147 11:23:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:12:20.147 11:23:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:12:20.147 11:23:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:12:20.712 11:23:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:02:OGEwMDZmYzk3YTg5OWI0ZmJlYjViNmI2YmQzN2ViYjZiODhiMTM4MjEzY2ZlYmUzuaS9rg==: --dhchap-ctrl-secret DHHC-1:01:MTcxNjJmZTg3YTMxYmYyZDA0YmFhY2Q0M2Y3OGQwNzhGAzMl: 00:12:20.712 11:23:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --hostid 3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -l 0 --dhchap-secret DHHC-1:02:OGEwMDZmYzk3YTg5OWI0ZmJlYjViNmI2YmQzN2ViYjZiODhiMTM4MjEzY2ZlYmUzuaS9rg==: --dhchap-ctrl-secret DHHC-1:01:MTcxNjJmZTg3YTMxYmYyZDA0YmFhY2Q0M2Y3OGQwNzhGAzMl: 00:12:21.278 11:23:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:12:21.278 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:12:21.278 11:23:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:12:21.278 11:23:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:21.278 11:23:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:21.278 11:23:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:21.278 11:23:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:12:21.278 11:23:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe2048 00:12:21.278 11:23:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe2048 00:12:21.536 11:23:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha256 ffdhe2048 3 00:12:21.536 11:23:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:12:21.536 11:23:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha256 00:12:21.536 11:23:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe2048 00:12:21.536 11:23:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key3 00:12:21.536 11:23:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:12:21.536 11:23:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --dhchap-key key3 00:12:21.536 11:23:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:21.536 11:23:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:21.536 11:23:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:21.536 11:23:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key3 00:12:21.536 11:23:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:12:21.536 11:23:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:12:22.102 00:12:22.102 11:23:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:12:22.102 11:23:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:12:22.102 11:23:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:12:22.360 11:23:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:12:22.360 11:23:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:12:22.360 11:23:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:22.360 11:23:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:22.360 11:23:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:22.360 11:23:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:12:22.360 { 00:12:22.360 "auth": { 00:12:22.360 "dhgroup": "ffdhe2048", 00:12:22.360 "digest": "sha256", 00:12:22.360 "state": "completed" 00:12:22.360 }, 00:12:22.360 "cntlid": 15, 00:12:22.360 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3", 00:12:22.360 "listen_address": { 00:12:22.360 "adrfam": "IPv4", 00:12:22.360 "traddr": "10.0.0.3", 00:12:22.360 "trsvcid": "4420", 00:12:22.360 "trtype": "TCP" 00:12:22.360 }, 00:12:22.360 "peer_address": { 00:12:22.360 "adrfam": "IPv4", 00:12:22.360 "traddr": "10.0.0.1", 00:12:22.360 "trsvcid": "59292", 00:12:22.360 "trtype": "TCP" 00:12:22.360 }, 00:12:22.360 "qid": 0, 00:12:22.360 "state": "enabled", 00:12:22.360 "thread": "nvmf_tgt_poll_group_000" 00:12:22.360 } 00:12:22.360 ]' 00:12:22.360 11:23:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:12:22.360 11:23:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha256 == \s\h\a\2\5\6 ]] 00:12:22.360 11:23:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:12:22.360 11:23:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe2048 == \f\f\d\h\e\2\0\4\8 ]] 00:12:22.361 11:23:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:12:22.361 11:23:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:12:22.361 11:23:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:12:22.361 11:23:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:12:22.619 11:23:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:03:N2U1YWE0ZGQ4YmRkNTZjYWQ0MTY0MWM2OTQzMDJkZGEyZDRjYjMxYmFhOTU4YjVjMWVhMGJkYzhlMmY3NzBkZSCeOpc=: 00:12:22.619 11:23:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --hostid 3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -l 0 --dhchap-secret DHHC-1:03:N2U1YWE0ZGQ4YmRkNTZjYWQ0MTY0MWM2OTQzMDJkZGEyZDRjYjMxYmFhOTU4YjVjMWVhMGJkYzhlMmY3NzBkZSCeOpc=: 00:12:23.552 11:23:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:12:23.552 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:12:23.552 11:23:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:12:23.552 11:23:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:23.552 11:23:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:23.552 11:23:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:23.552 11:23:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@119 -- # for dhgroup in "${dhgroups[@]}" 00:12:23.552 11:23:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:12:23.552 11:23:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe3072 00:12:23.552 11:23:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe3072 00:12:23.812 11:23:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha256 ffdhe3072 0 00:12:23.812 11:23:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:12:23.812 11:23:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha256 00:12:23.812 11:23:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe3072 00:12:23.812 11:23:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key0 00:12:23.812 11:23:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:12:23.812 11:23:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:12:23.812 11:23:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:23.812 11:23:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:23.812 11:23:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:23.812 11:23:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:12:23.812 11:23:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:12:23.812 11:23:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:12:24.072 00:12:24.330 11:23:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:12:24.330 11:23:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:12:24.330 11:23:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:12:24.588 11:23:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:12:24.588 11:23:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:12:24.588 11:23:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:24.588 11:23:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:24.588 11:23:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:24.588 11:23:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:12:24.588 { 00:12:24.588 "auth": { 00:12:24.588 "dhgroup": "ffdhe3072", 00:12:24.588 "digest": "sha256", 00:12:24.588 "state": "completed" 00:12:24.588 }, 00:12:24.588 "cntlid": 17, 00:12:24.588 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3", 00:12:24.588 "listen_address": { 00:12:24.588 "adrfam": "IPv4", 00:12:24.588 "traddr": "10.0.0.3", 00:12:24.588 "trsvcid": "4420", 00:12:24.588 "trtype": "TCP" 00:12:24.588 }, 00:12:24.588 "peer_address": { 00:12:24.588 "adrfam": "IPv4", 00:12:24.588 "traddr": "10.0.0.1", 00:12:24.588 "trsvcid": "59332", 00:12:24.588 "trtype": "TCP" 00:12:24.588 }, 00:12:24.588 "qid": 0, 00:12:24.588 "state": "enabled", 00:12:24.588 "thread": "nvmf_tgt_poll_group_000" 00:12:24.588 } 00:12:24.588 ]' 00:12:24.588 11:23:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:12:24.588 11:23:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha256 == \s\h\a\2\5\6 ]] 00:12:24.588 11:23:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:12:24.588 11:23:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe3072 == \f\f\d\h\e\3\0\7\2 ]] 00:12:24.588 11:23:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:12:24.588 11:23:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:12:24.588 11:23:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:12:24.588 11:23:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:12:24.846 11:23:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:00:YjQ0ZWQzNjNjMTQzYmZkMDJkM2FmYzIyMTEyMmY0MGExMDAwNWQ5ZWY2NGE2NjBjPhDLOQ==: --dhchap-ctrl-secret DHHC-1:03:NDMwZGJjZWY5ZWEzMDMxODE1MjFlOWMyMDkyYTNlYzA0Yjk3ZGM2MDJlMDQ4OTFhNWUwMjIyM2E4ZGVjMWU5Y1IEScw=: 00:12:24.846 11:23:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --hostid 3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -l 0 --dhchap-secret DHHC-1:00:YjQ0ZWQzNjNjMTQzYmZkMDJkM2FmYzIyMTEyMmY0MGExMDAwNWQ5ZWY2NGE2NjBjPhDLOQ==: --dhchap-ctrl-secret DHHC-1:03:NDMwZGJjZWY5ZWEzMDMxODE1MjFlOWMyMDkyYTNlYzA0Yjk3ZGM2MDJlMDQ4OTFhNWUwMjIyM2E4ZGVjMWU5Y1IEScw=: 00:12:25.781 11:23:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:12:25.781 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:12:25.781 11:23:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:12:25.781 11:23:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:25.781 11:23:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:25.781 11:23:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:25.781 11:23:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:12:25.781 11:23:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe3072 00:12:25.781 11:23:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe3072 00:12:25.781 11:23:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha256 ffdhe3072 1 00:12:25.781 11:23:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:12:25.781 11:23:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha256 00:12:25.781 11:23:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe3072 00:12:25.781 11:23:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key1 00:12:25.781 11:23:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:12:25.781 11:23:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:12:25.781 11:23:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:25.781 11:23:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:26.040 11:23:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:26.040 11:23:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:12:26.040 11:23:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:12:26.040 11:23:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:12:26.298 00:12:26.298 11:23:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:12:26.298 11:23:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:12:26.298 11:23:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:12:26.556 11:23:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:12:26.556 11:23:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:12:26.556 11:23:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:26.556 11:23:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:26.556 11:23:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:26.556 11:23:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:12:26.556 { 00:12:26.556 "auth": { 00:12:26.556 "dhgroup": "ffdhe3072", 00:12:26.556 "digest": "sha256", 00:12:26.556 "state": "completed" 00:12:26.556 }, 00:12:26.556 "cntlid": 19, 00:12:26.556 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3", 00:12:26.556 "listen_address": { 00:12:26.556 "adrfam": "IPv4", 00:12:26.556 "traddr": "10.0.0.3", 00:12:26.556 "trsvcid": "4420", 00:12:26.556 "trtype": "TCP" 00:12:26.556 }, 00:12:26.556 "peer_address": { 00:12:26.556 "adrfam": "IPv4", 00:12:26.556 "traddr": "10.0.0.1", 00:12:26.556 "trsvcid": "59348", 00:12:26.556 "trtype": "TCP" 00:12:26.557 }, 00:12:26.557 "qid": 0, 00:12:26.557 "state": "enabled", 00:12:26.557 "thread": "nvmf_tgt_poll_group_000" 00:12:26.557 } 00:12:26.557 ]' 00:12:26.557 11:23:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:12:26.875 11:23:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha256 == \s\h\a\2\5\6 ]] 00:12:26.875 11:23:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:12:26.875 11:23:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe3072 == \f\f\d\h\e\3\0\7\2 ]] 00:12:26.875 11:23:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:12:26.875 11:23:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:12:26.875 11:23:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:12:26.875 11:23:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:12:27.132 11:23:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:01:N2VkMTc0ODgwNWQxZTM0NTk5OTYwMDk1NmQ5ZGE3YzEKeI3L: --dhchap-ctrl-secret DHHC-1:02:MzI4NjQxYjU2NThlMTY5N2Y3MDgwYmM0MDIxZDY2MmVkOGQyNDA0N2MzNWJlZDNicraO3Q==: 00:12:27.132 11:23:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --hostid 3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -l 0 --dhchap-secret DHHC-1:01:N2VkMTc0ODgwNWQxZTM0NTk5OTYwMDk1NmQ5ZGE3YzEKeI3L: --dhchap-ctrl-secret DHHC-1:02:MzI4NjQxYjU2NThlMTY5N2Y3MDgwYmM0MDIxZDY2MmVkOGQyNDA0N2MzNWJlZDNicraO3Q==: 00:12:28.068 11:23:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:12:28.068 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:12:28.068 11:23:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:12:28.068 11:23:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:28.068 11:23:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:28.068 11:23:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:28.068 11:23:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:12:28.068 11:23:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe3072 00:12:28.068 11:23:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe3072 00:12:28.068 11:23:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha256 ffdhe3072 2 00:12:28.068 11:23:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:12:28.068 11:23:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha256 00:12:28.068 11:23:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe3072 00:12:28.068 11:23:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key2 00:12:28.068 11:23:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:12:28.068 11:23:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:12:28.068 11:23:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:28.068 11:23:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:28.068 11:23:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:28.068 11:23:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:12:28.068 11:23:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:12:28.068 11:23:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:12:28.634 00:12:28.634 11:23:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:12:28.634 11:23:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:12:28.634 11:23:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:12:28.893 11:23:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:12:28.893 11:23:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:12:28.893 11:23:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:28.893 11:23:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:28.893 11:23:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:28.893 11:23:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:12:28.893 { 00:12:28.893 "auth": { 00:12:28.893 "dhgroup": "ffdhe3072", 00:12:28.893 "digest": "sha256", 00:12:28.893 "state": "completed" 00:12:28.893 }, 00:12:28.893 "cntlid": 21, 00:12:28.893 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3", 00:12:28.893 "listen_address": { 00:12:28.893 "adrfam": "IPv4", 00:12:28.893 "traddr": "10.0.0.3", 00:12:28.893 "trsvcid": "4420", 00:12:28.893 "trtype": "TCP" 00:12:28.893 }, 00:12:28.893 "peer_address": { 00:12:28.893 "adrfam": "IPv4", 00:12:28.893 "traddr": "10.0.0.1", 00:12:28.893 "trsvcid": "59374", 00:12:28.893 "trtype": "TCP" 00:12:28.893 }, 00:12:28.893 "qid": 0, 00:12:28.893 "state": "enabled", 00:12:28.893 "thread": "nvmf_tgt_poll_group_000" 00:12:28.893 } 00:12:28.893 ]' 00:12:28.893 11:23:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:12:28.893 11:23:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha256 == \s\h\a\2\5\6 ]] 00:12:28.893 11:23:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:12:29.151 11:23:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe3072 == \f\f\d\h\e\3\0\7\2 ]] 00:12:29.151 11:23:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:12:29.151 11:23:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:12:29.151 11:23:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:12:29.151 11:23:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:12:29.408 11:23:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:02:OGEwMDZmYzk3YTg5OWI0ZmJlYjViNmI2YmQzN2ViYjZiODhiMTM4MjEzY2ZlYmUzuaS9rg==: --dhchap-ctrl-secret DHHC-1:01:MTcxNjJmZTg3YTMxYmYyZDA0YmFhY2Q0M2Y3OGQwNzhGAzMl: 00:12:29.408 11:23:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --hostid 3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -l 0 --dhchap-secret DHHC-1:02:OGEwMDZmYzk3YTg5OWI0ZmJlYjViNmI2YmQzN2ViYjZiODhiMTM4MjEzY2ZlYmUzuaS9rg==: --dhchap-ctrl-secret DHHC-1:01:MTcxNjJmZTg3YTMxYmYyZDA0YmFhY2Q0M2Y3OGQwNzhGAzMl: 00:12:29.973 11:23:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:12:29.973 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:12:29.973 11:23:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:12:29.973 11:23:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:29.973 11:23:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:29.973 11:23:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:29.973 11:23:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:12:29.973 11:23:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe3072 00:12:29.973 11:23:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe3072 00:12:30.537 11:23:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha256 ffdhe3072 3 00:12:30.537 11:23:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:12:30.537 11:23:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha256 00:12:30.537 11:23:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe3072 00:12:30.537 11:23:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key3 00:12:30.537 11:23:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:12:30.537 11:23:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --dhchap-key key3 00:12:30.537 11:23:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:30.537 11:23:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:30.537 11:23:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:30.537 11:23:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key3 00:12:30.537 11:23:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:12:30.538 11:23:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:12:30.794 00:12:30.794 11:23:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:12:30.794 11:23:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:12:30.794 11:23:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:12:31.358 11:23:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:12:31.358 11:23:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:12:31.358 11:23:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:31.358 11:23:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:31.358 11:23:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:31.358 11:23:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:12:31.358 { 00:12:31.358 "auth": { 00:12:31.358 "dhgroup": "ffdhe3072", 00:12:31.358 "digest": "sha256", 00:12:31.358 "state": "completed" 00:12:31.358 }, 00:12:31.358 "cntlid": 23, 00:12:31.358 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3", 00:12:31.358 "listen_address": { 00:12:31.358 "adrfam": "IPv4", 00:12:31.358 "traddr": "10.0.0.3", 00:12:31.358 "trsvcid": "4420", 00:12:31.358 "trtype": "TCP" 00:12:31.358 }, 00:12:31.358 "peer_address": { 00:12:31.358 "adrfam": "IPv4", 00:12:31.358 "traddr": "10.0.0.1", 00:12:31.358 "trsvcid": "33698", 00:12:31.358 "trtype": "TCP" 00:12:31.358 }, 00:12:31.358 "qid": 0, 00:12:31.358 "state": "enabled", 00:12:31.358 "thread": "nvmf_tgt_poll_group_000" 00:12:31.358 } 00:12:31.358 ]' 00:12:31.358 11:23:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:12:31.358 11:23:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha256 == \s\h\a\2\5\6 ]] 00:12:31.358 11:23:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:12:31.358 11:23:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe3072 == \f\f\d\h\e\3\0\7\2 ]] 00:12:31.358 11:23:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:12:31.358 11:23:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:12:31.358 11:23:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:12:31.358 11:23:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:12:31.616 11:23:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:03:N2U1YWE0ZGQ4YmRkNTZjYWQ0MTY0MWM2OTQzMDJkZGEyZDRjYjMxYmFhOTU4YjVjMWVhMGJkYzhlMmY3NzBkZSCeOpc=: 00:12:31.616 11:23:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --hostid 3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -l 0 --dhchap-secret DHHC-1:03:N2U1YWE0ZGQ4YmRkNTZjYWQ0MTY0MWM2OTQzMDJkZGEyZDRjYjMxYmFhOTU4YjVjMWVhMGJkYzhlMmY3NzBkZSCeOpc=: 00:12:32.573 11:23:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:12:32.573 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:12:32.573 11:23:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:12:32.573 11:23:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:32.573 11:23:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:32.573 11:23:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:32.573 11:23:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@119 -- # for dhgroup in "${dhgroups[@]}" 00:12:32.573 11:23:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:12:32.573 11:23:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe4096 00:12:32.573 11:23:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe4096 00:12:32.831 11:23:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha256 ffdhe4096 0 00:12:32.831 11:23:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:12:32.831 11:23:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha256 00:12:32.831 11:23:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe4096 00:12:32.831 11:23:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key0 00:12:32.831 11:23:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:12:32.831 11:23:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:12:32.831 11:23:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:32.831 11:23:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:32.831 11:23:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:32.831 11:23:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:12:32.831 11:23:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:12:32.831 11:23:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:12:33.089 00:12:33.089 11:23:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:12:33.089 11:23:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:12:33.089 11:23:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:12:33.347 11:23:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:12:33.347 11:23:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:12:33.347 11:23:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:33.347 11:23:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:33.347 11:23:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:33.347 11:23:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:12:33.347 { 00:12:33.347 "auth": { 00:12:33.347 "dhgroup": "ffdhe4096", 00:12:33.347 "digest": "sha256", 00:12:33.347 "state": "completed" 00:12:33.347 }, 00:12:33.347 "cntlid": 25, 00:12:33.347 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3", 00:12:33.347 "listen_address": { 00:12:33.347 "adrfam": "IPv4", 00:12:33.347 "traddr": "10.0.0.3", 00:12:33.347 "trsvcid": "4420", 00:12:33.347 "trtype": "TCP" 00:12:33.347 }, 00:12:33.347 "peer_address": { 00:12:33.347 "adrfam": "IPv4", 00:12:33.347 "traddr": "10.0.0.1", 00:12:33.347 "trsvcid": "33716", 00:12:33.347 "trtype": "TCP" 00:12:33.347 }, 00:12:33.347 "qid": 0, 00:12:33.347 "state": "enabled", 00:12:33.347 "thread": "nvmf_tgt_poll_group_000" 00:12:33.347 } 00:12:33.347 ]' 00:12:33.347 11:23:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:12:33.347 11:23:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha256 == \s\h\a\2\5\6 ]] 00:12:33.606 11:23:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:12:33.606 11:23:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe4096 == \f\f\d\h\e\4\0\9\6 ]] 00:12:33.606 11:23:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:12:33.606 11:23:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:12:33.606 11:23:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:12:33.606 11:23:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:12:33.865 11:23:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:00:YjQ0ZWQzNjNjMTQzYmZkMDJkM2FmYzIyMTEyMmY0MGExMDAwNWQ5ZWY2NGE2NjBjPhDLOQ==: --dhchap-ctrl-secret DHHC-1:03:NDMwZGJjZWY5ZWEzMDMxODE1MjFlOWMyMDkyYTNlYzA0Yjk3ZGM2MDJlMDQ4OTFhNWUwMjIyM2E4ZGVjMWU5Y1IEScw=: 00:12:33.865 11:23:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --hostid 3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -l 0 --dhchap-secret DHHC-1:00:YjQ0ZWQzNjNjMTQzYmZkMDJkM2FmYzIyMTEyMmY0MGExMDAwNWQ5ZWY2NGE2NjBjPhDLOQ==: --dhchap-ctrl-secret DHHC-1:03:NDMwZGJjZWY5ZWEzMDMxODE1MjFlOWMyMDkyYTNlYzA0Yjk3ZGM2MDJlMDQ4OTFhNWUwMjIyM2E4ZGVjMWU5Y1IEScw=: 00:12:34.432 11:23:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:12:34.432 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:12:34.432 11:23:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:12:34.432 11:23:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:34.432 11:23:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:34.432 11:23:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:34.432 11:23:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:12:34.432 11:23:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe4096 00:12:34.432 11:23:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe4096 00:12:35.000 11:23:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha256 ffdhe4096 1 00:12:35.000 11:23:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:12:35.000 11:23:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha256 00:12:35.000 11:23:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe4096 00:12:35.000 11:23:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key1 00:12:35.000 11:23:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:12:35.000 11:23:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:12:35.000 11:23:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:35.000 11:23:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:35.000 11:23:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:35.000 11:23:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:12:35.000 11:23:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:12:35.000 11:23:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:12:35.258 00:12:35.258 11:23:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:12:35.258 11:23:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:12:35.258 11:23:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:12:35.516 11:23:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:12:35.516 11:23:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:12:35.516 11:23:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:35.516 11:23:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:35.516 11:23:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:35.516 11:23:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:12:35.516 { 00:12:35.516 "auth": { 00:12:35.517 "dhgroup": "ffdhe4096", 00:12:35.517 "digest": "sha256", 00:12:35.517 "state": "completed" 00:12:35.517 }, 00:12:35.517 "cntlid": 27, 00:12:35.517 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3", 00:12:35.517 "listen_address": { 00:12:35.517 "adrfam": "IPv4", 00:12:35.517 "traddr": "10.0.0.3", 00:12:35.517 "trsvcid": "4420", 00:12:35.517 "trtype": "TCP" 00:12:35.517 }, 00:12:35.517 "peer_address": { 00:12:35.517 "adrfam": "IPv4", 00:12:35.517 "traddr": "10.0.0.1", 00:12:35.517 "trsvcid": "33728", 00:12:35.517 "trtype": "TCP" 00:12:35.517 }, 00:12:35.517 "qid": 0, 00:12:35.517 "state": "enabled", 00:12:35.517 "thread": "nvmf_tgt_poll_group_000" 00:12:35.517 } 00:12:35.517 ]' 00:12:35.517 11:23:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:12:35.517 11:23:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha256 == \s\h\a\2\5\6 ]] 00:12:35.517 11:23:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:12:35.774 11:23:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe4096 == \f\f\d\h\e\4\0\9\6 ]] 00:12:35.774 11:23:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:12:35.774 11:23:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:12:35.774 11:23:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:12:35.774 11:23:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:12:36.032 11:23:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:01:N2VkMTc0ODgwNWQxZTM0NTk5OTYwMDk1NmQ5ZGE3YzEKeI3L: --dhchap-ctrl-secret DHHC-1:02:MzI4NjQxYjU2NThlMTY5N2Y3MDgwYmM0MDIxZDY2MmVkOGQyNDA0N2MzNWJlZDNicraO3Q==: 00:12:36.032 11:23:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --hostid 3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -l 0 --dhchap-secret DHHC-1:01:N2VkMTc0ODgwNWQxZTM0NTk5OTYwMDk1NmQ5ZGE3YzEKeI3L: --dhchap-ctrl-secret DHHC-1:02:MzI4NjQxYjU2NThlMTY5N2Y3MDgwYmM0MDIxZDY2MmVkOGQyNDA0N2MzNWJlZDNicraO3Q==: 00:12:36.598 11:23:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:12:36.598 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:12:36.598 11:23:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:12:36.598 11:23:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:36.598 11:23:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:36.598 11:23:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:36.598 11:23:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:12:36.598 11:23:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe4096 00:12:36.598 11:23:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe4096 00:12:37.171 11:23:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha256 ffdhe4096 2 00:12:37.171 11:23:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:12:37.171 11:23:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha256 00:12:37.171 11:23:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe4096 00:12:37.171 11:23:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key2 00:12:37.171 11:23:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:12:37.171 11:23:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:12:37.171 11:23:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:37.171 11:23:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:37.171 11:23:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:37.171 11:23:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:12:37.171 11:23:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:12:37.171 11:23:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:12:37.429 00:12:37.429 11:23:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:12:37.429 11:23:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:12:37.429 11:23:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:12:37.687 11:23:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:12:37.687 11:23:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:12:37.687 11:23:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:37.687 11:23:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:37.687 11:23:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:37.687 11:23:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:12:37.687 { 00:12:37.687 "auth": { 00:12:37.687 "dhgroup": "ffdhe4096", 00:12:37.687 "digest": "sha256", 00:12:37.687 "state": "completed" 00:12:37.687 }, 00:12:37.687 "cntlid": 29, 00:12:37.687 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3", 00:12:37.687 "listen_address": { 00:12:37.687 "adrfam": "IPv4", 00:12:37.687 "traddr": "10.0.0.3", 00:12:37.687 "trsvcid": "4420", 00:12:37.687 "trtype": "TCP" 00:12:37.687 }, 00:12:37.687 "peer_address": { 00:12:37.687 "adrfam": "IPv4", 00:12:37.687 "traddr": "10.0.0.1", 00:12:37.687 "trsvcid": "33750", 00:12:37.687 "trtype": "TCP" 00:12:37.687 }, 00:12:37.687 "qid": 0, 00:12:37.687 "state": "enabled", 00:12:37.687 "thread": "nvmf_tgt_poll_group_000" 00:12:37.687 } 00:12:37.687 ]' 00:12:37.687 11:23:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:12:37.687 11:23:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha256 == \s\h\a\2\5\6 ]] 00:12:37.687 11:23:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:12:37.945 11:23:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe4096 == \f\f\d\h\e\4\0\9\6 ]] 00:12:37.945 11:23:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:12:37.945 11:23:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:12:37.945 11:23:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:12:37.945 11:23:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:12:38.202 11:23:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:02:OGEwMDZmYzk3YTg5OWI0ZmJlYjViNmI2YmQzN2ViYjZiODhiMTM4MjEzY2ZlYmUzuaS9rg==: --dhchap-ctrl-secret DHHC-1:01:MTcxNjJmZTg3YTMxYmYyZDA0YmFhY2Q0M2Y3OGQwNzhGAzMl: 00:12:38.202 11:23:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --hostid 3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -l 0 --dhchap-secret DHHC-1:02:OGEwMDZmYzk3YTg5OWI0ZmJlYjViNmI2YmQzN2ViYjZiODhiMTM4MjEzY2ZlYmUzuaS9rg==: --dhchap-ctrl-secret DHHC-1:01:MTcxNjJmZTg3YTMxYmYyZDA0YmFhY2Q0M2Y3OGQwNzhGAzMl: 00:12:39.137 11:23:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:12:39.137 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:12:39.137 11:23:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:12:39.137 11:23:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:39.137 11:23:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:39.137 11:23:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:39.137 11:23:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:12:39.137 11:23:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe4096 00:12:39.137 11:23:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe4096 00:12:39.396 11:23:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha256 ffdhe4096 3 00:12:39.396 11:23:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:12:39.396 11:23:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha256 00:12:39.396 11:23:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe4096 00:12:39.396 11:23:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key3 00:12:39.396 11:23:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:12:39.396 11:23:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --dhchap-key key3 00:12:39.396 11:23:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:39.396 11:23:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:39.396 11:23:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:39.396 11:23:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key3 00:12:39.396 11:23:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:12:39.396 11:23:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:12:39.654 00:12:39.654 11:23:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:12:39.654 11:23:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:12:39.654 11:23:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:12:39.912 11:23:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:12:39.912 11:23:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:12:39.912 11:23:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:39.912 11:23:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:39.912 11:23:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:39.912 11:23:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:12:39.912 { 00:12:39.912 "auth": { 00:12:39.912 "dhgroup": "ffdhe4096", 00:12:39.912 "digest": "sha256", 00:12:39.912 "state": "completed" 00:12:39.912 }, 00:12:39.912 "cntlid": 31, 00:12:39.912 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3", 00:12:39.912 "listen_address": { 00:12:39.912 "adrfam": "IPv4", 00:12:39.912 "traddr": "10.0.0.3", 00:12:39.912 "trsvcid": "4420", 00:12:39.912 "trtype": "TCP" 00:12:39.912 }, 00:12:39.912 "peer_address": { 00:12:39.912 "adrfam": "IPv4", 00:12:39.912 "traddr": "10.0.0.1", 00:12:39.912 "trsvcid": "59812", 00:12:39.912 "trtype": "TCP" 00:12:39.912 }, 00:12:39.912 "qid": 0, 00:12:39.912 "state": "enabled", 00:12:39.912 "thread": "nvmf_tgt_poll_group_000" 00:12:39.912 } 00:12:39.912 ]' 00:12:39.912 11:23:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:12:40.171 11:23:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha256 == \s\h\a\2\5\6 ]] 00:12:40.171 11:23:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:12:40.171 11:23:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe4096 == \f\f\d\h\e\4\0\9\6 ]] 00:12:40.171 11:23:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:12:40.171 11:23:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:12:40.171 11:23:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:12:40.171 11:23:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:12:40.484 11:23:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:03:N2U1YWE0ZGQ4YmRkNTZjYWQ0MTY0MWM2OTQzMDJkZGEyZDRjYjMxYmFhOTU4YjVjMWVhMGJkYzhlMmY3NzBkZSCeOpc=: 00:12:40.484 11:23:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --hostid 3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -l 0 --dhchap-secret DHHC-1:03:N2U1YWE0ZGQ4YmRkNTZjYWQ0MTY0MWM2OTQzMDJkZGEyZDRjYjMxYmFhOTU4YjVjMWVhMGJkYzhlMmY3NzBkZSCeOpc=: 00:12:41.416 11:23:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:12:41.416 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:12:41.417 11:23:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:12:41.417 11:23:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:41.417 11:23:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:41.417 11:23:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:41.417 11:23:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@119 -- # for dhgroup in "${dhgroups[@]}" 00:12:41.417 11:23:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:12:41.417 11:23:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe6144 00:12:41.417 11:23:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe6144 00:12:41.417 11:23:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha256 ffdhe6144 0 00:12:41.417 11:23:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:12:41.417 11:23:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha256 00:12:41.417 11:23:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe6144 00:12:41.417 11:23:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key0 00:12:41.417 11:23:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:12:41.417 11:23:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:12:41.417 11:23:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:41.417 11:23:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:41.417 11:23:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:41.417 11:23:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:12:41.417 11:23:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:12:41.417 11:23:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:12:41.982 00:12:41.982 11:23:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:12:41.982 11:23:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:12:41.982 11:23:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:12:42.239 11:23:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:12:42.239 11:23:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:12:42.239 11:23:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:42.239 11:23:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:42.239 11:23:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:42.239 11:23:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:12:42.239 { 00:12:42.239 "auth": { 00:12:42.239 "dhgroup": "ffdhe6144", 00:12:42.239 "digest": "sha256", 00:12:42.239 "state": "completed" 00:12:42.239 }, 00:12:42.239 "cntlid": 33, 00:12:42.239 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3", 00:12:42.239 "listen_address": { 00:12:42.239 "adrfam": "IPv4", 00:12:42.239 "traddr": "10.0.0.3", 00:12:42.239 "trsvcid": "4420", 00:12:42.239 "trtype": "TCP" 00:12:42.239 }, 00:12:42.239 "peer_address": { 00:12:42.239 "adrfam": "IPv4", 00:12:42.239 "traddr": "10.0.0.1", 00:12:42.239 "trsvcid": "59844", 00:12:42.239 "trtype": "TCP" 00:12:42.239 }, 00:12:42.239 "qid": 0, 00:12:42.239 "state": "enabled", 00:12:42.239 "thread": "nvmf_tgt_poll_group_000" 00:12:42.239 } 00:12:42.239 ]' 00:12:42.239 11:23:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:12:42.497 11:23:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha256 == \s\h\a\2\5\6 ]] 00:12:42.497 11:23:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:12:42.497 11:23:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe6144 == \f\f\d\h\e\6\1\4\4 ]] 00:12:42.497 11:23:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:12:42.497 11:23:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:12:42.497 11:23:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:12:42.497 11:23:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:12:42.755 11:23:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:00:YjQ0ZWQzNjNjMTQzYmZkMDJkM2FmYzIyMTEyMmY0MGExMDAwNWQ5ZWY2NGE2NjBjPhDLOQ==: --dhchap-ctrl-secret DHHC-1:03:NDMwZGJjZWY5ZWEzMDMxODE1MjFlOWMyMDkyYTNlYzA0Yjk3ZGM2MDJlMDQ4OTFhNWUwMjIyM2E4ZGVjMWU5Y1IEScw=: 00:12:42.755 11:23:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --hostid 3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -l 0 --dhchap-secret DHHC-1:00:YjQ0ZWQzNjNjMTQzYmZkMDJkM2FmYzIyMTEyMmY0MGExMDAwNWQ5ZWY2NGE2NjBjPhDLOQ==: --dhchap-ctrl-secret DHHC-1:03:NDMwZGJjZWY5ZWEzMDMxODE1MjFlOWMyMDkyYTNlYzA0Yjk3ZGM2MDJlMDQ4OTFhNWUwMjIyM2E4ZGVjMWU5Y1IEScw=: 00:12:43.689 11:23:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:12:43.689 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:12:43.689 11:23:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:12:43.689 11:23:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:43.689 11:23:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:43.689 11:23:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:43.689 11:23:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:12:43.690 11:23:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe6144 00:12:43.690 11:23:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe6144 00:12:43.948 11:23:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha256 ffdhe6144 1 00:12:43.948 11:23:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:12:43.948 11:23:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha256 00:12:43.948 11:23:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe6144 00:12:43.948 11:23:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key1 00:12:43.948 11:23:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:12:43.948 11:23:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:12:43.948 11:23:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:43.948 11:23:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:43.948 11:23:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:43.948 11:23:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:12:43.948 11:23:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:12:43.948 11:23:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:12:44.515 00:12:44.515 11:23:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:12:44.515 11:23:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:12:44.515 11:23:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:12:44.773 11:23:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:12:44.773 11:23:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:12:44.773 11:23:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:44.773 11:23:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:44.773 11:23:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:44.773 11:23:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:12:44.773 { 00:12:44.773 "auth": { 00:12:44.773 "dhgroup": "ffdhe6144", 00:12:44.773 "digest": "sha256", 00:12:44.773 "state": "completed" 00:12:44.773 }, 00:12:44.773 "cntlid": 35, 00:12:44.773 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3", 00:12:44.773 "listen_address": { 00:12:44.773 "adrfam": "IPv4", 00:12:44.774 "traddr": "10.0.0.3", 00:12:44.774 "trsvcid": "4420", 00:12:44.774 "trtype": "TCP" 00:12:44.774 }, 00:12:44.774 "peer_address": { 00:12:44.774 "adrfam": "IPv4", 00:12:44.774 "traddr": "10.0.0.1", 00:12:44.774 "trsvcid": "59886", 00:12:44.774 "trtype": "TCP" 00:12:44.774 }, 00:12:44.774 "qid": 0, 00:12:44.774 "state": "enabled", 00:12:44.774 "thread": "nvmf_tgt_poll_group_000" 00:12:44.774 } 00:12:44.774 ]' 00:12:44.774 11:23:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:12:44.774 11:23:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha256 == \s\h\a\2\5\6 ]] 00:12:44.774 11:23:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:12:45.032 11:23:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe6144 == \f\f\d\h\e\6\1\4\4 ]] 00:12:45.032 11:23:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:12:45.032 11:23:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:12:45.032 11:23:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:12:45.032 11:23:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:12:45.291 11:23:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:01:N2VkMTc0ODgwNWQxZTM0NTk5OTYwMDk1NmQ5ZGE3YzEKeI3L: --dhchap-ctrl-secret DHHC-1:02:MzI4NjQxYjU2NThlMTY5N2Y3MDgwYmM0MDIxZDY2MmVkOGQyNDA0N2MzNWJlZDNicraO3Q==: 00:12:45.291 11:23:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --hostid 3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -l 0 --dhchap-secret DHHC-1:01:N2VkMTc0ODgwNWQxZTM0NTk5OTYwMDk1NmQ5ZGE3YzEKeI3L: --dhchap-ctrl-secret DHHC-1:02:MzI4NjQxYjU2NThlMTY5N2Y3MDgwYmM0MDIxZDY2MmVkOGQyNDA0N2MzNWJlZDNicraO3Q==: 00:12:45.858 11:23:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:12:45.858 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:12:45.858 11:23:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:12:45.858 11:23:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:45.858 11:23:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:45.858 11:23:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:45.858 11:23:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:12:45.858 11:23:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe6144 00:12:45.858 11:23:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe6144 00:12:46.478 11:23:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha256 ffdhe6144 2 00:12:46.478 11:23:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:12:46.478 11:23:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha256 00:12:46.478 11:23:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe6144 00:12:46.478 11:23:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key2 00:12:46.478 11:23:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:12:46.478 11:23:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:12:46.478 11:23:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:46.478 11:23:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:46.478 11:23:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:46.478 11:23:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:12:46.478 11:23:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:12:46.478 11:23:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:12:46.736 00:12:46.994 11:23:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:12:46.994 11:23:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:12:46.994 11:23:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:12:47.253 11:23:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:12:47.253 11:23:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:12:47.253 11:23:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:47.253 11:23:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:47.253 11:23:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:47.253 11:23:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:12:47.253 { 00:12:47.253 "auth": { 00:12:47.253 "dhgroup": "ffdhe6144", 00:12:47.253 "digest": "sha256", 00:12:47.253 "state": "completed" 00:12:47.253 }, 00:12:47.253 "cntlid": 37, 00:12:47.253 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3", 00:12:47.253 "listen_address": { 00:12:47.253 "adrfam": "IPv4", 00:12:47.253 "traddr": "10.0.0.3", 00:12:47.253 "trsvcid": "4420", 00:12:47.253 "trtype": "TCP" 00:12:47.253 }, 00:12:47.253 "peer_address": { 00:12:47.253 "adrfam": "IPv4", 00:12:47.253 "traddr": "10.0.0.1", 00:12:47.253 "trsvcid": "59926", 00:12:47.253 "trtype": "TCP" 00:12:47.253 }, 00:12:47.253 "qid": 0, 00:12:47.253 "state": "enabled", 00:12:47.253 "thread": "nvmf_tgt_poll_group_000" 00:12:47.253 } 00:12:47.253 ]' 00:12:47.253 11:23:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:12:47.253 11:23:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha256 == \s\h\a\2\5\6 ]] 00:12:47.253 11:23:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:12:47.253 11:23:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe6144 == \f\f\d\h\e\6\1\4\4 ]] 00:12:47.253 11:23:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:12:47.511 11:23:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:12:47.511 11:23:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:12:47.511 11:23:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:12:47.769 11:23:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:02:OGEwMDZmYzk3YTg5OWI0ZmJlYjViNmI2YmQzN2ViYjZiODhiMTM4MjEzY2ZlYmUzuaS9rg==: --dhchap-ctrl-secret DHHC-1:01:MTcxNjJmZTg3YTMxYmYyZDA0YmFhY2Q0M2Y3OGQwNzhGAzMl: 00:12:47.769 11:23:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --hostid 3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -l 0 --dhchap-secret DHHC-1:02:OGEwMDZmYzk3YTg5OWI0ZmJlYjViNmI2YmQzN2ViYjZiODhiMTM4MjEzY2ZlYmUzuaS9rg==: --dhchap-ctrl-secret DHHC-1:01:MTcxNjJmZTg3YTMxYmYyZDA0YmFhY2Q0M2Y3OGQwNzhGAzMl: 00:12:48.335 11:23:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:12:48.335 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:12:48.335 11:23:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:12:48.335 11:23:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:48.335 11:23:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:48.335 11:23:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:48.335 11:23:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:12:48.335 11:23:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe6144 00:12:48.335 11:23:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe6144 00:12:48.594 11:23:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha256 ffdhe6144 3 00:12:48.594 11:23:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:12:48.594 11:23:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha256 00:12:48.594 11:23:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe6144 00:12:48.594 11:23:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key3 00:12:48.594 11:23:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:12:48.594 11:23:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --dhchap-key key3 00:12:48.594 11:23:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:48.594 11:23:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:48.594 11:23:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:48.594 11:23:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key3 00:12:48.594 11:23:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:12:48.594 11:23:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:12:49.160 00:12:49.160 11:23:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:12:49.160 11:23:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:12:49.160 11:23:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:12:49.725 11:23:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:12:49.725 11:23:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:12:49.725 11:23:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:49.725 11:23:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:49.725 11:23:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:49.725 11:23:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:12:49.725 { 00:12:49.725 "auth": { 00:12:49.725 "dhgroup": "ffdhe6144", 00:12:49.725 "digest": "sha256", 00:12:49.725 "state": "completed" 00:12:49.725 }, 00:12:49.725 "cntlid": 39, 00:12:49.725 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3", 00:12:49.725 "listen_address": { 00:12:49.725 "adrfam": "IPv4", 00:12:49.725 "traddr": "10.0.0.3", 00:12:49.725 "trsvcid": "4420", 00:12:49.725 "trtype": "TCP" 00:12:49.725 }, 00:12:49.725 "peer_address": { 00:12:49.725 "adrfam": "IPv4", 00:12:49.725 "traddr": "10.0.0.1", 00:12:49.725 "trsvcid": "59952", 00:12:49.725 "trtype": "TCP" 00:12:49.725 }, 00:12:49.725 "qid": 0, 00:12:49.725 "state": "enabled", 00:12:49.725 "thread": "nvmf_tgt_poll_group_000" 00:12:49.725 } 00:12:49.725 ]' 00:12:49.725 11:23:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:12:49.725 11:23:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha256 == \s\h\a\2\5\6 ]] 00:12:49.725 11:23:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:12:49.725 11:23:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe6144 == \f\f\d\h\e\6\1\4\4 ]] 00:12:49.725 11:23:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:12:49.725 11:23:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:12:49.725 11:23:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:12:49.725 11:23:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:12:50.290 11:23:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:03:N2U1YWE0ZGQ4YmRkNTZjYWQ0MTY0MWM2OTQzMDJkZGEyZDRjYjMxYmFhOTU4YjVjMWVhMGJkYzhlMmY3NzBkZSCeOpc=: 00:12:50.290 11:23:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --hostid 3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -l 0 --dhchap-secret DHHC-1:03:N2U1YWE0ZGQ4YmRkNTZjYWQ0MTY0MWM2OTQzMDJkZGEyZDRjYjMxYmFhOTU4YjVjMWVhMGJkYzhlMmY3NzBkZSCeOpc=: 00:12:50.855 11:23:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:12:50.855 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:12:50.855 11:23:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:12:50.855 11:23:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:50.855 11:23:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:50.855 11:23:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:50.855 11:23:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@119 -- # for dhgroup in "${dhgroups[@]}" 00:12:50.855 11:23:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:12:50.855 11:23:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe8192 00:12:50.855 11:23:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe8192 00:12:51.113 11:23:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha256 ffdhe8192 0 00:12:51.113 11:23:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:12:51.113 11:23:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha256 00:12:51.113 11:23:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe8192 00:12:51.113 11:23:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key0 00:12:51.113 11:23:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:12:51.113 11:23:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:12:51.113 11:23:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:51.113 11:23:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:51.113 11:23:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:51.113 11:23:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:12:51.113 11:23:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:12:51.113 11:23:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:12:52.083 00:12:52.083 11:23:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:12:52.083 11:23:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:12:52.083 11:23:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:12:52.083 11:23:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:12:52.083 11:23:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:12:52.083 11:23:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:52.083 11:23:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:52.083 11:23:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:52.083 11:23:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:12:52.083 { 00:12:52.083 "auth": { 00:12:52.083 "dhgroup": "ffdhe8192", 00:12:52.083 "digest": "sha256", 00:12:52.083 "state": "completed" 00:12:52.083 }, 00:12:52.083 "cntlid": 41, 00:12:52.083 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3", 00:12:52.083 "listen_address": { 00:12:52.083 "adrfam": "IPv4", 00:12:52.083 "traddr": "10.0.0.3", 00:12:52.083 "trsvcid": "4420", 00:12:52.083 "trtype": "TCP" 00:12:52.083 }, 00:12:52.083 "peer_address": { 00:12:52.083 "adrfam": "IPv4", 00:12:52.083 "traddr": "10.0.0.1", 00:12:52.083 "trsvcid": "41704", 00:12:52.083 "trtype": "TCP" 00:12:52.083 }, 00:12:52.083 "qid": 0, 00:12:52.083 "state": "enabled", 00:12:52.083 "thread": "nvmf_tgt_poll_group_000" 00:12:52.083 } 00:12:52.083 ]' 00:12:52.083 11:23:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:12:52.341 11:23:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha256 == \s\h\a\2\5\6 ]] 00:12:52.341 11:23:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:12:52.341 11:23:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe8192 == \f\f\d\h\e\8\1\9\2 ]] 00:12:52.341 11:23:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:12:52.341 11:23:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:12:52.341 11:23:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:12:52.341 11:23:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:12:52.599 11:23:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:00:YjQ0ZWQzNjNjMTQzYmZkMDJkM2FmYzIyMTEyMmY0MGExMDAwNWQ5ZWY2NGE2NjBjPhDLOQ==: --dhchap-ctrl-secret DHHC-1:03:NDMwZGJjZWY5ZWEzMDMxODE1MjFlOWMyMDkyYTNlYzA0Yjk3ZGM2MDJlMDQ4OTFhNWUwMjIyM2E4ZGVjMWU5Y1IEScw=: 00:12:52.599 11:23:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --hostid 3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -l 0 --dhchap-secret DHHC-1:00:YjQ0ZWQzNjNjMTQzYmZkMDJkM2FmYzIyMTEyMmY0MGExMDAwNWQ5ZWY2NGE2NjBjPhDLOQ==: --dhchap-ctrl-secret DHHC-1:03:NDMwZGJjZWY5ZWEzMDMxODE1MjFlOWMyMDkyYTNlYzA0Yjk3ZGM2MDJlMDQ4OTFhNWUwMjIyM2E4ZGVjMWU5Y1IEScw=: 00:12:53.530 11:23:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:12:53.530 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:12:53.530 11:23:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:12:53.530 11:23:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:53.530 11:23:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:53.530 11:23:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:53.530 11:23:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:12:53.530 11:23:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe8192 00:12:53.530 11:23:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe8192 00:12:53.530 11:23:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha256 ffdhe8192 1 00:12:53.530 11:23:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:12:53.530 11:23:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha256 00:12:53.530 11:23:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe8192 00:12:53.530 11:23:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key1 00:12:53.530 11:23:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:12:53.530 11:23:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:12:53.530 11:23:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:53.530 11:23:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:53.530 11:23:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:53.530 11:23:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:12:53.531 11:23:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:12:53.531 11:23:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:12:54.466 00:12:54.466 11:23:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:12:54.466 11:23:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:12:54.466 11:23:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:12:54.466 11:23:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:12:54.466 11:23:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:12:54.466 11:23:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:54.466 11:23:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:54.742 11:23:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:54.742 11:23:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:12:54.742 { 00:12:54.742 "auth": { 00:12:54.743 "dhgroup": "ffdhe8192", 00:12:54.743 "digest": "sha256", 00:12:54.743 "state": "completed" 00:12:54.743 }, 00:12:54.743 "cntlid": 43, 00:12:54.743 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3", 00:12:54.743 "listen_address": { 00:12:54.743 "adrfam": "IPv4", 00:12:54.743 "traddr": "10.0.0.3", 00:12:54.743 "trsvcid": "4420", 00:12:54.743 "trtype": "TCP" 00:12:54.743 }, 00:12:54.743 "peer_address": { 00:12:54.743 "adrfam": "IPv4", 00:12:54.743 "traddr": "10.0.0.1", 00:12:54.743 "trsvcid": "41740", 00:12:54.743 "trtype": "TCP" 00:12:54.743 }, 00:12:54.743 "qid": 0, 00:12:54.743 "state": "enabled", 00:12:54.743 "thread": "nvmf_tgt_poll_group_000" 00:12:54.743 } 00:12:54.743 ]' 00:12:54.743 11:23:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:12:54.743 11:23:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha256 == \s\h\a\2\5\6 ]] 00:12:54.743 11:23:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:12:54.743 11:23:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe8192 == \f\f\d\h\e\8\1\9\2 ]] 00:12:54.743 11:23:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:12:54.743 11:23:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:12:54.743 11:23:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:12:54.743 11:23:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:12:55.000 11:23:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:01:N2VkMTc0ODgwNWQxZTM0NTk5OTYwMDk1NmQ5ZGE3YzEKeI3L: --dhchap-ctrl-secret DHHC-1:02:MzI4NjQxYjU2NThlMTY5N2Y3MDgwYmM0MDIxZDY2MmVkOGQyNDA0N2MzNWJlZDNicraO3Q==: 00:12:55.000 11:23:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --hostid 3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -l 0 --dhchap-secret DHHC-1:01:N2VkMTc0ODgwNWQxZTM0NTk5OTYwMDk1NmQ5ZGE3YzEKeI3L: --dhchap-ctrl-secret DHHC-1:02:MzI4NjQxYjU2NThlMTY5N2Y3MDgwYmM0MDIxZDY2MmVkOGQyNDA0N2MzNWJlZDNicraO3Q==: 00:12:55.934 11:23:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:12:55.934 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:12:55.934 11:23:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:12:55.934 11:23:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:55.934 11:23:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:55.934 11:23:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:55.934 11:23:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:12:55.934 11:23:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe8192 00:12:55.934 11:23:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe8192 00:12:56.192 11:23:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha256 ffdhe8192 2 00:12:56.192 11:23:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:12:56.192 11:23:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha256 00:12:56.192 11:23:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe8192 00:12:56.192 11:23:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key2 00:12:56.192 11:23:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:12:56.192 11:23:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:12:56.192 11:23:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:56.192 11:23:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:56.192 11:23:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:56.192 11:23:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:12:56.192 11:23:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:12:56.192 11:23:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:12:56.757 00:12:56.757 11:23:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:12:56.757 11:23:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:12:56.757 11:23:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:12:57.324 11:23:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:12:57.324 11:23:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:12:57.324 11:23:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:57.324 11:23:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:57.324 11:23:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:57.324 11:23:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:12:57.324 { 00:12:57.324 "auth": { 00:12:57.324 "dhgroup": "ffdhe8192", 00:12:57.324 "digest": "sha256", 00:12:57.324 "state": "completed" 00:12:57.324 }, 00:12:57.324 "cntlid": 45, 00:12:57.324 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3", 00:12:57.324 "listen_address": { 00:12:57.324 "adrfam": "IPv4", 00:12:57.324 "traddr": "10.0.0.3", 00:12:57.324 "trsvcid": "4420", 00:12:57.324 "trtype": "TCP" 00:12:57.324 }, 00:12:57.324 "peer_address": { 00:12:57.324 "adrfam": "IPv4", 00:12:57.324 "traddr": "10.0.0.1", 00:12:57.324 "trsvcid": "41764", 00:12:57.324 "trtype": "TCP" 00:12:57.324 }, 00:12:57.324 "qid": 0, 00:12:57.324 "state": "enabled", 00:12:57.324 "thread": "nvmf_tgt_poll_group_000" 00:12:57.324 } 00:12:57.324 ]' 00:12:57.324 11:23:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:12:57.324 11:23:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha256 == \s\h\a\2\5\6 ]] 00:12:57.324 11:23:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:12:57.324 11:23:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe8192 == \f\f\d\h\e\8\1\9\2 ]] 00:12:57.324 11:23:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:12:57.324 11:23:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:12:57.324 11:23:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:12:57.324 11:23:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:12:57.592 11:23:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:02:OGEwMDZmYzk3YTg5OWI0ZmJlYjViNmI2YmQzN2ViYjZiODhiMTM4MjEzY2ZlYmUzuaS9rg==: --dhchap-ctrl-secret DHHC-1:01:MTcxNjJmZTg3YTMxYmYyZDA0YmFhY2Q0M2Y3OGQwNzhGAzMl: 00:12:57.592 11:23:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --hostid 3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -l 0 --dhchap-secret DHHC-1:02:OGEwMDZmYzk3YTg5OWI0ZmJlYjViNmI2YmQzN2ViYjZiODhiMTM4MjEzY2ZlYmUzuaS9rg==: --dhchap-ctrl-secret DHHC-1:01:MTcxNjJmZTg3YTMxYmYyZDA0YmFhY2Q0M2Y3OGQwNzhGAzMl: 00:12:58.524 11:23:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:12:58.524 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:12:58.524 11:23:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:12:58.524 11:23:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:58.524 11:23:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:58.524 11:23:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:58.524 11:23:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:12:58.524 11:23:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe8192 00:12:58.524 11:23:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe8192 00:12:58.784 11:23:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha256 ffdhe8192 3 00:12:58.784 11:23:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:12:58.784 11:23:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha256 00:12:58.784 11:23:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe8192 00:12:58.784 11:23:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key3 00:12:58.784 11:23:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:12:58.784 11:23:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --dhchap-key key3 00:12:58.784 11:23:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:58.784 11:23:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:58.784 11:23:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:58.784 11:23:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key3 00:12:58.784 11:23:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:12:58.784 11:23:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:12:59.718 00:12:59.718 11:23:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:12:59.718 11:23:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:12:59.718 11:23:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:12:59.976 11:23:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:12:59.976 11:23:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:12:59.976 11:23:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:59.976 11:23:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:12:59.976 11:23:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:59.976 11:23:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:12:59.976 { 00:12:59.976 "auth": { 00:12:59.976 "dhgroup": "ffdhe8192", 00:12:59.976 "digest": "sha256", 00:12:59.976 "state": "completed" 00:12:59.976 }, 00:12:59.976 "cntlid": 47, 00:12:59.976 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3", 00:12:59.976 "listen_address": { 00:12:59.976 "adrfam": "IPv4", 00:12:59.976 "traddr": "10.0.0.3", 00:12:59.976 "trsvcid": "4420", 00:12:59.976 "trtype": "TCP" 00:12:59.976 }, 00:12:59.976 "peer_address": { 00:12:59.976 "adrfam": "IPv4", 00:12:59.976 "traddr": "10.0.0.1", 00:12:59.976 "trsvcid": "41796", 00:12:59.976 "trtype": "TCP" 00:12:59.976 }, 00:12:59.976 "qid": 0, 00:12:59.976 "state": "enabled", 00:12:59.976 "thread": "nvmf_tgt_poll_group_000" 00:12:59.976 } 00:12:59.976 ]' 00:12:59.976 11:23:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:12:59.976 11:23:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha256 == \s\h\a\2\5\6 ]] 00:12:59.976 11:23:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:12:59.976 11:23:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe8192 == \f\f\d\h\e\8\1\9\2 ]] 00:12:59.976 11:23:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:12:59.976 11:23:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:12:59.976 11:23:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:12:59.976 11:23:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:13:00.562 11:23:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:03:N2U1YWE0ZGQ4YmRkNTZjYWQ0MTY0MWM2OTQzMDJkZGEyZDRjYjMxYmFhOTU4YjVjMWVhMGJkYzhlMmY3NzBkZSCeOpc=: 00:13:00.562 11:23:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --hostid 3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -l 0 --dhchap-secret DHHC-1:03:N2U1YWE0ZGQ4YmRkNTZjYWQ0MTY0MWM2OTQzMDJkZGEyZDRjYjMxYmFhOTU4YjVjMWVhMGJkYzhlMmY3NzBkZSCeOpc=: 00:13:01.135 11:23:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:13:01.135 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:13:01.135 11:23:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:13:01.135 11:23:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:01.135 11:23:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:01.135 11:23:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:01.135 11:23:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@118 -- # for digest in "${digests[@]}" 00:13:01.135 11:23:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@119 -- # for dhgroup in "${dhgroups[@]}" 00:13:01.135 11:23:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:13:01.135 11:23:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups null 00:13:01.135 11:23:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups null 00:13:01.394 11:23:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha384 null 0 00:13:01.394 11:23:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:13:01.394 11:23:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha384 00:13:01.394 11:23:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=null 00:13:01.394 11:23:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key0 00:13:01.394 11:23:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:13:01.394 11:23:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:13:01.394 11:23:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:01.394 11:23:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:01.394 11:23:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:01.394 11:23:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:13:01.394 11:23:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:13:01.394 11:23:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:13:01.958 00:13:01.958 11:23:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:13:01.958 11:23:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:13:01.958 11:23:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:13:02.215 11:23:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:13:02.215 11:23:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:13:02.215 11:23:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:02.215 11:23:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:02.215 11:23:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:02.215 11:23:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:13:02.215 { 00:13:02.215 "auth": { 00:13:02.215 "dhgroup": "null", 00:13:02.215 "digest": "sha384", 00:13:02.215 "state": "completed" 00:13:02.215 }, 00:13:02.215 "cntlid": 49, 00:13:02.215 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3", 00:13:02.215 "listen_address": { 00:13:02.215 "adrfam": "IPv4", 00:13:02.215 "traddr": "10.0.0.3", 00:13:02.215 "trsvcid": "4420", 00:13:02.215 "trtype": "TCP" 00:13:02.215 }, 00:13:02.215 "peer_address": { 00:13:02.215 "adrfam": "IPv4", 00:13:02.215 "traddr": "10.0.0.1", 00:13:02.215 "trsvcid": "56268", 00:13:02.215 "trtype": "TCP" 00:13:02.215 }, 00:13:02.215 "qid": 0, 00:13:02.215 "state": "enabled", 00:13:02.215 "thread": "nvmf_tgt_poll_group_000" 00:13:02.215 } 00:13:02.215 ]' 00:13:02.215 11:23:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:13:02.215 11:23:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha384 == \s\h\a\3\8\4 ]] 00:13:02.215 11:23:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:13:02.215 11:23:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ null == \n\u\l\l ]] 00:13:02.215 11:23:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:13:02.215 11:23:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:13:02.215 11:23:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:13:02.215 11:23:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:13:02.472 11:23:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:00:YjQ0ZWQzNjNjMTQzYmZkMDJkM2FmYzIyMTEyMmY0MGExMDAwNWQ5ZWY2NGE2NjBjPhDLOQ==: --dhchap-ctrl-secret DHHC-1:03:NDMwZGJjZWY5ZWEzMDMxODE1MjFlOWMyMDkyYTNlYzA0Yjk3ZGM2MDJlMDQ4OTFhNWUwMjIyM2E4ZGVjMWU5Y1IEScw=: 00:13:02.472 11:23:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --hostid 3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -l 0 --dhchap-secret DHHC-1:00:YjQ0ZWQzNjNjMTQzYmZkMDJkM2FmYzIyMTEyMmY0MGExMDAwNWQ5ZWY2NGE2NjBjPhDLOQ==: --dhchap-ctrl-secret DHHC-1:03:NDMwZGJjZWY5ZWEzMDMxODE1MjFlOWMyMDkyYTNlYzA0Yjk3ZGM2MDJlMDQ4OTFhNWUwMjIyM2E4ZGVjMWU5Y1IEScw=: 00:13:03.403 11:23:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:13:03.403 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:13:03.403 11:23:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:13:03.403 11:23:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:03.403 11:23:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:03.403 11:23:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:03.403 11:23:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:13:03.403 11:23:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups null 00:13:03.403 11:23:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups null 00:13:03.660 11:23:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha384 null 1 00:13:03.660 11:23:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:13:03.660 11:23:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha384 00:13:03.660 11:23:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=null 00:13:03.660 11:23:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key1 00:13:03.660 11:23:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:13:03.660 11:23:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:13:03.660 11:23:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:03.660 11:23:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:03.660 11:23:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:03.660 11:23:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:13:03.660 11:23:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:13:03.660 11:23:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:13:03.918 00:13:03.918 11:23:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:13:03.918 11:23:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:13:03.918 11:23:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:13:04.176 11:23:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:13:04.176 11:23:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:13:04.176 11:23:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:04.176 11:23:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:04.176 11:23:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:04.176 11:23:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:13:04.176 { 00:13:04.176 "auth": { 00:13:04.176 "dhgroup": "null", 00:13:04.176 "digest": "sha384", 00:13:04.176 "state": "completed" 00:13:04.176 }, 00:13:04.176 "cntlid": 51, 00:13:04.176 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3", 00:13:04.176 "listen_address": { 00:13:04.176 "adrfam": "IPv4", 00:13:04.176 "traddr": "10.0.0.3", 00:13:04.176 "trsvcid": "4420", 00:13:04.176 "trtype": "TCP" 00:13:04.176 }, 00:13:04.176 "peer_address": { 00:13:04.176 "adrfam": "IPv4", 00:13:04.176 "traddr": "10.0.0.1", 00:13:04.176 "trsvcid": "56286", 00:13:04.176 "trtype": "TCP" 00:13:04.176 }, 00:13:04.176 "qid": 0, 00:13:04.176 "state": "enabled", 00:13:04.176 "thread": "nvmf_tgt_poll_group_000" 00:13:04.176 } 00:13:04.176 ]' 00:13:04.176 11:23:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:13:04.176 11:23:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha384 == \s\h\a\3\8\4 ]] 00:13:04.176 11:23:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:13:04.435 11:23:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ null == \n\u\l\l ]] 00:13:04.435 11:23:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:13:04.435 11:23:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:13:04.435 11:23:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:13:04.435 11:23:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:13:04.693 11:23:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:01:N2VkMTc0ODgwNWQxZTM0NTk5OTYwMDk1NmQ5ZGE3YzEKeI3L: --dhchap-ctrl-secret DHHC-1:02:MzI4NjQxYjU2NThlMTY5N2Y3MDgwYmM0MDIxZDY2MmVkOGQyNDA0N2MzNWJlZDNicraO3Q==: 00:13:04.693 11:23:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --hostid 3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -l 0 --dhchap-secret DHHC-1:01:N2VkMTc0ODgwNWQxZTM0NTk5OTYwMDk1NmQ5ZGE3YzEKeI3L: --dhchap-ctrl-secret DHHC-1:02:MzI4NjQxYjU2NThlMTY5N2Y3MDgwYmM0MDIxZDY2MmVkOGQyNDA0N2MzNWJlZDNicraO3Q==: 00:13:05.259 11:23:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:13:05.259 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:13:05.516 11:23:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:13:05.516 11:23:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:05.516 11:23:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:05.516 11:23:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:05.516 11:23:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:13:05.516 11:23:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups null 00:13:05.516 11:23:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups null 00:13:05.774 11:23:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha384 null 2 00:13:05.774 11:23:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:13:05.775 11:23:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha384 00:13:05.775 11:23:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=null 00:13:05.775 11:23:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key2 00:13:05.775 11:23:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:13:05.775 11:23:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:13:05.775 11:23:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:05.775 11:23:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:05.775 11:23:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:05.775 11:23:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:13:05.775 11:23:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:13:05.775 11:23:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:13:06.032 00:13:06.032 11:23:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:13:06.032 11:23:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:13:06.032 11:23:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:13:06.598 11:23:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:13:06.598 11:23:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:13:06.598 11:23:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:06.598 11:23:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:06.598 11:23:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:06.598 11:23:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:13:06.598 { 00:13:06.598 "auth": { 00:13:06.598 "dhgroup": "null", 00:13:06.598 "digest": "sha384", 00:13:06.598 "state": "completed" 00:13:06.598 }, 00:13:06.598 "cntlid": 53, 00:13:06.598 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3", 00:13:06.598 "listen_address": { 00:13:06.598 "adrfam": "IPv4", 00:13:06.598 "traddr": "10.0.0.3", 00:13:06.598 "trsvcid": "4420", 00:13:06.598 "trtype": "TCP" 00:13:06.598 }, 00:13:06.598 "peer_address": { 00:13:06.598 "adrfam": "IPv4", 00:13:06.598 "traddr": "10.0.0.1", 00:13:06.598 "trsvcid": "56308", 00:13:06.598 "trtype": "TCP" 00:13:06.598 }, 00:13:06.598 "qid": 0, 00:13:06.598 "state": "enabled", 00:13:06.598 "thread": "nvmf_tgt_poll_group_000" 00:13:06.598 } 00:13:06.598 ]' 00:13:06.598 11:23:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:13:06.598 11:23:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha384 == \s\h\a\3\8\4 ]] 00:13:06.598 11:23:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:13:06.598 11:23:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ null == \n\u\l\l ]] 00:13:06.598 11:23:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:13:06.598 11:23:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:13:06.598 11:23:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:13:06.598 11:23:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:13:06.855 11:23:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:02:OGEwMDZmYzk3YTg5OWI0ZmJlYjViNmI2YmQzN2ViYjZiODhiMTM4MjEzY2ZlYmUzuaS9rg==: --dhchap-ctrl-secret DHHC-1:01:MTcxNjJmZTg3YTMxYmYyZDA0YmFhY2Q0M2Y3OGQwNzhGAzMl: 00:13:06.855 11:23:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --hostid 3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -l 0 --dhchap-secret DHHC-1:02:OGEwMDZmYzk3YTg5OWI0ZmJlYjViNmI2YmQzN2ViYjZiODhiMTM4MjEzY2ZlYmUzuaS9rg==: --dhchap-ctrl-secret DHHC-1:01:MTcxNjJmZTg3YTMxYmYyZDA0YmFhY2Q0M2Y3OGQwNzhGAzMl: 00:13:07.787 11:23:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:13:07.787 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:13:07.787 11:23:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:13:07.787 11:23:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:07.787 11:23:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:07.787 11:23:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:07.787 11:23:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:13:07.787 11:23:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups null 00:13:07.787 11:23:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups null 00:13:08.045 11:23:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha384 null 3 00:13:08.045 11:23:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:13:08.045 11:23:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha384 00:13:08.045 11:23:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=null 00:13:08.045 11:23:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key3 00:13:08.045 11:23:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:13:08.045 11:23:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --dhchap-key key3 00:13:08.045 11:23:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:08.045 11:23:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:08.045 11:23:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:08.045 11:23:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key3 00:13:08.045 11:23:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:13:08.045 11:23:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:13:08.303 00:13:08.303 11:23:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:13:08.304 11:23:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:13:08.304 11:23:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:13:08.868 11:23:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:13:08.868 11:23:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:13:08.868 11:23:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:08.868 11:23:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:08.868 11:23:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:08.868 11:23:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:13:08.868 { 00:13:08.868 "auth": { 00:13:08.868 "dhgroup": "null", 00:13:08.868 "digest": "sha384", 00:13:08.868 "state": "completed" 00:13:08.868 }, 00:13:08.868 "cntlid": 55, 00:13:08.868 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3", 00:13:08.868 "listen_address": { 00:13:08.868 "adrfam": "IPv4", 00:13:08.868 "traddr": "10.0.0.3", 00:13:08.868 "trsvcid": "4420", 00:13:08.868 "trtype": "TCP" 00:13:08.868 }, 00:13:08.868 "peer_address": { 00:13:08.868 "adrfam": "IPv4", 00:13:08.868 "traddr": "10.0.0.1", 00:13:08.868 "trsvcid": "56336", 00:13:08.868 "trtype": "TCP" 00:13:08.868 }, 00:13:08.868 "qid": 0, 00:13:08.868 "state": "enabled", 00:13:08.868 "thread": "nvmf_tgt_poll_group_000" 00:13:08.868 } 00:13:08.868 ]' 00:13:08.868 11:23:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:13:08.868 11:23:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha384 == \s\h\a\3\8\4 ]] 00:13:08.868 11:23:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:13:08.868 11:23:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ null == \n\u\l\l ]] 00:13:08.868 11:23:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:13:08.868 11:23:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:13:08.868 11:23:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:13:08.868 11:23:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:13:09.126 11:23:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:03:N2U1YWE0ZGQ4YmRkNTZjYWQ0MTY0MWM2OTQzMDJkZGEyZDRjYjMxYmFhOTU4YjVjMWVhMGJkYzhlMmY3NzBkZSCeOpc=: 00:13:09.126 11:23:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --hostid 3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -l 0 --dhchap-secret DHHC-1:03:N2U1YWE0ZGQ4YmRkNTZjYWQ0MTY0MWM2OTQzMDJkZGEyZDRjYjMxYmFhOTU4YjVjMWVhMGJkYzhlMmY3NzBkZSCeOpc=: 00:13:10.056 11:23:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:13:10.056 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:13:10.056 11:23:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:13:10.056 11:23:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:10.056 11:23:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:10.056 11:23:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:10.056 11:23:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@119 -- # for dhgroup in "${dhgroups[@]}" 00:13:10.056 11:23:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:13:10.056 11:23:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe2048 00:13:10.056 11:23:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe2048 00:13:10.313 11:23:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha384 ffdhe2048 0 00:13:10.313 11:23:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:13:10.313 11:23:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha384 00:13:10.313 11:23:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe2048 00:13:10.313 11:23:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key0 00:13:10.313 11:23:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:13:10.313 11:23:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:13:10.313 11:23:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:10.313 11:23:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:10.313 11:23:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:10.313 11:23:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:13:10.313 11:23:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:13:10.313 11:23:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:13:10.570 00:13:10.570 11:23:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:13:10.570 11:23:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:13:10.570 11:23:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:13:10.826 11:23:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:13:10.826 11:23:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:13:10.826 11:23:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:10.826 11:23:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:10.826 11:23:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:10.826 11:23:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:13:10.826 { 00:13:10.826 "auth": { 00:13:10.826 "dhgroup": "ffdhe2048", 00:13:10.826 "digest": "sha384", 00:13:10.826 "state": "completed" 00:13:10.826 }, 00:13:10.826 "cntlid": 57, 00:13:10.826 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3", 00:13:10.826 "listen_address": { 00:13:10.826 "adrfam": "IPv4", 00:13:10.826 "traddr": "10.0.0.3", 00:13:10.826 "trsvcid": "4420", 00:13:10.826 "trtype": "TCP" 00:13:10.826 }, 00:13:10.826 "peer_address": { 00:13:10.826 "adrfam": "IPv4", 00:13:10.826 "traddr": "10.0.0.1", 00:13:10.826 "trsvcid": "43328", 00:13:10.826 "trtype": "TCP" 00:13:10.826 }, 00:13:10.826 "qid": 0, 00:13:10.826 "state": "enabled", 00:13:10.826 "thread": "nvmf_tgt_poll_group_000" 00:13:10.826 } 00:13:10.826 ]' 00:13:10.826 11:23:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:13:11.084 11:23:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha384 == \s\h\a\3\8\4 ]] 00:13:11.084 11:23:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:13:11.084 11:23:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe2048 == \f\f\d\h\e\2\0\4\8 ]] 00:13:11.084 11:23:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:13:11.084 11:23:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:13:11.084 11:23:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:13:11.084 11:23:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:13:11.342 11:23:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:00:YjQ0ZWQzNjNjMTQzYmZkMDJkM2FmYzIyMTEyMmY0MGExMDAwNWQ5ZWY2NGE2NjBjPhDLOQ==: --dhchap-ctrl-secret DHHC-1:03:NDMwZGJjZWY5ZWEzMDMxODE1MjFlOWMyMDkyYTNlYzA0Yjk3ZGM2MDJlMDQ4OTFhNWUwMjIyM2E4ZGVjMWU5Y1IEScw=: 00:13:11.342 11:23:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --hostid 3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -l 0 --dhchap-secret DHHC-1:00:YjQ0ZWQzNjNjMTQzYmZkMDJkM2FmYzIyMTEyMmY0MGExMDAwNWQ5ZWY2NGE2NjBjPhDLOQ==: --dhchap-ctrl-secret DHHC-1:03:NDMwZGJjZWY5ZWEzMDMxODE1MjFlOWMyMDkyYTNlYzA0Yjk3ZGM2MDJlMDQ4OTFhNWUwMjIyM2E4ZGVjMWU5Y1IEScw=: 00:13:11.907 11:23:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:13:12.166 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:13:12.166 11:23:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:13:12.166 11:23:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:12.166 11:23:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:12.166 11:23:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:12.166 11:23:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:13:12.166 11:23:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe2048 00:13:12.166 11:23:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe2048 00:13:12.425 11:23:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha384 ffdhe2048 1 00:13:12.425 11:23:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:13:12.425 11:23:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha384 00:13:12.425 11:23:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe2048 00:13:12.425 11:23:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key1 00:13:12.425 11:23:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:13:12.425 11:23:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:13:12.425 11:23:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:12.425 11:23:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:12.425 11:23:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:12.425 11:23:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:13:12.425 11:23:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:13:12.425 11:23:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:13:12.683 00:13:12.683 11:23:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:13:12.683 11:23:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:13:12.683 11:23:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:13:13.248 11:23:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:13:13.249 11:23:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:13:13.249 11:23:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:13.249 11:23:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:13.249 11:23:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:13.249 11:23:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:13:13.249 { 00:13:13.249 "auth": { 00:13:13.249 "dhgroup": "ffdhe2048", 00:13:13.249 "digest": "sha384", 00:13:13.249 "state": "completed" 00:13:13.249 }, 00:13:13.249 "cntlid": 59, 00:13:13.249 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3", 00:13:13.249 "listen_address": { 00:13:13.249 "adrfam": "IPv4", 00:13:13.249 "traddr": "10.0.0.3", 00:13:13.249 "trsvcid": "4420", 00:13:13.249 "trtype": "TCP" 00:13:13.249 }, 00:13:13.249 "peer_address": { 00:13:13.249 "adrfam": "IPv4", 00:13:13.249 "traddr": "10.0.0.1", 00:13:13.249 "trsvcid": "43354", 00:13:13.249 "trtype": "TCP" 00:13:13.249 }, 00:13:13.249 "qid": 0, 00:13:13.249 "state": "enabled", 00:13:13.249 "thread": "nvmf_tgt_poll_group_000" 00:13:13.249 } 00:13:13.249 ]' 00:13:13.249 11:23:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:13:13.249 11:23:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha384 == \s\h\a\3\8\4 ]] 00:13:13.249 11:23:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:13:13.249 11:23:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe2048 == \f\f\d\h\e\2\0\4\8 ]] 00:13:13.249 11:23:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:13:13.249 11:23:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:13:13.249 11:23:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:13:13.249 11:23:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:13:13.507 11:23:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:01:N2VkMTc0ODgwNWQxZTM0NTk5OTYwMDk1NmQ5ZGE3YzEKeI3L: --dhchap-ctrl-secret DHHC-1:02:MzI4NjQxYjU2NThlMTY5N2Y3MDgwYmM0MDIxZDY2MmVkOGQyNDA0N2MzNWJlZDNicraO3Q==: 00:13:13.507 11:23:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --hostid 3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -l 0 --dhchap-secret DHHC-1:01:N2VkMTc0ODgwNWQxZTM0NTk5OTYwMDk1NmQ5ZGE3YzEKeI3L: --dhchap-ctrl-secret DHHC-1:02:MzI4NjQxYjU2NThlMTY5N2Y3MDgwYmM0MDIxZDY2MmVkOGQyNDA0N2MzNWJlZDNicraO3Q==: 00:13:14.441 11:23:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:13:14.441 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:13:14.441 11:23:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:13:14.441 11:23:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:14.441 11:23:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:14.441 11:23:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:14.441 11:23:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:13:14.441 11:23:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe2048 00:13:14.441 11:23:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe2048 00:13:14.699 11:23:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha384 ffdhe2048 2 00:13:14.699 11:23:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:13:14.699 11:23:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha384 00:13:14.699 11:23:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe2048 00:13:14.699 11:23:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key2 00:13:14.699 11:23:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:13:14.699 11:23:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:13:14.699 11:23:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:14.699 11:23:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:14.699 11:23:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:14.699 11:23:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:13:14.699 11:23:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:13:14.699 11:23:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:13:14.957 00:13:15.215 11:23:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:13:15.215 11:23:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:13:15.215 11:23:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:13:15.473 11:23:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:13:15.473 11:23:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:13:15.473 11:23:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:15.473 11:23:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:15.473 11:23:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:15.473 11:23:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:13:15.473 { 00:13:15.473 "auth": { 00:13:15.473 "dhgroup": "ffdhe2048", 00:13:15.473 "digest": "sha384", 00:13:15.473 "state": "completed" 00:13:15.473 }, 00:13:15.473 "cntlid": 61, 00:13:15.473 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3", 00:13:15.473 "listen_address": { 00:13:15.473 "adrfam": "IPv4", 00:13:15.473 "traddr": "10.0.0.3", 00:13:15.473 "trsvcid": "4420", 00:13:15.473 "trtype": "TCP" 00:13:15.473 }, 00:13:15.473 "peer_address": { 00:13:15.473 "adrfam": "IPv4", 00:13:15.473 "traddr": "10.0.0.1", 00:13:15.473 "trsvcid": "43378", 00:13:15.473 "trtype": "TCP" 00:13:15.473 }, 00:13:15.473 "qid": 0, 00:13:15.473 "state": "enabled", 00:13:15.473 "thread": "nvmf_tgt_poll_group_000" 00:13:15.473 } 00:13:15.473 ]' 00:13:15.473 11:23:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:13:15.473 11:23:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha384 == \s\h\a\3\8\4 ]] 00:13:15.473 11:23:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:13:15.473 11:23:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe2048 == \f\f\d\h\e\2\0\4\8 ]] 00:13:15.473 11:23:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:13:15.473 11:23:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:13:15.473 11:23:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:13:15.473 11:23:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:13:16.038 11:23:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:02:OGEwMDZmYzk3YTg5OWI0ZmJlYjViNmI2YmQzN2ViYjZiODhiMTM4MjEzY2ZlYmUzuaS9rg==: --dhchap-ctrl-secret DHHC-1:01:MTcxNjJmZTg3YTMxYmYyZDA0YmFhY2Q0M2Y3OGQwNzhGAzMl: 00:13:16.038 11:23:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --hostid 3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -l 0 --dhchap-secret DHHC-1:02:OGEwMDZmYzk3YTg5OWI0ZmJlYjViNmI2YmQzN2ViYjZiODhiMTM4MjEzY2ZlYmUzuaS9rg==: --dhchap-ctrl-secret DHHC-1:01:MTcxNjJmZTg3YTMxYmYyZDA0YmFhY2Q0M2Y3OGQwNzhGAzMl: 00:13:16.603 11:23:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:13:16.603 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:13:16.603 11:23:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:13:16.603 11:23:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:16.603 11:23:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:16.603 11:23:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:16.603 11:23:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:13:16.603 11:23:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe2048 00:13:16.603 11:23:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe2048 00:13:16.862 11:23:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha384 ffdhe2048 3 00:13:16.862 11:23:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:13:16.862 11:23:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha384 00:13:16.862 11:23:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe2048 00:13:16.862 11:23:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key3 00:13:16.862 11:23:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:13:16.862 11:23:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --dhchap-key key3 00:13:16.862 11:23:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:16.862 11:23:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:16.862 11:23:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:16.862 11:23:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key3 00:13:16.862 11:23:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:13:16.862 11:23:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:13:17.120 00:13:17.120 11:23:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:13:17.120 11:23:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:13:17.120 11:23:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:13:17.686 11:23:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:13:17.686 11:23:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:13:17.686 11:23:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:17.686 11:23:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:17.686 11:23:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:17.686 11:23:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:13:17.686 { 00:13:17.686 "auth": { 00:13:17.686 "dhgroup": "ffdhe2048", 00:13:17.686 "digest": "sha384", 00:13:17.686 "state": "completed" 00:13:17.686 }, 00:13:17.686 "cntlid": 63, 00:13:17.686 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3", 00:13:17.686 "listen_address": { 00:13:17.686 "adrfam": "IPv4", 00:13:17.686 "traddr": "10.0.0.3", 00:13:17.686 "trsvcid": "4420", 00:13:17.686 "trtype": "TCP" 00:13:17.686 }, 00:13:17.686 "peer_address": { 00:13:17.686 "adrfam": "IPv4", 00:13:17.686 "traddr": "10.0.0.1", 00:13:17.686 "trsvcid": "43398", 00:13:17.686 "trtype": "TCP" 00:13:17.686 }, 00:13:17.686 "qid": 0, 00:13:17.686 "state": "enabled", 00:13:17.686 "thread": "nvmf_tgt_poll_group_000" 00:13:17.686 } 00:13:17.686 ]' 00:13:17.686 11:23:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:13:17.686 11:23:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha384 == \s\h\a\3\8\4 ]] 00:13:17.686 11:23:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:13:17.686 11:23:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe2048 == \f\f\d\h\e\2\0\4\8 ]] 00:13:17.686 11:23:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:13:17.686 11:23:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:13:17.686 11:23:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:13:17.686 11:23:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:13:17.943 11:23:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:03:N2U1YWE0ZGQ4YmRkNTZjYWQ0MTY0MWM2OTQzMDJkZGEyZDRjYjMxYmFhOTU4YjVjMWVhMGJkYzhlMmY3NzBkZSCeOpc=: 00:13:17.943 11:23:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --hostid 3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -l 0 --dhchap-secret DHHC-1:03:N2U1YWE0ZGQ4YmRkNTZjYWQ0MTY0MWM2OTQzMDJkZGEyZDRjYjMxYmFhOTU4YjVjMWVhMGJkYzhlMmY3NzBkZSCeOpc=: 00:13:18.876 11:24:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:13:18.876 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:13:18.876 11:24:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:13:18.876 11:24:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:18.876 11:24:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:18.876 11:24:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:18.876 11:24:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@119 -- # for dhgroup in "${dhgroups[@]}" 00:13:18.876 11:24:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:13:18.877 11:24:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe3072 00:13:18.877 11:24:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe3072 00:13:19.134 11:24:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha384 ffdhe3072 0 00:13:19.134 11:24:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:13:19.134 11:24:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha384 00:13:19.134 11:24:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe3072 00:13:19.134 11:24:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key0 00:13:19.134 11:24:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:13:19.134 11:24:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:13:19.134 11:24:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:19.134 11:24:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:19.134 11:24:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:19.134 11:24:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:13:19.134 11:24:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:13:19.134 11:24:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:13:19.390 00:13:19.390 11:24:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:13:19.390 11:24:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:13:19.390 11:24:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:13:19.648 11:24:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:13:19.906 11:24:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:13:19.906 11:24:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:19.906 11:24:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:19.906 11:24:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:19.906 11:24:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:13:19.906 { 00:13:19.906 "auth": { 00:13:19.906 "dhgroup": "ffdhe3072", 00:13:19.906 "digest": "sha384", 00:13:19.906 "state": "completed" 00:13:19.906 }, 00:13:19.906 "cntlid": 65, 00:13:19.906 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3", 00:13:19.906 "listen_address": { 00:13:19.906 "adrfam": "IPv4", 00:13:19.906 "traddr": "10.0.0.3", 00:13:19.906 "trsvcid": "4420", 00:13:19.906 "trtype": "TCP" 00:13:19.906 }, 00:13:19.906 "peer_address": { 00:13:19.906 "adrfam": "IPv4", 00:13:19.906 "traddr": "10.0.0.1", 00:13:19.906 "trsvcid": "53834", 00:13:19.906 "trtype": "TCP" 00:13:19.906 }, 00:13:19.906 "qid": 0, 00:13:19.906 "state": "enabled", 00:13:19.906 "thread": "nvmf_tgt_poll_group_000" 00:13:19.906 } 00:13:19.906 ]' 00:13:19.906 11:24:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:13:19.906 11:24:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha384 == \s\h\a\3\8\4 ]] 00:13:19.906 11:24:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:13:19.906 11:24:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe3072 == \f\f\d\h\e\3\0\7\2 ]] 00:13:19.906 11:24:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:13:19.906 11:24:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:13:19.906 11:24:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:13:19.906 11:24:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:13:20.164 11:24:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:00:YjQ0ZWQzNjNjMTQzYmZkMDJkM2FmYzIyMTEyMmY0MGExMDAwNWQ5ZWY2NGE2NjBjPhDLOQ==: --dhchap-ctrl-secret DHHC-1:03:NDMwZGJjZWY5ZWEzMDMxODE1MjFlOWMyMDkyYTNlYzA0Yjk3ZGM2MDJlMDQ4OTFhNWUwMjIyM2E4ZGVjMWU5Y1IEScw=: 00:13:20.164 11:24:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --hostid 3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -l 0 --dhchap-secret DHHC-1:00:YjQ0ZWQzNjNjMTQzYmZkMDJkM2FmYzIyMTEyMmY0MGExMDAwNWQ5ZWY2NGE2NjBjPhDLOQ==: --dhchap-ctrl-secret DHHC-1:03:NDMwZGJjZWY5ZWEzMDMxODE1MjFlOWMyMDkyYTNlYzA0Yjk3ZGM2MDJlMDQ4OTFhNWUwMjIyM2E4ZGVjMWU5Y1IEScw=: 00:13:21.095 11:24:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:13:21.095 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:13:21.096 11:24:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:13:21.096 11:24:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:21.096 11:24:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:21.096 11:24:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:21.096 11:24:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:13:21.096 11:24:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe3072 00:13:21.096 11:24:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe3072 00:13:21.353 11:24:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha384 ffdhe3072 1 00:13:21.353 11:24:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:13:21.353 11:24:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha384 00:13:21.353 11:24:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe3072 00:13:21.353 11:24:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key1 00:13:21.353 11:24:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:13:21.353 11:24:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:13:21.353 11:24:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:21.353 11:24:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:21.353 11:24:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:21.353 11:24:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:13:21.353 11:24:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:13:21.353 11:24:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:13:21.918 00:13:21.919 11:24:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:13:21.919 11:24:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:13:21.919 11:24:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:13:22.177 11:24:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:13:22.177 11:24:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:13:22.177 11:24:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:22.177 11:24:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:22.177 11:24:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:22.177 11:24:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:13:22.177 { 00:13:22.177 "auth": { 00:13:22.177 "dhgroup": "ffdhe3072", 00:13:22.177 "digest": "sha384", 00:13:22.177 "state": "completed" 00:13:22.177 }, 00:13:22.177 "cntlid": 67, 00:13:22.177 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3", 00:13:22.177 "listen_address": { 00:13:22.177 "adrfam": "IPv4", 00:13:22.177 "traddr": "10.0.0.3", 00:13:22.177 "trsvcid": "4420", 00:13:22.177 "trtype": "TCP" 00:13:22.177 }, 00:13:22.177 "peer_address": { 00:13:22.177 "adrfam": "IPv4", 00:13:22.177 "traddr": "10.0.0.1", 00:13:22.177 "trsvcid": "53856", 00:13:22.177 "trtype": "TCP" 00:13:22.177 }, 00:13:22.177 "qid": 0, 00:13:22.177 "state": "enabled", 00:13:22.177 "thread": "nvmf_tgt_poll_group_000" 00:13:22.177 } 00:13:22.177 ]' 00:13:22.177 11:24:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:13:22.177 11:24:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha384 == \s\h\a\3\8\4 ]] 00:13:22.177 11:24:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:13:22.177 11:24:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe3072 == \f\f\d\h\e\3\0\7\2 ]] 00:13:22.177 11:24:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:13:22.436 11:24:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:13:22.436 11:24:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:13:22.436 11:24:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:13:22.694 11:24:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:01:N2VkMTc0ODgwNWQxZTM0NTk5OTYwMDk1NmQ5ZGE3YzEKeI3L: --dhchap-ctrl-secret DHHC-1:02:MzI4NjQxYjU2NThlMTY5N2Y3MDgwYmM0MDIxZDY2MmVkOGQyNDA0N2MzNWJlZDNicraO3Q==: 00:13:22.694 11:24:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --hostid 3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -l 0 --dhchap-secret DHHC-1:01:N2VkMTc0ODgwNWQxZTM0NTk5OTYwMDk1NmQ5ZGE3YzEKeI3L: --dhchap-ctrl-secret DHHC-1:02:MzI4NjQxYjU2NThlMTY5N2Y3MDgwYmM0MDIxZDY2MmVkOGQyNDA0N2MzNWJlZDNicraO3Q==: 00:13:23.259 11:24:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:13:23.259 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:13:23.259 11:24:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:13:23.259 11:24:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:23.259 11:24:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:23.259 11:24:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:23.259 11:24:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:13:23.259 11:24:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe3072 00:13:23.259 11:24:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe3072 00:13:23.516 11:24:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha384 ffdhe3072 2 00:13:23.516 11:24:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:13:23.516 11:24:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha384 00:13:23.516 11:24:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe3072 00:13:23.516 11:24:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key2 00:13:23.516 11:24:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:13:23.516 11:24:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:13:23.516 11:24:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:23.516 11:24:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:23.516 11:24:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:23.516 11:24:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:13:23.516 11:24:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:13:23.516 11:24:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:13:24.081 00:13:24.081 11:24:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:13:24.081 11:24:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:13:24.081 11:24:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:13:24.339 11:24:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:13:24.339 11:24:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:13:24.339 11:24:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:24.339 11:24:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:24.339 11:24:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:24.339 11:24:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:13:24.339 { 00:13:24.339 "auth": { 00:13:24.339 "dhgroup": "ffdhe3072", 00:13:24.339 "digest": "sha384", 00:13:24.339 "state": "completed" 00:13:24.339 }, 00:13:24.339 "cntlid": 69, 00:13:24.339 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3", 00:13:24.339 "listen_address": { 00:13:24.339 "adrfam": "IPv4", 00:13:24.339 "traddr": "10.0.0.3", 00:13:24.339 "trsvcid": "4420", 00:13:24.339 "trtype": "TCP" 00:13:24.339 }, 00:13:24.339 "peer_address": { 00:13:24.339 "adrfam": "IPv4", 00:13:24.339 "traddr": "10.0.0.1", 00:13:24.339 "trsvcid": "53886", 00:13:24.339 "trtype": "TCP" 00:13:24.339 }, 00:13:24.339 "qid": 0, 00:13:24.339 "state": "enabled", 00:13:24.339 "thread": "nvmf_tgt_poll_group_000" 00:13:24.339 } 00:13:24.339 ]' 00:13:24.339 11:24:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:13:24.339 11:24:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha384 == \s\h\a\3\8\4 ]] 00:13:24.339 11:24:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:13:24.339 11:24:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe3072 == \f\f\d\h\e\3\0\7\2 ]] 00:13:24.339 11:24:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:13:24.339 11:24:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:13:24.339 11:24:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:13:24.339 11:24:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:13:24.903 11:24:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:02:OGEwMDZmYzk3YTg5OWI0ZmJlYjViNmI2YmQzN2ViYjZiODhiMTM4MjEzY2ZlYmUzuaS9rg==: --dhchap-ctrl-secret DHHC-1:01:MTcxNjJmZTg3YTMxYmYyZDA0YmFhY2Q0M2Y3OGQwNzhGAzMl: 00:13:24.903 11:24:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --hostid 3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -l 0 --dhchap-secret DHHC-1:02:OGEwMDZmYzk3YTg5OWI0ZmJlYjViNmI2YmQzN2ViYjZiODhiMTM4MjEzY2ZlYmUzuaS9rg==: --dhchap-ctrl-secret DHHC-1:01:MTcxNjJmZTg3YTMxYmYyZDA0YmFhY2Q0M2Y3OGQwNzhGAzMl: 00:13:25.468 11:24:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:13:25.468 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:13:25.468 11:24:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:13:25.468 11:24:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:25.468 11:24:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:25.468 11:24:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:25.468 11:24:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:13:25.468 11:24:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe3072 00:13:25.468 11:24:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe3072 00:13:25.726 11:24:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha384 ffdhe3072 3 00:13:25.726 11:24:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:13:25.726 11:24:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha384 00:13:25.726 11:24:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe3072 00:13:25.726 11:24:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key3 00:13:25.726 11:24:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:13:25.726 11:24:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --dhchap-key key3 00:13:25.726 11:24:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:25.726 11:24:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:25.726 11:24:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:25.726 11:24:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key3 00:13:25.726 11:24:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:13:25.726 11:24:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:13:25.983 00:13:25.983 11:24:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:13:25.983 11:24:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:13:25.983 11:24:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:13:26.548 11:24:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:13:26.548 11:24:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:13:26.548 11:24:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:26.548 11:24:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:26.548 11:24:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:26.548 11:24:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:13:26.548 { 00:13:26.548 "auth": { 00:13:26.548 "dhgroup": "ffdhe3072", 00:13:26.548 "digest": "sha384", 00:13:26.548 "state": "completed" 00:13:26.548 }, 00:13:26.548 "cntlid": 71, 00:13:26.548 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3", 00:13:26.548 "listen_address": { 00:13:26.548 "adrfam": "IPv4", 00:13:26.548 "traddr": "10.0.0.3", 00:13:26.548 "trsvcid": "4420", 00:13:26.548 "trtype": "TCP" 00:13:26.548 }, 00:13:26.548 "peer_address": { 00:13:26.548 "adrfam": "IPv4", 00:13:26.548 "traddr": "10.0.0.1", 00:13:26.548 "trsvcid": "53908", 00:13:26.548 "trtype": "TCP" 00:13:26.548 }, 00:13:26.548 "qid": 0, 00:13:26.548 "state": "enabled", 00:13:26.548 "thread": "nvmf_tgt_poll_group_000" 00:13:26.548 } 00:13:26.548 ]' 00:13:26.548 11:24:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:13:26.548 11:24:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha384 == \s\h\a\3\8\4 ]] 00:13:26.548 11:24:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:13:26.548 11:24:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe3072 == \f\f\d\h\e\3\0\7\2 ]] 00:13:26.548 11:24:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:13:26.548 11:24:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:13:26.548 11:24:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:13:26.548 11:24:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:13:26.805 11:24:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:03:N2U1YWE0ZGQ4YmRkNTZjYWQ0MTY0MWM2OTQzMDJkZGEyZDRjYjMxYmFhOTU4YjVjMWVhMGJkYzhlMmY3NzBkZSCeOpc=: 00:13:26.805 11:24:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --hostid 3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -l 0 --dhchap-secret DHHC-1:03:N2U1YWE0ZGQ4YmRkNTZjYWQ0MTY0MWM2OTQzMDJkZGEyZDRjYjMxYmFhOTU4YjVjMWVhMGJkYzhlMmY3NzBkZSCeOpc=: 00:13:27.736 11:24:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:13:27.736 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:13:27.736 11:24:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:13:27.736 11:24:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:27.736 11:24:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:27.736 11:24:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:27.736 11:24:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@119 -- # for dhgroup in "${dhgroups[@]}" 00:13:27.736 11:24:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:13:27.736 11:24:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe4096 00:13:27.736 11:24:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe4096 00:13:27.994 11:24:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha384 ffdhe4096 0 00:13:27.994 11:24:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:13:27.994 11:24:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha384 00:13:27.994 11:24:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe4096 00:13:27.994 11:24:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key0 00:13:27.994 11:24:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:13:27.994 11:24:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:13:27.994 11:24:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:27.994 11:24:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:27.994 11:24:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:27.994 11:24:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:13:27.994 11:24:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:13:27.994 11:24:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:13:28.252 00:13:28.252 11:24:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:13:28.252 11:24:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:13:28.252 11:24:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:13:28.510 11:24:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:13:28.510 11:24:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:13:28.510 11:24:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:28.510 11:24:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:28.767 11:24:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:28.767 11:24:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:13:28.767 { 00:13:28.767 "auth": { 00:13:28.767 "dhgroup": "ffdhe4096", 00:13:28.767 "digest": "sha384", 00:13:28.767 "state": "completed" 00:13:28.767 }, 00:13:28.767 "cntlid": 73, 00:13:28.767 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3", 00:13:28.767 "listen_address": { 00:13:28.767 "adrfam": "IPv4", 00:13:28.767 "traddr": "10.0.0.3", 00:13:28.767 "trsvcid": "4420", 00:13:28.767 "trtype": "TCP" 00:13:28.767 }, 00:13:28.767 "peer_address": { 00:13:28.767 "adrfam": "IPv4", 00:13:28.767 "traddr": "10.0.0.1", 00:13:28.767 "trsvcid": "53922", 00:13:28.767 "trtype": "TCP" 00:13:28.767 }, 00:13:28.767 "qid": 0, 00:13:28.767 "state": "enabled", 00:13:28.767 "thread": "nvmf_tgt_poll_group_000" 00:13:28.767 } 00:13:28.767 ]' 00:13:28.767 11:24:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:13:28.767 11:24:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha384 == \s\h\a\3\8\4 ]] 00:13:28.767 11:24:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:13:28.767 11:24:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe4096 == \f\f\d\h\e\4\0\9\6 ]] 00:13:28.767 11:24:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:13:28.767 11:24:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:13:28.767 11:24:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:13:28.767 11:24:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:13:29.026 11:24:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:00:YjQ0ZWQzNjNjMTQzYmZkMDJkM2FmYzIyMTEyMmY0MGExMDAwNWQ5ZWY2NGE2NjBjPhDLOQ==: --dhchap-ctrl-secret DHHC-1:03:NDMwZGJjZWY5ZWEzMDMxODE1MjFlOWMyMDkyYTNlYzA0Yjk3ZGM2MDJlMDQ4OTFhNWUwMjIyM2E4ZGVjMWU5Y1IEScw=: 00:13:29.026 11:24:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --hostid 3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -l 0 --dhchap-secret DHHC-1:00:YjQ0ZWQzNjNjMTQzYmZkMDJkM2FmYzIyMTEyMmY0MGExMDAwNWQ5ZWY2NGE2NjBjPhDLOQ==: --dhchap-ctrl-secret DHHC-1:03:NDMwZGJjZWY5ZWEzMDMxODE1MjFlOWMyMDkyYTNlYzA0Yjk3ZGM2MDJlMDQ4OTFhNWUwMjIyM2E4ZGVjMWU5Y1IEScw=: 00:13:29.978 11:24:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:13:29.978 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:13:29.978 11:24:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:13:29.978 11:24:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:29.978 11:24:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:29.978 11:24:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:29.978 11:24:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:13:29.978 11:24:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe4096 00:13:29.978 11:24:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe4096 00:13:30.235 11:24:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha384 ffdhe4096 1 00:13:30.235 11:24:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:13:30.235 11:24:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha384 00:13:30.236 11:24:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe4096 00:13:30.236 11:24:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key1 00:13:30.236 11:24:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:13:30.236 11:24:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:13:30.236 11:24:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:30.236 11:24:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:30.236 11:24:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:30.236 11:24:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:13:30.236 11:24:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:13:30.236 11:24:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:13:30.493 00:13:30.493 11:24:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:13:30.493 11:24:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:13:30.493 11:24:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:13:31.058 11:24:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:13:31.059 11:24:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:13:31.059 11:24:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:31.059 11:24:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:31.059 11:24:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:31.059 11:24:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:13:31.059 { 00:13:31.059 "auth": { 00:13:31.059 "dhgroup": "ffdhe4096", 00:13:31.059 "digest": "sha384", 00:13:31.059 "state": "completed" 00:13:31.059 }, 00:13:31.059 "cntlid": 75, 00:13:31.059 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3", 00:13:31.059 "listen_address": { 00:13:31.059 "adrfam": "IPv4", 00:13:31.059 "traddr": "10.0.0.3", 00:13:31.059 "trsvcid": "4420", 00:13:31.059 "trtype": "TCP" 00:13:31.059 }, 00:13:31.059 "peer_address": { 00:13:31.059 "adrfam": "IPv4", 00:13:31.059 "traddr": "10.0.0.1", 00:13:31.059 "trsvcid": "59834", 00:13:31.059 "trtype": "TCP" 00:13:31.059 }, 00:13:31.059 "qid": 0, 00:13:31.059 "state": "enabled", 00:13:31.059 "thread": "nvmf_tgt_poll_group_000" 00:13:31.059 } 00:13:31.059 ]' 00:13:31.059 11:24:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:13:31.059 11:24:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha384 == \s\h\a\3\8\4 ]] 00:13:31.059 11:24:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:13:31.059 11:24:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe4096 == \f\f\d\h\e\4\0\9\6 ]] 00:13:31.059 11:24:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:13:31.059 11:24:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:13:31.059 11:24:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:13:31.059 11:24:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:13:31.317 11:24:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:01:N2VkMTc0ODgwNWQxZTM0NTk5OTYwMDk1NmQ5ZGE3YzEKeI3L: --dhchap-ctrl-secret DHHC-1:02:MzI4NjQxYjU2NThlMTY5N2Y3MDgwYmM0MDIxZDY2MmVkOGQyNDA0N2MzNWJlZDNicraO3Q==: 00:13:31.317 11:24:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --hostid 3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -l 0 --dhchap-secret DHHC-1:01:N2VkMTc0ODgwNWQxZTM0NTk5OTYwMDk1NmQ5ZGE3YzEKeI3L: --dhchap-ctrl-secret DHHC-1:02:MzI4NjQxYjU2NThlMTY5N2Y3MDgwYmM0MDIxZDY2MmVkOGQyNDA0N2MzNWJlZDNicraO3Q==: 00:13:32.251 11:24:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:13:32.251 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:13:32.251 11:24:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:13:32.251 11:24:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:32.251 11:24:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:32.251 11:24:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:32.251 11:24:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:13:32.251 11:24:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe4096 00:13:32.251 11:24:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe4096 00:13:32.509 11:24:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha384 ffdhe4096 2 00:13:32.509 11:24:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:13:32.509 11:24:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha384 00:13:32.509 11:24:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe4096 00:13:32.509 11:24:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key2 00:13:32.509 11:24:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:13:32.509 11:24:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:13:32.509 11:24:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:32.509 11:24:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:32.509 11:24:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:32.509 11:24:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:13:32.509 11:24:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:13:32.509 11:24:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:13:32.767 00:13:32.767 11:24:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:13:32.767 11:24:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:13:32.767 11:24:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:13:33.025 11:24:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:13:33.025 11:24:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:13:33.025 11:24:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:33.025 11:24:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:33.025 11:24:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:33.025 11:24:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:13:33.025 { 00:13:33.025 "auth": { 00:13:33.025 "dhgroup": "ffdhe4096", 00:13:33.025 "digest": "sha384", 00:13:33.025 "state": "completed" 00:13:33.025 }, 00:13:33.025 "cntlid": 77, 00:13:33.025 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3", 00:13:33.025 "listen_address": { 00:13:33.025 "adrfam": "IPv4", 00:13:33.025 "traddr": "10.0.0.3", 00:13:33.025 "trsvcid": "4420", 00:13:33.025 "trtype": "TCP" 00:13:33.025 }, 00:13:33.025 "peer_address": { 00:13:33.025 "adrfam": "IPv4", 00:13:33.025 "traddr": "10.0.0.1", 00:13:33.025 "trsvcid": "59856", 00:13:33.025 "trtype": "TCP" 00:13:33.025 }, 00:13:33.025 "qid": 0, 00:13:33.025 "state": "enabled", 00:13:33.025 "thread": "nvmf_tgt_poll_group_000" 00:13:33.025 } 00:13:33.025 ]' 00:13:33.025 11:24:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:13:33.283 11:24:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha384 == \s\h\a\3\8\4 ]] 00:13:33.283 11:24:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:13:33.283 11:24:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe4096 == \f\f\d\h\e\4\0\9\6 ]] 00:13:33.283 11:24:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:13:33.283 11:24:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:13:33.283 11:24:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:13:33.283 11:24:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:13:33.541 11:24:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:02:OGEwMDZmYzk3YTg5OWI0ZmJlYjViNmI2YmQzN2ViYjZiODhiMTM4MjEzY2ZlYmUzuaS9rg==: --dhchap-ctrl-secret DHHC-1:01:MTcxNjJmZTg3YTMxYmYyZDA0YmFhY2Q0M2Y3OGQwNzhGAzMl: 00:13:33.541 11:24:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --hostid 3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -l 0 --dhchap-secret DHHC-1:02:OGEwMDZmYzk3YTg5OWI0ZmJlYjViNmI2YmQzN2ViYjZiODhiMTM4MjEzY2ZlYmUzuaS9rg==: --dhchap-ctrl-secret DHHC-1:01:MTcxNjJmZTg3YTMxYmYyZDA0YmFhY2Q0M2Y3OGQwNzhGAzMl: 00:13:34.475 11:24:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:13:34.475 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:13:34.475 11:24:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:13:34.475 11:24:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:34.475 11:24:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:34.475 11:24:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:34.475 11:24:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:13:34.475 11:24:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe4096 00:13:34.475 11:24:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe4096 00:13:34.732 11:24:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha384 ffdhe4096 3 00:13:34.732 11:24:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:13:34.732 11:24:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha384 00:13:34.732 11:24:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe4096 00:13:34.732 11:24:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key3 00:13:34.732 11:24:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:13:34.732 11:24:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --dhchap-key key3 00:13:34.732 11:24:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:34.732 11:24:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:34.732 11:24:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:34.732 11:24:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key3 00:13:34.732 11:24:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:13:34.732 11:24:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:13:35.335 00:13:35.335 11:24:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:13:35.335 11:24:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:13:35.335 11:24:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:13:35.593 11:24:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:13:35.593 11:24:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:13:35.593 11:24:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:35.593 11:24:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:35.593 11:24:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:35.593 11:24:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:13:35.593 { 00:13:35.593 "auth": { 00:13:35.593 "dhgroup": "ffdhe4096", 00:13:35.593 "digest": "sha384", 00:13:35.593 "state": "completed" 00:13:35.593 }, 00:13:35.593 "cntlid": 79, 00:13:35.593 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3", 00:13:35.593 "listen_address": { 00:13:35.593 "adrfam": "IPv4", 00:13:35.593 "traddr": "10.0.0.3", 00:13:35.593 "trsvcid": "4420", 00:13:35.593 "trtype": "TCP" 00:13:35.593 }, 00:13:35.593 "peer_address": { 00:13:35.593 "adrfam": "IPv4", 00:13:35.593 "traddr": "10.0.0.1", 00:13:35.593 "trsvcid": "59876", 00:13:35.593 "trtype": "TCP" 00:13:35.593 }, 00:13:35.593 "qid": 0, 00:13:35.593 "state": "enabled", 00:13:35.593 "thread": "nvmf_tgt_poll_group_000" 00:13:35.593 } 00:13:35.593 ]' 00:13:35.593 11:24:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:13:35.593 11:24:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha384 == \s\h\a\3\8\4 ]] 00:13:35.593 11:24:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:13:35.593 11:24:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe4096 == \f\f\d\h\e\4\0\9\6 ]] 00:13:35.593 11:24:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:13:35.593 11:24:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:13:35.593 11:24:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:13:35.593 11:24:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:13:35.851 11:24:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:03:N2U1YWE0ZGQ4YmRkNTZjYWQ0MTY0MWM2OTQzMDJkZGEyZDRjYjMxYmFhOTU4YjVjMWVhMGJkYzhlMmY3NzBkZSCeOpc=: 00:13:35.851 11:24:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --hostid 3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -l 0 --dhchap-secret DHHC-1:03:N2U1YWE0ZGQ4YmRkNTZjYWQ0MTY0MWM2OTQzMDJkZGEyZDRjYjMxYmFhOTU4YjVjMWVhMGJkYzhlMmY3NzBkZSCeOpc=: 00:13:36.782 11:24:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:13:36.782 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:13:36.782 11:24:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:13:36.782 11:24:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:36.782 11:24:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:36.782 11:24:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:36.782 11:24:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@119 -- # for dhgroup in "${dhgroups[@]}" 00:13:36.782 11:24:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:13:36.782 11:24:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe6144 00:13:36.782 11:24:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe6144 00:13:37.039 11:24:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha384 ffdhe6144 0 00:13:37.039 11:24:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:13:37.039 11:24:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha384 00:13:37.039 11:24:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe6144 00:13:37.039 11:24:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key0 00:13:37.039 11:24:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:13:37.039 11:24:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:13:37.040 11:24:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:37.040 11:24:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:37.040 11:24:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:37.040 11:24:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:13:37.040 11:24:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:13:37.040 11:24:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:13:37.606 00:13:37.606 11:24:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:13:37.606 11:24:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:13:37.606 11:24:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:13:37.864 11:24:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:13:37.864 11:24:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:13:37.864 11:24:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:37.864 11:24:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:37.864 11:24:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:37.864 11:24:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:13:37.864 { 00:13:37.864 "auth": { 00:13:37.864 "dhgroup": "ffdhe6144", 00:13:37.864 "digest": "sha384", 00:13:37.864 "state": "completed" 00:13:37.864 }, 00:13:37.864 "cntlid": 81, 00:13:37.864 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3", 00:13:37.864 "listen_address": { 00:13:37.864 "adrfam": "IPv4", 00:13:37.864 "traddr": "10.0.0.3", 00:13:37.865 "trsvcid": "4420", 00:13:37.865 "trtype": "TCP" 00:13:37.865 }, 00:13:37.865 "peer_address": { 00:13:37.865 "adrfam": "IPv4", 00:13:37.865 "traddr": "10.0.0.1", 00:13:37.865 "trsvcid": "59890", 00:13:37.865 "trtype": "TCP" 00:13:37.865 }, 00:13:37.865 "qid": 0, 00:13:37.865 "state": "enabled", 00:13:37.865 "thread": "nvmf_tgt_poll_group_000" 00:13:37.865 } 00:13:37.865 ]' 00:13:37.865 11:24:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:13:37.865 11:24:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha384 == \s\h\a\3\8\4 ]] 00:13:37.865 11:24:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:13:38.124 11:24:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe6144 == \f\f\d\h\e\6\1\4\4 ]] 00:13:38.124 11:24:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:13:38.124 11:24:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:13:38.124 11:24:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:13:38.124 11:24:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:13:38.450 11:24:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:00:YjQ0ZWQzNjNjMTQzYmZkMDJkM2FmYzIyMTEyMmY0MGExMDAwNWQ5ZWY2NGE2NjBjPhDLOQ==: --dhchap-ctrl-secret DHHC-1:03:NDMwZGJjZWY5ZWEzMDMxODE1MjFlOWMyMDkyYTNlYzA0Yjk3ZGM2MDJlMDQ4OTFhNWUwMjIyM2E4ZGVjMWU5Y1IEScw=: 00:13:38.450 11:24:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --hostid 3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -l 0 --dhchap-secret DHHC-1:00:YjQ0ZWQzNjNjMTQzYmZkMDJkM2FmYzIyMTEyMmY0MGExMDAwNWQ5ZWY2NGE2NjBjPhDLOQ==: --dhchap-ctrl-secret DHHC-1:03:NDMwZGJjZWY5ZWEzMDMxODE1MjFlOWMyMDkyYTNlYzA0Yjk3ZGM2MDJlMDQ4OTFhNWUwMjIyM2E4ZGVjMWU5Y1IEScw=: 00:13:39.031 11:24:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:13:39.031 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:13:39.031 11:24:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:13:39.031 11:24:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:39.031 11:24:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:39.031 11:24:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:39.031 11:24:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:13:39.031 11:24:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe6144 00:13:39.031 11:24:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe6144 00:13:39.288 11:24:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha384 ffdhe6144 1 00:13:39.288 11:24:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:13:39.288 11:24:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha384 00:13:39.288 11:24:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe6144 00:13:39.288 11:24:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key1 00:13:39.288 11:24:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:13:39.288 11:24:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:13:39.288 11:24:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:39.288 11:24:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:39.288 11:24:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:39.288 11:24:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:13:39.289 11:24:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:13:39.289 11:24:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:13:39.854 00:13:39.854 11:24:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:13:39.854 11:24:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:13:39.854 11:24:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:13:40.421 11:24:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:13:40.421 11:24:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:13:40.422 11:24:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:40.422 11:24:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:40.422 11:24:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:40.422 11:24:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:13:40.422 { 00:13:40.422 "auth": { 00:13:40.422 "dhgroup": "ffdhe6144", 00:13:40.422 "digest": "sha384", 00:13:40.422 "state": "completed" 00:13:40.422 }, 00:13:40.422 "cntlid": 83, 00:13:40.422 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3", 00:13:40.422 "listen_address": { 00:13:40.422 "adrfam": "IPv4", 00:13:40.422 "traddr": "10.0.0.3", 00:13:40.422 "trsvcid": "4420", 00:13:40.422 "trtype": "TCP" 00:13:40.422 }, 00:13:40.422 "peer_address": { 00:13:40.422 "adrfam": "IPv4", 00:13:40.422 "traddr": "10.0.0.1", 00:13:40.422 "trsvcid": "44972", 00:13:40.422 "trtype": "TCP" 00:13:40.422 }, 00:13:40.422 "qid": 0, 00:13:40.422 "state": "enabled", 00:13:40.422 "thread": "nvmf_tgt_poll_group_000" 00:13:40.422 } 00:13:40.422 ]' 00:13:40.422 11:24:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:13:40.422 11:24:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha384 == \s\h\a\3\8\4 ]] 00:13:40.422 11:24:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:13:40.422 11:24:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe6144 == \f\f\d\h\e\6\1\4\4 ]] 00:13:40.422 11:24:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:13:40.422 11:24:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:13:40.422 11:24:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:13:40.422 11:24:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:13:40.679 11:24:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:01:N2VkMTc0ODgwNWQxZTM0NTk5OTYwMDk1NmQ5ZGE3YzEKeI3L: --dhchap-ctrl-secret DHHC-1:02:MzI4NjQxYjU2NThlMTY5N2Y3MDgwYmM0MDIxZDY2MmVkOGQyNDA0N2MzNWJlZDNicraO3Q==: 00:13:40.679 11:24:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --hostid 3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -l 0 --dhchap-secret DHHC-1:01:N2VkMTc0ODgwNWQxZTM0NTk5OTYwMDk1NmQ5ZGE3YzEKeI3L: --dhchap-ctrl-secret DHHC-1:02:MzI4NjQxYjU2NThlMTY5N2Y3MDgwYmM0MDIxZDY2MmVkOGQyNDA0N2MzNWJlZDNicraO3Q==: 00:13:41.612 11:24:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:13:41.612 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:13:41.612 11:24:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:13:41.612 11:24:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:41.612 11:24:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:41.612 11:24:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:41.612 11:24:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:13:41.612 11:24:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe6144 00:13:41.612 11:24:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe6144 00:13:41.871 11:24:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha384 ffdhe6144 2 00:13:41.871 11:24:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:13:41.871 11:24:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha384 00:13:41.871 11:24:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe6144 00:13:41.871 11:24:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key2 00:13:41.871 11:24:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:13:41.871 11:24:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:13:41.871 11:24:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:41.871 11:24:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:41.871 11:24:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:41.871 11:24:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:13:41.871 11:24:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:13:41.871 11:24:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:13:42.534 00:13:42.534 11:24:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:13:42.534 11:24:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:13:42.534 11:24:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:13:42.792 11:24:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:13:42.792 11:24:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:13:42.792 11:24:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:42.792 11:24:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:42.792 11:24:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:42.792 11:24:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:13:42.792 { 00:13:42.792 "auth": { 00:13:42.792 "dhgroup": "ffdhe6144", 00:13:42.792 "digest": "sha384", 00:13:42.792 "state": "completed" 00:13:42.792 }, 00:13:42.792 "cntlid": 85, 00:13:42.792 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3", 00:13:42.792 "listen_address": { 00:13:42.792 "adrfam": "IPv4", 00:13:42.792 "traddr": "10.0.0.3", 00:13:42.792 "trsvcid": "4420", 00:13:42.792 "trtype": "TCP" 00:13:42.792 }, 00:13:42.792 "peer_address": { 00:13:42.792 "adrfam": "IPv4", 00:13:42.792 "traddr": "10.0.0.1", 00:13:42.792 "trsvcid": "44996", 00:13:42.792 "trtype": "TCP" 00:13:42.792 }, 00:13:42.792 "qid": 0, 00:13:42.792 "state": "enabled", 00:13:42.792 "thread": "nvmf_tgt_poll_group_000" 00:13:42.792 } 00:13:42.792 ]' 00:13:42.792 11:24:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:13:42.792 11:24:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha384 == \s\h\a\3\8\4 ]] 00:13:42.792 11:24:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:13:42.792 11:24:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe6144 == \f\f\d\h\e\6\1\4\4 ]] 00:13:42.792 11:24:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:13:42.792 11:24:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:13:42.792 11:24:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:13:42.792 11:24:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:13:43.357 11:24:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:02:OGEwMDZmYzk3YTg5OWI0ZmJlYjViNmI2YmQzN2ViYjZiODhiMTM4MjEzY2ZlYmUzuaS9rg==: --dhchap-ctrl-secret DHHC-1:01:MTcxNjJmZTg3YTMxYmYyZDA0YmFhY2Q0M2Y3OGQwNzhGAzMl: 00:13:43.357 11:24:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --hostid 3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -l 0 --dhchap-secret DHHC-1:02:OGEwMDZmYzk3YTg5OWI0ZmJlYjViNmI2YmQzN2ViYjZiODhiMTM4MjEzY2ZlYmUzuaS9rg==: --dhchap-ctrl-secret DHHC-1:01:MTcxNjJmZTg3YTMxYmYyZDA0YmFhY2Q0M2Y3OGQwNzhGAzMl: 00:13:43.921 11:24:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:13:43.921 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:13:43.921 11:24:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:13:43.921 11:24:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:43.921 11:24:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:43.921 11:24:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:43.921 11:24:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:13:43.921 11:24:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe6144 00:13:43.921 11:24:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe6144 00:13:44.178 11:24:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha384 ffdhe6144 3 00:13:44.178 11:24:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:13:44.178 11:24:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha384 00:13:44.178 11:24:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe6144 00:13:44.178 11:24:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key3 00:13:44.178 11:24:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:13:44.179 11:24:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --dhchap-key key3 00:13:44.179 11:24:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:44.179 11:24:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:44.179 11:24:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:44.179 11:24:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key3 00:13:44.179 11:24:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:13:44.179 11:24:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:13:44.744 00:13:44.744 11:24:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:13:44.744 11:24:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:13:44.744 11:24:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:13:45.002 11:24:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:13:45.002 11:24:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:13:45.002 11:24:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:45.002 11:24:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:45.002 11:24:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:45.002 11:24:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:13:45.002 { 00:13:45.002 "auth": { 00:13:45.002 "dhgroup": "ffdhe6144", 00:13:45.002 "digest": "sha384", 00:13:45.002 "state": "completed" 00:13:45.002 }, 00:13:45.002 "cntlid": 87, 00:13:45.002 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3", 00:13:45.002 "listen_address": { 00:13:45.002 "adrfam": "IPv4", 00:13:45.002 "traddr": "10.0.0.3", 00:13:45.002 "trsvcid": "4420", 00:13:45.002 "trtype": "TCP" 00:13:45.002 }, 00:13:45.002 "peer_address": { 00:13:45.002 "adrfam": "IPv4", 00:13:45.002 "traddr": "10.0.0.1", 00:13:45.002 "trsvcid": "45032", 00:13:45.002 "trtype": "TCP" 00:13:45.002 }, 00:13:45.002 "qid": 0, 00:13:45.002 "state": "enabled", 00:13:45.002 "thread": "nvmf_tgt_poll_group_000" 00:13:45.002 } 00:13:45.002 ]' 00:13:45.002 11:24:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:13:45.002 11:24:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha384 == \s\h\a\3\8\4 ]] 00:13:45.002 11:24:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:13:45.260 11:24:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe6144 == \f\f\d\h\e\6\1\4\4 ]] 00:13:45.260 11:24:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:13:45.260 11:24:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:13:45.260 11:24:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:13:45.260 11:24:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:13:45.517 11:24:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:03:N2U1YWE0ZGQ4YmRkNTZjYWQ0MTY0MWM2OTQzMDJkZGEyZDRjYjMxYmFhOTU4YjVjMWVhMGJkYzhlMmY3NzBkZSCeOpc=: 00:13:45.517 11:24:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --hostid 3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -l 0 --dhchap-secret DHHC-1:03:N2U1YWE0ZGQ4YmRkNTZjYWQ0MTY0MWM2OTQzMDJkZGEyZDRjYjMxYmFhOTU4YjVjMWVhMGJkYzhlMmY3NzBkZSCeOpc=: 00:13:46.450 11:24:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:13:46.450 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:13:46.450 11:24:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:13:46.450 11:24:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:46.450 11:24:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:46.450 11:24:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:46.450 11:24:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@119 -- # for dhgroup in "${dhgroups[@]}" 00:13:46.450 11:24:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:13:46.450 11:24:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe8192 00:13:46.450 11:24:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe8192 00:13:46.740 11:24:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha384 ffdhe8192 0 00:13:46.740 11:24:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:13:46.740 11:24:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha384 00:13:46.740 11:24:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe8192 00:13:46.740 11:24:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key0 00:13:46.740 11:24:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:13:46.740 11:24:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:13:46.740 11:24:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:46.740 11:24:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:46.740 11:24:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:46.740 11:24:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:13:46.740 11:24:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:13:46.740 11:24:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:13:47.307 00:13:47.307 11:24:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:13:47.307 11:24:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:13:47.307 11:24:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:13:47.565 11:24:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:13:47.565 11:24:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:13:47.565 11:24:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:47.565 11:24:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:47.565 11:24:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:47.565 11:24:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:13:47.565 { 00:13:47.565 "auth": { 00:13:47.565 "dhgroup": "ffdhe8192", 00:13:47.565 "digest": "sha384", 00:13:47.565 "state": "completed" 00:13:47.565 }, 00:13:47.565 "cntlid": 89, 00:13:47.565 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3", 00:13:47.565 "listen_address": { 00:13:47.565 "adrfam": "IPv4", 00:13:47.565 "traddr": "10.0.0.3", 00:13:47.565 "trsvcid": "4420", 00:13:47.565 "trtype": "TCP" 00:13:47.565 }, 00:13:47.565 "peer_address": { 00:13:47.565 "adrfam": "IPv4", 00:13:47.565 "traddr": "10.0.0.1", 00:13:47.565 "trsvcid": "45068", 00:13:47.565 "trtype": "TCP" 00:13:47.565 }, 00:13:47.565 "qid": 0, 00:13:47.565 "state": "enabled", 00:13:47.565 "thread": "nvmf_tgt_poll_group_000" 00:13:47.565 } 00:13:47.565 ]' 00:13:47.565 11:24:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:13:47.822 11:24:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha384 == \s\h\a\3\8\4 ]] 00:13:47.822 11:24:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:13:47.822 11:24:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe8192 == \f\f\d\h\e\8\1\9\2 ]] 00:13:47.822 11:24:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:13:47.822 11:24:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:13:47.822 11:24:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:13:47.822 11:24:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:13:48.080 11:24:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:00:YjQ0ZWQzNjNjMTQzYmZkMDJkM2FmYzIyMTEyMmY0MGExMDAwNWQ5ZWY2NGE2NjBjPhDLOQ==: --dhchap-ctrl-secret DHHC-1:03:NDMwZGJjZWY5ZWEzMDMxODE1MjFlOWMyMDkyYTNlYzA0Yjk3ZGM2MDJlMDQ4OTFhNWUwMjIyM2E4ZGVjMWU5Y1IEScw=: 00:13:48.080 11:24:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --hostid 3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -l 0 --dhchap-secret DHHC-1:00:YjQ0ZWQzNjNjMTQzYmZkMDJkM2FmYzIyMTEyMmY0MGExMDAwNWQ5ZWY2NGE2NjBjPhDLOQ==: --dhchap-ctrl-secret DHHC-1:03:NDMwZGJjZWY5ZWEzMDMxODE1MjFlOWMyMDkyYTNlYzA0Yjk3ZGM2MDJlMDQ4OTFhNWUwMjIyM2E4ZGVjMWU5Y1IEScw=: 00:13:48.646 11:24:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:13:48.646 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:13:48.646 11:24:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:13:48.646 11:24:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:48.646 11:24:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:48.646 11:24:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:48.646 11:24:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:13:48.646 11:24:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe8192 00:13:48.646 11:24:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe8192 00:13:49.211 11:24:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha384 ffdhe8192 1 00:13:49.211 11:24:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:13:49.211 11:24:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha384 00:13:49.211 11:24:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe8192 00:13:49.211 11:24:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key1 00:13:49.211 11:24:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:13:49.211 11:24:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:13:49.211 11:24:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:49.211 11:24:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:49.211 11:24:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:49.211 11:24:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:13:49.211 11:24:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:13:49.211 11:24:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:13:49.774 00:13:49.774 11:24:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:13:49.774 11:24:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:13:49.774 11:24:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:13:50.054 11:24:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:13:50.054 11:24:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:13:50.054 11:24:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:50.054 11:24:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:50.054 11:24:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:50.054 11:24:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:13:50.054 { 00:13:50.054 "auth": { 00:13:50.054 "dhgroup": "ffdhe8192", 00:13:50.054 "digest": "sha384", 00:13:50.054 "state": "completed" 00:13:50.054 }, 00:13:50.054 "cntlid": 91, 00:13:50.054 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3", 00:13:50.054 "listen_address": { 00:13:50.054 "adrfam": "IPv4", 00:13:50.054 "traddr": "10.0.0.3", 00:13:50.054 "trsvcid": "4420", 00:13:50.054 "trtype": "TCP" 00:13:50.054 }, 00:13:50.054 "peer_address": { 00:13:50.054 "adrfam": "IPv4", 00:13:50.054 "traddr": "10.0.0.1", 00:13:50.054 "trsvcid": "43084", 00:13:50.054 "trtype": "TCP" 00:13:50.054 }, 00:13:50.054 "qid": 0, 00:13:50.054 "state": "enabled", 00:13:50.054 "thread": "nvmf_tgt_poll_group_000" 00:13:50.054 } 00:13:50.054 ]' 00:13:50.054 11:24:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:13:50.054 11:24:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha384 == \s\h\a\3\8\4 ]] 00:13:50.054 11:24:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:13:50.054 11:24:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe8192 == \f\f\d\h\e\8\1\9\2 ]] 00:13:50.054 11:24:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:13:50.311 11:24:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:13:50.311 11:24:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:13:50.311 11:24:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:13:50.569 11:24:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:01:N2VkMTc0ODgwNWQxZTM0NTk5OTYwMDk1NmQ5ZGE3YzEKeI3L: --dhchap-ctrl-secret DHHC-1:02:MzI4NjQxYjU2NThlMTY5N2Y3MDgwYmM0MDIxZDY2MmVkOGQyNDA0N2MzNWJlZDNicraO3Q==: 00:13:50.569 11:24:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --hostid 3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -l 0 --dhchap-secret DHHC-1:01:N2VkMTc0ODgwNWQxZTM0NTk5OTYwMDk1NmQ5ZGE3YzEKeI3L: --dhchap-ctrl-secret DHHC-1:02:MzI4NjQxYjU2NThlMTY5N2Y3MDgwYmM0MDIxZDY2MmVkOGQyNDA0N2MzNWJlZDNicraO3Q==: 00:13:51.552 11:24:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:13:51.552 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:13:51.552 11:24:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:13:51.552 11:24:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:51.552 11:24:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:51.552 11:24:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:51.552 11:24:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:13:51.552 11:24:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe8192 00:13:51.552 11:24:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe8192 00:13:51.552 11:24:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha384 ffdhe8192 2 00:13:51.552 11:24:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:13:51.552 11:24:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha384 00:13:51.552 11:24:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe8192 00:13:51.552 11:24:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key2 00:13:51.552 11:24:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:13:51.552 11:24:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:13:51.552 11:24:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:51.552 11:24:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:51.552 11:24:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:51.552 11:24:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:13:51.552 11:24:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:13:51.552 11:24:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:13:52.487 00:13:52.487 11:24:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:13:52.487 11:24:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:13:52.487 11:24:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:13:52.745 11:24:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:13:52.745 11:24:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:13:52.745 11:24:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:52.745 11:24:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:52.745 11:24:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:52.745 11:24:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:13:52.745 { 00:13:52.745 "auth": { 00:13:52.745 "dhgroup": "ffdhe8192", 00:13:52.745 "digest": "sha384", 00:13:52.745 "state": "completed" 00:13:52.745 }, 00:13:52.745 "cntlid": 93, 00:13:52.745 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3", 00:13:52.745 "listen_address": { 00:13:52.745 "adrfam": "IPv4", 00:13:52.745 "traddr": "10.0.0.3", 00:13:52.745 "trsvcid": "4420", 00:13:52.745 "trtype": "TCP" 00:13:52.745 }, 00:13:52.745 "peer_address": { 00:13:52.745 "adrfam": "IPv4", 00:13:52.745 "traddr": "10.0.0.1", 00:13:52.745 "trsvcid": "43122", 00:13:52.745 "trtype": "TCP" 00:13:52.746 }, 00:13:52.746 "qid": 0, 00:13:52.746 "state": "enabled", 00:13:52.746 "thread": "nvmf_tgt_poll_group_000" 00:13:52.746 } 00:13:52.746 ]' 00:13:52.746 11:24:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:13:52.746 11:24:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha384 == \s\h\a\3\8\4 ]] 00:13:52.746 11:24:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:13:52.746 11:24:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe8192 == \f\f\d\h\e\8\1\9\2 ]] 00:13:52.746 11:24:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:13:53.004 11:24:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:13:53.004 11:24:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:13:53.004 11:24:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:13:53.262 11:24:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:02:OGEwMDZmYzk3YTg5OWI0ZmJlYjViNmI2YmQzN2ViYjZiODhiMTM4MjEzY2ZlYmUzuaS9rg==: --dhchap-ctrl-secret DHHC-1:01:MTcxNjJmZTg3YTMxYmYyZDA0YmFhY2Q0M2Y3OGQwNzhGAzMl: 00:13:53.262 11:24:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --hostid 3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -l 0 --dhchap-secret DHHC-1:02:OGEwMDZmYzk3YTg5OWI0ZmJlYjViNmI2YmQzN2ViYjZiODhiMTM4MjEzY2ZlYmUzuaS9rg==: --dhchap-ctrl-secret DHHC-1:01:MTcxNjJmZTg3YTMxYmYyZDA0YmFhY2Q0M2Y3OGQwNzhGAzMl: 00:13:53.828 11:24:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:13:53.828 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:13:53.828 11:24:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:13:53.828 11:24:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:53.828 11:24:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:53.828 11:24:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:53.829 11:24:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:13:53.829 11:24:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe8192 00:13:53.829 11:24:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe8192 00:13:54.086 11:24:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha384 ffdhe8192 3 00:13:54.086 11:24:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:13:54.086 11:24:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha384 00:13:54.086 11:24:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe8192 00:13:54.086 11:24:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key3 00:13:54.086 11:24:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:13:54.086 11:24:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --dhchap-key key3 00:13:54.086 11:24:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:54.086 11:24:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:54.086 11:24:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:54.086 11:24:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key3 00:13:54.087 11:24:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:13:54.087 11:24:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:13:55.019 00:13:55.019 11:24:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:13:55.019 11:24:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:13:55.019 11:24:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:13:55.019 11:24:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:13:55.019 11:24:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:13:55.019 11:24:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:55.019 11:24:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:55.277 11:24:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:55.277 11:24:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:13:55.277 { 00:13:55.277 "auth": { 00:13:55.277 "dhgroup": "ffdhe8192", 00:13:55.277 "digest": "sha384", 00:13:55.277 "state": "completed" 00:13:55.277 }, 00:13:55.277 "cntlid": 95, 00:13:55.277 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3", 00:13:55.277 "listen_address": { 00:13:55.277 "adrfam": "IPv4", 00:13:55.277 "traddr": "10.0.0.3", 00:13:55.277 "trsvcid": "4420", 00:13:55.277 "trtype": "TCP" 00:13:55.277 }, 00:13:55.277 "peer_address": { 00:13:55.277 "adrfam": "IPv4", 00:13:55.277 "traddr": "10.0.0.1", 00:13:55.277 "trsvcid": "43144", 00:13:55.277 "trtype": "TCP" 00:13:55.277 }, 00:13:55.277 "qid": 0, 00:13:55.277 "state": "enabled", 00:13:55.277 "thread": "nvmf_tgt_poll_group_000" 00:13:55.277 } 00:13:55.277 ]' 00:13:55.277 11:24:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:13:55.277 11:24:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha384 == \s\h\a\3\8\4 ]] 00:13:55.277 11:24:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:13:55.277 11:24:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe8192 == \f\f\d\h\e\8\1\9\2 ]] 00:13:55.277 11:24:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:13:55.277 11:24:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:13:55.277 11:24:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:13:55.277 11:24:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:13:55.535 11:24:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:03:N2U1YWE0ZGQ4YmRkNTZjYWQ0MTY0MWM2OTQzMDJkZGEyZDRjYjMxYmFhOTU4YjVjMWVhMGJkYzhlMmY3NzBkZSCeOpc=: 00:13:55.535 11:24:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --hostid 3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -l 0 --dhchap-secret DHHC-1:03:N2U1YWE0ZGQ4YmRkNTZjYWQ0MTY0MWM2OTQzMDJkZGEyZDRjYjMxYmFhOTU4YjVjMWVhMGJkYzhlMmY3NzBkZSCeOpc=: 00:13:56.470 11:24:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:13:56.470 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:13:56.470 11:24:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:13:56.470 11:24:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:56.470 11:24:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:56.470 11:24:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:56.470 11:24:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@118 -- # for digest in "${digests[@]}" 00:13:56.470 11:24:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@119 -- # for dhgroup in "${dhgroups[@]}" 00:13:56.470 11:24:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:13:56.470 11:24:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups null 00:13:56.470 11:24:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups null 00:13:56.728 11:24:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha512 null 0 00:13:56.728 11:24:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:13:56.728 11:24:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha512 00:13:56.728 11:24:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=null 00:13:56.728 11:24:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key0 00:13:56.728 11:24:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:13:56.728 11:24:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:13:56.728 11:24:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:56.728 11:24:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:56.728 11:24:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:56.728 11:24:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:13:56.728 11:24:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:13:56.728 11:24:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:13:56.986 00:13:56.986 11:24:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:13:56.986 11:24:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:13:56.986 11:24:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:13:57.244 11:24:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:13:57.244 11:24:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:13:57.244 11:24:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:57.244 11:24:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:57.244 11:24:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:57.244 11:24:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:13:57.244 { 00:13:57.244 "auth": { 00:13:57.244 "dhgroup": "null", 00:13:57.244 "digest": "sha512", 00:13:57.244 "state": "completed" 00:13:57.244 }, 00:13:57.244 "cntlid": 97, 00:13:57.244 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3", 00:13:57.244 "listen_address": { 00:13:57.244 "adrfam": "IPv4", 00:13:57.244 "traddr": "10.0.0.3", 00:13:57.244 "trsvcid": "4420", 00:13:57.244 "trtype": "TCP" 00:13:57.244 }, 00:13:57.244 "peer_address": { 00:13:57.244 "adrfam": "IPv4", 00:13:57.244 "traddr": "10.0.0.1", 00:13:57.244 "trsvcid": "43154", 00:13:57.244 "trtype": "TCP" 00:13:57.244 }, 00:13:57.244 "qid": 0, 00:13:57.244 "state": "enabled", 00:13:57.244 "thread": "nvmf_tgt_poll_group_000" 00:13:57.244 } 00:13:57.244 ]' 00:13:57.244 11:24:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:13:57.502 11:24:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha512 == \s\h\a\5\1\2 ]] 00:13:57.502 11:24:38 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:13:57.502 11:24:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ null == \n\u\l\l ]] 00:13:57.502 11:24:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:13:57.502 11:24:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:13:57.502 11:24:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:13:57.502 11:24:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:13:57.760 11:24:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:00:YjQ0ZWQzNjNjMTQzYmZkMDJkM2FmYzIyMTEyMmY0MGExMDAwNWQ5ZWY2NGE2NjBjPhDLOQ==: --dhchap-ctrl-secret DHHC-1:03:NDMwZGJjZWY5ZWEzMDMxODE1MjFlOWMyMDkyYTNlYzA0Yjk3ZGM2MDJlMDQ4OTFhNWUwMjIyM2E4ZGVjMWU5Y1IEScw=: 00:13:57.760 11:24:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --hostid 3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -l 0 --dhchap-secret DHHC-1:00:YjQ0ZWQzNjNjMTQzYmZkMDJkM2FmYzIyMTEyMmY0MGExMDAwNWQ5ZWY2NGE2NjBjPhDLOQ==: --dhchap-ctrl-secret DHHC-1:03:NDMwZGJjZWY5ZWEzMDMxODE1MjFlOWMyMDkyYTNlYzA0Yjk3ZGM2MDJlMDQ4OTFhNWUwMjIyM2E4ZGVjMWU5Y1IEScw=: 00:13:58.328 11:24:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:13:58.328 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:13:58.328 11:24:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:13:58.328 11:24:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:58.328 11:24:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:58.328 11:24:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:58.328 11:24:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:13:58.328 11:24:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups null 00:13:58.328 11:24:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups null 00:13:58.904 11:24:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha512 null 1 00:13:58.904 11:24:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:13:58.904 11:24:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha512 00:13:58.904 11:24:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=null 00:13:58.904 11:24:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key1 00:13:58.904 11:24:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:13:58.904 11:24:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:13:58.904 11:24:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:58.904 11:24:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:58.904 11:24:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:58.904 11:24:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:13:58.904 11:24:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:13:58.904 11:24:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:13:59.163 00:13:59.163 11:24:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:13:59.163 11:24:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:13:59.163 11:24:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:13:59.421 11:24:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:13:59.422 11:24:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:13:59.422 11:24:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:59.422 11:24:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:13:59.422 11:24:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:59.422 11:24:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:13:59.422 { 00:13:59.422 "auth": { 00:13:59.422 "dhgroup": "null", 00:13:59.422 "digest": "sha512", 00:13:59.422 "state": "completed" 00:13:59.422 }, 00:13:59.422 "cntlid": 99, 00:13:59.422 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3", 00:13:59.422 "listen_address": { 00:13:59.422 "adrfam": "IPv4", 00:13:59.422 "traddr": "10.0.0.3", 00:13:59.422 "trsvcid": "4420", 00:13:59.422 "trtype": "TCP" 00:13:59.422 }, 00:13:59.422 "peer_address": { 00:13:59.422 "adrfam": "IPv4", 00:13:59.422 "traddr": "10.0.0.1", 00:13:59.422 "trsvcid": "43190", 00:13:59.422 "trtype": "TCP" 00:13:59.422 }, 00:13:59.422 "qid": 0, 00:13:59.422 "state": "enabled", 00:13:59.422 "thread": "nvmf_tgt_poll_group_000" 00:13:59.422 } 00:13:59.422 ]' 00:13:59.422 11:24:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:13:59.422 11:24:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha512 == \s\h\a\5\1\2 ]] 00:13:59.422 11:24:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:13:59.422 11:24:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ null == \n\u\l\l ]] 00:13:59.422 11:24:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:13:59.422 11:24:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:13:59.422 11:24:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:13:59.422 11:24:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:13:59.680 11:24:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:01:N2VkMTc0ODgwNWQxZTM0NTk5OTYwMDk1NmQ5ZGE3YzEKeI3L: --dhchap-ctrl-secret DHHC-1:02:MzI4NjQxYjU2NThlMTY5N2Y3MDgwYmM0MDIxZDY2MmVkOGQyNDA0N2MzNWJlZDNicraO3Q==: 00:13:59.680 11:24:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --hostid 3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -l 0 --dhchap-secret DHHC-1:01:N2VkMTc0ODgwNWQxZTM0NTk5OTYwMDk1NmQ5ZGE3YzEKeI3L: --dhchap-ctrl-secret DHHC-1:02:MzI4NjQxYjU2NThlMTY5N2Y3MDgwYmM0MDIxZDY2MmVkOGQyNDA0N2MzNWJlZDNicraO3Q==: 00:14:00.615 11:24:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:14:00.615 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:14:00.615 11:24:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:14:00.615 11:24:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:00.615 11:24:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:00.615 11:24:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:00.615 11:24:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:14:00.615 11:24:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups null 00:14:00.615 11:24:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups null 00:14:00.873 11:24:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha512 null 2 00:14:00.873 11:24:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:14:00.873 11:24:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha512 00:14:00.873 11:24:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=null 00:14:00.873 11:24:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key2 00:14:00.873 11:24:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:14:00.873 11:24:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:14:00.873 11:24:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:00.873 11:24:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:00.873 11:24:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:00.873 11:24:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:14:00.873 11:24:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:14:00.873 11:24:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:14:01.131 00:14:01.131 11:24:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:14:01.131 11:24:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:14:01.131 11:24:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:14:01.698 11:24:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:14:01.698 11:24:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:14:01.698 11:24:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:01.698 11:24:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:01.698 11:24:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:01.698 11:24:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:14:01.698 { 00:14:01.698 "auth": { 00:14:01.698 "dhgroup": "null", 00:14:01.698 "digest": "sha512", 00:14:01.698 "state": "completed" 00:14:01.698 }, 00:14:01.698 "cntlid": 101, 00:14:01.698 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3", 00:14:01.698 "listen_address": { 00:14:01.698 "adrfam": "IPv4", 00:14:01.698 "traddr": "10.0.0.3", 00:14:01.698 "trsvcid": "4420", 00:14:01.698 "trtype": "TCP" 00:14:01.698 }, 00:14:01.698 "peer_address": { 00:14:01.698 "adrfam": "IPv4", 00:14:01.698 "traddr": "10.0.0.1", 00:14:01.698 "trsvcid": "47312", 00:14:01.698 "trtype": "TCP" 00:14:01.698 }, 00:14:01.698 "qid": 0, 00:14:01.698 "state": "enabled", 00:14:01.698 "thread": "nvmf_tgt_poll_group_000" 00:14:01.698 } 00:14:01.698 ]' 00:14:01.698 11:24:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:14:01.698 11:24:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha512 == \s\h\a\5\1\2 ]] 00:14:01.698 11:24:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:14:01.698 11:24:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ null == \n\u\l\l ]] 00:14:01.698 11:24:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:14:01.698 11:24:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:14:01.698 11:24:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:14:01.698 11:24:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:14:01.956 11:24:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:02:OGEwMDZmYzk3YTg5OWI0ZmJlYjViNmI2YmQzN2ViYjZiODhiMTM4MjEzY2ZlYmUzuaS9rg==: --dhchap-ctrl-secret DHHC-1:01:MTcxNjJmZTg3YTMxYmYyZDA0YmFhY2Q0M2Y3OGQwNzhGAzMl: 00:14:01.956 11:24:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --hostid 3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -l 0 --dhchap-secret DHHC-1:02:OGEwMDZmYzk3YTg5OWI0ZmJlYjViNmI2YmQzN2ViYjZiODhiMTM4MjEzY2ZlYmUzuaS9rg==: --dhchap-ctrl-secret DHHC-1:01:MTcxNjJmZTg3YTMxYmYyZDA0YmFhY2Q0M2Y3OGQwNzhGAzMl: 00:14:02.890 11:24:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:14:02.890 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:14:02.890 11:24:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:14:02.890 11:24:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:02.890 11:24:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:02.890 11:24:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:02.890 11:24:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:14:02.890 11:24:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups null 00:14:02.890 11:24:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups null 00:14:03.149 11:24:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha512 null 3 00:14:03.149 11:24:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:14:03.149 11:24:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha512 00:14:03.149 11:24:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=null 00:14:03.149 11:24:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key3 00:14:03.149 11:24:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:14:03.149 11:24:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --dhchap-key key3 00:14:03.149 11:24:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:03.149 11:24:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:03.149 11:24:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:03.149 11:24:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key3 00:14:03.149 11:24:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:14:03.149 11:24:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:14:03.407 00:14:03.407 11:24:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:14:03.407 11:24:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:14:03.407 11:24:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:14:03.973 11:24:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:14:03.973 11:24:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:14:03.973 11:24:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:03.973 11:24:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:03.973 11:24:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:03.973 11:24:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:14:03.973 { 00:14:03.973 "auth": { 00:14:03.973 "dhgroup": "null", 00:14:03.973 "digest": "sha512", 00:14:03.973 "state": "completed" 00:14:03.973 }, 00:14:03.973 "cntlid": 103, 00:14:03.973 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3", 00:14:03.973 "listen_address": { 00:14:03.973 "adrfam": "IPv4", 00:14:03.973 "traddr": "10.0.0.3", 00:14:03.973 "trsvcid": "4420", 00:14:03.973 "trtype": "TCP" 00:14:03.973 }, 00:14:03.973 "peer_address": { 00:14:03.973 "adrfam": "IPv4", 00:14:03.973 "traddr": "10.0.0.1", 00:14:03.973 "trsvcid": "47342", 00:14:03.973 "trtype": "TCP" 00:14:03.973 }, 00:14:03.973 "qid": 0, 00:14:03.973 "state": "enabled", 00:14:03.973 "thread": "nvmf_tgt_poll_group_000" 00:14:03.973 } 00:14:03.973 ]' 00:14:03.973 11:24:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:14:03.973 11:24:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha512 == \s\h\a\5\1\2 ]] 00:14:03.973 11:24:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:14:03.973 11:24:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ null == \n\u\l\l ]] 00:14:03.974 11:24:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:14:03.974 11:24:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:14:03.974 11:24:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:14:03.974 11:24:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:14:04.263 11:24:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:03:N2U1YWE0ZGQ4YmRkNTZjYWQ0MTY0MWM2OTQzMDJkZGEyZDRjYjMxYmFhOTU4YjVjMWVhMGJkYzhlMmY3NzBkZSCeOpc=: 00:14:04.263 11:24:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --hostid 3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -l 0 --dhchap-secret DHHC-1:03:N2U1YWE0ZGQ4YmRkNTZjYWQ0MTY0MWM2OTQzMDJkZGEyZDRjYjMxYmFhOTU4YjVjMWVhMGJkYzhlMmY3NzBkZSCeOpc=: 00:14:05.196 11:24:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:14:05.196 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:14:05.196 11:24:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:14:05.196 11:24:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:05.196 11:24:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:05.196 11:24:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:05.196 11:24:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@119 -- # for dhgroup in "${dhgroups[@]}" 00:14:05.196 11:24:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:14:05.196 11:24:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe2048 00:14:05.196 11:24:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe2048 00:14:05.454 11:24:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha512 ffdhe2048 0 00:14:05.454 11:24:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:14:05.454 11:24:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha512 00:14:05.454 11:24:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe2048 00:14:05.454 11:24:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key0 00:14:05.454 11:24:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:14:05.454 11:24:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:14:05.454 11:24:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:05.454 11:24:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:05.454 11:24:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:05.454 11:24:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:14:05.454 11:24:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:14:05.454 11:24:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:14:05.712 00:14:05.712 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:14:05.712 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:14:05.712 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:14:05.970 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:14:05.970 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:14:05.970 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:05.970 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:06.228 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:06.228 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:14:06.228 { 00:14:06.228 "auth": { 00:14:06.228 "dhgroup": "ffdhe2048", 00:14:06.228 "digest": "sha512", 00:14:06.228 "state": "completed" 00:14:06.228 }, 00:14:06.228 "cntlid": 105, 00:14:06.228 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3", 00:14:06.228 "listen_address": { 00:14:06.228 "adrfam": "IPv4", 00:14:06.228 "traddr": "10.0.0.3", 00:14:06.228 "trsvcid": "4420", 00:14:06.228 "trtype": "TCP" 00:14:06.228 }, 00:14:06.228 "peer_address": { 00:14:06.228 "adrfam": "IPv4", 00:14:06.228 "traddr": "10.0.0.1", 00:14:06.228 "trsvcid": "47374", 00:14:06.228 "trtype": "TCP" 00:14:06.228 }, 00:14:06.228 "qid": 0, 00:14:06.228 "state": "enabled", 00:14:06.228 "thread": "nvmf_tgt_poll_group_000" 00:14:06.228 } 00:14:06.228 ]' 00:14:06.228 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:14:06.228 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha512 == \s\h\a\5\1\2 ]] 00:14:06.228 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:14:06.228 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe2048 == \f\f\d\h\e\2\0\4\8 ]] 00:14:06.228 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:14:06.228 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:14:06.228 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:14:06.229 11:24:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:14:06.800 11:24:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:00:YjQ0ZWQzNjNjMTQzYmZkMDJkM2FmYzIyMTEyMmY0MGExMDAwNWQ5ZWY2NGE2NjBjPhDLOQ==: --dhchap-ctrl-secret DHHC-1:03:NDMwZGJjZWY5ZWEzMDMxODE1MjFlOWMyMDkyYTNlYzA0Yjk3ZGM2MDJlMDQ4OTFhNWUwMjIyM2E4ZGVjMWU5Y1IEScw=: 00:14:06.800 11:24:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --hostid 3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -l 0 --dhchap-secret DHHC-1:00:YjQ0ZWQzNjNjMTQzYmZkMDJkM2FmYzIyMTEyMmY0MGExMDAwNWQ5ZWY2NGE2NjBjPhDLOQ==: --dhchap-ctrl-secret DHHC-1:03:NDMwZGJjZWY5ZWEzMDMxODE1MjFlOWMyMDkyYTNlYzA0Yjk3ZGM2MDJlMDQ4OTFhNWUwMjIyM2E4ZGVjMWU5Y1IEScw=: 00:14:07.369 11:24:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:14:07.369 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:14:07.369 11:24:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:14:07.369 11:24:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:07.369 11:24:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:07.369 11:24:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:07.369 11:24:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:14:07.369 11:24:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe2048 00:14:07.369 11:24:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe2048 00:14:07.627 11:24:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha512 ffdhe2048 1 00:14:07.627 11:24:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:14:07.627 11:24:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha512 00:14:07.627 11:24:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe2048 00:14:07.627 11:24:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key1 00:14:07.627 11:24:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:14:07.627 11:24:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:14:07.627 11:24:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:07.627 11:24:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:07.627 11:24:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:07.627 11:24:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:14:07.627 11:24:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:14:07.627 11:24:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:14:08.194 00:14:08.194 11:24:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:14:08.194 11:24:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:14:08.194 11:24:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:14:08.451 11:24:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:14:08.451 11:24:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:14:08.451 11:24:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:08.451 11:24:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:08.451 11:24:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:08.451 11:24:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:14:08.451 { 00:14:08.451 "auth": { 00:14:08.451 "dhgroup": "ffdhe2048", 00:14:08.451 "digest": "sha512", 00:14:08.451 "state": "completed" 00:14:08.451 }, 00:14:08.451 "cntlid": 107, 00:14:08.451 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3", 00:14:08.451 "listen_address": { 00:14:08.451 "adrfam": "IPv4", 00:14:08.451 "traddr": "10.0.0.3", 00:14:08.451 "trsvcid": "4420", 00:14:08.451 "trtype": "TCP" 00:14:08.451 }, 00:14:08.451 "peer_address": { 00:14:08.451 "adrfam": "IPv4", 00:14:08.451 "traddr": "10.0.0.1", 00:14:08.451 "trsvcid": "47406", 00:14:08.451 "trtype": "TCP" 00:14:08.451 }, 00:14:08.451 "qid": 0, 00:14:08.451 "state": "enabled", 00:14:08.451 "thread": "nvmf_tgt_poll_group_000" 00:14:08.451 } 00:14:08.451 ]' 00:14:08.451 11:24:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:14:08.451 11:24:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha512 == \s\h\a\5\1\2 ]] 00:14:08.451 11:24:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:14:08.451 11:24:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe2048 == \f\f\d\h\e\2\0\4\8 ]] 00:14:08.451 11:24:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:14:08.709 11:24:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:14:08.709 11:24:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:14:08.709 11:24:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:14:08.967 11:24:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:01:N2VkMTc0ODgwNWQxZTM0NTk5OTYwMDk1NmQ5ZGE3YzEKeI3L: --dhchap-ctrl-secret DHHC-1:02:MzI4NjQxYjU2NThlMTY5N2Y3MDgwYmM0MDIxZDY2MmVkOGQyNDA0N2MzNWJlZDNicraO3Q==: 00:14:08.967 11:24:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --hostid 3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -l 0 --dhchap-secret DHHC-1:01:N2VkMTc0ODgwNWQxZTM0NTk5OTYwMDk1NmQ5ZGE3YzEKeI3L: --dhchap-ctrl-secret DHHC-1:02:MzI4NjQxYjU2NThlMTY5N2Y3MDgwYmM0MDIxZDY2MmVkOGQyNDA0N2MzNWJlZDNicraO3Q==: 00:14:09.560 11:24:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:14:09.560 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:14:09.560 11:24:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:14:09.560 11:24:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:09.560 11:24:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:09.560 11:24:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:09.560 11:24:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:14:09.560 11:24:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe2048 00:14:09.560 11:24:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe2048 00:14:09.855 11:24:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha512 ffdhe2048 2 00:14:09.855 11:24:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:14:09.855 11:24:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha512 00:14:09.855 11:24:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe2048 00:14:09.855 11:24:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key2 00:14:09.855 11:24:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:14:09.855 11:24:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:14:09.855 11:24:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:09.855 11:24:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:09.855 11:24:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:09.855 11:24:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:14:09.855 11:24:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:14:09.855 11:24:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:14:10.112 00:14:10.370 11:24:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:14:10.370 11:24:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:14:10.370 11:24:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:14:10.629 11:24:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:14:10.629 11:24:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:14:10.629 11:24:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:10.629 11:24:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:10.629 11:24:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:10.629 11:24:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:14:10.629 { 00:14:10.629 "auth": { 00:14:10.629 "dhgroup": "ffdhe2048", 00:14:10.629 "digest": "sha512", 00:14:10.629 "state": "completed" 00:14:10.629 }, 00:14:10.629 "cntlid": 109, 00:14:10.629 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3", 00:14:10.629 "listen_address": { 00:14:10.629 "adrfam": "IPv4", 00:14:10.629 "traddr": "10.0.0.3", 00:14:10.629 "trsvcid": "4420", 00:14:10.629 "trtype": "TCP" 00:14:10.629 }, 00:14:10.629 "peer_address": { 00:14:10.629 "adrfam": "IPv4", 00:14:10.629 "traddr": "10.0.0.1", 00:14:10.629 "trsvcid": "55668", 00:14:10.629 "trtype": "TCP" 00:14:10.629 }, 00:14:10.629 "qid": 0, 00:14:10.629 "state": "enabled", 00:14:10.629 "thread": "nvmf_tgt_poll_group_000" 00:14:10.629 } 00:14:10.629 ]' 00:14:10.629 11:24:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:14:10.629 11:24:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha512 == \s\h\a\5\1\2 ]] 00:14:10.629 11:24:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:14:10.629 11:24:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe2048 == \f\f\d\h\e\2\0\4\8 ]] 00:14:10.629 11:24:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:14:10.888 11:24:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:14:10.888 11:24:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:14:10.888 11:24:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:14:11.148 11:24:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:02:OGEwMDZmYzk3YTg5OWI0ZmJlYjViNmI2YmQzN2ViYjZiODhiMTM4MjEzY2ZlYmUzuaS9rg==: --dhchap-ctrl-secret DHHC-1:01:MTcxNjJmZTg3YTMxYmYyZDA0YmFhY2Q0M2Y3OGQwNzhGAzMl: 00:14:11.148 11:24:52 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --hostid 3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -l 0 --dhchap-secret DHHC-1:02:OGEwMDZmYzk3YTg5OWI0ZmJlYjViNmI2YmQzN2ViYjZiODhiMTM4MjEzY2ZlYmUzuaS9rg==: --dhchap-ctrl-secret DHHC-1:01:MTcxNjJmZTg3YTMxYmYyZDA0YmFhY2Q0M2Y3OGQwNzhGAzMl: 00:14:12.109 11:24:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:14:12.109 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:14:12.109 11:24:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:14:12.109 11:24:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:12.109 11:24:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:12.109 11:24:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:12.109 11:24:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:14:12.109 11:24:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe2048 00:14:12.109 11:24:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe2048 00:14:12.381 11:24:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha512 ffdhe2048 3 00:14:12.381 11:24:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:14:12.381 11:24:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha512 00:14:12.381 11:24:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe2048 00:14:12.381 11:24:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key3 00:14:12.381 11:24:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:14:12.381 11:24:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --dhchap-key key3 00:14:12.381 11:24:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:12.381 11:24:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:12.381 11:24:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:12.381 11:24:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key3 00:14:12.381 11:24:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:14:12.381 11:24:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:14:12.639 00:14:12.639 11:24:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:14:12.639 11:24:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:14:12.639 11:24:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:14:12.895 11:24:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:14:12.895 11:24:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:14:12.895 11:24:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:12.895 11:24:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:12.895 11:24:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:12.895 11:24:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:14:12.895 { 00:14:12.895 "auth": { 00:14:12.895 "dhgroup": "ffdhe2048", 00:14:12.895 "digest": "sha512", 00:14:12.895 "state": "completed" 00:14:12.895 }, 00:14:12.895 "cntlid": 111, 00:14:12.895 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3", 00:14:12.895 "listen_address": { 00:14:12.895 "adrfam": "IPv4", 00:14:12.895 "traddr": "10.0.0.3", 00:14:12.895 "trsvcid": "4420", 00:14:12.895 "trtype": "TCP" 00:14:12.895 }, 00:14:12.895 "peer_address": { 00:14:12.895 "adrfam": "IPv4", 00:14:12.895 "traddr": "10.0.0.1", 00:14:12.895 "trsvcid": "55688", 00:14:12.895 "trtype": "TCP" 00:14:12.895 }, 00:14:12.895 "qid": 0, 00:14:12.895 "state": "enabled", 00:14:12.895 "thread": "nvmf_tgt_poll_group_000" 00:14:12.895 } 00:14:12.895 ]' 00:14:12.895 11:24:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:14:13.153 11:24:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha512 == \s\h\a\5\1\2 ]] 00:14:13.153 11:24:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:14:13.153 11:24:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe2048 == \f\f\d\h\e\2\0\4\8 ]] 00:14:13.153 11:24:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:14:13.153 11:24:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:14:13.153 11:24:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:14:13.153 11:24:54 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:14:13.411 11:24:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:03:N2U1YWE0ZGQ4YmRkNTZjYWQ0MTY0MWM2OTQzMDJkZGEyZDRjYjMxYmFhOTU4YjVjMWVhMGJkYzhlMmY3NzBkZSCeOpc=: 00:14:13.411 11:24:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --hostid 3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -l 0 --dhchap-secret DHHC-1:03:N2U1YWE0ZGQ4YmRkNTZjYWQ0MTY0MWM2OTQzMDJkZGEyZDRjYjMxYmFhOTU4YjVjMWVhMGJkYzhlMmY3NzBkZSCeOpc=: 00:14:14.346 11:24:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:14:14.346 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:14:14.346 11:24:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:14:14.346 11:24:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:14.346 11:24:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:14.346 11:24:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:14.346 11:24:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@119 -- # for dhgroup in "${dhgroups[@]}" 00:14:14.346 11:24:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:14:14.346 11:24:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe3072 00:14:14.346 11:24:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe3072 00:14:14.604 11:24:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha512 ffdhe3072 0 00:14:14.604 11:24:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:14:14.604 11:24:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha512 00:14:14.604 11:24:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe3072 00:14:14.604 11:24:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key0 00:14:14.604 11:24:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:14:14.604 11:24:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:14:14.604 11:24:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:14.604 11:24:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:14.604 11:24:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:14.604 11:24:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:14:14.604 11:24:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:14:14.604 11:24:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:14:14.863 00:14:14.863 11:24:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:14:14.863 11:24:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:14:14.863 11:24:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:14:15.431 11:24:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:14:15.431 11:24:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:14:15.431 11:24:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:15.431 11:24:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:15.431 11:24:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:15.431 11:24:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:14:15.431 { 00:14:15.431 "auth": { 00:14:15.431 "dhgroup": "ffdhe3072", 00:14:15.431 "digest": "sha512", 00:14:15.431 "state": "completed" 00:14:15.431 }, 00:14:15.431 "cntlid": 113, 00:14:15.431 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3", 00:14:15.431 "listen_address": { 00:14:15.431 "adrfam": "IPv4", 00:14:15.431 "traddr": "10.0.0.3", 00:14:15.431 "trsvcid": "4420", 00:14:15.431 "trtype": "TCP" 00:14:15.431 }, 00:14:15.431 "peer_address": { 00:14:15.431 "adrfam": "IPv4", 00:14:15.431 "traddr": "10.0.0.1", 00:14:15.431 "trsvcid": "55728", 00:14:15.431 "trtype": "TCP" 00:14:15.431 }, 00:14:15.431 "qid": 0, 00:14:15.431 "state": "enabled", 00:14:15.431 "thread": "nvmf_tgt_poll_group_000" 00:14:15.431 } 00:14:15.431 ]' 00:14:15.431 11:24:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:14:15.431 11:24:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha512 == \s\h\a\5\1\2 ]] 00:14:15.431 11:24:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:14:15.431 11:24:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe3072 == \f\f\d\h\e\3\0\7\2 ]] 00:14:15.431 11:24:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:14:15.431 11:24:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:14:15.431 11:24:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:14:15.431 11:24:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:14:15.689 11:24:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:00:YjQ0ZWQzNjNjMTQzYmZkMDJkM2FmYzIyMTEyMmY0MGExMDAwNWQ5ZWY2NGE2NjBjPhDLOQ==: --dhchap-ctrl-secret DHHC-1:03:NDMwZGJjZWY5ZWEzMDMxODE1MjFlOWMyMDkyYTNlYzA0Yjk3ZGM2MDJlMDQ4OTFhNWUwMjIyM2E4ZGVjMWU5Y1IEScw=: 00:14:15.689 11:24:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --hostid 3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -l 0 --dhchap-secret DHHC-1:00:YjQ0ZWQzNjNjMTQzYmZkMDJkM2FmYzIyMTEyMmY0MGExMDAwNWQ5ZWY2NGE2NjBjPhDLOQ==: --dhchap-ctrl-secret DHHC-1:03:NDMwZGJjZWY5ZWEzMDMxODE1MjFlOWMyMDkyYTNlYzA0Yjk3ZGM2MDJlMDQ4OTFhNWUwMjIyM2E4ZGVjMWU5Y1IEScw=: 00:14:16.622 11:24:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:14:16.622 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:14:16.622 11:24:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:14:16.622 11:24:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:16.622 11:24:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:16.622 11:24:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:16.622 11:24:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:14:16.622 11:24:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe3072 00:14:16.622 11:24:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe3072 00:14:16.879 11:24:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha512 ffdhe3072 1 00:14:16.879 11:24:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:14:16.879 11:24:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha512 00:14:16.879 11:24:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe3072 00:14:16.879 11:24:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key1 00:14:16.879 11:24:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:14:16.879 11:24:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:14:16.879 11:24:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:16.879 11:24:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:16.879 11:24:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:16.879 11:24:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:14:16.879 11:24:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:14:16.879 11:24:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:14:17.136 00:14:17.136 11:24:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:14:17.136 11:24:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:14:17.136 11:24:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:14:17.699 11:24:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:14:17.699 11:24:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:14:17.699 11:24:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:17.699 11:24:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:17.699 11:24:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:17.699 11:24:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:14:17.699 { 00:14:17.699 "auth": { 00:14:17.699 "dhgroup": "ffdhe3072", 00:14:17.699 "digest": "sha512", 00:14:17.699 "state": "completed" 00:14:17.700 }, 00:14:17.700 "cntlid": 115, 00:14:17.700 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3", 00:14:17.700 "listen_address": { 00:14:17.700 "adrfam": "IPv4", 00:14:17.700 "traddr": "10.0.0.3", 00:14:17.700 "trsvcid": "4420", 00:14:17.700 "trtype": "TCP" 00:14:17.700 }, 00:14:17.700 "peer_address": { 00:14:17.700 "adrfam": "IPv4", 00:14:17.700 "traddr": "10.0.0.1", 00:14:17.700 "trsvcid": "55748", 00:14:17.700 "trtype": "TCP" 00:14:17.700 }, 00:14:17.700 "qid": 0, 00:14:17.700 "state": "enabled", 00:14:17.700 "thread": "nvmf_tgt_poll_group_000" 00:14:17.700 } 00:14:17.700 ]' 00:14:17.700 11:24:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:14:17.700 11:24:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha512 == \s\h\a\5\1\2 ]] 00:14:17.700 11:24:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:14:17.700 11:24:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe3072 == \f\f\d\h\e\3\0\7\2 ]] 00:14:17.700 11:24:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:14:17.700 11:24:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:14:17.700 11:24:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:14:17.700 11:24:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:14:18.263 11:24:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:01:N2VkMTc0ODgwNWQxZTM0NTk5OTYwMDk1NmQ5ZGE3YzEKeI3L: --dhchap-ctrl-secret DHHC-1:02:MzI4NjQxYjU2NThlMTY5N2Y3MDgwYmM0MDIxZDY2MmVkOGQyNDA0N2MzNWJlZDNicraO3Q==: 00:14:18.263 11:24:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --hostid 3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -l 0 --dhchap-secret DHHC-1:01:N2VkMTc0ODgwNWQxZTM0NTk5OTYwMDk1NmQ5ZGE3YzEKeI3L: --dhchap-ctrl-secret DHHC-1:02:MzI4NjQxYjU2NThlMTY5N2Y3MDgwYmM0MDIxZDY2MmVkOGQyNDA0N2MzNWJlZDNicraO3Q==: 00:14:18.827 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:14:18.827 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:14:18.827 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:14:18.827 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:18.827 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:18.827 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:18.827 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:14:18.827 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe3072 00:14:18.827 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe3072 00:14:19.085 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha512 ffdhe3072 2 00:14:19.085 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:14:19.085 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha512 00:14:19.085 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe3072 00:14:19.085 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key2 00:14:19.085 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:14:19.085 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:14:19.085 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:19.085 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:19.085 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:19.085 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:14:19.085 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:14:19.085 11:25:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:14:19.650 00:14:19.650 11:25:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:14:19.650 11:25:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:14:19.650 11:25:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:14:19.910 11:25:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:14:19.910 11:25:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:14:19.910 11:25:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:19.910 11:25:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:19.910 11:25:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:19.910 11:25:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:14:19.910 { 00:14:19.910 "auth": { 00:14:19.910 "dhgroup": "ffdhe3072", 00:14:19.910 "digest": "sha512", 00:14:19.910 "state": "completed" 00:14:19.910 }, 00:14:19.910 "cntlid": 117, 00:14:19.910 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3", 00:14:19.910 "listen_address": { 00:14:19.910 "adrfam": "IPv4", 00:14:19.910 "traddr": "10.0.0.3", 00:14:19.910 "trsvcid": "4420", 00:14:19.910 "trtype": "TCP" 00:14:19.910 }, 00:14:19.910 "peer_address": { 00:14:19.910 "adrfam": "IPv4", 00:14:19.910 "traddr": "10.0.0.1", 00:14:19.910 "trsvcid": "35176", 00:14:19.910 "trtype": "TCP" 00:14:19.910 }, 00:14:19.910 "qid": 0, 00:14:19.910 "state": "enabled", 00:14:19.910 "thread": "nvmf_tgt_poll_group_000" 00:14:19.910 } 00:14:19.910 ]' 00:14:19.910 11:25:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:14:19.910 11:25:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha512 == \s\h\a\5\1\2 ]] 00:14:19.910 11:25:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:14:19.910 11:25:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe3072 == \f\f\d\h\e\3\0\7\2 ]] 00:14:19.910 11:25:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:14:20.167 11:25:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:14:20.167 11:25:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:14:20.167 11:25:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:14:20.426 11:25:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:02:OGEwMDZmYzk3YTg5OWI0ZmJlYjViNmI2YmQzN2ViYjZiODhiMTM4MjEzY2ZlYmUzuaS9rg==: --dhchap-ctrl-secret DHHC-1:01:MTcxNjJmZTg3YTMxYmYyZDA0YmFhY2Q0M2Y3OGQwNzhGAzMl: 00:14:20.426 11:25:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --hostid 3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -l 0 --dhchap-secret DHHC-1:02:OGEwMDZmYzk3YTg5OWI0ZmJlYjViNmI2YmQzN2ViYjZiODhiMTM4MjEzY2ZlYmUzuaS9rg==: --dhchap-ctrl-secret DHHC-1:01:MTcxNjJmZTg3YTMxYmYyZDA0YmFhY2Q0M2Y3OGQwNzhGAzMl: 00:14:20.991 11:25:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:14:21.249 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:14:21.249 11:25:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:14:21.249 11:25:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:21.249 11:25:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:21.249 11:25:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:21.249 11:25:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:14:21.249 11:25:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe3072 00:14:21.250 11:25:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe3072 00:14:21.508 11:25:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha512 ffdhe3072 3 00:14:21.508 11:25:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:14:21.508 11:25:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha512 00:14:21.508 11:25:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe3072 00:14:21.508 11:25:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key3 00:14:21.508 11:25:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:14:21.508 11:25:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --dhchap-key key3 00:14:21.508 11:25:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:21.508 11:25:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:21.508 11:25:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:21.508 11:25:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key3 00:14:21.508 11:25:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:14:21.508 11:25:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:14:21.766 00:14:21.766 11:25:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:14:21.766 11:25:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:14:21.766 11:25:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:14:22.334 11:25:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:14:22.334 11:25:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:14:22.334 11:25:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:22.334 11:25:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:22.334 11:25:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:22.334 11:25:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:14:22.334 { 00:14:22.334 "auth": { 00:14:22.334 "dhgroup": "ffdhe3072", 00:14:22.334 "digest": "sha512", 00:14:22.334 "state": "completed" 00:14:22.334 }, 00:14:22.334 "cntlid": 119, 00:14:22.334 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3", 00:14:22.334 "listen_address": { 00:14:22.334 "adrfam": "IPv4", 00:14:22.334 "traddr": "10.0.0.3", 00:14:22.334 "trsvcid": "4420", 00:14:22.334 "trtype": "TCP" 00:14:22.334 }, 00:14:22.334 "peer_address": { 00:14:22.334 "adrfam": "IPv4", 00:14:22.334 "traddr": "10.0.0.1", 00:14:22.334 "trsvcid": "35208", 00:14:22.334 "trtype": "TCP" 00:14:22.334 }, 00:14:22.334 "qid": 0, 00:14:22.334 "state": "enabled", 00:14:22.334 "thread": "nvmf_tgt_poll_group_000" 00:14:22.334 } 00:14:22.334 ]' 00:14:22.334 11:25:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:14:22.334 11:25:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha512 == \s\h\a\5\1\2 ]] 00:14:22.334 11:25:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:14:22.334 11:25:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe3072 == \f\f\d\h\e\3\0\7\2 ]] 00:14:22.334 11:25:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:14:22.334 11:25:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:14:22.334 11:25:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:14:22.334 11:25:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:14:22.592 11:25:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:03:N2U1YWE0ZGQ4YmRkNTZjYWQ0MTY0MWM2OTQzMDJkZGEyZDRjYjMxYmFhOTU4YjVjMWVhMGJkYzhlMmY3NzBkZSCeOpc=: 00:14:22.592 11:25:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --hostid 3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -l 0 --dhchap-secret DHHC-1:03:N2U1YWE0ZGQ4YmRkNTZjYWQ0MTY0MWM2OTQzMDJkZGEyZDRjYjMxYmFhOTU4YjVjMWVhMGJkYzhlMmY3NzBkZSCeOpc=: 00:14:23.526 11:25:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:14:23.526 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:14:23.526 11:25:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:14:23.526 11:25:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:23.527 11:25:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:23.527 11:25:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:23.527 11:25:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@119 -- # for dhgroup in "${dhgroups[@]}" 00:14:23.527 11:25:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:14:23.527 11:25:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe4096 00:14:23.527 11:25:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe4096 00:14:23.527 11:25:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha512 ffdhe4096 0 00:14:23.527 11:25:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:14:23.527 11:25:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha512 00:14:23.527 11:25:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe4096 00:14:23.527 11:25:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key0 00:14:23.527 11:25:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:14:23.527 11:25:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:14:23.527 11:25:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:23.527 11:25:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:23.527 11:25:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:23.527 11:25:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:14:23.527 11:25:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:14:23.527 11:25:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:14:24.091 00:14:24.091 11:25:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:14:24.091 11:25:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:14:24.091 11:25:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:14:24.369 11:25:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:14:24.369 11:25:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:14:24.369 11:25:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:24.369 11:25:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:24.369 11:25:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:24.369 11:25:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:14:24.369 { 00:14:24.369 "auth": { 00:14:24.369 "dhgroup": "ffdhe4096", 00:14:24.369 "digest": "sha512", 00:14:24.369 "state": "completed" 00:14:24.369 }, 00:14:24.369 "cntlid": 121, 00:14:24.369 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3", 00:14:24.369 "listen_address": { 00:14:24.369 "adrfam": "IPv4", 00:14:24.369 "traddr": "10.0.0.3", 00:14:24.369 "trsvcid": "4420", 00:14:24.369 "trtype": "TCP" 00:14:24.369 }, 00:14:24.369 "peer_address": { 00:14:24.369 "adrfam": "IPv4", 00:14:24.369 "traddr": "10.0.0.1", 00:14:24.369 "trsvcid": "35238", 00:14:24.369 "trtype": "TCP" 00:14:24.369 }, 00:14:24.369 "qid": 0, 00:14:24.369 "state": "enabled", 00:14:24.369 "thread": "nvmf_tgt_poll_group_000" 00:14:24.369 } 00:14:24.369 ]' 00:14:24.369 11:25:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:14:24.369 11:25:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha512 == \s\h\a\5\1\2 ]] 00:14:24.627 11:25:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:14:24.627 11:25:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe4096 == \f\f\d\h\e\4\0\9\6 ]] 00:14:24.627 11:25:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:14:24.627 11:25:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:14:24.627 11:25:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:14:24.627 11:25:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:14:24.885 11:25:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:00:YjQ0ZWQzNjNjMTQzYmZkMDJkM2FmYzIyMTEyMmY0MGExMDAwNWQ5ZWY2NGE2NjBjPhDLOQ==: --dhchap-ctrl-secret DHHC-1:03:NDMwZGJjZWY5ZWEzMDMxODE1MjFlOWMyMDkyYTNlYzA0Yjk3ZGM2MDJlMDQ4OTFhNWUwMjIyM2E4ZGVjMWU5Y1IEScw=: 00:14:24.885 11:25:06 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --hostid 3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -l 0 --dhchap-secret DHHC-1:00:YjQ0ZWQzNjNjMTQzYmZkMDJkM2FmYzIyMTEyMmY0MGExMDAwNWQ5ZWY2NGE2NjBjPhDLOQ==: --dhchap-ctrl-secret DHHC-1:03:NDMwZGJjZWY5ZWEzMDMxODE1MjFlOWMyMDkyYTNlYzA0Yjk3ZGM2MDJlMDQ4OTFhNWUwMjIyM2E4ZGVjMWU5Y1IEScw=: 00:14:25.451 11:25:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:14:25.707 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:14:25.708 11:25:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:14:25.708 11:25:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:25.708 11:25:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:25.708 11:25:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:25.708 11:25:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:14:25.708 11:25:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe4096 00:14:25.708 11:25:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe4096 00:14:25.965 11:25:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha512 ffdhe4096 1 00:14:25.965 11:25:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:14:25.965 11:25:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha512 00:14:25.965 11:25:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe4096 00:14:25.965 11:25:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key1 00:14:25.965 11:25:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:14:25.965 11:25:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:14:25.965 11:25:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:25.965 11:25:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:25.965 11:25:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:25.965 11:25:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:14:25.965 11:25:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:14:25.965 11:25:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:14:26.222 00:14:26.222 11:25:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:14:26.222 11:25:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:14:26.222 11:25:07 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:14:26.787 11:25:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:14:26.787 11:25:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:14:26.787 11:25:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:26.787 11:25:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:26.787 11:25:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:26.787 11:25:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:14:26.787 { 00:14:26.787 "auth": { 00:14:26.787 "dhgroup": "ffdhe4096", 00:14:26.787 "digest": "sha512", 00:14:26.787 "state": "completed" 00:14:26.787 }, 00:14:26.787 "cntlid": 123, 00:14:26.787 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3", 00:14:26.787 "listen_address": { 00:14:26.787 "adrfam": "IPv4", 00:14:26.787 "traddr": "10.0.0.3", 00:14:26.787 "trsvcid": "4420", 00:14:26.787 "trtype": "TCP" 00:14:26.787 }, 00:14:26.787 "peer_address": { 00:14:26.787 "adrfam": "IPv4", 00:14:26.787 "traddr": "10.0.0.1", 00:14:26.787 "trsvcid": "35272", 00:14:26.787 "trtype": "TCP" 00:14:26.787 }, 00:14:26.787 "qid": 0, 00:14:26.787 "state": "enabled", 00:14:26.787 "thread": "nvmf_tgt_poll_group_000" 00:14:26.787 } 00:14:26.787 ]' 00:14:26.787 11:25:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:14:26.787 11:25:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha512 == \s\h\a\5\1\2 ]] 00:14:26.787 11:25:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:14:26.787 11:25:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe4096 == \f\f\d\h\e\4\0\9\6 ]] 00:14:26.787 11:25:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:14:26.787 11:25:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:14:26.787 11:25:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:14:26.787 11:25:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:14:27.045 11:25:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:01:N2VkMTc0ODgwNWQxZTM0NTk5OTYwMDk1NmQ5ZGE3YzEKeI3L: --dhchap-ctrl-secret DHHC-1:02:MzI4NjQxYjU2NThlMTY5N2Y3MDgwYmM0MDIxZDY2MmVkOGQyNDA0N2MzNWJlZDNicraO3Q==: 00:14:27.045 11:25:08 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --hostid 3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -l 0 --dhchap-secret DHHC-1:01:N2VkMTc0ODgwNWQxZTM0NTk5OTYwMDk1NmQ5ZGE3YzEKeI3L: --dhchap-ctrl-secret DHHC-1:02:MzI4NjQxYjU2NThlMTY5N2Y3MDgwYmM0MDIxZDY2MmVkOGQyNDA0N2MzNWJlZDNicraO3Q==: 00:14:27.977 11:25:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:14:27.977 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:14:27.977 11:25:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:14:27.977 11:25:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:27.977 11:25:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:27.977 11:25:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:27.977 11:25:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:14:27.977 11:25:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe4096 00:14:27.977 11:25:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe4096 00:14:28.235 11:25:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha512 ffdhe4096 2 00:14:28.235 11:25:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:14:28.235 11:25:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha512 00:14:28.235 11:25:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe4096 00:14:28.235 11:25:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key2 00:14:28.235 11:25:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:14:28.235 11:25:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:14:28.235 11:25:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:28.235 11:25:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:28.235 11:25:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:28.235 11:25:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:14:28.235 11:25:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:14:28.235 11:25:09 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:14:28.492 00:14:28.492 11:25:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:14:28.492 11:25:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:14:28.492 11:25:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:14:29.056 11:25:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:14:29.056 11:25:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:14:29.056 11:25:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:29.056 11:25:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:29.056 11:25:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:29.056 11:25:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:14:29.056 { 00:14:29.056 "auth": { 00:14:29.056 "dhgroup": "ffdhe4096", 00:14:29.056 "digest": "sha512", 00:14:29.056 "state": "completed" 00:14:29.056 }, 00:14:29.056 "cntlid": 125, 00:14:29.056 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3", 00:14:29.056 "listen_address": { 00:14:29.056 "adrfam": "IPv4", 00:14:29.056 "traddr": "10.0.0.3", 00:14:29.056 "trsvcid": "4420", 00:14:29.056 "trtype": "TCP" 00:14:29.056 }, 00:14:29.056 "peer_address": { 00:14:29.056 "adrfam": "IPv4", 00:14:29.056 "traddr": "10.0.0.1", 00:14:29.056 "trsvcid": "35304", 00:14:29.056 "trtype": "TCP" 00:14:29.056 }, 00:14:29.056 "qid": 0, 00:14:29.056 "state": "enabled", 00:14:29.056 "thread": "nvmf_tgt_poll_group_000" 00:14:29.056 } 00:14:29.056 ]' 00:14:29.056 11:25:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:14:29.056 11:25:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha512 == \s\h\a\5\1\2 ]] 00:14:29.056 11:25:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:14:29.056 11:25:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe4096 == \f\f\d\h\e\4\0\9\6 ]] 00:14:29.056 11:25:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:14:29.056 11:25:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:14:29.056 11:25:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:14:29.056 11:25:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:14:29.315 11:25:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:02:OGEwMDZmYzk3YTg5OWI0ZmJlYjViNmI2YmQzN2ViYjZiODhiMTM4MjEzY2ZlYmUzuaS9rg==: --dhchap-ctrl-secret DHHC-1:01:MTcxNjJmZTg3YTMxYmYyZDA0YmFhY2Q0M2Y3OGQwNzhGAzMl: 00:14:29.315 11:25:10 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --hostid 3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -l 0 --dhchap-secret DHHC-1:02:OGEwMDZmYzk3YTg5OWI0ZmJlYjViNmI2YmQzN2ViYjZiODhiMTM4MjEzY2ZlYmUzuaS9rg==: --dhchap-ctrl-secret DHHC-1:01:MTcxNjJmZTg3YTMxYmYyZDA0YmFhY2Q0M2Y3OGQwNzhGAzMl: 00:14:29.881 11:25:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:14:29.881 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:14:29.881 11:25:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:14:29.881 11:25:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:29.881 11:25:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:29.881 11:25:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:29.881 11:25:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:14:29.881 11:25:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe4096 00:14:29.881 11:25:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe4096 00:14:30.446 11:25:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha512 ffdhe4096 3 00:14:30.446 11:25:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:14:30.446 11:25:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha512 00:14:30.446 11:25:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe4096 00:14:30.446 11:25:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key3 00:14:30.446 11:25:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:14:30.446 11:25:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --dhchap-key key3 00:14:30.446 11:25:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:30.446 11:25:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:30.446 11:25:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:30.446 11:25:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key3 00:14:30.446 11:25:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:14:30.446 11:25:11 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:14:30.704 00:14:30.704 11:25:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:14:30.704 11:25:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:14:30.704 11:25:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:14:30.962 11:25:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:14:30.962 11:25:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:14:30.962 11:25:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:30.962 11:25:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:30.962 11:25:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:30.962 11:25:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:14:30.962 { 00:14:30.962 "auth": { 00:14:30.962 "dhgroup": "ffdhe4096", 00:14:30.962 "digest": "sha512", 00:14:30.962 "state": "completed" 00:14:30.962 }, 00:14:30.962 "cntlid": 127, 00:14:30.962 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3", 00:14:30.962 "listen_address": { 00:14:30.962 "adrfam": "IPv4", 00:14:30.962 "traddr": "10.0.0.3", 00:14:30.962 "trsvcid": "4420", 00:14:30.962 "trtype": "TCP" 00:14:30.962 }, 00:14:30.962 "peer_address": { 00:14:30.962 "adrfam": "IPv4", 00:14:30.962 "traddr": "10.0.0.1", 00:14:30.962 "trsvcid": "59218", 00:14:30.962 "trtype": "TCP" 00:14:30.962 }, 00:14:30.962 "qid": 0, 00:14:30.962 "state": "enabled", 00:14:30.962 "thread": "nvmf_tgt_poll_group_000" 00:14:30.962 } 00:14:30.962 ]' 00:14:30.962 11:25:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:14:30.962 11:25:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha512 == \s\h\a\5\1\2 ]] 00:14:30.962 11:25:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:14:31.219 11:25:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe4096 == \f\f\d\h\e\4\0\9\6 ]] 00:14:31.219 11:25:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:14:31.219 11:25:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:14:31.219 11:25:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:14:31.219 11:25:12 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:14:31.477 11:25:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:03:N2U1YWE0ZGQ4YmRkNTZjYWQ0MTY0MWM2OTQzMDJkZGEyZDRjYjMxYmFhOTU4YjVjMWVhMGJkYzhlMmY3NzBkZSCeOpc=: 00:14:31.477 11:25:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --hostid 3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -l 0 --dhchap-secret DHHC-1:03:N2U1YWE0ZGQ4YmRkNTZjYWQ0MTY0MWM2OTQzMDJkZGEyZDRjYjMxYmFhOTU4YjVjMWVhMGJkYzhlMmY3NzBkZSCeOpc=: 00:14:32.042 11:25:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:14:32.042 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:14:32.042 11:25:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:14:32.042 11:25:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:32.042 11:25:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:32.042 11:25:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:32.042 11:25:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@119 -- # for dhgroup in "${dhgroups[@]}" 00:14:32.042 11:25:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:14:32.042 11:25:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe6144 00:14:32.042 11:25:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe6144 00:14:32.300 11:25:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha512 ffdhe6144 0 00:14:32.300 11:25:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:14:32.300 11:25:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha512 00:14:32.300 11:25:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe6144 00:14:32.300 11:25:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key0 00:14:32.300 11:25:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:14:32.300 11:25:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:14:32.300 11:25:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:32.300 11:25:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:32.300 11:25:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:32.300 11:25:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:14:32.300 11:25:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:14:32.300 11:25:13 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:14:32.866 00:14:32.866 11:25:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:14:32.866 11:25:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:14:32.866 11:25:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:14:33.124 11:25:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:14:33.124 11:25:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:14:33.124 11:25:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:33.124 11:25:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:33.124 11:25:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:33.124 11:25:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:14:33.124 { 00:14:33.124 "auth": { 00:14:33.124 "dhgroup": "ffdhe6144", 00:14:33.124 "digest": "sha512", 00:14:33.124 "state": "completed" 00:14:33.124 }, 00:14:33.124 "cntlid": 129, 00:14:33.124 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3", 00:14:33.124 "listen_address": { 00:14:33.124 "adrfam": "IPv4", 00:14:33.124 "traddr": "10.0.0.3", 00:14:33.124 "trsvcid": "4420", 00:14:33.124 "trtype": "TCP" 00:14:33.124 }, 00:14:33.124 "peer_address": { 00:14:33.124 "adrfam": "IPv4", 00:14:33.124 "traddr": "10.0.0.1", 00:14:33.124 "trsvcid": "59240", 00:14:33.124 "trtype": "TCP" 00:14:33.124 }, 00:14:33.124 "qid": 0, 00:14:33.124 "state": "enabled", 00:14:33.124 "thread": "nvmf_tgt_poll_group_000" 00:14:33.124 } 00:14:33.124 ]' 00:14:33.382 11:25:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:14:33.382 11:25:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha512 == \s\h\a\5\1\2 ]] 00:14:33.382 11:25:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:14:33.382 11:25:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe6144 == \f\f\d\h\e\6\1\4\4 ]] 00:14:33.382 11:25:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:14:33.382 11:25:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:14:33.382 11:25:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:14:33.382 11:25:14 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:14:33.639 11:25:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:00:YjQ0ZWQzNjNjMTQzYmZkMDJkM2FmYzIyMTEyMmY0MGExMDAwNWQ5ZWY2NGE2NjBjPhDLOQ==: --dhchap-ctrl-secret DHHC-1:03:NDMwZGJjZWY5ZWEzMDMxODE1MjFlOWMyMDkyYTNlYzA0Yjk3ZGM2MDJlMDQ4OTFhNWUwMjIyM2E4ZGVjMWU5Y1IEScw=: 00:14:33.639 11:25:15 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --hostid 3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -l 0 --dhchap-secret DHHC-1:00:YjQ0ZWQzNjNjMTQzYmZkMDJkM2FmYzIyMTEyMmY0MGExMDAwNWQ5ZWY2NGE2NjBjPhDLOQ==: --dhchap-ctrl-secret DHHC-1:03:NDMwZGJjZWY5ZWEzMDMxODE1MjFlOWMyMDkyYTNlYzA0Yjk3ZGM2MDJlMDQ4OTFhNWUwMjIyM2E4ZGVjMWU5Y1IEScw=: 00:14:34.574 11:25:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:14:34.574 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:14:34.574 11:25:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:14:34.574 11:25:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:34.574 11:25:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:34.574 11:25:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:34.574 11:25:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:14:34.574 11:25:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe6144 00:14:34.574 11:25:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe6144 00:14:34.834 11:25:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha512 ffdhe6144 1 00:14:34.834 11:25:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:14:34.834 11:25:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha512 00:14:34.834 11:25:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe6144 00:14:34.834 11:25:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key1 00:14:34.834 11:25:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:14:34.834 11:25:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:14:34.834 11:25:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:34.834 11:25:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:34.834 11:25:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:34.834 11:25:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:14:34.834 11:25:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:14:34.834 11:25:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:14:35.399 00:14:35.399 11:25:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:14:35.399 11:25:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:14:35.399 11:25:16 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:14:35.657 11:25:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:14:35.657 11:25:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:14:35.657 11:25:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:35.657 11:25:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:35.657 11:25:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:35.657 11:25:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:14:35.657 { 00:14:35.657 "auth": { 00:14:35.657 "dhgroup": "ffdhe6144", 00:14:35.657 "digest": "sha512", 00:14:35.657 "state": "completed" 00:14:35.657 }, 00:14:35.657 "cntlid": 131, 00:14:35.657 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3", 00:14:35.657 "listen_address": { 00:14:35.657 "adrfam": "IPv4", 00:14:35.657 "traddr": "10.0.0.3", 00:14:35.657 "trsvcid": "4420", 00:14:35.657 "trtype": "TCP" 00:14:35.657 }, 00:14:35.657 "peer_address": { 00:14:35.657 "adrfam": "IPv4", 00:14:35.657 "traddr": "10.0.0.1", 00:14:35.657 "trsvcid": "59262", 00:14:35.657 "trtype": "TCP" 00:14:35.657 }, 00:14:35.657 "qid": 0, 00:14:35.657 "state": "enabled", 00:14:35.657 "thread": "nvmf_tgt_poll_group_000" 00:14:35.657 } 00:14:35.657 ]' 00:14:35.657 11:25:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:14:35.915 11:25:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha512 == \s\h\a\5\1\2 ]] 00:14:35.915 11:25:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:14:35.915 11:25:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe6144 == \f\f\d\h\e\6\1\4\4 ]] 00:14:35.915 11:25:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:14:35.915 11:25:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:14:35.915 11:25:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:14:35.915 11:25:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:14:36.173 11:25:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:01:N2VkMTc0ODgwNWQxZTM0NTk5OTYwMDk1NmQ5ZGE3YzEKeI3L: --dhchap-ctrl-secret DHHC-1:02:MzI4NjQxYjU2NThlMTY5N2Y3MDgwYmM0MDIxZDY2MmVkOGQyNDA0N2MzNWJlZDNicraO3Q==: 00:14:36.173 11:25:17 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --hostid 3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -l 0 --dhchap-secret DHHC-1:01:N2VkMTc0ODgwNWQxZTM0NTk5OTYwMDk1NmQ5ZGE3YzEKeI3L: --dhchap-ctrl-secret DHHC-1:02:MzI4NjQxYjU2NThlMTY5N2Y3MDgwYmM0MDIxZDY2MmVkOGQyNDA0N2MzNWJlZDNicraO3Q==: 00:14:36.737 11:25:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:14:36.737 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:14:36.737 11:25:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:14:36.737 11:25:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:36.737 11:25:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:36.738 11:25:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:36.738 11:25:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:14:36.738 11:25:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe6144 00:14:36.738 11:25:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe6144 00:14:36.996 11:25:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha512 ffdhe6144 2 00:14:36.996 11:25:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:14:36.996 11:25:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha512 00:14:36.996 11:25:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe6144 00:14:36.996 11:25:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key2 00:14:36.996 11:25:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:14:36.996 11:25:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:14:36.996 11:25:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:36.996 11:25:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:36.996 11:25:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:36.996 11:25:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:14:36.996 11:25:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:14:36.996 11:25:18 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:14:37.608 00:14:37.608 11:25:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:14:37.609 11:25:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:14:37.609 11:25:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:14:37.866 11:25:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:14:37.866 11:25:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:14:37.866 11:25:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:37.866 11:25:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:37.866 11:25:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:37.866 11:25:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:14:37.866 { 00:14:37.866 "auth": { 00:14:37.866 "dhgroup": "ffdhe6144", 00:14:37.866 "digest": "sha512", 00:14:37.866 "state": "completed" 00:14:37.866 }, 00:14:37.866 "cntlid": 133, 00:14:37.866 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3", 00:14:37.866 "listen_address": { 00:14:37.866 "adrfam": "IPv4", 00:14:37.866 "traddr": "10.0.0.3", 00:14:37.866 "trsvcid": "4420", 00:14:37.866 "trtype": "TCP" 00:14:37.866 }, 00:14:37.866 "peer_address": { 00:14:37.866 "adrfam": "IPv4", 00:14:37.866 "traddr": "10.0.0.1", 00:14:37.866 "trsvcid": "59274", 00:14:37.866 "trtype": "TCP" 00:14:37.866 }, 00:14:37.866 "qid": 0, 00:14:37.866 "state": "enabled", 00:14:37.866 "thread": "nvmf_tgt_poll_group_000" 00:14:37.866 } 00:14:37.866 ]' 00:14:37.866 11:25:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:14:38.124 11:25:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha512 == \s\h\a\5\1\2 ]] 00:14:38.124 11:25:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:14:38.124 11:25:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe6144 == \f\f\d\h\e\6\1\4\4 ]] 00:14:38.124 11:25:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:14:38.124 11:25:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:14:38.124 11:25:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:14:38.124 11:25:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:14:38.382 11:25:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:02:OGEwMDZmYzk3YTg5OWI0ZmJlYjViNmI2YmQzN2ViYjZiODhiMTM4MjEzY2ZlYmUzuaS9rg==: --dhchap-ctrl-secret DHHC-1:01:MTcxNjJmZTg3YTMxYmYyZDA0YmFhY2Q0M2Y3OGQwNzhGAzMl: 00:14:38.382 11:25:19 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --hostid 3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -l 0 --dhchap-secret DHHC-1:02:OGEwMDZmYzk3YTg5OWI0ZmJlYjViNmI2YmQzN2ViYjZiODhiMTM4MjEzY2ZlYmUzuaS9rg==: --dhchap-ctrl-secret DHHC-1:01:MTcxNjJmZTg3YTMxYmYyZDA0YmFhY2Q0M2Y3OGQwNzhGAzMl: 00:14:38.947 11:25:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:14:38.947 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:14:38.947 11:25:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:14:38.947 11:25:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:38.947 11:25:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:38.947 11:25:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:38.947 11:25:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:14:38.947 11:25:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe6144 00:14:38.947 11:25:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe6144 00:14:39.512 11:25:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha512 ffdhe6144 3 00:14:39.512 11:25:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:14:39.512 11:25:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha512 00:14:39.512 11:25:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe6144 00:14:39.512 11:25:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key3 00:14:39.512 11:25:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:14:39.512 11:25:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --dhchap-key key3 00:14:39.512 11:25:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:39.512 11:25:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:39.512 11:25:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:39.512 11:25:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key3 00:14:39.512 11:25:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:14:39.512 11:25:20 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:14:40.078 00:14:40.078 11:25:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:14:40.078 11:25:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:14:40.078 11:25:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:14:40.336 11:25:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:14:40.336 11:25:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:14:40.336 11:25:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:40.336 11:25:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:40.336 11:25:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:40.336 11:25:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:14:40.336 { 00:14:40.336 "auth": { 00:14:40.336 "dhgroup": "ffdhe6144", 00:14:40.336 "digest": "sha512", 00:14:40.336 "state": "completed" 00:14:40.336 }, 00:14:40.336 "cntlid": 135, 00:14:40.336 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3", 00:14:40.336 "listen_address": { 00:14:40.336 "adrfam": "IPv4", 00:14:40.336 "traddr": "10.0.0.3", 00:14:40.336 "trsvcid": "4420", 00:14:40.336 "trtype": "TCP" 00:14:40.336 }, 00:14:40.336 "peer_address": { 00:14:40.336 "adrfam": "IPv4", 00:14:40.336 "traddr": "10.0.0.1", 00:14:40.336 "trsvcid": "45852", 00:14:40.336 "trtype": "TCP" 00:14:40.336 }, 00:14:40.336 "qid": 0, 00:14:40.336 "state": "enabled", 00:14:40.336 "thread": "nvmf_tgt_poll_group_000" 00:14:40.336 } 00:14:40.336 ]' 00:14:40.336 11:25:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:14:40.336 11:25:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha512 == \s\h\a\5\1\2 ]] 00:14:40.336 11:25:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:14:40.336 11:25:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe6144 == \f\f\d\h\e\6\1\4\4 ]] 00:14:40.336 11:25:21 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:14:40.336 11:25:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:14:40.336 11:25:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:14:40.336 11:25:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:14:40.901 11:25:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:03:N2U1YWE0ZGQ4YmRkNTZjYWQ0MTY0MWM2OTQzMDJkZGEyZDRjYjMxYmFhOTU4YjVjMWVhMGJkYzhlMmY3NzBkZSCeOpc=: 00:14:40.902 11:25:22 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --hostid 3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -l 0 --dhchap-secret DHHC-1:03:N2U1YWE0ZGQ4YmRkNTZjYWQ0MTY0MWM2OTQzMDJkZGEyZDRjYjMxYmFhOTU4YjVjMWVhMGJkYzhlMmY3NzBkZSCeOpc=: 00:14:41.467 11:25:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:14:41.467 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:14:41.467 11:25:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:14:41.467 11:25:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:41.467 11:25:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:41.467 11:25:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:41.467 11:25:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@119 -- # for dhgroup in "${dhgroups[@]}" 00:14:41.467 11:25:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:14:41.467 11:25:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe8192 00:14:41.467 11:25:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe8192 00:14:41.725 11:25:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha512 ffdhe8192 0 00:14:41.725 11:25:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:14:41.725 11:25:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha512 00:14:41.725 11:25:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe8192 00:14:41.725 11:25:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key0 00:14:41.725 11:25:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:14:41.725 11:25:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:14:41.725 11:25:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:41.725 11:25:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:41.725 11:25:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:41.725 11:25:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:14:41.725 11:25:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:14:41.725 11:25:23 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:14:42.657 00:14:42.657 11:25:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:14:42.657 11:25:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:14:42.657 11:25:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:14:42.915 11:25:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:14:42.915 11:25:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:14:42.915 11:25:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:42.915 11:25:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:42.915 11:25:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:42.915 11:25:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:14:42.915 { 00:14:42.915 "auth": { 00:14:42.915 "dhgroup": "ffdhe8192", 00:14:42.915 "digest": "sha512", 00:14:42.915 "state": "completed" 00:14:42.915 }, 00:14:42.915 "cntlid": 137, 00:14:42.915 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3", 00:14:42.915 "listen_address": { 00:14:42.915 "adrfam": "IPv4", 00:14:42.915 "traddr": "10.0.0.3", 00:14:42.915 "trsvcid": "4420", 00:14:42.915 "trtype": "TCP" 00:14:42.915 }, 00:14:42.915 "peer_address": { 00:14:42.915 "adrfam": "IPv4", 00:14:42.915 "traddr": "10.0.0.1", 00:14:42.915 "trsvcid": "45880", 00:14:42.915 "trtype": "TCP" 00:14:42.915 }, 00:14:42.915 "qid": 0, 00:14:42.915 "state": "enabled", 00:14:42.915 "thread": "nvmf_tgt_poll_group_000" 00:14:42.915 } 00:14:42.915 ]' 00:14:42.915 11:25:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:14:42.915 11:25:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha512 == \s\h\a\5\1\2 ]] 00:14:42.915 11:25:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:14:42.915 11:25:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe8192 == \f\f\d\h\e\8\1\9\2 ]] 00:14:42.915 11:25:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:14:42.915 11:25:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:14:42.915 11:25:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:14:42.915 11:25:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:14:43.485 11:25:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:00:YjQ0ZWQzNjNjMTQzYmZkMDJkM2FmYzIyMTEyMmY0MGExMDAwNWQ5ZWY2NGE2NjBjPhDLOQ==: --dhchap-ctrl-secret DHHC-1:03:NDMwZGJjZWY5ZWEzMDMxODE1MjFlOWMyMDkyYTNlYzA0Yjk3ZGM2MDJlMDQ4OTFhNWUwMjIyM2E4ZGVjMWU5Y1IEScw=: 00:14:43.485 11:25:24 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --hostid 3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -l 0 --dhchap-secret DHHC-1:00:YjQ0ZWQzNjNjMTQzYmZkMDJkM2FmYzIyMTEyMmY0MGExMDAwNWQ5ZWY2NGE2NjBjPhDLOQ==: --dhchap-ctrl-secret DHHC-1:03:NDMwZGJjZWY5ZWEzMDMxODE1MjFlOWMyMDkyYTNlYzA0Yjk3ZGM2MDJlMDQ4OTFhNWUwMjIyM2E4ZGVjMWU5Y1IEScw=: 00:14:44.051 11:25:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:14:44.051 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:14:44.051 11:25:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:14:44.051 11:25:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:44.051 11:25:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:44.051 11:25:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:44.051 11:25:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:14:44.051 11:25:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe8192 00:14:44.051 11:25:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe8192 00:14:44.310 11:25:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha512 ffdhe8192 1 00:14:44.310 11:25:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:14:44.310 11:25:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha512 00:14:44.310 11:25:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe8192 00:14:44.310 11:25:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key1 00:14:44.310 11:25:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:14:44.310 11:25:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:14:44.310 11:25:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:44.310 11:25:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:44.310 11:25:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:44.310 11:25:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:14:44.310 11:25:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:14:44.310 11:25:25 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:14:44.877 00:14:44.877 11:25:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:14:44.877 11:25:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:14:44.877 11:25:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:14:45.134 11:25:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:14:45.134 11:25:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:14:45.134 11:25:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:45.134 11:25:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:45.134 11:25:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:45.134 11:25:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:14:45.134 { 00:14:45.134 "auth": { 00:14:45.134 "dhgroup": "ffdhe8192", 00:14:45.134 "digest": "sha512", 00:14:45.134 "state": "completed" 00:14:45.134 }, 00:14:45.134 "cntlid": 139, 00:14:45.134 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3", 00:14:45.134 "listen_address": { 00:14:45.134 "adrfam": "IPv4", 00:14:45.134 "traddr": "10.0.0.3", 00:14:45.134 "trsvcid": "4420", 00:14:45.134 "trtype": "TCP" 00:14:45.134 }, 00:14:45.134 "peer_address": { 00:14:45.134 "adrfam": "IPv4", 00:14:45.134 "traddr": "10.0.0.1", 00:14:45.134 "trsvcid": "45902", 00:14:45.134 "trtype": "TCP" 00:14:45.134 }, 00:14:45.134 "qid": 0, 00:14:45.134 "state": "enabled", 00:14:45.134 "thread": "nvmf_tgt_poll_group_000" 00:14:45.134 } 00:14:45.134 ]' 00:14:45.134 11:25:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:14:45.392 11:25:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha512 == \s\h\a\5\1\2 ]] 00:14:45.392 11:25:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:14:45.392 11:25:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe8192 == \f\f\d\h\e\8\1\9\2 ]] 00:14:45.392 11:25:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:14:45.392 11:25:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:14:45.392 11:25:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:14:45.392 11:25:26 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:14:45.650 11:25:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:01:N2VkMTc0ODgwNWQxZTM0NTk5OTYwMDk1NmQ5ZGE3YzEKeI3L: --dhchap-ctrl-secret DHHC-1:02:MzI4NjQxYjU2NThlMTY5N2Y3MDgwYmM0MDIxZDY2MmVkOGQyNDA0N2MzNWJlZDNicraO3Q==: 00:14:45.650 11:25:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --hostid 3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -l 0 --dhchap-secret DHHC-1:01:N2VkMTc0ODgwNWQxZTM0NTk5OTYwMDk1NmQ5ZGE3YzEKeI3L: --dhchap-ctrl-secret DHHC-1:02:MzI4NjQxYjU2NThlMTY5N2Y3MDgwYmM0MDIxZDY2MmVkOGQyNDA0N2MzNWJlZDNicraO3Q==: 00:14:46.600 11:25:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:14:46.600 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:14:46.600 11:25:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:14:46.600 11:25:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:46.601 11:25:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:46.601 11:25:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:46.601 11:25:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:14:46.601 11:25:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe8192 00:14:46.601 11:25:27 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe8192 00:14:46.601 11:25:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha512 ffdhe8192 2 00:14:46.601 11:25:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:14:46.601 11:25:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha512 00:14:46.601 11:25:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe8192 00:14:46.601 11:25:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key2 00:14:46.601 11:25:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:14:46.601 11:25:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:14:46.601 11:25:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:46.601 11:25:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:46.601 11:25:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:46.601 11:25:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:14:46.601 11:25:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:14:46.601 11:25:28 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key ckey2 00:14:47.535 00:14:47.535 11:25:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:14:47.535 11:25:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:14:47.535 11:25:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:14:47.793 11:25:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:14:47.793 11:25:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:14:47.793 11:25:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:47.793 11:25:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:47.793 11:25:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:47.793 11:25:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:14:47.793 { 00:14:47.793 "auth": { 00:14:47.793 "dhgroup": "ffdhe8192", 00:14:47.793 "digest": "sha512", 00:14:47.793 "state": "completed" 00:14:47.793 }, 00:14:47.793 "cntlid": 141, 00:14:47.793 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3", 00:14:47.793 "listen_address": { 00:14:47.793 "adrfam": "IPv4", 00:14:47.793 "traddr": "10.0.0.3", 00:14:47.793 "trsvcid": "4420", 00:14:47.793 "trtype": "TCP" 00:14:47.793 }, 00:14:47.793 "peer_address": { 00:14:47.793 "adrfam": "IPv4", 00:14:47.793 "traddr": "10.0.0.1", 00:14:47.793 "trsvcid": "45932", 00:14:47.793 "trtype": "TCP" 00:14:47.793 }, 00:14:47.793 "qid": 0, 00:14:47.793 "state": "enabled", 00:14:47.793 "thread": "nvmf_tgt_poll_group_000" 00:14:47.793 } 00:14:47.793 ]' 00:14:47.793 11:25:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:14:47.793 11:25:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha512 == \s\h\a\5\1\2 ]] 00:14:47.793 11:25:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:14:47.793 11:25:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe8192 == \f\f\d\h\e\8\1\9\2 ]] 00:14:47.793 11:25:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:14:48.050 11:25:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:14:48.050 11:25:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:14:48.050 11:25:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:14:48.308 11:25:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:02:OGEwMDZmYzk3YTg5OWI0ZmJlYjViNmI2YmQzN2ViYjZiODhiMTM4MjEzY2ZlYmUzuaS9rg==: --dhchap-ctrl-secret DHHC-1:01:MTcxNjJmZTg3YTMxYmYyZDA0YmFhY2Q0M2Y3OGQwNzhGAzMl: 00:14:48.308 11:25:29 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --hostid 3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -l 0 --dhchap-secret DHHC-1:02:OGEwMDZmYzk3YTg5OWI0ZmJlYjViNmI2YmQzN2ViYjZiODhiMTM4MjEzY2ZlYmUzuaS9rg==: --dhchap-ctrl-secret DHHC-1:01:MTcxNjJmZTg3YTMxYmYyZDA0YmFhY2Q0M2Y3OGQwNzhGAzMl: 00:14:48.873 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:14:48.873 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:14:48.873 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:14:48.873 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:48.873 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:48.873 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:48.873 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@120 -- # for keyid in "${!keys[@]}" 00:14:48.873 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@121 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe8192 00:14:48.873 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe8192 00:14:49.130 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@123 -- # connect_authenticate sha512 ffdhe8192 3 00:14:49.130 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:14:49.130 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha512 00:14:49.130 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe8192 00:14:49.130 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key3 00:14:49.130 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:14:49.130 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --dhchap-key key3 00:14:49.130 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:49.130 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:49.130 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:49.130 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key3 00:14:49.131 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:14:49.131 11:25:30 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:14:50.065 00:14:50.065 11:25:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:14:50.065 11:25:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:14:50.065 11:25:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:14:50.323 11:25:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:14:50.323 11:25:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:14:50.323 11:25:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:50.323 11:25:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:50.323 11:25:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:50.323 11:25:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:14:50.323 { 00:14:50.323 "auth": { 00:14:50.323 "dhgroup": "ffdhe8192", 00:14:50.323 "digest": "sha512", 00:14:50.323 "state": "completed" 00:14:50.323 }, 00:14:50.323 "cntlid": 143, 00:14:50.323 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3", 00:14:50.323 "listen_address": { 00:14:50.323 "adrfam": "IPv4", 00:14:50.323 "traddr": "10.0.0.3", 00:14:50.323 "trsvcid": "4420", 00:14:50.323 "trtype": "TCP" 00:14:50.323 }, 00:14:50.323 "peer_address": { 00:14:50.323 "adrfam": "IPv4", 00:14:50.323 "traddr": "10.0.0.1", 00:14:50.323 "trsvcid": "40378", 00:14:50.323 "trtype": "TCP" 00:14:50.323 }, 00:14:50.323 "qid": 0, 00:14:50.323 "state": "enabled", 00:14:50.323 "thread": "nvmf_tgt_poll_group_000" 00:14:50.323 } 00:14:50.323 ]' 00:14:50.323 11:25:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:14:50.323 11:25:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha512 == \s\h\a\5\1\2 ]] 00:14:50.323 11:25:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:14:50.323 11:25:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe8192 == \f\f\d\h\e\8\1\9\2 ]] 00:14:50.323 11:25:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:14:50.323 11:25:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:14:50.323 11:25:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:14:50.323 11:25:31 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:14:50.890 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:03:N2U1YWE0ZGQ4YmRkNTZjYWQ0MTY0MWM2OTQzMDJkZGEyZDRjYjMxYmFhOTU4YjVjMWVhMGJkYzhlMmY3NzBkZSCeOpc=: 00:14:50.890 11:25:32 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --hostid 3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -l 0 --dhchap-secret DHHC-1:03:N2U1YWE0ZGQ4YmRkNTZjYWQ0MTY0MWM2OTQzMDJkZGEyZDRjYjMxYmFhOTU4YjVjMWVhMGJkYzhlMmY3NzBkZSCeOpc=: 00:14:51.457 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:14:51.457 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:14:51.457 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:14:51.457 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:51.457 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:51.457 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:51.457 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@129 -- # IFS=, 00:14:51.457 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@130 -- # printf %s sha256,sha384,sha512 00:14:51.457 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@129 -- # IFS=, 00:14:51.457 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@130 -- # printf %s null,ffdhe2048,ffdhe3072,ffdhe4096,ffdhe6144,ffdhe8192 00:14:51.457 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@129 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha256,sha384,sha512 --dhchap-dhgroups null,ffdhe2048,ffdhe3072,ffdhe4096,ffdhe6144,ffdhe8192 00:14:51.457 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha256,sha384,sha512 --dhchap-dhgroups null,ffdhe2048,ffdhe3072,ffdhe4096,ffdhe6144,ffdhe8192 00:14:51.714 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@141 -- # connect_authenticate sha512 ffdhe8192 0 00:14:51.714 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:14:51.714 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha512 00:14:51.714 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe8192 00:14:51.714 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key0 00:14:51.714 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:14:51.714 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:14:51.714 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:51.714 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:51.714 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:51.714 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:14:51.715 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:14:51.715 11:25:33 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key ckey0 00:14:52.676 00:14:52.676 11:25:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:14:52.676 11:25:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:14:52.676 11:25:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:14:52.677 11:25:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:14:52.677 11:25:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:14:52.677 11:25:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:52.677 11:25:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:52.677 11:25:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:52.677 11:25:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:14:52.677 { 00:14:52.677 "auth": { 00:14:52.677 "dhgroup": "ffdhe8192", 00:14:52.677 "digest": "sha512", 00:14:52.677 "state": "completed" 00:14:52.677 }, 00:14:52.677 "cntlid": 145, 00:14:52.677 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3", 00:14:52.677 "listen_address": { 00:14:52.677 "adrfam": "IPv4", 00:14:52.677 "traddr": "10.0.0.3", 00:14:52.677 "trsvcid": "4420", 00:14:52.677 "trtype": "TCP" 00:14:52.677 }, 00:14:52.677 "peer_address": { 00:14:52.677 "adrfam": "IPv4", 00:14:52.677 "traddr": "10.0.0.1", 00:14:52.677 "trsvcid": "40406", 00:14:52.677 "trtype": "TCP" 00:14:52.677 }, 00:14:52.677 "qid": 0, 00:14:52.677 "state": "enabled", 00:14:52.677 "thread": "nvmf_tgt_poll_group_000" 00:14:52.677 } 00:14:52.677 ]' 00:14:52.677 11:25:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:14:52.938 11:25:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha512 == \s\h\a\5\1\2 ]] 00:14:52.938 11:25:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:14:52.938 11:25:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe8192 == \f\f\d\h\e\8\1\9\2 ]] 00:14:52.938 11:25:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:14:52.938 11:25:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:14:52.938 11:25:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:14:52.938 11:25:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:14:53.196 11:25:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:00:YjQ0ZWQzNjNjMTQzYmZkMDJkM2FmYzIyMTEyMmY0MGExMDAwNWQ5ZWY2NGE2NjBjPhDLOQ==: --dhchap-ctrl-secret DHHC-1:03:NDMwZGJjZWY5ZWEzMDMxODE1MjFlOWMyMDkyYTNlYzA0Yjk3ZGM2MDJlMDQ4OTFhNWUwMjIyM2E4ZGVjMWU5Y1IEScw=: 00:14:53.196 11:25:34 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --hostid 3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -l 0 --dhchap-secret DHHC-1:00:YjQ0ZWQzNjNjMTQzYmZkMDJkM2FmYzIyMTEyMmY0MGExMDAwNWQ5ZWY2NGE2NjBjPhDLOQ==: --dhchap-ctrl-secret DHHC-1:03:NDMwZGJjZWY5ZWEzMDMxODE1MjFlOWMyMDkyYTNlYzA0Yjk3ZGM2MDJlMDQ4OTFhNWUwMjIyM2E4ZGVjMWU5Y1IEScw=: 00:14:54.131 11:25:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:14:54.131 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:14:54.131 11:25:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:14:54.131 11:25:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:54.131 11:25:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:54.131 11:25:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:54.131 11:25:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@144 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --dhchap-key key1 00:14:54.131 11:25:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:54.131 11:25:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:54.131 11:25:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:54.131 11:25:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@145 -- # NOT bdev_connect -b nvme0 --dhchap-key key2 00:14:54.131 11:25:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@650 -- # local es=0 00:14:54.131 11:25:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@652 -- # valid_exec_arg bdev_connect -b nvme0 --dhchap-key key2 00:14:54.131 11:25:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@638 -- # local arg=bdev_connect 00:14:54.131 11:25:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:14:54.131 11:25:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@642 -- # type -t bdev_connect 00:14:54.131 11:25:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:14:54.131 11:25:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@653 -- # bdev_connect -b nvme0 --dhchap-key key2 00:14:54.131 11:25:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 00:14:54.131 11:25:35 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 00:14:54.704 2024/10/07 11:25:36 error on JSON-RPC call, method: bdev_nvme_attach_controller, params: map[adrfam:ipv4 allow_unrecognized_csi:%!s(bool=false) ddgst:%!s(bool=false) dhchap_key:key2 hdgst:%!s(bool=false) hostnqn:nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 name:nvme0 prchk_guard:%!s(bool=false) prchk_reftag:%!s(bool=false) subnqn:nqn.2024-03.io.spdk:cnode0 traddr:10.0.0.3 trsvcid:4420 trtype:tcp], err: error received for bdev_nvme_attach_controller method, err: Code=-5 Msg=Input/output error 00:14:54.704 request: 00:14:54.704 { 00:14:54.704 "method": "bdev_nvme_attach_controller", 00:14:54.705 "params": { 00:14:54.705 "name": "nvme0", 00:14:54.705 "trtype": "tcp", 00:14:54.705 "traddr": "10.0.0.3", 00:14:54.705 "adrfam": "ipv4", 00:14:54.705 "trsvcid": "4420", 00:14:54.705 "subnqn": "nqn.2024-03.io.spdk:cnode0", 00:14:54.705 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3", 00:14:54.705 "prchk_reftag": false, 00:14:54.705 "prchk_guard": false, 00:14:54.705 "hdgst": false, 00:14:54.705 "ddgst": false, 00:14:54.705 "dhchap_key": "key2", 00:14:54.705 "allow_unrecognized_csi": false 00:14:54.705 } 00:14:54.705 } 00:14:54.705 Got JSON-RPC error response 00:14:54.705 GoRPCClient: error on JSON-RPC call 00:14:54.705 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@653 -- # es=1 00:14:54.705 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:14:54.705 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:14:54.705 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:14:54.705 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@146 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:14:54.705 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:54.705 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:54.705 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:54.705 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@149 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:14:54.705 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:54.705 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:54.705 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:54.705 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@150 -- # NOT bdev_connect -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey2 00:14:54.705 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@650 -- # local es=0 00:14:54.705 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@652 -- # valid_exec_arg bdev_connect -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey2 00:14:54.705 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@638 -- # local arg=bdev_connect 00:14:54.705 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:14:54.705 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@642 -- # type -t bdev_connect 00:14:54.705 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:14:54.705 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@653 -- # bdev_connect -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey2 00:14:54.705 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey2 00:14:54.705 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey2 00:14:55.296 2024/10/07 11:25:36 error on JSON-RPC call, method: bdev_nvme_attach_controller, params: map[adrfam:ipv4 allow_unrecognized_csi:%!s(bool=false) ddgst:%!s(bool=false) dhchap_ctrlr_key:ckey2 dhchap_key:key1 hdgst:%!s(bool=false) hostnqn:nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 name:nvme0 prchk_guard:%!s(bool=false) prchk_reftag:%!s(bool=false) subnqn:nqn.2024-03.io.spdk:cnode0 traddr:10.0.0.3 trsvcid:4420 trtype:tcp], err: error received for bdev_nvme_attach_controller method, err: Code=-5 Msg=Input/output error 00:14:55.296 request: 00:14:55.296 { 00:14:55.296 "method": "bdev_nvme_attach_controller", 00:14:55.296 "params": { 00:14:55.296 "name": "nvme0", 00:14:55.296 "trtype": "tcp", 00:14:55.296 "traddr": "10.0.0.3", 00:14:55.296 "adrfam": "ipv4", 00:14:55.296 "trsvcid": "4420", 00:14:55.296 "subnqn": "nqn.2024-03.io.spdk:cnode0", 00:14:55.296 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3", 00:14:55.296 "prchk_reftag": false, 00:14:55.296 "prchk_guard": false, 00:14:55.296 "hdgst": false, 00:14:55.296 "ddgst": false, 00:14:55.296 "dhchap_key": "key1", 00:14:55.296 "dhchap_ctrlr_key": "ckey2", 00:14:55.296 "allow_unrecognized_csi": false 00:14:55.296 } 00:14:55.296 } 00:14:55.296 Got JSON-RPC error response 00:14:55.296 GoRPCClient: error on JSON-RPC call 00:14:55.296 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@653 -- # es=1 00:14:55.296 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:14:55.296 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:14:55.296 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:14:55.296 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@151 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:14:55.296 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:55.296 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:55.296 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:55.296 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@154 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --dhchap-key key1 00:14:55.296 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:55.296 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:55.296 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:55.296 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@155 -- # NOT bdev_connect -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:14:55.296 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@650 -- # local es=0 00:14:55.296 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@652 -- # valid_exec_arg bdev_connect -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:14:55.296 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@638 -- # local arg=bdev_connect 00:14:55.296 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:14:55.296 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@642 -- # type -t bdev_connect 00:14:55.296 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:14:55.296 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@653 -- # bdev_connect -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:14:55.296 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:14:55.296 11:25:36 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 --dhchap-ctrlr-key ckey1 00:14:56.233 2024/10/07 11:25:37 error on JSON-RPC call, method: bdev_nvme_attach_controller, params: map[adrfam:ipv4 allow_unrecognized_csi:%!s(bool=false) ddgst:%!s(bool=false) dhchap_ctrlr_key:ckey1 dhchap_key:key1 hdgst:%!s(bool=false) hostnqn:nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 name:nvme0 prchk_guard:%!s(bool=false) prchk_reftag:%!s(bool=false) subnqn:nqn.2024-03.io.spdk:cnode0 traddr:10.0.0.3 trsvcid:4420 trtype:tcp], err: error received for bdev_nvme_attach_controller method, err: Code=-5 Msg=Input/output error 00:14:56.233 request: 00:14:56.233 { 00:14:56.233 "method": "bdev_nvme_attach_controller", 00:14:56.233 "params": { 00:14:56.233 "name": "nvme0", 00:14:56.233 "trtype": "tcp", 00:14:56.233 "traddr": "10.0.0.3", 00:14:56.233 "adrfam": "ipv4", 00:14:56.233 "trsvcid": "4420", 00:14:56.233 "subnqn": "nqn.2024-03.io.spdk:cnode0", 00:14:56.233 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3", 00:14:56.233 "prchk_reftag": false, 00:14:56.233 "prchk_guard": false, 00:14:56.233 "hdgst": false, 00:14:56.233 "ddgst": false, 00:14:56.233 "dhchap_key": "key1", 00:14:56.233 "dhchap_ctrlr_key": "ckey1", 00:14:56.233 "allow_unrecognized_csi": false 00:14:56.233 } 00:14:56.233 } 00:14:56.233 Got JSON-RPC error response 00:14:56.233 GoRPCClient: error on JSON-RPC call 00:14:56.233 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@653 -- # es=1 00:14:56.233 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:14:56.233 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:14:56.233 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:14:56.233 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@156 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:14:56.233 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:56.233 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:56.233 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:56.233 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@159 -- # killprocess 76912 00:14:56.233 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@950 -- # '[' -z 76912 ']' 00:14:56.233 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@954 -- # kill -0 76912 00:14:56.233 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@955 -- # uname 00:14:56.233 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:14:56.233 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 76912 00:14:56.233 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:14:56.233 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:14:56.233 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@968 -- # echo 'killing process with pid 76912' 00:14:56.233 killing process with pid 76912 00:14:56.233 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@969 -- # kill 76912 00:14:56.233 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@974 -- # wait 76912 00:14:56.491 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@160 -- # nvmfappstart --wait-for-rpc -L nvmf_auth 00:14:56.491 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:14:56.491 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@724 -- # xtrace_disable 00:14:56.491 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:56.491 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@507 -- # nvmfpid=81949 00:14:56.491 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@506 -- # ip netns exec nvmf_tgt_ns_spdk /home/vagrant/spdk_repo/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --wait-for-rpc -L nvmf_auth 00:14:56.491 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@508 -- # waitforlisten 81949 00:14:56.491 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@831 -- # '[' -z 81949 ']' 00:14:56.491 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:56.491 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@836 -- # local max_retries=100 00:14:56.491 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:56.491 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@840 -- # xtrace_disable 00:14:56.491 11:25:37 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:57.424 11:25:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:14:57.424 11:25:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@864 -- # return 0 00:14:57.424 11:25:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:14:57.424 11:25:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@730 -- # xtrace_disable 00:14:57.424 11:25:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:57.704 11:25:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:57.704 11:25:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@161 -- # trap 'dumplogs; cleanup' SIGINT SIGTERM EXIT 00:14:57.704 11:25:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@163 -- # waitforlisten 81949 00:14:57.704 11:25:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@831 -- # '[' -z 81949 ']' 00:14:57.704 11:25:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:57.704 11:25:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@836 -- # local max_retries=100 00:14:57.704 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:57.704 11:25:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:57.704 11:25:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@840 -- # xtrace_disable 00:14:57.704 11:25:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:58.003 11:25:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:14:58.003 11:25:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@864 -- # return 0 00:14:58.003 11:25:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@164 -- # rpc_cmd 00:14:58.003 11:25:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:58.003 11:25:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:58.003 null0 00:14:58.003 11:25:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:58.003 11:25:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@174 -- # for i in "${!keys[@]}" 00:14:58.003 11:25:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@175 -- # rpc_cmd keyring_file_add_key key0 /tmp/spdk.key-null.93D 00:14:58.003 11:25:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:58.003 11:25:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:58.003 11:25:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:58.003 11:25:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@176 -- # [[ -n /tmp/spdk.key-sha512.CCs ]] 00:14:58.003 11:25:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@176 -- # rpc_cmd keyring_file_add_key ckey0 /tmp/spdk.key-sha512.CCs 00:14:58.003 11:25:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:58.003 11:25:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:58.003 11:25:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:58.003 11:25:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@174 -- # for i in "${!keys[@]}" 00:14:58.003 11:25:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@175 -- # rpc_cmd keyring_file_add_key key1 /tmp/spdk.key-sha256.t6V 00:14:58.003 11:25:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:58.003 11:25:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:58.003 11:25:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:58.003 11:25:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@176 -- # [[ -n /tmp/spdk.key-sha384.PMi ]] 00:14:58.003 11:25:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@176 -- # rpc_cmd keyring_file_add_key ckey1 /tmp/spdk.key-sha384.PMi 00:14:58.003 11:25:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:58.003 11:25:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:58.003 11:25:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:58.003 11:25:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@174 -- # for i in "${!keys[@]}" 00:14:58.003 11:25:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@175 -- # rpc_cmd keyring_file_add_key key2 /tmp/spdk.key-sha384.F4n 00:14:58.003 11:25:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:58.003 11:25:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:58.003 11:25:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:58.003 11:25:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@176 -- # [[ -n /tmp/spdk.key-sha256.PKN ]] 00:14:58.003 11:25:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@176 -- # rpc_cmd keyring_file_add_key ckey2 /tmp/spdk.key-sha256.PKN 00:14:58.003 11:25:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:58.003 11:25:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:58.003 11:25:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:58.003 11:25:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@174 -- # for i in "${!keys[@]}" 00:14:58.003 11:25:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@175 -- # rpc_cmd keyring_file_add_key key3 /tmp/spdk.key-sha512.sgX 00:14:58.003 11:25:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:58.003 11:25:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:58.003 11:25:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:58.003 11:25:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@176 -- # [[ -n '' ]] 00:14:58.003 11:25:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@179 -- # connect_authenticate sha512 ffdhe8192 3 00:14:58.003 11:25:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@65 -- # local digest dhgroup key ckey qpairs 00:14:58.003 11:25:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # digest=sha512 00:14:58.003 11:25:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # dhgroup=ffdhe8192 00:14:58.003 11:25:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@67 -- # key=key3 00:14:58.003 11:25:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@68 -- # ckey=(${ckeys[$3]:+--dhchap-ctrlr-key "ckey$3"}) 00:14:58.003 11:25:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@70 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --dhchap-key key3 00:14:58.003 11:25:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:58.003 11:25:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:58.262 11:25:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:58.262 11:25:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@71 -- # bdev_connect -b nvme0 --dhchap-key key3 00:14:58.262 11:25:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:14:58.262 11:25:39 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:14:59.197 nvme0n1 00:14:59.197 11:25:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # hostrpc bdev_nvme_get_controllers 00:14:59.197 11:25:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:14:59.197 11:25:40 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # jq -r '.[].name' 00:14:59.455 11:25:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:14:59.455 11:25:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2024-03.io.spdk:cnode0 00:14:59.455 11:25:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:59.455 11:25:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:14:59.713 11:25:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:59.713 11:25:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@74 -- # qpairs='[ 00:14:59.713 { 00:14:59.713 "auth": { 00:14:59.713 "dhgroup": "ffdhe8192", 00:14:59.713 "digest": "sha512", 00:14:59.713 "state": "completed" 00:14:59.713 }, 00:14:59.713 "cntlid": 1, 00:14:59.713 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3", 00:14:59.713 "listen_address": { 00:14:59.713 "adrfam": "IPv4", 00:14:59.713 "traddr": "10.0.0.3", 00:14:59.713 "trsvcid": "4420", 00:14:59.713 "trtype": "TCP" 00:14:59.713 }, 00:14:59.713 "peer_address": { 00:14:59.713 "adrfam": "IPv4", 00:14:59.713 "traddr": "10.0.0.1", 00:14:59.714 "trsvcid": "40444", 00:14:59.714 "trtype": "TCP" 00:14:59.714 }, 00:14:59.714 "qid": 0, 00:14:59.714 "state": "enabled", 00:14:59.714 "thread": "nvmf_tgt_poll_group_000" 00:14:59.714 } 00:14:59.714 ]' 00:14:59.714 11:25:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # jq -r '.[0].auth.digest' 00:14:59.714 11:25:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@75 -- # [[ sha512 == \s\h\a\5\1\2 ]] 00:14:59.714 11:25:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # jq -r '.[0].auth.dhgroup' 00:14:59.714 11:25:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@76 -- # [[ ffdhe8192 == \f\f\d\h\e\8\1\9\2 ]] 00:14:59.714 11:25:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # jq -r '.[0].auth.state' 00:14:59.714 11:25:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@77 -- # [[ completed == \c\o\m\p\l\e\t\e\d ]] 00:14:59.714 11:25:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@78 -- # hostrpc bdev_nvme_detach_controller nvme0 00:14:59.714 11:25:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:14:59.971 11:25:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@80 -- # nvme_connect --dhchap-secret DHHC-1:03:N2U1YWE0ZGQ4YmRkNTZjYWQ0MTY0MWM2OTQzMDJkZGEyZDRjYjMxYmFhOTU4YjVjMWVhMGJkYzhlMmY3NzBkZSCeOpc=: 00:14:59.971 11:25:41 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --hostid 3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -l 0 --dhchap-secret DHHC-1:03:N2U1YWE0ZGQ4YmRkNTZjYWQ0MTY0MWM2OTQzMDJkZGEyZDRjYjMxYmFhOTU4YjVjMWVhMGJkYzhlMmY3NzBkZSCeOpc=: 00:15:00.905 11:25:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@82 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:15:00.905 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:15:00.905 11:25:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@83 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:15:00.905 11:25:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:00.905 11:25:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:15:00.905 11:25:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:00.905 11:25:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@182 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --dhchap-key key3 00:15:00.905 11:25:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:00.905 11:25:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:15:00.905 11:25:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:00.905 11:25:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@183 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha256 00:15:00.905 11:25:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha256 00:15:01.163 11:25:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@184 -- # NOT bdev_connect -b nvme0 --dhchap-key key3 00:15:01.163 11:25:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@650 -- # local es=0 00:15:01.163 11:25:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@652 -- # valid_exec_arg bdev_connect -b nvme0 --dhchap-key key3 00:15:01.163 11:25:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@638 -- # local arg=bdev_connect 00:15:01.163 11:25:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:01.163 11:25:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@642 -- # type -t bdev_connect 00:15:01.163 11:25:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:01.163 11:25:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@653 -- # bdev_connect -b nvme0 --dhchap-key key3 00:15:01.163 11:25:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:15:01.163 11:25:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:15:01.421 2024/10/07 11:25:42 error on JSON-RPC call, method: bdev_nvme_attach_controller, params: map[adrfam:ipv4 allow_unrecognized_csi:%!s(bool=false) ddgst:%!s(bool=false) dhchap_key:key3 hdgst:%!s(bool=false) hostnqn:nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 name:nvme0 prchk_guard:%!s(bool=false) prchk_reftag:%!s(bool=false) subnqn:nqn.2024-03.io.spdk:cnode0 traddr:10.0.0.3 trsvcid:4420 trtype:tcp], err: error received for bdev_nvme_attach_controller method, err: Code=-5 Msg=Input/output error 00:15:01.421 request: 00:15:01.421 { 00:15:01.421 "method": "bdev_nvme_attach_controller", 00:15:01.421 "params": { 00:15:01.421 "name": "nvme0", 00:15:01.421 "trtype": "tcp", 00:15:01.421 "traddr": "10.0.0.3", 00:15:01.421 "adrfam": "ipv4", 00:15:01.421 "trsvcid": "4420", 00:15:01.421 "subnqn": "nqn.2024-03.io.spdk:cnode0", 00:15:01.421 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3", 00:15:01.421 "prchk_reftag": false, 00:15:01.421 "prchk_guard": false, 00:15:01.421 "hdgst": false, 00:15:01.421 "ddgst": false, 00:15:01.421 "dhchap_key": "key3", 00:15:01.421 "allow_unrecognized_csi": false 00:15:01.421 } 00:15:01.421 } 00:15:01.421 Got JSON-RPC error response 00:15:01.421 GoRPCClient: error on JSON-RPC call 00:15:01.421 11:25:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@653 -- # es=1 00:15:01.421 11:25:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:15:01.421 11:25:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:15:01.422 11:25:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:15:01.422 11:25:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@187 -- # IFS=, 00:15:01.422 11:25:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@188 -- # printf %s sha256,sha384,sha512 00:15:01.422 11:25:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@187 -- # hostrpc bdev_nvme_set_options --dhchap-dhgroups ffdhe2048 --dhchap-digests sha256,sha384,sha512 00:15:01.422 11:25:42 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-dhgroups ffdhe2048 --dhchap-digests sha256,sha384,sha512 00:15:01.679 11:25:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@193 -- # NOT bdev_connect -b nvme0 --dhchap-key key3 00:15:01.679 11:25:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@650 -- # local es=0 00:15:01.679 11:25:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@652 -- # valid_exec_arg bdev_connect -b nvme0 --dhchap-key key3 00:15:01.679 11:25:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@638 -- # local arg=bdev_connect 00:15:01.679 11:25:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:01.679 11:25:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@642 -- # type -t bdev_connect 00:15:01.679 11:25:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:01.679 11:25:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@653 -- # bdev_connect -b nvme0 --dhchap-key key3 00:15:01.679 11:25:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:15:01.680 11:25:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key3 00:15:01.937 request: 00:15:01.937 { 00:15:01.937 "method": "bdev_nvme_attach_controller", 00:15:01.937 "params": { 00:15:01.937 "name": "nvme0", 00:15:01.937 "trtype": "tcp", 00:15:01.937 "traddr": "10.0.0.3", 00:15:01.937 "adrfam": "ipv4", 00:15:01.937 "trsvcid": "4420", 00:15:01.937 "subnqn": "nqn.2024-03.io.spdk:cnode0", 00:15:01.937 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3", 00:15:01.937 "prchk_reftag": false, 00:15:01.937 "prchk_guard": false, 00:15:01.937 "hdgst": false, 00:15:01.937 "ddgst": false, 00:15:01.937 "dhchap_key": "key3", 00:15:01.937 "allow_unrecognized_csi": false 00:15:01.937 } 00:15:01.937 } 00:15:01.937 Got JSON-RPC error response 00:15:01.937 GoRPCClient: error on JSON-RPC call 00:15:01.937 2024/10/07 11:25:43 error on JSON-RPC call, method: bdev_nvme_attach_controller, params: map[adrfam:ipv4 allow_unrecognized_csi:%!s(bool=false) ddgst:%!s(bool=false) dhchap_key:key3 hdgst:%!s(bool=false) hostnqn:nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 name:nvme0 prchk_guard:%!s(bool=false) prchk_reftag:%!s(bool=false) subnqn:nqn.2024-03.io.spdk:cnode0 traddr:10.0.0.3 trsvcid:4420 trtype:tcp], err: error received for bdev_nvme_attach_controller method, err: Code=-5 Msg=Input/output error 00:15:01.937 11:25:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@653 -- # es=1 00:15:01.937 11:25:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:15:01.937 11:25:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:15:01.937 11:25:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:15:01.937 11:25:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@197 -- # IFS=, 00:15:01.937 11:25:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@198 -- # printf %s sha256,sha384,sha512 00:15:01.937 11:25:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@197 -- # IFS=, 00:15:01.937 11:25:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@198 -- # printf %s null,ffdhe2048,ffdhe3072,ffdhe4096,ffdhe6144,ffdhe8192 00:15:01.937 11:25:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@197 -- # hostrpc bdev_nvme_set_options --dhchap-digests sha256,sha384,sha512 --dhchap-dhgroups null,ffdhe2048,ffdhe3072,ffdhe4096,ffdhe6144,ffdhe8192 00:15:01.937 11:25:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_options --dhchap-digests sha256,sha384,sha512 --dhchap-dhgroups null,ffdhe2048,ffdhe3072,ffdhe4096,ffdhe6144,ffdhe8192 00:15:02.504 11:25:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@208 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:15:02.504 11:25:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:02.504 11:25:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:15:02.504 11:25:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:02.504 11:25:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@209 -- # rpc_cmd nvmf_subsystem_add_host nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:15:02.504 11:25:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:02.504 11:25:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:15:02.504 11:25:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:02.504 11:25:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@210 -- # NOT bdev_connect -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key key1 00:15:02.505 11:25:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@650 -- # local es=0 00:15:02.505 11:25:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@652 -- # valid_exec_arg bdev_connect -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key key1 00:15:02.505 11:25:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@638 -- # local arg=bdev_connect 00:15:02.505 11:25:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:02.505 11:25:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@642 -- # type -t bdev_connect 00:15:02.505 11:25:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:02.505 11:25:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@653 -- # bdev_connect -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key key1 00:15:02.505 11:25:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key key1 00:15:02.505 11:25:43 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key key1 00:15:02.763 2024/10/07 11:25:44 error on JSON-RPC call, method: bdev_nvme_attach_controller, params: map[adrfam:ipv4 allow_unrecognized_csi:%!s(bool=false) ddgst:%!s(bool=false) dhchap_ctrlr_key:key1 dhchap_key:key0 hdgst:%!s(bool=false) hostnqn:nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 name:nvme0 prchk_guard:%!s(bool=false) prchk_reftag:%!s(bool=false) subnqn:nqn.2024-03.io.spdk:cnode0 traddr:10.0.0.3 trsvcid:4420 trtype:tcp], err: error received for bdev_nvme_attach_controller method, err: Code=-5 Msg=Input/output error 00:15:02.763 request: 00:15:02.763 { 00:15:02.763 "method": "bdev_nvme_attach_controller", 00:15:02.763 "params": { 00:15:02.763 "name": "nvme0", 00:15:02.763 "trtype": "tcp", 00:15:02.763 "traddr": "10.0.0.3", 00:15:02.763 "adrfam": "ipv4", 00:15:02.763 "trsvcid": "4420", 00:15:02.763 "subnqn": "nqn.2024-03.io.spdk:cnode0", 00:15:02.763 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3", 00:15:02.763 "prchk_reftag": false, 00:15:02.763 "prchk_guard": false, 00:15:02.763 "hdgst": false, 00:15:02.763 "ddgst": false, 00:15:02.763 "dhchap_key": "key0", 00:15:02.763 "dhchap_ctrlr_key": "key1", 00:15:02.763 "allow_unrecognized_csi": false 00:15:02.763 } 00:15:02.763 } 00:15:02.763 Got JSON-RPC error response 00:15:02.763 GoRPCClient: error on JSON-RPC call 00:15:02.763 11:25:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@653 -- # es=1 00:15:02.763 11:25:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:15:02.763 11:25:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:15:02.763 11:25:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:15:02.763 11:25:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@213 -- # bdev_connect -b nvme0 --dhchap-key key0 00:15:02.763 11:25:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 00:15:02.764 11:25:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 00:15:03.022 nvme0n1 00:15:03.280 11:25:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@214 -- # hostrpc bdev_nvme_get_controllers 00:15:03.280 11:25:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:15:03.280 11:25:44 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@214 -- # jq -r '.[].name' 00:15:03.538 11:25:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@214 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:15:03.538 11:25:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@215 -- # hostrpc bdev_nvme_detach_controller nvme0 00:15:03.538 11:25:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:15:03.796 11:25:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@218 -- # rpc_cmd nvmf_subsystem_set_keys nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --dhchap-key key1 00:15:03.796 11:25:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:03.796 11:25:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:15:03.796 11:25:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:03.796 11:25:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@219 -- # bdev_connect -b nvme0 --dhchap-key key1 00:15:03.796 11:25:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 00:15:03.796 11:25:45 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 00:15:04.730 nvme0n1 00:15:04.730 11:25:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@220 -- # hostrpc bdev_nvme_get_controllers 00:15:04.730 11:25:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:15:04.730 11:25:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@220 -- # jq -r '.[].name' 00:15:04.988 11:25:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@220 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:15:04.988 11:25:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@222 -- # rpc_cmd nvmf_subsystem_set_keys nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --dhchap-key key2 --dhchap-ctrlr-key key3 00:15:04.988 11:25:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:04.988 11:25:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:15:04.988 11:25:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:04.988 11:25:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@223 -- # hostrpc bdev_nvme_get_controllers 00:15:04.988 11:25:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:15:04.988 11:25:46 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@223 -- # jq -r '.[].name' 00:15:05.553 11:25:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@223 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:15:05.553 11:25:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@225 -- # nvme_connect --dhchap-secret DHHC-1:02:OGEwMDZmYzk3YTg5OWI0ZmJlYjViNmI2YmQzN2ViYjZiODhiMTM4MjEzY2ZlYmUzuaS9rg==: --dhchap-ctrl-secret DHHC-1:03:N2U1YWE0ZGQ4YmRkNTZjYWQ0MTY0MWM2OTQzMDJkZGEyZDRjYjMxYmFhOTU4YjVjMWVhMGJkYzhlMmY3NzBkZSCeOpc=: 00:15:05.553 11:25:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@36 -- # nvme connect -t tcp -a 10.0.0.3 -n nqn.2024-03.io.spdk:cnode0 -i 1 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --hostid 3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -l 0 --dhchap-secret DHHC-1:02:OGEwMDZmYzk3YTg5OWI0ZmJlYjViNmI2YmQzN2ViYjZiODhiMTM4MjEzY2ZlYmUzuaS9rg==: --dhchap-ctrl-secret DHHC-1:03:N2U1YWE0ZGQ4YmRkNTZjYWQ0MTY0MWM2OTQzMDJkZGEyZDRjYjMxYmFhOTU4YjVjMWVhMGJkYzhlMmY3NzBkZSCeOpc=: 00:15:06.119 11:25:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@226 -- # nvme_get_ctrlr 00:15:06.119 11:25:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@41 -- # local dev 00:15:06.119 11:25:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@43 -- # for dev in /sys/devices/virtual/nvme-fabrics/ctl/nvme* 00:15:06.119 11:25:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@44 -- # [[ nqn.2024-03.io.spdk:cnode0 == \n\q\n\.\2\0\2\4\-\0\3\.\i\o\.\s\p\d\k\:\c\n\o\d\e\0 ]] 00:15:06.119 11:25:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@44 -- # echo nvme0 00:15:06.119 11:25:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@44 -- # break 00:15:06.119 11:25:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@226 -- # nctrlr=nvme0 00:15:06.119 11:25:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@227 -- # hostrpc bdev_nvme_detach_controller nvme0 00:15:06.119 11:25:47 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:15:06.377 11:25:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@228 -- # NOT bdev_connect -b nvme0 --dhchap-key key1 00:15:06.377 11:25:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@650 -- # local es=0 00:15:06.377 11:25:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@652 -- # valid_exec_arg bdev_connect -b nvme0 --dhchap-key key1 00:15:06.377 11:25:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@638 -- # local arg=bdev_connect 00:15:06.377 11:25:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:06.377 11:25:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@642 -- # type -t bdev_connect 00:15:06.377 11:25:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:06.377 11:25:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@653 -- # bdev_connect -b nvme0 --dhchap-key key1 00:15:06.377 11:25:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 00:15:06.377 11:25:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key1 00:15:06.941 2024/10/07 11:25:48 error on JSON-RPC call, method: bdev_nvme_attach_controller, params: map[adrfam:ipv4 allow_unrecognized_csi:%!s(bool=false) ddgst:%!s(bool=false) dhchap_key:key1 hdgst:%!s(bool=false) hostnqn:nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 name:nvme0 prchk_guard:%!s(bool=false) prchk_reftag:%!s(bool=false) subnqn:nqn.2024-03.io.spdk:cnode0 traddr:10.0.0.3 trsvcid:4420 trtype:tcp], err: error received for bdev_nvme_attach_controller method, err: Code=-5 Msg=Input/output error 00:15:07.199 request: 00:15:07.199 { 00:15:07.199 "method": "bdev_nvme_attach_controller", 00:15:07.199 "params": { 00:15:07.199 "name": "nvme0", 00:15:07.199 "trtype": "tcp", 00:15:07.199 "traddr": "10.0.0.3", 00:15:07.199 "adrfam": "ipv4", 00:15:07.199 "trsvcid": "4420", 00:15:07.199 "subnqn": "nqn.2024-03.io.spdk:cnode0", 00:15:07.199 "hostnqn": "nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3", 00:15:07.199 "prchk_reftag": false, 00:15:07.199 "prchk_guard": false, 00:15:07.199 "hdgst": false, 00:15:07.199 "ddgst": false, 00:15:07.199 "dhchap_key": "key1", 00:15:07.199 "allow_unrecognized_csi": false 00:15:07.199 } 00:15:07.199 } 00:15:07.199 Got JSON-RPC error response 00:15:07.199 GoRPCClient: error on JSON-RPC call 00:15:07.199 11:25:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@653 -- # es=1 00:15:07.199 11:25:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:15:07.199 11:25:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:15:07.199 11:25:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:15:07.199 11:25:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@229 -- # bdev_connect -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key key3 00:15:07.199 11:25:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key key3 00:15:07.199 11:25:48 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key2 --dhchap-ctrlr-key key3 00:15:08.132 nvme0n1 00:15:08.132 11:25:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@230 -- # hostrpc bdev_nvme_get_controllers 00:15:08.132 11:25:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:15:08.132 11:25:49 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@230 -- # jq -r '.[].name' 00:15:08.389 11:25:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@230 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:15:08.389 11:25:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@231 -- # hostrpc bdev_nvme_detach_controller nvme0 00:15:08.389 11:25:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:15:08.955 11:25:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@233 -- # rpc_cmd nvmf_subsystem_set_keys nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:15:08.955 11:25:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:08.955 11:25:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:15:08.955 11:25:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:08.955 11:25:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@234 -- # bdev_connect -b nvme0 00:15:08.955 11:25:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 00:15:08.955 11:25:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 00:15:09.213 nvme0n1 00:15:09.213 11:25:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@235 -- # hostrpc bdev_nvme_get_controllers 00:15:09.213 11:25:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:15:09.213 11:25:50 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@235 -- # jq -r '.[].name' 00:15:09.471 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@235 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:15:09.471 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@236 -- # hostrpc bdev_nvme_detach_controller nvme0 00:15:09.471 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_detach_controller nvme0 00:15:10.037 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@239 -- # rpc_cmd nvmf_subsystem_set_keys nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --dhchap-key key1 --dhchap-ctrlr-key key3 00:15:10.037 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:10.037 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:15:10.037 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:10.037 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@240 -- # nvme_set_keys nvme0 DHHC-1:01:N2VkMTc0ODgwNWQxZTM0NTk5OTYwMDk1NmQ5ZGE3YzEKeI3L: '' 2s 00:15:10.037 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@49 -- # local ctl key ckey dev timeout 00:15:10.037 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@51 -- # ctl=nvme0 00:15:10.037 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@51 -- # key=DHHC-1:01:N2VkMTc0ODgwNWQxZTM0NTk5OTYwMDk1NmQ5ZGE3YzEKeI3L: 00:15:10.037 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@51 -- # ckey= 00:15:10.037 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@51 -- # timeout=2s 00:15:10.037 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@52 -- # dev=/sys/devices/virtual/nvme-fabrics/ctl/nvme0 00:15:10.037 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@54 -- # [[ -z DHHC-1:01:N2VkMTc0ODgwNWQxZTM0NTk5OTYwMDk1NmQ5ZGE3YzEKeI3L: ]] 00:15:10.037 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@54 -- # echo DHHC-1:01:N2VkMTc0ODgwNWQxZTM0NTk5OTYwMDk1NmQ5ZGE3YzEKeI3L: 00:15:10.037 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@55 -- # [[ -z '' ]] 00:15:10.037 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@56 -- # [[ -z 2s ]] 00:15:10.037 11:25:51 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@56 -- # sleep 2s 00:15:11.956 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@241 -- # waitforblk nvme0n1 00:15:11.956 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@1235 -- # local i=0 00:15:11.956 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@1236 -- # lsblk -l -o NAME 00:15:11.956 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@1236 -- # grep -q -w nvme0n1 00:15:11.956 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@1242 -- # lsblk -l -o NAME 00:15:11.956 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@1242 -- # grep -q -w nvme0n1 00:15:11.956 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@1246 -- # return 0 00:15:11.956 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@243 -- # rpc_cmd nvmf_subsystem_set_keys nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --dhchap-key key1 --dhchap-ctrlr-key key2 00:15:11.956 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:11.956 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:15:11.956 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:11.956 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@244 -- # nvme_set_keys nvme0 '' DHHC-1:02:OGEwMDZmYzk3YTg5OWI0ZmJlYjViNmI2YmQzN2ViYjZiODhiMTM4MjEzY2ZlYmUzuaS9rg==: 2s 00:15:11.956 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@49 -- # local ctl key ckey dev timeout 00:15:11.956 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@51 -- # ctl=nvme0 00:15:11.956 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@51 -- # key= 00:15:11.956 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@51 -- # ckey=DHHC-1:02:OGEwMDZmYzk3YTg5OWI0ZmJlYjViNmI2YmQzN2ViYjZiODhiMTM4MjEzY2ZlYmUzuaS9rg==: 00:15:11.956 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@51 -- # timeout=2s 00:15:11.956 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@52 -- # dev=/sys/devices/virtual/nvme-fabrics/ctl/nvme0 00:15:11.956 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@54 -- # [[ -z '' ]] 00:15:11.956 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@55 -- # [[ -z DHHC-1:02:OGEwMDZmYzk3YTg5OWI0ZmJlYjViNmI2YmQzN2ViYjZiODhiMTM4MjEzY2ZlYmUzuaS9rg==: ]] 00:15:11.956 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@55 -- # echo DHHC-1:02:OGEwMDZmYzk3YTg5OWI0ZmJlYjViNmI2YmQzN2ViYjZiODhiMTM4MjEzY2ZlYmUzuaS9rg==: 00:15:11.956 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@56 -- # [[ -z 2s ]] 00:15:11.956 11:25:53 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@56 -- # sleep 2s 00:15:13.869 11:25:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@245 -- # waitforblk nvme0n1 00:15:13.869 11:25:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@1235 -- # local i=0 00:15:13.869 11:25:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@1236 -- # lsblk -l -o NAME 00:15:13.869 11:25:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@1236 -- # grep -q -w nvme0n1 00:15:13.869 11:25:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@1242 -- # lsblk -l -o NAME 00:15:13.869 11:25:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@1242 -- # grep -q -w nvme0n1 00:15:13.869 11:25:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@1246 -- # return 0 00:15:13.869 11:25:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@246 -- # nvme disconnect -n nqn.2024-03.io.spdk:cnode0 00:15:13.869 NQN:nqn.2024-03.io.spdk:cnode0 disconnected 1 controller(s) 00:15:13.869 11:25:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@249 -- # rpc_cmd nvmf_subsystem_set_keys nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --dhchap-key key0 --dhchap-ctrlr-key key1 00:15:13.869 11:25:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:13.869 11:25:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:15:13.869 11:25:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:13.869 11:25:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@250 -- # bdev_connect -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key key1 --ctrlr-loss-timeout-sec 1 --reconnect-delay-sec 1 00:15:13.869 11:25:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key key1 --ctrlr-loss-timeout-sec 1 --reconnect-delay-sec 1 00:15:13.869 11:25:55 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key key1 --ctrlr-loss-timeout-sec 1 --reconnect-delay-sec 1 00:15:15.240 nvme0n1 00:15:15.240 11:25:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@252 -- # rpc_cmd nvmf_subsystem_set_keys nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --dhchap-key key2 --dhchap-ctrlr-key key3 00:15:15.240 11:25:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:15.240 11:25:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:15:15.240 11:25:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:15.240 11:25:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@253 -- # hostrpc bdev_nvme_set_keys nvme0 --dhchap-key key2 --dhchap-ctrlr-key key3 00:15:15.240 11:25:56 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_keys nvme0 --dhchap-key key2 --dhchap-ctrlr-key key3 00:15:15.806 11:25:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@254 -- # hostrpc bdev_nvme_get_controllers 00:15:15.806 11:25:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:15:15.806 11:25:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@254 -- # jq -r '.[].name' 00:15:16.064 11:25:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@254 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:15:16.064 11:25:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@256 -- # rpc_cmd nvmf_subsystem_set_keys nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:15:16.064 11:25:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:16.064 11:25:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:15:16.064 11:25:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:16.064 11:25:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@257 -- # hostrpc bdev_nvme_set_keys nvme0 00:15:16.064 11:25:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_keys nvme0 00:15:16.323 11:25:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@258 -- # hostrpc bdev_nvme_get_controllers 00:15:16.323 11:25:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@258 -- # jq -r '.[].name' 00:15:16.323 11:25:57 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:15:16.581 11:25:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@258 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:15:16.581 11:25:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@260 -- # rpc_cmd nvmf_subsystem_set_keys nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --dhchap-key key2 --dhchap-ctrlr-key key3 00:15:16.581 11:25:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:16.581 11:25:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:15:16.581 11:25:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:16.581 11:25:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@261 -- # NOT hostrpc bdev_nvme_set_keys nvme0 --dhchap-key key1 --dhchap-ctrlr-key key3 00:15:16.581 11:25:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@650 -- # local es=0 00:15:16.581 11:25:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@652 -- # valid_exec_arg hostrpc bdev_nvme_set_keys nvme0 --dhchap-key key1 --dhchap-ctrlr-key key3 00:15:16.581 11:25:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@638 -- # local arg=hostrpc 00:15:16.581 11:25:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:16.581 11:25:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@642 -- # type -t hostrpc 00:15:16.581 11:25:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:16.581 11:25:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@653 -- # hostrpc bdev_nvme_set_keys nvme0 --dhchap-key key1 --dhchap-ctrlr-key key3 00:15:16.581 11:25:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_keys nvme0 --dhchap-key key1 --dhchap-ctrlr-key key3 00:15:17.154 2024/10/07 11:25:58 error on JSON-RPC call, method: bdev_nvme_set_keys, params: map[dhchap_ctrlr_key:key3 dhchap_key:key1 name:nvme0], err: error received for bdev_nvme_set_keys method, err: Code=-13 Msg=Permission denied 00:15:17.154 request: 00:15:17.154 { 00:15:17.154 "method": "bdev_nvme_set_keys", 00:15:17.154 "params": { 00:15:17.154 "name": "nvme0", 00:15:17.154 "dhchap_key": "key1", 00:15:17.154 "dhchap_ctrlr_key": "key3" 00:15:17.154 } 00:15:17.154 } 00:15:17.154 Got JSON-RPC error response 00:15:17.154 GoRPCClient: error on JSON-RPC call 00:15:17.413 11:25:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@653 -- # es=1 00:15:17.413 11:25:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:15:17.413 11:25:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:15:17.413 11:25:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:15:17.413 11:25:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@262 -- # hostrpc bdev_nvme_get_controllers 00:15:17.413 11:25:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:15:17.413 11:25:58 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@262 -- # jq length 00:15:17.671 11:25:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@262 -- # (( 1 != 0 )) 00:15:17.671 11:25:59 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@263 -- # sleep 1s 00:15:18.605 11:26:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@262 -- # hostrpc bdev_nvme_get_controllers 00:15:18.605 11:26:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@262 -- # jq length 00:15:18.605 11:26:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:15:18.863 11:26:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@262 -- # (( 0 != 0 )) 00:15:18.863 11:26:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@267 -- # rpc_cmd nvmf_subsystem_set_keys nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --dhchap-key key0 --dhchap-ctrlr-key key1 00:15:18.863 11:26:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:18.863 11:26:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:15:18.863 11:26:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:18.863 11:26:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@268 -- # bdev_connect -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key key1 --ctrlr-loss-timeout-sec 1 --reconnect-delay-sec 1 00:15:18.863 11:26:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@60 -- # hostrpc bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key key1 --ctrlr-loss-timeout-sec 1 --reconnect-delay-sec 1 00:15:18.863 11:26:00 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_attach_controller -t tcp -f ipv4 -a 10.0.0.3 -s 4420 -q nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 -n nqn.2024-03.io.spdk:cnode0 -b nvme0 --dhchap-key key0 --dhchap-ctrlr-key key1 --ctrlr-loss-timeout-sec 1 --reconnect-delay-sec 1 00:15:20.293 nvme0n1 00:15:20.293 11:26:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@270 -- # rpc_cmd nvmf_subsystem_set_keys nqn.2024-03.io.spdk:cnode0 nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 --dhchap-key key2 --dhchap-ctrlr-key key3 00:15:20.293 11:26:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:20.293 11:26:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:15:20.293 11:26:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:20.293 11:26:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@271 -- # NOT hostrpc bdev_nvme_set_keys nvme0 --dhchap-key key2 --dhchap-ctrlr-key key0 00:15:20.293 11:26:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@650 -- # local es=0 00:15:20.293 11:26:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@652 -- # valid_exec_arg hostrpc bdev_nvme_set_keys nvme0 --dhchap-key key2 --dhchap-ctrlr-key key0 00:15:20.293 11:26:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@638 -- # local arg=hostrpc 00:15:20.293 11:26:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:20.293 11:26:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@642 -- # type -t hostrpc 00:15:20.293 11:26:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:20.293 11:26:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@653 -- # hostrpc bdev_nvme_set_keys nvme0 --dhchap-key key2 --dhchap-ctrlr-key key0 00:15:20.293 11:26:01 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_set_keys nvme0 --dhchap-key key2 --dhchap-ctrlr-key key0 00:15:20.858 2024/10/07 11:26:02 error on JSON-RPC call, method: bdev_nvme_set_keys, params: map[dhchap_ctrlr_key:key0 dhchap_key:key2 name:nvme0], err: error received for bdev_nvme_set_keys method, err: Code=-13 Msg=Permission denied 00:15:20.858 request: 00:15:20.858 { 00:15:20.858 "method": "bdev_nvme_set_keys", 00:15:20.858 "params": { 00:15:20.858 "name": "nvme0", 00:15:20.858 "dhchap_key": "key2", 00:15:20.858 "dhchap_ctrlr_key": "key0" 00:15:20.858 } 00:15:20.858 } 00:15:20.858 Got JSON-RPC error response 00:15:20.858 GoRPCClient: error on JSON-RPC call 00:15:20.858 11:26:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@653 -- # es=1 00:15:20.858 11:26:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:15:20.858 11:26:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:15:20.858 11:26:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:15:20.858 11:26:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@272 -- # hostrpc bdev_nvme_get_controllers 00:15:20.858 11:26:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@272 -- # jq length 00:15:20.858 11:26:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:15:21.116 11:26:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@272 -- # (( 1 != 0 )) 00:15:21.116 11:26:02 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@273 -- # sleep 1s 00:15:22.097 11:26:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@272 -- # hostrpc bdev_nvme_get_controllers 00:15:22.097 11:26:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@272 -- # jq length 00:15:22.097 11:26:03 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/host.sock bdev_nvme_get_controllers 00:15:22.354 11:26:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@272 -- # (( 0 != 0 )) 00:15:22.354 11:26:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@276 -- # trap - SIGINT SIGTERM EXIT 00:15:22.354 11:26:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@277 -- # cleanup 00:15:22.354 11:26:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@21 -- # killprocess 76956 00:15:22.354 11:26:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@950 -- # '[' -z 76956 ']' 00:15:22.354 11:26:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@954 -- # kill -0 76956 00:15:22.355 11:26:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@955 -- # uname 00:15:22.355 11:26:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:15:22.355 11:26:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 76956 00:15:22.612 11:26:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@956 -- # process_name=reactor_1 00:15:22.612 killing process with pid 76956 00:15:22.612 11:26:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@960 -- # '[' reactor_1 = sudo ']' 00:15:22.612 11:26:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@968 -- # echo 'killing process with pid 76956' 00:15:22.612 11:26:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@969 -- # kill 76956 00:15:22.612 11:26:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@974 -- # wait 76956 00:15:23.179 11:26:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@22 -- # nvmftestfini 00:15:23.179 11:26:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@514 -- # nvmfcleanup 00:15:23.179 11:26:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@121 -- # sync 00:15:23.180 11:26:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:15:23.180 11:26:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@124 -- # set +e 00:15:23.180 11:26:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@125 -- # for i in {1..20} 00:15:23.180 11:26:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:15:23.180 rmmod nvme_tcp 00:15:23.180 rmmod nvme_fabrics 00:15:23.180 rmmod nvme_keyring 00:15:23.180 11:26:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:15:23.180 11:26:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@128 -- # set -e 00:15:23.180 11:26:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@129 -- # return 0 00:15:23.180 11:26:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@515 -- # '[' -n 81949 ']' 00:15:23.180 11:26:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@516 -- # killprocess 81949 00:15:23.180 11:26:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@950 -- # '[' -z 81949 ']' 00:15:23.180 11:26:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@954 -- # kill -0 81949 00:15:23.180 11:26:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@955 -- # uname 00:15:23.180 11:26:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:15:23.180 11:26:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 81949 00:15:23.180 11:26:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:15:23.180 11:26:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:15:23.180 11:26:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@968 -- # echo 'killing process with pid 81949' 00:15:23.180 killing process with pid 81949 00:15:23.180 11:26:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@969 -- # kill 81949 00:15:23.180 11:26:04 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@974 -- # wait 81949 00:15:23.745 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:15:23.745 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:15:23.745 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:15:23.745 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@297 -- # iptr 00:15:23.745 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:15:23.745 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@789 -- # iptables-save 00:15:23.745 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@789 -- # iptables-restore 00:15:23.745 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@298 -- # [[ nvmf_tgt_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:15:23.745 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@299 -- # nvmf_veth_fini 00:15:23.745 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@233 -- # ip link set nvmf_init_br nomaster 00:15:23.745 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@234 -- # ip link set nvmf_init_br2 nomaster 00:15:23.745 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@235 -- # ip link set nvmf_tgt_br nomaster 00:15:23.745 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@236 -- # ip link set nvmf_tgt_br2 nomaster 00:15:23.745 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@237 -- # ip link set nvmf_init_br down 00:15:23.745 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@238 -- # ip link set nvmf_init_br2 down 00:15:23.745 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@239 -- # ip link set nvmf_tgt_br down 00:15:23.745 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@240 -- # ip link set nvmf_tgt_br2 down 00:15:23.745 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@241 -- # ip link delete nvmf_br type bridge 00:15:23.745 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@242 -- # ip link delete nvmf_init_if 00:15:23.745 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@243 -- # ip link delete nvmf_init_if2 00:15:23.745 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@244 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:15:23.745 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@245 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:15:23.745 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@246 -- # remove_spdk_ns 00:15:23.745 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:23.745 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:15:23.745 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:24.003 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- nvmf/common.sh@300 -- # return 0 00:15:24.003 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- target/auth.sh@23 -- # rm -f /tmp/spdk.key-null.93D /tmp/spdk.key-sha256.t6V /tmp/spdk.key-sha384.F4n /tmp/spdk.key-sha512.sgX /tmp/spdk.key-sha512.CCs /tmp/spdk.key-sha384.PMi /tmp/spdk.key-sha256.PKN '' /home/vagrant/spdk_repo/spdk/../output/nvme-auth.log /home/vagrant/spdk_repo/spdk/../output/nvmf-auth.log 00:15:24.003 00:15:24.003 real 3m27.573s 00:15:24.003 user 8m24.926s 00:15:24.003 sys 0m26.852s 00:15:24.003 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@1126 -- # xtrace_disable 00:15:24.003 ************************************ 00:15:24.003 END TEST nvmf_auth_target 00:15:24.003 ************************************ 00:15:24.003 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_auth_target -- common/autotest_common.sh@10 -- # set +x 00:15:24.003 11:26:05 nvmf_tcp.nvmf_target_extra -- nvmf/nvmf_target_extra.sh@39 -- # '[' tcp = tcp ']' 00:15:24.003 11:26:05 nvmf_tcp.nvmf_target_extra -- nvmf/nvmf_target_extra.sh@40 -- # run_test nvmf_bdevio_no_huge /home/vagrant/spdk_repo/spdk/test/nvmf/target/bdevio.sh --transport=tcp --no-hugepages 00:15:24.003 11:26:05 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1101 -- # '[' 4 -le 1 ']' 00:15:24.003 11:26:05 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1107 -- # xtrace_disable 00:15:24.003 11:26:05 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@10 -- # set +x 00:15:24.003 ************************************ 00:15:24.003 START TEST nvmf_bdevio_no_huge 00:15:24.003 ************************************ 00:15:24.003 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/nvmf/target/bdevio.sh --transport=tcp --no-hugepages 00:15:24.003 * Looking for test storage... 00:15:24.003 * Found test storage at /home/vagrant/spdk_repo/spdk/test/nvmf/target 00:15:24.003 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:15:24.003 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@1681 -- # lcov --version 00:15:24.003 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:15:24.262 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:15:24.262 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:15:24.262 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- scripts/common.sh@333 -- # local ver1 ver1_l 00:15:24.262 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- scripts/common.sh@334 -- # local ver2 ver2_l 00:15:24.262 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- scripts/common.sh@336 -- # IFS=.-: 00:15:24.262 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- scripts/common.sh@336 -- # read -ra ver1 00:15:24.262 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- scripts/common.sh@337 -- # IFS=.-: 00:15:24.262 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- scripts/common.sh@337 -- # read -ra ver2 00:15:24.262 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- scripts/common.sh@338 -- # local 'op=<' 00:15:24.262 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- scripts/common.sh@340 -- # ver1_l=2 00:15:24.262 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- scripts/common.sh@341 -- # ver2_l=1 00:15:24.262 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:15:24.262 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- scripts/common.sh@344 -- # case "$op" in 00:15:24.262 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- scripts/common.sh@345 -- # : 1 00:15:24.262 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- scripts/common.sh@364 -- # (( v = 0 )) 00:15:24.262 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:15:24.262 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- scripts/common.sh@365 -- # decimal 1 00:15:24.262 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- scripts/common.sh@353 -- # local d=1 00:15:24.262 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:15:24.262 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- scripts/common.sh@355 -- # echo 1 00:15:24.262 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- scripts/common.sh@365 -- # ver1[v]=1 00:15:24.262 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- scripts/common.sh@366 -- # decimal 2 00:15:24.262 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- scripts/common.sh@353 -- # local d=2 00:15:24.262 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:15:24.262 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- scripts/common.sh@355 -- # echo 2 00:15:24.262 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- scripts/common.sh@366 -- # ver2[v]=2 00:15:24.262 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:15:24.262 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:15:24.262 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- scripts/common.sh@368 -- # return 0 00:15:24.262 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:15:24.262 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:15:24.262 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:24.262 --rc genhtml_branch_coverage=1 00:15:24.262 --rc genhtml_function_coverage=1 00:15:24.262 --rc genhtml_legend=1 00:15:24.262 --rc geninfo_all_blocks=1 00:15:24.262 --rc geninfo_unexecuted_blocks=1 00:15:24.262 00:15:24.262 ' 00:15:24.262 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:15:24.262 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:24.262 --rc genhtml_branch_coverage=1 00:15:24.262 --rc genhtml_function_coverage=1 00:15:24.262 --rc genhtml_legend=1 00:15:24.262 --rc geninfo_all_blocks=1 00:15:24.262 --rc geninfo_unexecuted_blocks=1 00:15:24.262 00:15:24.262 ' 00:15:24.262 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:15:24.262 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:24.262 --rc genhtml_branch_coverage=1 00:15:24.262 --rc genhtml_function_coverage=1 00:15:24.262 --rc genhtml_legend=1 00:15:24.262 --rc geninfo_all_blocks=1 00:15:24.262 --rc geninfo_unexecuted_blocks=1 00:15:24.262 00:15:24.262 ' 00:15:24.262 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:15:24.262 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:24.262 --rc genhtml_branch_coverage=1 00:15:24.262 --rc genhtml_function_coverage=1 00:15:24.262 --rc genhtml_legend=1 00:15:24.262 --rc geninfo_all_blocks=1 00:15:24.262 --rc geninfo_unexecuted_blocks=1 00:15:24.262 00:15:24.262 ' 00:15:24.262 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- target/bdevio.sh@9 -- # source /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh 00:15:24.262 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@7 -- # uname -s 00:15:24.262 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:24.262 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:24.262 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:24.262 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:24.262 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:24.262 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:24.262 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:24.262 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:24.262 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:24.262 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:24.262 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:15:24.262 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@18 -- # NVME_HOSTID=3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:15:24.262 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:24.262 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:24.263 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@21 -- # NET_TYPE=virt 00:15:24.263 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:15:24.263 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@49 -- # source /home/vagrant/spdk_repo/spdk/scripts/common.sh 00:15:24.263 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- scripts/common.sh@15 -- # shopt -s extglob 00:15:24.263 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:24.263 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:24.263 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:24.263 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:24.263 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:24.263 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:24.263 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- paths/export.sh@5 -- # export PATH 00:15:24.263 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:24.263 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@51 -- # : 0 00:15:24.263 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:15:24.263 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:15:24.263 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:15:24.263 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:24.263 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:24.263 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:15:24.263 /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:15:24.263 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:15:24.263 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:15:24.263 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@55 -- # have_pci_nics=0 00:15:24.263 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- target/bdevio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:15:24.263 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- target/bdevio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:15:24.263 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- target/bdevio.sh@14 -- # nvmftestinit 00:15:24.263 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:15:24.263 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:24.263 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@474 -- # prepare_net_devs 00:15:24.263 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@436 -- # local -g is_hw=no 00:15:24.263 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@438 -- # remove_spdk_ns 00:15:24.263 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:24.263 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:15:24.263 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:24.263 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@440 -- # [[ virt != virt ]] 00:15:24.263 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@442 -- # [[ no == yes ]] 00:15:24.263 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@449 -- # [[ virt == phy ]] 00:15:24.263 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@452 -- # [[ virt == phy-fallback ]] 00:15:24.263 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@457 -- # [[ tcp == tcp ]] 00:15:24.263 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@458 -- # nvmf_veth_init 00:15:24.263 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@145 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:15:24.263 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@146 -- # NVMF_SECOND_INITIATOR_IP=10.0.0.2 00:15:24.263 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@147 -- # NVMF_FIRST_TARGET_IP=10.0.0.3 00:15:24.263 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@148 -- # NVMF_SECOND_TARGET_IP=10.0.0.4 00:15:24.263 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@149 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:24.263 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@150 -- # NVMF_BRIDGE=nvmf_br 00:15:24.263 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@151 -- # NVMF_INITIATOR_INTERFACE=nvmf_init_if 00:15:24.263 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@152 -- # NVMF_INITIATOR_INTERFACE2=nvmf_init_if2 00:15:24.263 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@153 -- # NVMF_INITIATOR_BRIDGE=nvmf_init_br 00:15:24.263 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@154 -- # NVMF_INITIATOR_BRIDGE2=nvmf_init_br2 00:15:24.263 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@155 -- # NVMF_TARGET_NAMESPACE=nvmf_tgt_ns_spdk 00:15:24.263 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@156 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:24.263 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@157 -- # NVMF_TARGET_INTERFACE=nvmf_tgt_if 00:15:24.263 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@158 -- # NVMF_TARGET_INTERFACE2=nvmf_tgt_if2 00:15:24.263 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@159 -- # NVMF_TARGET_BRIDGE=nvmf_tgt_br 00:15:24.263 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@160 -- # NVMF_TARGET_BRIDGE2=nvmf_tgt_br2 00:15:24.263 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@162 -- # ip link set nvmf_init_br nomaster 00:15:24.263 Cannot find device "nvmf_init_br" 00:15:24.263 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@162 -- # true 00:15:24.263 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@163 -- # ip link set nvmf_init_br2 nomaster 00:15:24.263 Cannot find device "nvmf_init_br2" 00:15:24.263 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@163 -- # true 00:15:24.263 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@164 -- # ip link set nvmf_tgt_br nomaster 00:15:24.263 Cannot find device "nvmf_tgt_br" 00:15:24.263 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@164 -- # true 00:15:24.263 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@165 -- # ip link set nvmf_tgt_br2 nomaster 00:15:24.263 Cannot find device "nvmf_tgt_br2" 00:15:24.263 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@165 -- # true 00:15:24.263 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@166 -- # ip link set nvmf_init_br down 00:15:24.263 Cannot find device "nvmf_init_br" 00:15:24.263 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@166 -- # true 00:15:24.263 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@167 -- # ip link set nvmf_init_br2 down 00:15:24.263 Cannot find device "nvmf_init_br2" 00:15:24.263 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@167 -- # true 00:15:24.263 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@168 -- # ip link set nvmf_tgt_br down 00:15:24.263 Cannot find device "nvmf_tgt_br" 00:15:24.263 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@168 -- # true 00:15:24.263 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@169 -- # ip link set nvmf_tgt_br2 down 00:15:24.263 Cannot find device "nvmf_tgt_br2" 00:15:24.263 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@169 -- # true 00:15:24.263 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@170 -- # ip link delete nvmf_br type bridge 00:15:24.263 Cannot find device "nvmf_br" 00:15:24.263 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@170 -- # true 00:15:24.263 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@171 -- # ip link delete nvmf_init_if 00:15:24.263 Cannot find device "nvmf_init_if" 00:15:24.263 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@171 -- # true 00:15:24.263 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@172 -- # ip link delete nvmf_init_if2 00:15:24.263 Cannot find device "nvmf_init_if2" 00:15:24.263 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@172 -- # true 00:15:24.263 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@173 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:15:24.263 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:15:24.263 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@173 -- # true 00:15:24.263 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@174 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:15:24.263 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:15:24.263 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@174 -- # true 00:15:24.264 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@177 -- # ip netns add nvmf_tgt_ns_spdk 00:15:24.264 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@180 -- # ip link add nvmf_init_if type veth peer name nvmf_init_br 00:15:24.264 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@181 -- # ip link add nvmf_init_if2 type veth peer name nvmf_init_br2 00:15:24.264 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@182 -- # ip link add nvmf_tgt_if type veth peer name nvmf_tgt_br 00:15:24.264 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@183 -- # ip link add nvmf_tgt_if2 type veth peer name nvmf_tgt_br2 00:15:24.521 11:26:05 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@186 -- # ip link set nvmf_tgt_if netns nvmf_tgt_ns_spdk 00:15:24.521 11:26:06 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@187 -- # ip link set nvmf_tgt_if2 netns nvmf_tgt_ns_spdk 00:15:24.521 11:26:06 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@190 -- # ip addr add 10.0.0.1/24 dev nvmf_init_if 00:15:24.521 11:26:06 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@191 -- # ip addr add 10.0.0.2/24 dev nvmf_init_if2 00:15:24.521 11:26:06 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@192 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.3/24 dev nvmf_tgt_if 00:15:24.521 11:26:06 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@193 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.4/24 dev nvmf_tgt_if2 00:15:24.521 11:26:06 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@196 -- # ip link set nvmf_init_if up 00:15:24.521 11:26:06 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@197 -- # ip link set nvmf_init_if2 up 00:15:24.521 11:26:06 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@198 -- # ip link set nvmf_init_br up 00:15:24.521 11:26:06 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@199 -- # ip link set nvmf_init_br2 up 00:15:24.521 11:26:06 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@200 -- # ip link set nvmf_tgt_br up 00:15:24.521 11:26:06 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@201 -- # ip link set nvmf_tgt_br2 up 00:15:24.521 11:26:06 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@202 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if up 00:15:24.521 11:26:06 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@203 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if2 up 00:15:24.521 11:26:06 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@204 -- # ip netns exec nvmf_tgt_ns_spdk ip link set lo up 00:15:24.521 11:26:06 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@207 -- # ip link add nvmf_br type bridge 00:15:24.521 11:26:06 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@208 -- # ip link set nvmf_br up 00:15:24.521 11:26:06 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@211 -- # ip link set nvmf_init_br master nvmf_br 00:15:24.521 11:26:06 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@212 -- # ip link set nvmf_init_br2 master nvmf_br 00:15:24.521 11:26:06 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@213 -- # ip link set nvmf_tgt_br master nvmf_br 00:15:24.521 11:26:06 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@214 -- # ip link set nvmf_tgt_br2 master nvmf_br 00:15:24.522 11:26:06 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@217 -- # ipts -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT 00:15:24.522 11:26:06 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT' 00:15:24.522 11:26:06 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@218 -- # ipts -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT 00:15:24.522 11:26:06 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT' 00:15:24.522 11:26:06 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@219 -- # ipts -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT 00:15:24.522 11:26:06 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@788 -- # iptables -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT -m comment --comment 'SPDK_NVMF:-A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT' 00:15:24.522 11:26:06 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@222 -- # ping -c 1 10.0.0.3 00:15:24.522 PING 10.0.0.3 (10.0.0.3) 56(84) bytes of data. 00:15:24.522 64 bytes from 10.0.0.3: icmp_seq=1 ttl=64 time=0.088 ms 00:15:24.522 00:15:24.522 --- 10.0.0.3 ping statistics --- 00:15:24.522 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:24.522 rtt min/avg/max/mdev = 0.088/0.088/0.088/0.000 ms 00:15:24.522 11:26:06 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@223 -- # ping -c 1 10.0.0.4 00:15:24.522 PING 10.0.0.4 (10.0.0.4) 56(84) bytes of data. 00:15:24.522 64 bytes from 10.0.0.4: icmp_seq=1 ttl=64 time=0.041 ms 00:15:24.522 00:15:24.522 --- 10.0.0.4 ping statistics --- 00:15:24.522 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:24.522 rtt min/avg/max/mdev = 0.041/0.041/0.041/0.000 ms 00:15:24.522 11:26:06 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@224 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.1 00:15:24.522 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:24.522 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.032 ms 00:15:24.522 00:15:24.522 --- 10.0.0.1 ping statistics --- 00:15:24.522 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:24.522 rtt min/avg/max/mdev = 0.032/0.032/0.032/0.000 ms 00:15:24.522 11:26:06 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@225 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.2 00:15:24.522 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:24.522 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.055 ms 00:15:24.522 00:15:24.522 --- 10.0.0.2 ping statistics --- 00:15:24.522 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:24.522 rtt min/avg/max/mdev = 0.055/0.055/0.055/0.000 ms 00:15:24.522 11:26:06 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@227 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:24.522 11:26:06 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@459 -- # return 0 00:15:24.522 11:26:06 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:15:24.522 11:26:06 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:24.522 11:26:06 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:15:24.522 11:26:06 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:15:24.522 11:26:06 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:24.522 11:26:06 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:15:24.522 11:26:06 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:15:24.779 11:26:06 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- target/bdevio.sh@16 -- # nvmfappstart -m 0x78 00:15:24.779 11:26:06 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:15:24.779 11:26:06 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@724 -- # xtrace_disable 00:15:24.779 11:26:06 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@10 -- # set +x 00:15:24.779 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:24.779 11:26:06 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@507 -- # nvmfpid=82843 00:15:24.779 11:26:06 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@506 -- # ip netns exec nvmf_tgt_ns_spdk /home/vagrant/spdk_repo/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --no-huge -s 1024 -m 0x78 00:15:24.779 11:26:06 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@508 -- # waitforlisten 82843 00:15:24.779 11:26:06 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@831 -- # '[' -z 82843 ']' 00:15:24.779 11:26:06 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:24.780 11:26:06 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@836 -- # local max_retries=100 00:15:24.780 11:26:06 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:24.780 11:26:06 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@840 -- # xtrace_disable 00:15:24.780 11:26:06 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@10 -- # set +x 00:15:24.780 [2024-10-07 11:26:06.307127] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:15:24.780 [2024-10-07 11:26:06.307239] [ DPDK EAL parameters: nvmf -c 0x78 -m 1024 --no-huge --iova-mode=va --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --file-prefix=spdk0 --proc-type=auto ] 00:15:24.780 [2024-10-07 11:26:06.458405] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 4 00:15:25.038 [2024-10-07 11:26:06.617540] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:25.038 [2024-10-07 11:26:06.617949] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:25.038 [2024-10-07 11:26:06.618330] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:15:25.038 [2024-10-07 11:26:06.618703] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:15:25.038 [2024-10-07 11:26:06.618891] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:25.038 [2024-10-07 11:26:06.619752] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 4 00:15:25.038 [2024-10-07 11:26:06.619963] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 6 00:15:25.038 [2024-10-07 11:26:06.619970] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 3 00:15:25.038 [2024-10-07 11:26:06.619798] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 5 00:15:25.971 11:26:07 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:15:25.971 11:26:07 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@864 -- # return 0 00:15:25.971 11:26:07 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:15:25.971 11:26:07 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@730 -- # xtrace_disable 00:15:25.971 11:26:07 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@10 -- # set +x 00:15:25.971 11:26:07 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:25.971 11:26:07 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- target/bdevio.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:15:25.971 11:26:07 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:25.971 11:26:07 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@10 -- # set +x 00:15:25.971 [2024-10-07 11:26:07.380016] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:15:25.971 11:26:07 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:25.971 11:26:07 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- target/bdevio.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:15:25.971 11:26:07 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:25.971 11:26:07 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@10 -- # set +x 00:15:25.971 Malloc0 00:15:25.971 11:26:07 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:25.971 11:26:07 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- target/bdevio.sh@20 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:15:25.971 11:26:07 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:25.971 11:26:07 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@10 -- # set +x 00:15:25.971 11:26:07 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:25.971 11:26:07 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- target/bdevio.sh@21 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:15:25.971 11:26:07 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:25.971 11:26:07 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@10 -- # set +x 00:15:25.971 11:26:07 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:25.971 11:26:07 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- target/bdevio.sh@22 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4420 00:15:25.971 11:26:07 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:25.971 11:26:07 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@10 -- # set +x 00:15:25.971 [2024-10-07 11:26:07.434212] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:15:25.971 11:26:07 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:25.971 11:26:07 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- target/bdevio.sh@24 -- # /home/vagrant/spdk_repo/spdk/test/bdev/bdevio/bdevio --json /dev/fd/62 --no-huge -s 1024 00:15:25.971 11:26:07 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- target/bdevio.sh@24 -- # gen_nvmf_target_json 00:15:25.971 11:26:07 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@558 -- # config=() 00:15:25.971 11:26:07 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@558 -- # local subsystem config 00:15:25.971 11:26:07 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@560 -- # for subsystem in "${@:-1}" 00:15:25.971 11:26:07 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@580 -- # config+=("$(cat <<-EOF 00:15:25.971 { 00:15:25.971 "params": { 00:15:25.971 "name": "Nvme$subsystem", 00:15:25.971 "trtype": "$TEST_TRANSPORT", 00:15:25.971 "traddr": "$NVMF_FIRST_TARGET_IP", 00:15:25.971 "adrfam": "ipv4", 00:15:25.971 "trsvcid": "$NVMF_PORT", 00:15:25.971 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:15:25.971 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:15:25.971 "hdgst": ${hdgst:-false}, 00:15:25.971 "ddgst": ${ddgst:-false} 00:15:25.971 }, 00:15:25.971 "method": "bdev_nvme_attach_controller" 00:15:25.971 } 00:15:25.971 EOF 00:15:25.971 )") 00:15:25.971 11:26:07 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@580 -- # cat 00:15:25.971 11:26:07 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@582 -- # jq . 00:15:25.971 11:26:07 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@583 -- # IFS=, 00:15:25.971 11:26:07 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@584 -- # printf '%s\n' '{ 00:15:25.971 "params": { 00:15:25.971 "name": "Nvme1", 00:15:25.971 "trtype": "tcp", 00:15:25.971 "traddr": "10.0.0.3", 00:15:25.971 "adrfam": "ipv4", 00:15:25.971 "trsvcid": "4420", 00:15:25.971 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:15:25.971 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:15:25.971 "hdgst": false, 00:15:25.971 "ddgst": false 00:15:25.971 }, 00:15:25.971 "method": "bdev_nvme_attach_controller" 00:15:25.971 }' 00:15:25.971 [2024-10-07 11:26:07.502265] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:15:25.971 [2024-10-07 11:26:07.502386] [ DPDK EAL parameters: bdevio --no-shconf -c 0x7 -m 1024 --no-huge --iova-mode=va --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --file-prefix=spdk_pid82897 ] 00:15:25.971 [2024-10-07 11:26:07.650508] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 3 00:15:26.229 [2024-10-07 11:26:07.859221] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:15:26.229 [2024-10-07 11:26:07.859379] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:15:26.229 [2024-10-07 11:26:07.859386] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:15:26.488 I/O targets: 00:15:26.488 Nvme1n1: 131072 blocks of 512 bytes (64 MiB) 00:15:26.488 00:15:26.488 00:15:26.488 CUnit - A unit testing framework for C - Version 2.1-3 00:15:26.488 http://cunit.sourceforge.net/ 00:15:26.488 00:15:26.488 00:15:26.488 Suite: bdevio tests on: Nvme1n1 00:15:26.488 Test: blockdev write read block ...passed 00:15:26.747 Test: blockdev write zeroes read block ...passed 00:15:26.747 Test: blockdev write zeroes read no split ...passed 00:15:26.747 Test: blockdev write zeroes read split ...passed 00:15:26.747 Test: blockdev write zeroes read split partial ...passed 00:15:26.747 Test: blockdev reset ...[2024-10-07 11:26:08.274551] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:15:26.747 [2024-10-07 11:26:08.274706] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xda3450 (9): Bad file descriptor 00:15:26.747 [2024-10-07 11:26:08.286926] bdev_nvme.c:2183:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:15:26.747 passed 00:15:26.747 Test: blockdev write read 8 blocks ...passed 00:15:26.747 Test: blockdev write read size > 128k ...passed 00:15:26.747 Test: blockdev write read invalid size ...passed 00:15:26.747 Test: blockdev write read offset + nbytes == size of blockdev ...passed 00:15:26.747 Test: blockdev write read offset + nbytes > size of blockdev ...passed 00:15:26.747 Test: blockdev write read max offset ...passed 00:15:26.747 Test: blockdev write read 2 blocks on overlapped address offset ...passed 00:15:26.747 Test: blockdev writev readv 8 blocks ...passed 00:15:26.747 Test: blockdev writev readv 30 x 1block ...passed 00:15:26.747 Test: blockdev writev readv block ...passed 00:15:27.006 Test: blockdev writev readv size > 128k ...passed 00:15:27.006 Test: blockdev writev readv size > 128k in two iovs ...passed 00:15:27.006 Test: blockdev comparev and writev ...[2024-10-07 11:26:08.461212] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:15:27.006 [2024-10-07 11:26:08.461273] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:15:27.006 [2024-10-07 11:26:08.461295] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:15:27.006 [2024-10-07 11:26:08.461307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0022 p:0 m:0 dnr:0 00:15:27.006 [2024-10-07 11:26:08.462046] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:15:27.006 [2024-10-07 11:26:08.462074] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0023 p:0 m:0 dnr:0 00:15:27.006 [2024-10-07 11:26:08.462093] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:15:27.006 [2024-10-07 11:26:08.462105] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0024 p:0 m:0 dnr:0 00:15:27.006 [2024-10-07 11:26:08.462572] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:15:27.006 [2024-10-07 11:26:08.462599] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0025 p:0 m:0 dnr:0 00:15:27.006 [2024-10-07 11:26:08.462618] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:15:27.006 [2024-10-07 11:26:08.462630] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0026 p:0 m:0 dnr:0 00:15:27.006 [2024-10-07 11:26:08.463129] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:15:27.006 [2024-10-07 11:26:08.463156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0027 p:0 m:0 dnr:0 00:15:27.006 [2024-10-07 11:26:08.463174] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:15:27.006 [2024-10-07 11:26:08.463186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0028 p:0 m:0 dnr:0 00:15:27.006 passed 00:15:27.006 Test: blockdev nvme passthru rw ...passed 00:15:27.006 Test: blockdev nvme passthru vendor specific ...[2024-10-07 11:26:08.547007] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:15:27.006 [2024-10-07 11:26:08.547047] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002c p:0 m:0 dnr:0 00:15:27.006 [2024-10-07 11:26:08.547735] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:15:27.006 [2024-10-07 11:26:08.547764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002d p:0 m:0 dnr:0 00:15:27.006 [2024-10-07 11:26:08.547980] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:15:27.006 [2024-10-07 11:26:08.548006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002e p:0 m:0 dnr:0 00:15:27.006 [2024-10-07 11:26:08.548228] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:15:27.006 [2024-10-07 11:26:08.548262] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002f p:0 m:0 dnr:0 00:15:27.006 passed 00:15:27.006 Test: blockdev nvme admin passthru ...passed 00:15:27.006 Test: blockdev copy ...passed 00:15:27.006 00:15:27.006 Run Summary: Type Total Ran Passed Failed Inactive 00:15:27.006 suites 1 1 n/a 0 0 00:15:27.006 tests 23 23 23 0 0 00:15:27.006 asserts 152 152 152 0 n/a 00:15:27.006 00:15:27.006 Elapsed time = 0.943 seconds 00:15:27.574 11:26:09 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- target/bdevio.sh@26 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:15:27.574 11:26:09 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:27.574 11:26:09 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@10 -- # set +x 00:15:27.574 11:26:09 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:27.574 11:26:09 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- target/bdevio.sh@28 -- # trap - SIGINT SIGTERM EXIT 00:15:27.574 11:26:09 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- target/bdevio.sh@30 -- # nvmftestfini 00:15:27.574 11:26:09 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@514 -- # nvmfcleanup 00:15:27.574 11:26:09 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@121 -- # sync 00:15:27.574 11:26:09 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:15:27.574 11:26:09 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@124 -- # set +e 00:15:27.574 11:26:09 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@125 -- # for i in {1..20} 00:15:27.574 11:26:09 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:15:27.575 rmmod nvme_tcp 00:15:27.575 rmmod nvme_fabrics 00:15:27.575 rmmod nvme_keyring 00:15:27.834 11:26:09 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:15:27.834 11:26:09 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@128 -- # set -e 00:15:27.834 11:26:09 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@129 -- # return 0 00:15:27.834 11:26:09 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@515 -- # '[' -n 82843 ']' 00:15:27.834 11:26:09 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@516 -- # killprocess 82843 00:15:27.834 11:26:09 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@950 -- # '[' -z 82843 ']' 00:15:27.834 11:26:09 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@954 -- # kill -0 82843 00:15:27.834 11:26:09 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@955 -- # uname 00:15:27.834 11:26:09 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:15:27.834 11:26:09 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 82843 00:15:27.834 killing process with pid 82843 00:15:27.834 11:26:09 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@956 -- # process_name=reactor_3 00:15:27.834 11:26:09 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@960 -- # '[' reactor_3 = sudo ']' 00:15:27.834 11:26:09 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@968 -- # echo 'killing process with pid 82843' 00:15:27.834 11:26:09 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@969 -- # kill 82843 00:15:27.834 11:26:09 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@974 -- # wait 82843 00:15:28.401 11:26:09 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:15:28.401 11:26:09 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:15:28.401 11:26:09 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:15:28.401 11:26:09 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@297 -- # iptr 00:15:28.401 11:26:09 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@789 -- # iptables-save 00:15:28.401 11:26:09 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:15:28.401 11:26:09 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@789 -- # iptables-restore 00:15:28.401 11:26:09 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@298 -- # [[ nvmf_tgt_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:15:28.401 11:26:09 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@299 -- # nvmf_veth_fini 00:15:28.401 11:26:09 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@233 -- # ip link set nvmf_init_br nomaster 00:15:28.401 11:26:09 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@234 -- # ip link set nvmf_init_br2 nomaster 00:15:28.401 11:26:09 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@235 -- # ip link set nvmf_tgt_br nomaster 00:15:28.401 11:26:09 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@236 -- # ip link set nvmf_tgt_br2 nomaster 00:15:28.401 11:26:09 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@237 -- # ip link set nvmf_init_br down 00:15:28.401 11:26:09 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@238 -- # ip link set nvmf_init_br2 down 00:15:28.401 11:26:09 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@239 -- # ip link set nvmf_tgt_br down 00:15:28.401 11:26:09 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@240 -- # ip link set nvmf_tgt_br2 down 00:15:28.401 11:26:09 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@241 -- # ip link delete nvmf_br type bridge 00:15:28.401 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@242 -- # ip link delete nvmf_init_if 00:15:28.401 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@243 -- # ip link delete nvmf_init_if2 00:15:28.401 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@244 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:15:28.661 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@245 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:15:28.661 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@246 -- # remove_spdk_ns 00:15:28.661 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:28.661 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:15:28.661 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:28.661 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- nvmf/common.sh@300 -- # return 0 00:15:28.661 00:15:28.661 real 0m4.633s 00:15:28.661 user 0m15.130s 00:15:28.661 sys 0m1.867s 00:15:28.661 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@1126 -- # xtrace_disable 00:15:28.661 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_bdevio_no_huge -- common/autotest_common.sh@10 -- # set +x 00:15:28.661 ************************************ 00:15:28.661 END TEST nvmf_bdevio_no_huge 00:15:28.661 ************************************ 00:15:28.661 11:26:10 nvmf_tcp.nvmf_target_extra -- nvmf/nvmf_target_extra.sh@41 -- # run_test nvmf_tls /home/vagrant/spdk_repo/spdk/test/nvmf/target/tls.sh --transport=tcp 00:15:28.661 11:26:10 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:15:28.661 11:26:10 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1107 -- # xtrace_disable 00:15:28.661 11:26:10 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@10 -- # set +x 00:15:28.661 ************************************ 00:15:28.661 START TEST nvmf_tls 00:15:28.661 ************************************ 00:15:28.661 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/nvmf/target/tls.sh --transport=tcp 00:15:28.661 * Looking for test storage... 00:15:28.661 * Found test storage at /home/vagrant/spdk_repo/spdk/test/nvmf/target 00:15:28.661 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:15:28.661 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@1681 -- # lcov --version 00:15:28.661 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:15:28.922 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:15:28.922 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:15:28.922 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- scripts/common.sh@333 -- # local ver1 ver1_l 00:15:28.922 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- scripts/common.sh@334 -- # local ver2 ver2_l 00:15:28.922 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- scripts/common.sh@336 -- # IFS=.-: 00:15:28.922 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- scripts/common.sh@336 -- # read -ra ver1 00:15:28.922 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- scripts/common.sh@337 -- # IFS=.-: 00:15:28.922 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- scripts/common.sh@337 -- # read -ra ver2 00:15:28.922 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- scripts/common.sh@338 -- # local 'op=<' 00:15:28.922 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- scripts/common.sh@340 -- # ver1_l=2 00:15:28.922 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- scripts/common.sh@341 -- # ver2_l=1 00:15:28.922 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:15:28.922 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- scripts/common.sh@344 -- # case "$op" in 00:15:28.922 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- scripts/common.sh@345 -- # : 1 00:15:28.922 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- scripts/common.sh@364 -- # (( v = 0 )) 00:15:28.922 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:15:28.922 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- scripts/common.sh@365 -- # decimal 1 00:15:28.922 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- scripts/common.sh@353 -- # local d=1 00:15:28.922 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:15:28.922 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- scripts/common.sh@355 -- # echo 1 00:15:28.922 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- scripts/common.sh@365 -- # ver1[v]=1 00:15:28.922 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- scripts/common.sh@366 -- # decimal 2 00:15:28.922 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- scripts/common.sh@353 -- # local d=2 00:15:28.922 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:15:28.922 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- scripts/common.sh@355 -- # echo 2 00:15:28.922 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- scripts/common.sh@366 -- # ver2[v]=2 00:15:28.922 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:15:28.922 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:15:28.922 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- scripts/common.sh@368 -- # return 0 00:15:28.922 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:15:28.922 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:15:28.922 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:28.922 --rc genhtml_branch_coverage=1 00:15:28.922 --rc genhtml_function_coverage=1 00:15:28.922 --rc genhtml_legend=1 00:15:28.922 --rc geninfo_all_blocks=1 00:15:28.922 --rc geninfo_unexecuted_blocks=1 00:15:28.923 00:15:28.923 ' 00:15:28.923 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:15:28.923 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:28.923 --rc genhtml_branch_coverage=1 00:15:28.923 --rc genhtml_function_coverage=1 00:15:28.923 --rc genhtml_legend=1 00:15:28.923 --rc geninfo_all_blocks=1 00:15:28.923 --rc geninfo_unexecuted_blocks=1 00:15:28.923 00:15:28.923 ' 00:15:28.923 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:15:28.923 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:28.923 --rc genhtml_branch_coverage=1 00:15:28.923 --rc genhtml_function_coverage=1 00:15:28.923 --rc genhtml_legend=1 00:15:28.923 --rc geninfo_all_blocks=1 00:15:28.923 --rc geninfo_unexecuted_blocks=1 00:15:28.923 00:15:28.923 ' 00:15:28.923 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:15:28.923 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:28.923 --rc genhtml_branch_coverage=1 00:15:28.923 --rc genhtml_function_coverage=1 00:15:28.923 --rc genhtml_legend=1 00:15:28.923 --rc geninfo_all_blocks=1 00:15:28.923 --rc geninfo_unexecuted_blocks=1 00:15:28.923 00:15:28.923 ' 00:15:28.923 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@10 -- # source /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh 00:15:28.923 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@7 -- # uname -s 00:15:28.923 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:28.923 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:28.923 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:28.923 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:28.923 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:28.923 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:28.923 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:28.923 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:28.923 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:28.923 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:28.923 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:15:28.923 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@18 -- # NVME_HOSTID=3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:15:28.923 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:28.923 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:28.923 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@21 -- # NET_TYPE=virt 00:15:28.923 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:15:28.923 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@49 -- # source /home/vagrant/spdk_repo/spdk/scripts/common.sh 00:15:28.923 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- scripts/common.sh@15 -- # shopt -s extglob 00:15:28.923 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:28.923 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:28.923 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:28.923 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:28.923 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:28.923 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:28.923 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- paths/export.sh@5 -- # export PATH 00:15:28.923 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:28.923 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@51 -- # : 0 00:15:28.923 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:15:28.923 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:15:28.923 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:15:28.923 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:28.923 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:28.923 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:15:28.923 /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:15:28.923 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:15:28.923 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:15:28.923 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@55 -- # have_pci_nics=0 00:15:28.923 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@12 -- # rpc_py=/home/vagrant/spdk_repo/spdk/scripts/rpc.py 00:15:28.923 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@63 -- # nvmftestinit 00:15:28.923 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:15:28.923 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:28.923 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@474 -- # prepare_net_devs 00:15:28.923 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@436 -- # local -g is_hw=no 00:15:28.923 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@438 -- # remove_spdk_ns 00:15:28.923 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:28.923 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:15:28.923 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:28.923 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@440 -- # [[ virt != virt ]] 00:15:28.923 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@442 -- # [[ no == yes ]] 00:15:28.923 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@449 -- # [[ virt == phy ]] 00:15:28.923 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@452 -- # [[ virt == phy-fallback ]] 00:15:28.923 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@457 -- # [[ tcp == tcp ]] 00:15:28.923 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@458 -- # nvmf_veth_init 00:15:28.923 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@145 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:15:28.923 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@146 -- # NVMF_SECOND_INITIATOR_IP=10.0.0.2 00:15:28.923 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@147 -- # NVMF_FIRST_TARGET_IP=10.0.0.3 00:15:28.923 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@148 -- # NVMF_SECOND_TARGET_IP=10.0.0.4 00:15:28.923 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@149 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:28.923 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@150 -- # NVMF_BRIDGE=nvmf_br 00:15:28.923 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@151 -- # NVMF_INITIATOR_INTERFACE=nvmf_init_if 00:15:28.923 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@152 -- # NVMF_INITIATOR_INTERFACE2=nvmf_init_if2 00:15:28.923 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@153 -- # NVMF_INITIATOR_BRIDGE=nvmf_init_br 00:15:28.923 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@154 -- # NVMF_INITIATOR_BRIDGE2=nvmf_init_br2 00:15:28.923 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@155 -- # NVMF_TARGET_NAMESPACE=nvmf_tgt_ns_spdk 00:15:28.923 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@156 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:28.923 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@157 -- # NVMF_TARGET_INTERFACE=nvmf_tgt_if 00:15:28.923 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@158 -- # NVMF_TARGET_INTERFACE2=nvmf_tgt_if2 00:15:28.923 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@159 -- # NVMF_TARGET_BRIDGE=nvmf_tgt_br 00:15:28.923 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@160 -- # NVMF_TARGET_BRIDGE2=nvmf_tgt_br2 00:15:28.923 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@162 -- # ip link set nvmf_init_br nomaster 00:15:28.923 Cannot find device "nvmf_init_br" 00:15:28.923 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@162 -- # true 00:15:28.923 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@163 -- # ip link set nvmf_init_br2 nomaster 00:15:28.923 Cannot find device "nvmf_init_br2" 00:15:28.923 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@163 -- # true 00:15:28.923 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@164 -- # ip link set nvmf_tgt_br nomaster 00:15:28.923 Cannot find device "nvmf_tgt_br" 00:15:28.923 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@164 -- # true 00:15:28.923 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@165 -- # ip link set nvmf_tgt_br2 nomaster 00:15:28.923 Cannot find device "nvmf_tgt_br2" 00:15:28.923 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@165 -- # true 00:15:28.923 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@166 -- # ip link set nvmf_init_br down 00:15:28.923 Cannot find device "nvmf_init_br" 00:15:28.923 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@166 -- # true 00:15:28.923 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@167 -- # ip link set nvmf_init_br2 down 00:15:28.923 Cannot find device "nvmf_init_br2" 00:15:28.923 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@167 -- # true 00:15:28.923 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@168 -- # ip link set nvmf_tgt_br down 00:15:28.923 Cannot find device "nvmf_tgt_br" 00:15:28.923 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@168 -- # true 00:15:28.924 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@169 -- # ip link set nvmf_tgt_br2 down 00:15:28.924 Cannot find device "nvmf_tgt_br2" 00:15:28.924 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@169 -- # true 00:15:28.924 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@170 -- # ip link delete nvmf_br type bridge 00:15:28.924 Cannot find device "nvmf_br" 00:15:28.924 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@170 -- # true 00:15:28.924 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@171 -- # ip link delete nvmf_init_if 00:15:28.924 Cannot find device "nvmf_init_if" 00:15:28.924 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@171 -- # true 00:15:28.924 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@172 -- # ip link delete nvmf_init_if2 00:15:28.924 Cannot find device "nvmf_init_if2" 00:15:28.924 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@172 -- # true 00:15:28.924 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@173 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:15:28.924 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:15:28.924 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@173 -- # true 00:15:28.924 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@174 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:15:28.924 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:15:28.924 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@174 -- # true 00:15:28.924 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@177 -- # ip netns add nvmf_tgt_ns_spdk 00:15:28.924 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@180 -- # ip link add nvmf_init_if type veth peer name nvmf_init_br 00:15:28.924 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@181 -- # ip link add nvmf_init_if2 type veth peer name nvmf_init_br2 00:15:28.924 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@182 -- # ip link add nvmf_tgt_if type veth peer name nvmf_tgt_br 00:15:28.924 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@183 -- # ip link add nvmf_tgt_if2 type veth peer name nvmf_tgt_br2 00:15:28.924 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@186 -- # ip link set nvmf_tgt_if netns nvmf_tgt_ns_spdk 00:15:29.195 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@187 -- # ip link set nvmf_tgt_if2 netns nvmf_tgt_ns_spdk 00:15:29.195 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@190 -- # ip addr add 10.0.0.1/24 dev nvmf_init_if 00:15:29.195 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@191 -- # ip addr add 10.0.0.2/24 dev nvmf_init_if2 00:15:29.195 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@192 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.3/24 dev nvmf_tgt_if 00:15:29.195 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@193 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.4/24 dev nvmf_tgt_if2 00:15:29.195 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@196 -- # ip link set nvmf_init_if up 00:15:29.195 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@197 -- # ip link set nvmf_init_if2 up 00:15:29.196 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@198 -- # ip link set nvmf_init_br up 00:15:29.196 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@199 -- # ip link set nvmf_init_br2 up 00:15:29.196 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@200 -- # ip link set nvmf_tgt_br up 00:15:29.196 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@201 -- # ip link set nvmf_tgt_br2 up 00:15:29.196 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@202 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if up 00:15:29.196 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@203 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if2 up 00:15:29.196 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@204 -- # ip netns exec nvmf_tgt_ns_spdk ip link set lo up 00:15:29.196 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@207 -- # ip link add nvmf_br type bridge 00:15:29.196 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@208 -- # ip link set nvmf_br up 00:15:29.196 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@211 -- # ip link set nvmf_init_br master nvmf_br 00:15:29.196 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@212 -- # ip link set nvmf_init_br2 master nvmf_br 00:15:29.196 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@213 -- # ip link set nvmf_tgt_br master nvmf_br 00:15:29.196 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@214 -- # ip link set nvmf_tgt_br2 master nvmf_br 00:15:29.196 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@217 -- # ipts -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT 00:15:29.196 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT' 00:15:29.196 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@218 -- # ipts -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT 00:15:29.196 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT' 00:15:29.196 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@219 -- # ipts -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT 00:15:29.196 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@788 -- # iptables -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT -m comment --comment 'SPDK_NVMF:-A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT' 00:15:29.196 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@222 -- # ping -c 1 10.0.0.3 00:15:29.196 PING 10.0.0.3 (10.0.0.3) 56(84) bytes of data. 00:15:29.196 64 bytes from 10.0.0.3: icmp_seq=1 ttl=64 time=0.077 ms 00:15:29.196 00:15:29.196 --- 10.0.0.3 ping statistics --- 00:15:29.196 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:29.196 rtt min/avg/max/mdev = 0.077/0.077/0.077/0.000 ms 00:15:29.196 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@223 -- # ping -c 1 10.0.0.4 00:15:29.196 PING 10.0.0.4 (10.0.0.4) 56(84) bytes of data. 00:15:29.196 64 bytes from 10.0.0.4: icmp_seq=1 ttl=64 time=0.045 ms 00:15:29.196 00:15:29.196 --- 10.0.0.4 ping statistics --- 00:15:29.196 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:29.196 rtt min/avg/max/mdev = 0.045/0.045/0.045/0.000 ms 00:15:29.196 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@224 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.1 00:15:29.196 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:29.196 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.033 ms 00:15:29.196 00:15:29.196 --- 10.0.0.1 ping statistics --- 00:15:29.196 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:29.196 rtt min/avg/max/mdev = 0.033/0.033/0.033/0.000 ms 00:15:29.196 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@225 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.2 00:15:29.196 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:29.196 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.061 ms 00:15:29.196 00:15:29.196 --- 10.0.0.2 ping statistics --- 00:15:29.196 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:29.196 rtt min/avg/max/mdev = 0.061/0.061/0.061/0.000 ms 00:15:29.196 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@227 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:29.196 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@459 -- # return 0 00:15:29.196 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:15:29.196 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:29.196 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:15:29.196 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:15:29.196 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:29.196 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:15:29.196 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:15:29.196 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@64 -- # nvmfappstart -m 0x2 --wait-for-rpc 00:15:29.196 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:15:29.196 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@724 -- # xtrace_disable 00:15:29.196 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:15:29.196 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@507 -- # nvmfpid=83182 00:15:29.196 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@506 -- # ip netns exec nvmf_tgt_ns_spdk /home/vagrant/spdk_repo/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 --wait-for-rpc 00:15:29.196 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@508 -- # waitforlisten 83182 00:15:29.196 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@831 -- # '[' -z 83182 ']' 00:15:29.196 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:29.196 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@836 -- # local max_retries=100 00:15:29.196 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:29.196 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:29.196 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@840 -- # xtrace_disable 00:15:29.196 11:26:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:15:29.196 [2024-10-07 11:26:10.899606] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:15:29.196 [2024-10-07 11:26:10.899788] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:29.454 [2024-10-07 11:26:11.047391] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:29.712 [2024-10-07 11:26:11.210284] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:29.712 [2024-10-07 11:26:11.210354] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:29.712 [2024-10-07 11:26:11.210369] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:15:29.712 [2024-10-07 11:26:11.210380] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:15:29.712 [2024-10-07 11:26:11.210390] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:29.712 [2024-10-07 11:26:11.210928] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:15:30.648 11:26:11 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:15:30.648 11:26:11 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@864 -- # return 0 00:15:30.648 11:26:11 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:15:30.648 11:26:11 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@730 -- # xtrace_disable 00:15:30.648 11:26:11 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:15:30.648 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:30.648 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@66 -- # '[' tcp '!=' tcp ']' 00:15:30.648 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@71 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py sock_set_default_impl -i ssl 00:15:30.907 true 00:15:30.907 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@74 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:15:30.907 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@74 -- # jq -r .tls_version 00:15:31.166 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@74 -- # version=0 00:15:31.166 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@75 -- # [[ 0 != \0 ]] 00:15:31.166 11:26:12 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@81 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 13 00:15:31.423 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@82 -- # jq -r .tls_version 00:15:31.423 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@82 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:15:31.681 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@82 -- # version=13 00:15:31.681 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@83 -- # [[ 13 != \1\3 ]] 00:15:31.681 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@89 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 7 00:15:32.249 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@90 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:15:32.249 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@90 -- # jq -r .tls_version 00:15:32.507 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@90 -- # version=7 00:15:32.507 11:26:13 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@91 -- # [[ 7 != \7 ]] 00:15:32.507 11:26:14 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@97 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:15:32.507 11:26:14 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@97 -- # jq -r .enable_ktls 00:15:32.765 11:26:14 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@97 -- # ktls=false 00:15:32.765 11:26:14 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@98 -- # [[ false != \f\a\l\s\e ]] 00:15:32.765 11:26:14 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@104 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py sock_impl_set_options -i ssl --enable-ktls 00:15:33.022 11:26:14 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@105 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:15:33.022 11:26:14 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@105 -- # jq -r .enable_ktls 00:15:33.587 11:26:15 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@105 -- # ktls=true 00:15:33.587 11:26:15 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@106 -- # [[ true != \t\r\u\e ]] 00:15:33.587 11:26:15 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@112 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py sock_impl_set_options -i ssl --disable-ktls 00:15:33.845 11:26:15 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@113 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:15:33.845 11:26:15 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@113 -- # jq -r .enable_ktls 00:15:34.103 11:26:15 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@113 -- # ktls=false 00:15:34.103 11:26:15 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@114 -- # [[ false != \f\a\l\s\e ]] 00:15:34.103 11:26:15 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@119 -- # format_interchange_psk 00112233445566778899aabbccddeeff 1 00:15:34.103 11:26:15 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@741 -- # format_key NVMeTLSkey-1 00112233445566778899aabbccddeeff 1 00:15:34.103 11:26:15 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@728 -- # local prefix key digest 00:15:34.103 11:26:15 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@730 -- # prefix=NVMeTLSkey-1 00:15:34.103 11:26:15 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@730 -- # key=00112233445566778899aabbccddeeff 00:15:34.103 11:26:15 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@730 -- # digest=1 00:15:34.103 11:26:15 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@731 -- # python - 00:15:34.103 11:26:15 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@119 -- # key=NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:15:34.103 11:26:15 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@120 -- # format_interchange_psk ffeeddccbbaa99887766554433221100 1 00:15:34.103 11:26:15 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@741 -- # format_key NVMeTLSkey-1 ffeeddccbbaa99887766554433221100 1 00:15:34.103 11:26:15 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@728 -- # local prefix key digest 00:15:34.103 11:26:15 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@730 -- # prefix=NVMeTLSkey-1 00:15:34.103 11:26:15 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@730 -- # key=ffeeddccbbaa99887766554433221100 00:15:34.103 11:26:15 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@730 -- # digest=1 00:15:34.103 11:26:15 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@731 -- # python - 00:15:34.361 11:26:15 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@120 -- # key_2=NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:15:34.361 11:26:15 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@122 -- # mktemp 00:15:34.361 11:26:15 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@122 -- # key_path=/tmp/tmp.V7HBwO5RcH 00:15:34.361 11:26:15 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@123 -- # mktemp 00:15:34.361 11:26:15 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@123 -- # key_2_path=/tmp/tmp.fabY5wQYeq 00:15:34.361 11:26:15 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@125 -- # echo -n NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:15:34.361 11:26:15 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@126 -- # echo -n NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:15:34.361 11:26:15 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@128 -- # chmod 0600 /tmp/tmp.V7HBwO5RcH 00:15:34.361 11:26:15 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@129 -- # chmod 0600 /tmp/tmp.fabY5wQYeq 00:15:34.361 11:26:15 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@131 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 13 00:15:34.618 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@132 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py framework_start_init 00:15:34.876 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@134 -- # setup_nvmf_tgt /tmp/tmp.V7HBwO5RcH 00:15:34.876 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@50 -- # local key=/tmp/tmp.V7HBwO5RcH 00:15:34.876 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@52 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:15:35.442 [2024-10-07 11:26:16.879769] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:15:35.442 11:26:16 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@53 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:15:35.699 11:26:17 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@54 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4420 -k 00:15:35.957 [2024-10-07 11:26:17.475900] tcp.c:1031:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:15:35.957 [2024-10-07 11:26:17.476182] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:15:35.957 11:26:17 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@56 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:15:36.229 malloc0 00:15:36.229 11:26:17 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@57 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:15:36.487 11:26:18 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@58 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py keyring_file_add_key key0 /tmp/tmp.V7HBwO5RcH 00:15:37.051 11:26:18 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@59 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk key0 00:15:37.309 11:26:18 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@138 -- # ip netns exec nvmf_tgt_ns_spdk /home/vagrant/spdk_repo/spdk/build/bin/spdk_nvme_perf -S ssl -q 64 -o 4096 -w randrw -M 30 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.3 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 hostnqn:nqn.2016-06.io.spdk:host1' --psk-path /tmp/tmp.V7HBwO5RcH 00:15:49.522 Initializing NVMe Controllers 00:15:49.522 Attached to NVMe over Fabrics controller at 10.0.0.3:4420: nqn.2016-06.io.spdk:cnode1 00:15:49.522 Associating TCP (addr:10.0.0.3 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:15:49.522 Initialization complete. Launching workers. 00:15:49.522 ======================================================== 00:15:49.522 Latency(us) 00:15:49.522 Device Information : IOPS MiB/s Average min max 00:15:49.522 TCP (addr:10.0.0.3 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 9243.79 36.11 6925.06 2591.80 13120.91 00:15:49.522 ======================================================== 00:15:49.522 Total : 9243.79 36.11 6925.06 2591.80 13120.91 00:15:49.522 00:15:49.523 11:26:29 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@144 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /tmp/tmp.V7HBwO5RcH 00:15:49.523 11:26:29 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:15:49.523 11:26:29 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:15:49.523 11:26:29 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:15:49.523 11:26:29 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@23 -- # psk=/tmp/tmp.V7HBwO5RcH 00:15:49.523 11:26:29 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:15:49.523 11:26:29 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@28 -- # bdevperf_pid=83572 00:15:49.523 11:26:29 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@27 -- # /home/vagrant/spdk_repo/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:15:49.523 11:26:29 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:15:49.523 11:26:29 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@31 -- # waitforlisten 83572 /var/tmp/bdevperf.sock 00:15:49.523 11:26:29 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@831 -- # '[' -z 83572 ']' 00:15:49.523 11:26:29 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:15:49.523 11:26:29 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@836 -- # local max_retries=100 00:15:49.523 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:15:49.523 11:26:29 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:15:49.523 11:26:29 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@840 -- # xtrace_disable 00:15:49.523 11:26:29 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:15:49.523 [2024-10-07 11:26:29.076430] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:15:49.523 [2024-10-07 11:26:29.076546] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid83572 ] 00:15:49.523 [2024-10-07 11:26:29.215245] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:49.523 [2024-10-07 11:26:29.382057] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:15:49.523 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:15:49.523 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@864 -- # return 0 00:15:49.523 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@33 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock keyring_file_add_key key0 /tmp/tmp.V7HBwO5RcH 00:15:49.523 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@35 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.3 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk key0 00:15:49.523 [2024-10-07 11:26:30.763966] bdev_nvme_rpc.c: 514:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:15:49.523 TLSTESTn1 00:15:49.523 11:26:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@42 -- # /home/vagrant/spdk_repo/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:15:49.523 Running I/O for 10 seconds... 00:15:51.394 3968.00 IOPS, 15.50 MiB/s [2024-10-07T11:26:34.039Z] 3952.00 IOPS, 15.44 MiB/s [2024-10-07T11:26:35.413Z] 4000.67 IOPS, 15.63 MiB/s [2024-10-07T11:26:36.347Z] 4025.25 IOPS, 15.72 MiB/s [2024-10-07T11:26:37.281Z] 4038.60 IOPS, 15.78 MiB/s [2024-10-07T11:26:38.214Z] 4046.67 IOPS, 15.81 MiB/s [2024-10-07T11:26:39.179Z] 4051.86 IOPS, 15.83 MiB/s [2024-10-07T11:26:40.115Z] 4057.12 IOPS, 15.85 MiB/s [2024-10-07T11:26:41.049Z] 4063.22 IOPS, 15.87 MiB/s [2024-10-07T11:26:41.049Z] 4067.80 IOPS, 15.89 MiB/s 00:15:59.338 Latency(us) 00:15:59.338 [2024-10-07T11:26:41.049Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:59.338 Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:15:59.338 Verification LBA range: start 0x0 length 0x2000 00:15:59.338 TLSTESTn1 : 10.02 4073.17 15.91 0.00 0.00 31365.07 6583.39 36223.53 00:15:59.338 [2024-10-07T11:26:41.049Z] =================================================================================================================== 00:15:59.338 [2024-10-07T11:26:41.049Z] Total : 4073.17 15.91 0.00 0.00 31365.07 6583.39 36223.53 00:15:59.338 { 00:15:59.338 "results": [ 00:15:59.338 { 00:15:59.338 "job": "TLSTESTn1", 00:15:59.338 "core_mask": "0x4", 00:15:59.338 "workload": "verify", 00:15:59.338 "status": "finished", 00:15:59.338 "verify_range": { 00:15:59.338 "start": 0, 00:15:59.338 "length": 8192 00:15:59.338 }, 00:15:59.338 "queue_depth": 128, 00:15:59.338 "io_size": 4096, 00:15:59.338 "runtime": 10.017987, 00:15:59.338 "iops": 4073.173582676839, 00:15:59.338 "mibps": 15.910834307331402, 00:15:59.338 "io_failed": 0, 00:15:59.338 "io_timeout": 0, 00:15:59.338 "avg_latency_us": 31365.069969767523, 00:15:59.338 "min_latency_us": 6583.389090909091, 00:15:59.338 "max_latency_us": 36223.534545454546 00:15:59.338 } 00:15:59.338 ], 00:15:59.338 "core_count": 1 00:15:59.338 } 00:15:59.338 11:26:41 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@45 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:15:59.338 11:26:41 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@46 -- # killprocess 83572 00:15:59.338 11:26:41 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@950 -- # '[' -z 83572 ']' 00:15:59.338 11:26:41 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@954 -- # kill -0 83572 00:15:59.338 11:26:41 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # uname 00:15:59.338 11:26:41 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:15:59.338 11:26:41 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 83572 00:15:59.597 killing process with pid 83572 00:15:59.597 Received shutdown signal, test time was about 10.000000 seconds 00:15:59.597 00:15:59.597 Latency(us) 00:15:59.597 [2024-10-07T11:26:41.308Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:59.597 [2024-10-07T11:26:41.308Z] =================================================================================================================== 00:15:59.597 [2024-10-07T11:26:41.308Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:15:59.597 11:26:41 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # process_name=reactor_2 00:15:59.597 11:26:41 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@960 -- # '[' reactor_2 = sudo ']' 00:15:59.597 11:26:41 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@968 -- # echo 'killing process with pid 83572' 00:15:59.597 11:26:41 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@969 -- # kill 83572 00:15:59.597 11:26:41 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@974 -- # wait 83572 00:15:59.855 11:26:41 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@147 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /tmp/tmp.fabY5wQYeq 00:15:59.855 11:26:41 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@650 -- # local es=0 00:15:59.855 11:26:41 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /tmp/tmp.fabY5wQYeq 00:15:59.855 11:26:41 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:15:59.855 11:26:41 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:59.855 11:26:41 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:15:59.855 11:26:41 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:59.855 11:26:41 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /tmp/tmp.fabY5wQYeq 00:15:59.855 11:26:41 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:15:59.855 11:26:41 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:15:59.855 11:26:41 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:15:59.855 11:26:41 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@23 -- # psk=/tmp/tmp.fabY5wQYeq 00:15:59.855 11:26:41 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:15:59.855 11:26:41 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@27 -- # /home/vagrant/spdk_repo/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:15:59.855 11:26:41 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@28 -- # bdevperf_pid=83743 00:15:59.855 11:26:41 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:15:59.855 11:26:41 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@31 -- # waitforlisten 83743 /var/tmp/bdevperf.sock 00:15:59.855 11:26:41 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@831 -- # '[' -z 83743 ']' 00:15:59.855 11:26:41 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:15:59.855 11:26:41 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@836 -- # local max_retries=100 00:15:59.855 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:15:59.855 11:26:41 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:15:59.855 11:26:41 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@840 -- # xtrace_disable 00:15:59.855 11:26:41 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:15:59.855 [2024-10-07 11:26:41.444366] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:15:59.855 [2024-10-07 11:26:41.444805] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid83743 ] 00:16:00.114 [2024-10-07 11:26:41.578392] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:00.114 [2024-10-07 11:26:41.727343] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:16:01.048 11:26:42 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:16:01.048 11:26:42 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@864 -- # return 0 00:16:01.048 11:26:42 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@33 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock keyring_file_add_key key0 /tmp/tmp.fabY5wQYeq 00:16:01.376 11:26:42 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@35 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.3 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk key0 00:16:01.636 [2024-10-07 11:26:43.176475] bdev_nvme_rpc.c: 514:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:16:01.636 [2024-10-07 11:26:43.186016] /home/vagrant/spdk_repo/spdk/include/spdk_internal/nvme_tcp.h: 421:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:16:01.636 [2024-10-07 11:26:43.186337] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2273b80 (107): Transport endpoint is not connected 00:16:01.636 [2024-10-07 11:26:43.187326] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2273b80 (9): Bad file descriptor 00:16:01.636 [2024-10-07 11:26:43.188322] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:16:01.636 [2024-10-07 11:26:43.188347] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.3 00:16:01.636 [2024-10-07 11:26:43.188359] nvme.c: 884:nvme_dummy_attach_fail_cb: *ERROR*: Failed to attach nvme ctrlr: trtype=TCP adrfam=IPv4 traddr=10.0.0.3 trsvcid=4420 subnqn=nqn.2016-06.io.spdk:cnode1, Operation not permitted 00:16:01.636 [2024-10-07 11:26:43.188371] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:16:01.636 2024/10/07 11:26:43 error on JSON-RPC call, method: bdev_nvme_attach_controller, params: map[adrfam:ipv4 allow_unrecognized_csi:%!s(bool=false) ddgst:%!s(bool=false) hdgst:%!s(bool=false) hostnqn:nqn.2016-06.io.spdk:host1 name:TLSTEST prchk_guard:%!s(bool=false) prchk_reftag:%!s(bool=false) psk:key0 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.3 trsvcid:4420 trtype:tcp], err: error received for bdev_nvme_attach_controller method, err: Code=-5 Msg=Input/output error 00:16:01.636 request: 00:16:01.636 { 00:16:01.636 "method": "bdev_nvme_attach_controller", 00:16:01.636 "params": { 00:16:01.636 "name": "TLSTEST", 00:16:01.636 "trtype": "tcp", 00:16:01.636 "traddr": "10.0.0.3", 00:16:01.636 "adrfam": "ipv4", 00:16:01.636 "trsvcid": "4420", 00:16:01.636 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:16:01.636 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:16:01.636 "prchk_reftag": false, 00:16:01.636 "prchk_guard": false, 00:16:01.636 "hdgst": false, 00:16:01.636 "ddgst": false, 00:16:01.636 "psk": "key0", 00:16:01.636 "allow_unrecognized_csi": false 00:16:01.636 } 00:16:01.636 } 00:16:01.636 Got JSON-RPC error response 00:16:01.636 GoRPCClient: error on JSON-RPC call 00:16:01.636 11:26:43 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@37 -- # killprocess 83743 00:16:01.636 11:26:43 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@950 -- # '[' -z 83743 ']' 00:16:01.636 11:26:43 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@954 -- # kill -0 83743 00:16:01.636 11:26:43 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # uname 00:16:01.636 11:26:43 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:16:01.636 11:26:43 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 83743 00:16:01.636 killing process with pid 83743 00:16:01.636 Received shutdown signal, test time was about 10.000000 seconds 00:16:01.636 00:16:01.636 Latency(us) 00:16:01.636 [2024-10-07T11:26:43.347Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:16:01.636 [2024-10-07T11:26:43.347Z] =================================================================================================================== 00:16:01.636 [2024-10-07T11:26:43.347Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:16:01.636 11:26:43 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # process_name=reactor_2 00:16:01.636 11:26:43 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@960 -- # '[' reactor_2 = sudo ']' 00:16:01.636 11:26:43 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@968 -- # echo 'killing process with pid 83743' 00:16:01.636 11:26:43 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@969 -- # kill 83743 00:16:01.636 11:26:43 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@974 -- # wait 83743 00:16:01.894 11:26:43 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@38 -- # return 1 00:16:01.895 11:26:43 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@653 -- # es=1 00:16:01.895 11:26:43 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:16:01.895 11:26:43 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:16:01.895 11:26:43 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:16:01.895 11:26:43 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@150 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /tmp/tmp.V7HBwO5RcH 00:16:01.895 11:26:43 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@650 -- # local es=0 00:16:01.895 11:26:43 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /tmp/tmp.V7HBwO5RcH 00:16:01.895 11:26:43 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:16:01.895 11:26:43 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:16:01.895 11:26:43 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:16:01.895 11:26:43 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:16:01.895 11:26:43 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /tmp/tmp.V7HBwO5RcH 00:16:01.895 11:26:43 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:16:01.895 11:26:43 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:16:01.895 11:26:43 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host2 00:16:01.895 11:26:43 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@23 -- # psk=/tmp/tmp.V7HBwO5RcH 00:16:01.895 11:26:43 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:16:01.895 11:26:43 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@27 -- # /home/vagrant/spdk_repo/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:16:01.895 11:26:43 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@28 -- # bdevperf_pid=83800 00:16:01.895 11:26:43 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:16:01.895 11:26:43 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@31 -- # waitforlisten 83800 /var/tmp/bdevperf.sock 00:16:01.895 11:26:43 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@831 -- # '[' -z 83800 ']' 00:16:01.895 11:26:43 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:16:01.895 11:26:43 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@836 -- # local max_retries=100 00:16:01.895 11:26:43 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:16:01.895 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:16:01.895 11:26:43 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@840 -- # xtrace_disable 00:16:01.895 11:26:43 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:16:02.153 [2024-10-07 11:26:43.619265] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:16:02.153 [2024-10-07 11:26:43.619380] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid83800 ] 00:16:02.153 [2024-10-07 11:26:43.751404] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:02.411 [2024-10-07 11:26:43.902626] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:16:02.978 11:26:44 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:16:02.978 11:26:44 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@864 -- # return 0 00:16:02.978 11:26:44 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@33 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock keyring_file_add_key key0 /tmp/tmp.V7HBwO5RcH 00:16:03.236 11:26:44 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@35 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.3 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host2 --psk key0 00:16:03.495 [2024-10-07 11:26:45.184204] bdev_nvme_rpc.c: 514:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:16:03.495 [2024-10-07 11:26:45.196374] tcp.c: 969:tcp_sock_get_key: *ERROR*: Could not find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host2 nqn.2016-06.io.spdk:cnode1 00:16:03.495 [2024-10-07 11:26:45.196449] posix.c: 574:posix_sock_psk_find_session_server_cb: *ERROR*: Unable to find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host2 nqn.2016-06.io.spdk:cnode1 00:16:03.495 [2024-10-07 11:26:45.196511] /home/vagrant/spdk_repo/spdk/include/spdk_internal/nvme_tcp.h: 421:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:16:03.495 [2024-10-07 11:26:45.197102] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1908b80 (107): Transport endpoint is not connected 00:16:03.495 [2024-10-07 11:26:45.198091] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1908b80 (9): Bad file descriptor 00:16:03.495 [2024-10-07 11:26:45.199087] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:16:03.495 [2024-10-07 11:26:45.199110] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.3 00:16:03.495 [2024-10-07 11:26:45.199121] nvme.c: 884:nvme_dummy_attach_fail_cb: *ERROR*: Failed to attach nvme ctrlr: trtype=TCP adrfam=IPv4 traddr=10.0.0.3 trsvcid=4420 subnqn=nqn.2016-06.io.spdk:cnode1, Operation not permitted 00:16:03.495 [2024-10-07 11:26:45.199140] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:16:03.495 2024/10/07 11:26:45 error on JSON-RPC call, method: bdev_nvme_attach_controller, params: map[adrfam:ipv4 allow_unrecognized_csi:%!s(bool=false) ddgst:%!s(bool=false) hdgst:%!s(bool=false) hostnqn:nqn.2016-06.io.spdk:host2 name:TLSTEST prchk_guard:%!s(bool=false) prchk_reftag:%!s(bool=false) psk:key0 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.3 trsvcid:4420 trtype:tcp], err: error received for bdev_nvme_attach_controller method, err: Code=-5 Msg=Input/output error 00:16:03.495 request: 00:16:03.495 { 00:16:03.495 "method": "bdev_nvme_attach_controller", 00:16:03.495 "params": { 00:16:03.495 "name": "TLSTEST", 00:16:03.495 "trtype": "tcp", 00:16:03.495 "traddr": "10.0.0.3", 00:16:03.495 "adrfam": "ipv4", 00:16:03.495 "trsvcid": "4420", 00:16:03.495 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:16:03.495 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:16:03.495 "prchk_reftag": false, 00:16:03.495 "prchk_guard": false, 00:16:03.495 "hdgst": false, 00:16:03.495 "ddgst": false, 00:16:03.495 "psk": "key0", 00:16:03.495 "allow_unrecognized_csi": false 00:16:03.495 } 00:16:03.495 } 00:16:03.495 Got JSON-RPC error response 00:16:03.495 GoRPCClient: error on JSON-RPC call 00:16:03.753 11:26:45 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@37 -- # killprocess 83800 00:16:03.753 11:26:45 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@950 -- # '[' -z 83800 ']' 00:16:03.753 11:26:45 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@954 -- # kill -0 83800 00:16:03.753 11:26:45 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # uname 00:16:03.753 11:26:45 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:16:03.753 11:26:45 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 83800 00:16:03.753 killing process with pid 83800 00:16:03.753 Received shutdown signal, test time was about 10.000000 seconds 00:16:03.753 00:16:03.753 Latency(us) 00:16:03.753 [2024-10-07T11:26:45.464Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:16:03.753 [2024-10-07T11:26:45.464Z] =================================================================================================================== 00:16:03.753 [2024-10-07T11:26:45.464Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:16:03.753 11:26:45 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # process_name=reactor_2 00:16:03.753 11:26:45 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@960 -- # '[' reactor_2 = sudo ']' 00:16:03.753 11:26:45 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@968 -- # echo 'killing process with pid 83800' 00:16:03.753 11:26:45 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@969 -- # kill 83800 00:16:03.753 11:26:45 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@974 -- # wait 83800 00:16:04.012 11:26:45 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@38 -- # return 1 00:16:04.012 11:26:45 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@653 -- # es=1 00:16:04.012 11:26:45 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:16:04.012 11:26:45 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:16:04.012 11:26:45 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:16:04.012 11:26:45 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@153 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /tmp/tmp.V7HBwO5RcH 00:16:04.012 11:26:45 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@650 -- # local es=0 00:16:04.012 11:26:45 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /tmp/tmp.V7HBwO5RcH 00:16:04.012 11:26:45 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:16:04.012 11:26:45 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:16:04.012 11:26:45 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:16:04.012 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:16:04.012 11:26:45 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:16:04.012 11:26:45 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /tmp/tmp.V7HBwO5RcH 00:16:04.012 11:26:45 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:16:04.012 11:26:45 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode2 00:16:04.012 11:26:45 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:16:04.012 11:26:45 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@23 -- # psk=/tmp/tmp.V7HBwO5RcH 00:16:04.012 11:26:45 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:16:04.012 11:26:45 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@28 -- # bdevperf_pid=83855 00:16:04.012 11:26:45 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:16:04.012 11:26:45 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@31 -- # waitforlisten 83855 /var/tmp/bdevperf.sock 00:16:04.012 11:26:45 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@27 -- # /home/vagrant/spdk_repo/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:16:04.012 11:26:45 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@831 -- # '[' -z 83855 ']' 00:16:04.012 11:26:45 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:16:04.012 11:26:45 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@836 -- # local max_retries=100 00:16:04.012 11:26:45 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:16:04.012 11:26:45 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@840 -- # xtrace_disable 00:16:04.012 11:26:45 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:16:04.012 [2024-10-07 11:26:45.648757] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:16:04.012 [2024-10-07 11:26:45.649248] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid83855 ] 00:16:04.270 [2024-10-07 11:26:45.794008] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:04.270 [2024-10-07 11:26:45.941887] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:16:05.203 11:26:46 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:16:05.203 11:26:46 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@864 -- # return 0 00:16:05.203 11:26:46 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@33 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock keyring_file_add_key key0 /tmp/tmp.V7HBwO5RcH 00:16:05.460 11:26:46 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@35 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.3 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -q nqn.2016-06.io.spdk:host1 --psk key0 00:16:05.717 [2024-10-07 11:26:47.213566] bdev_nvme_rpc.c: 514:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:16:05.717 [2024-10-07 11:26:47.218831] tcp.c: 969:tcp_sock_get_key: *ERROR*: Could not find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host1 nqn.2016-06.io.spdk:cnode2 00:16:05.717 [2024-10-07 11:26:47.218887] posix.c: 574:posix_sock_psk_find_session_server_cb: *ERROR*: Unable to find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host1 nqn.2016-06.io.spdk:cnode2 00:16:05.717 [2024-10-07 11:26:47.218943] /home/vagrant/spdk_repo/spdk/include/spdk_internal/nvme_tcp.h: 421:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:16:05.717 [2024-10-07 11:26:47.219508] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b0db80 (107): Transport endpoint is not connected 00:16:05.717 [2024-10-07 11:26:47.220494] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b0db80 (9): Bad file descriptor 00:16:05.717 [2024-10-07 11:26:47.221494] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:16:05.718 [2024-10-07 11:26:47.221521] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.3 00:16:05.718 [2024-10-07 11:26:47.221534] nvme.c: 884:nvme_dummy_attach_fail_cb: *ERROR*: Failed to attach nvme ctrlr: trtype=TCP adrfam=IPv4 traddr=10.0.0.3 trsvcid=4420 subnqn=nqn.2016-06.io.spdk:cnode2, Operation not permitted 00:16:05.718 [2024-10-07 11:26:47.221546] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:16:05.718 2024/10/07 11:26:47 error on JSON-RPC call, method: bdev_nvme_attach_controller, params: map[adrfam:ipv4 allow_unrecognized_csi:%!s(bool=false) ddgst:%!s(bool=false) hdgst:%!s(bool=false) hostnqn:nqn.2016-06.io.spdk:host1 name:TLSTEST prchk_guard:%!s(bool=false) prchk_reftag:%!s(bool=false) psk:key0 subnqn:nqn.2016-06.io.spdk:cnode2 traddr:10.0.0.3 trsvcid:4420 trtype:tcp], err: error received for bdev_nvme_attach_controller method, err: Code=-5 Msg=Input/output error 00:16:05.718 request: 00:16:05.718 { 00:16:05.718 "method": "bdev_nvme_attach_controller", 00:16:05.718 "params": { 00:16:05.718 "name": "TLSTEST", 00:16:05.718 "trtype": "tcp", 00:16:05.718 "traddr": "10.0.0.3", 00:16:05.718 "adrfam": "ipv4", 00:16:05.718 "trsvcid": "4420", 00:16:05.718 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:16:05.718 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:16:05.718 "prchk_reftag": false, 00:16:05.718 "prchk_guard": false, 00:16:05.718 "hdgst": false, 00:16:05.718 "ddgst": false, 00:16:05.718 "psk": "key0", 00:16:05.718 "allow_unrecognized_csi": false 00:16:05.718 } 00:16:05.718 } 00:16:05.718 Got JSON-RPC error response 00:16:05.718 GoRPCClient: error on JSON-RPC call 00:16:05.718 11:26:47 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@37 -- # killprocess 83855 00:16:05.718 11:26:47 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@950 -- # '[' -z 83855 ']' 00:16:05.718 11:26:47 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@954 -- # kill -0 83855 00:16:05.718 11:26:47 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # uname 00:16:05.718 11:26:47 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:16:05.718 11:26:47 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 83855 00:16:05.718 killing process with pid 83855 00:16:05.718 Received shutdown signal, test time was about 10.000000 seconds 00:16:05.718 00:16:05.718 Latency(us) 00:16:05.718 [2024-10-07T11:26:47.429Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:16:05.718 [2024-10-07T11:26:47.429Z] =================================================================================================================== 00:16:05.718 [2024-10-07T11:26:47.429Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:16:05.718 11:26:47 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # process_name=reactor_2 00:16:05.718 11:26:47 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@960 -- # '[' reactor_2 = sudo ']' 00:16:05.718 11:26:47 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@968 -- # echo 'killing process with pid 83855' 00:16:05.718 11:26:47 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@969 -- # kill 83855 00:16:05.718 11:26:47 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@974 -- # wait 83855 00:16:05.976 11:26:47 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@38 -- # return 1 00:16:05.976 11:26:47 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@653 -- # es=1 00:16:05.976 11:26:47 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:16:05.976 11:26:47 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:16:05.976 11:26:47 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:16:05.976 11:26:47 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@156 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:16:05.976 11:26:47 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@650 -- # local es=0 00:16:05.976 11:26:47 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:16:05.976 11:26:47 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:16:05.976 11:26:47 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:16:05.976 11:26:47 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:16:05.976 11:26:47 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:16:05.976 11:26:47 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:16:05.976 11:26:47 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:16:05.976 11:26:47 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:16:05.976 11:26:47 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:16:05.976 11:26:47 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@23 -- # psk= 00:16:05.976 11:26:47 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:16:05.976 11:26:47 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@28 -- # bdevperf_pid=83913 00:16:05.976 11:26:47 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@27 -- # /home/vagrant/spdk_repo/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:16:05.976 11:26:47 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:16:05.976 11:26:47 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@31 -- # waitforlisten 83913 /var/tmp/bdevperf.sock 00:16:05.976 11:26:47 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@831 -- # '[' -z 83913 ']' 00:16:05.976 11:26:47 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:16:05.977 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:16:05.977 11:26:47 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@836 -- # local max_retries=100 00:16:05.977 11:26:47 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:16:05.977 11:26:47 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@840 -- # xtrace_disable 00:16:05.977 11:26:47 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:16:05.977 [2024-10-07 11:26:47.665776] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:16:05.977 [2024-10-07 11:26:47.666636] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid83913 ] 00:16:06.235 [2024-10-07 11:26:47.802177] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:06.493 [2024-10-07 11:26:47.951984] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:16:07.069 11:26:48 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:16:07.069 11:26:48 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@864 -- # return 0 00:16:07.069 11:26:48 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@33 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock keyring_file_add_key key0 '' 00:16:07.326 [2024-10-07 11:26:48.912677] keyring.c: 24:keyring_file_check_path: *ERROR*: Non-absolute paths are not allowed: 00:16:07.326 [2024-10-07 11:26:48.912736] keyring.c: 126:spdk_keyring_add_key: *ERROR*: Failed to add key 'key0' to the keyring 00:16:07.326 2024/10/07 11:26:48 error on JSON-RPC call, method: keyring_file_add_key, params: map[name:key0 path:], err: error received for keyring_file_add_key method, err: Code=-1 Msg=Operation not permitted 00:16:07.326 request: 00:16:07.326 { 00:16:07.326 "method": "keyring_file_add_key", 00:16:07.326 "params": { 00:16:07.326 "name": "key0", 00:16:07.326 "path": "" 00:16:07.326 } 00:16:07.326 } 00:16:07.326 Got JSON-RPC error response 00:16:07.326 GoRPCClient: error on JSON-RPC call 00:16:07.326 11:26:48 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@35 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.3 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk key0 00:16:07.584 [2024-10-07 11:26:49.180863] bdev_nvme_rpc.c: 514:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:16:07.584 [2024-10-07 11:26:49.180940] bdev_nvme.c:6391:spdk_bdev_nvme_create: *ERROR*: Could not load PSK: key0 00:16:07.584 2024/10/07 11:26:49 error on JSON-RPC call, method: bdev_nvme_attach_controller, params: map[adrfam:ipv4 allow_unrecognized_csi:%!s(bool=false) ddgst:%!s(bool=false) hdgst:%!s(bool=false) hostnqn:nqn.2016-06.io.spdk:host1 name:TLSTEST prchk_guard:%!s(bool=false) prchk_reftag:%!s(bool=false) psk:key0 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.3 trsvcid:4420 trtype:tcp], err: error received for bdev_nvme_attach_controller method, err: Code=-126 Msg=Required key not available 00:16:07.584 request: 00:16:07.584 { 00:16:07.584 "method": "bdev_nvme_attach_controller", 00:16:07.584 "params": { 00:16:07.584 "name": "TLSTEST", 00:16:07.584 "trtype": "tcp", 00:16:07.584 "traddr": "10.0.0.3", 00:16:07.584 "adrfam": "ipv4", 00:16:07.584 "trsvcid": "4420", 00:16:07.584 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:16:07.584 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:16:07.584 "prchk_reftag": false, 00:16:07.584 "prchk_guard": false, 00:16:07.584 "hdgst": false, 00:16:07.584 "ddgst": false, 00:16:07.584 "psk": "key0", 00:16:07.584 "allow_unrecognized_csi": false 00:16:07.584 } 00:16:07.584 } 00:16:07.584 Got JSON-RPC error response 00:16:07.584 GoRPCClient: error on JSON-RPC call 00:16:07.584 11:26:49 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@37 -- # killprocess 83913 00:16:07.584 11:26:49 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@950 -- # '[' -z 83913 ']' 00:16:07.584 11:26:49 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@954 -- # kill -0 83913 00:16:07.584 11:26:49 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # uname 00:16:07.584 11:26:49 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:16:07.584 11:26:49 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 83913 00:16:07.585 11:26:49 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # process_name=reactor_2 00:16:07.585 11:26:49 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@960 -- # '[' reactor_2 = sudo ']' 00:16:07.585 killing process with pid 83913 00:16:07.585 11:26:49 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@968 -- # echo 'killing process with pid 83913' 00:16:07.585 Received shutdown signal, test time was about 10.000000 seconds 00:16:07.585 00:16:07.585 Latency(us) 00:16:07.585 [2024-10-07T11:26:49.296Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:16:07.585 [2024-10-07T11:26:49.296Z] =================================================================================================================== 00:16:07.585 [2024-10-07T11:26:49.296Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:16:07.585 11:26:49 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@969 -- # kill 83913 00:16:07.585 11:26:49 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@974 -- # wait 83913 00:16:07.844 11:26:49 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@38 -- # return 1 00:16:07.844 11:26:49 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@653 -- # es=1 00:16:07.844 11:26:49 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:16:07.844 11:26:49 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:16:07.844 11:26:49 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:16:07.844 11:26:49 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@159 -- # killprocess 83182 00:16:07.844 11:26:49 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@950 -- # '[' -z 83182 ']' 00:16:07.844 11:26:49 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@954 -- # kill -0 83182 00:16:07.844 11:26:49 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # uname 00:16:07.844 11:26:49 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:16:07.844 11:26:49 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 83182 00:16:08.109 11:26:49 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # process_name=reactor_1 00:16:08.109 11:26:49 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@960 -- # '[' reactor_1 = sudo ']' 00:16:08.109 killing process with pid 83182 00:16:08.109 11:26:49 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@968 -- # echo 'killing process with pid 83182' 00:16:08.109 11:26:49 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@969 -- # kill 83182 00:16:08.109 11:26:49 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@974 -- # wait 83182 00:16:08.367 11:26:49 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@160 -- # format_interchange_psk 00112233445566778899aabbccddeeff0011223344556677 2 00:16:08.367 11:26:49 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@741 -- # format_key NVMeTLSkey-1 00112233445566778899aabbccddeeff0011223344556677 2 00:16:08.367 11:26:49 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@728 -- # local prefix key digest 00:16:08.367 11:26:49 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@730 -- # prefix=NVMeTLSkey-1 00:16:08.367 11:26:49 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@730 -- # key=00112233445566778899aabbccddeeff0011223344556677 00:16:08.367 11:26:49 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@730 -- # digest=2 00:16:08.367 11:26:49 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@731 -- # python - 00:16:08.367 11:26:49 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@160 -- # key_long=NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:16:08.367 11:26:49 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@161 -- # mktemp 00:16:08.367 11:26:49 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@161 -- # key_long_path=/tmp/tmp.PjWRSOdBbt 00:16:08.367 11:26:49 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@162 -- # echo -n NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:16:08.367 11:26:49 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@163 -- # chmod 0600 /tmp/tmp.PjWRSOdBbt 00:16:08.367 11:26:49 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@164 -- # nvmfappstart -m 0x2 00:16:08.367 11:26:49 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:16:08.367 11:26:49 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@724 -- # xtrace_disable 00:16:08.367 11:26:49 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:16:08.367 11:26:49 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@507 -- # nvmfpid=83983 00:16:08.367 11:26:49 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@506 -- # ip netns exec nvmf_tgt_ns_spdk /home/vagrant/spdk_repo/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:16:08.367 11:26:49 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@508 -- # waitforlisten 83983 00:16:08.367 11:26:49 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@831 -- # '[' -z 83983 ']' 00:16:08.367 11:26:49 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:08.367 11:26:49 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@836 -- # local max_retries=100 00:16:08.367 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:08.367 11:26:49 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:08.367 11:26:49 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@840 -- # xtrace_disable 00:16:08.367 11:26:49 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:16:08.367 [2024-10-07 11:26:50.048183] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:16:08.367 [2024-10-07 11:26:50.048316] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:08.625 [2024-10-07 11:26:50.188307] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:08.625 [2024-10-07 11:26:50.335334] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:08.625 [2024-10-07 11:26:50.335424] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:08.625 [2024-10-07 11:26:50.335438] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:16:08.625 [2024-10-07 11:26:50.335447] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:16:08.625 [2024-10-07 11:26:50.335454] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:08.625 [2024-10-07 11:26:50.335924] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:16:09.560 11:26:51 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:16:09.560 11:26:51 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@864 -- # return 0 00:16:09.560 11:26:51 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:16:09.560 11:26:51 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@730 -- # xtrace_disable 00:16:09.560 11:26:51 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:16:09.560 11:26:51 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:09.560 11:26:51 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@166 -- # setup_nvmf_tgt /tmp/tmp.PjWRSOdBbt 00:16:09.560 11:26:51 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@50 -- # local key=/tmp/tmp.PjWRSOdBbt 00:16:09.560 11:26:51 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@52 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:16:09.817 [2024-10-07 11:26:51.389715] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:16:09.817 11:26:51 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@53 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:16:10.383 11:26:51 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@54 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4420 -k 00:16:10.383 [2024-10-07 11:26:52.045887] tcp.c:1031:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:16:10.383 [2024-10-07 11:26:52.046204] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:16:10.383 11:26:52 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@56 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:16:10.640 malloc0 00:16:10.897 11:26:52 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@57 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:16:11.157 11:26:52 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@58 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py keyring_file_add_key key0 /tmp/tmp.PjWRSOdBbt 00:16:11.422 11:26:52 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@59 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk key0 00:16:11.680 11:26:53 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@168 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /tmp/tmp.PjWRSOdBbt 00:16:11.680 11:26:53 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:16:11.680 11:26:53 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:16:11.680 11:26:53 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:16:11.680 11:26:53 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@23 -- # psk=/tmp/tmp.PjWRSOdBbt 00:16:11.680 11:26:53 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:16:11.680 11:26:53 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@27 -- # /home/vagrant/spdk_repo/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:16:11.680 11:26:53 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@28 -- # bdevperf_pid=84099 00:16:11.680 11:26:53 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:16:11.680 11:26:53 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@31 -- # waitforlisten 84099 /var/tmp/bdevperf.sock 00:16:11.680 11:26:53 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@831 -- # '[' -z 84099 ']' 00:16:11.680 11:26:53 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:16:11.680 11:26:53 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@836 -- # local max_retries=100 00:16:11.680 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:16:11.680 11:26:53 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:16:11.680 11:26:53 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@840 -- # xtrace_disable 00:16:11.680 11:26:53 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:16:11.680 [2024-10-07 11:26:53.242098] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:16:11.680 [2024-10-07 11:26:53.242213] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid84099 ] 00:16:11.680 [2024-10-07 11:26:53.377744] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:11.938 [2024-10-07 11:26:53.538140] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:16:12.871 11:26:54 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:16:12.871 11:26:54 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@864 -- # return 0 00:16:12.871 11:26:54 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@33 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock keyring_file_add_key key0 /tmp/tmp.PjWRSOdBbt 00:16:12.871 11:26:54 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@35 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.3 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk key0 00:16:13.437 [2024-10-07 11:26:54.858067] bdev_nvme_rpc.c: 514:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:16:13.437 TLSTESTn1 00:16:13.437 11:26:54 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@42 -- # /home/vagrant/spdk_repo/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:16:13.437 Running I/O for 10 seconds... 00:16:15.743 3746.00 IOPS, 14.63 MiB/s [2024-10-07T11:26:58.385Z] 3842.00 IOPS, 15.01 MiB/s [2024-10-07T11:26:59.316Z] 3851.00 IOPS, 15.04 MiB/s [2024-10-07T11:27:00.275Z] 3862.25 IOPS, 15.09 MiB/s [2024-10-07T11:27:01.208Z] 3869.00 IOPS, 15.11 MiB/s [2024-10-07T11:27:02.143Z] 3879.83 IOPS, 15.16 MiB/s [2024-10-07T11:27:03.515Z] 3887.00 IOPS, 15.18 MiB/s [2024-10-07T11:27:04.449Z] 3892.50 IOPS, 15.21 MiB/s [2024-10-07T11:27:05.383Z] 3895.22 IOPS, 15.22 MiB/s [2024-10-07T11:27:05.383Z] 3893.00 IOPS, 15.21 MiB/s 00:16:23.672 Latency(us) 00:16:23.672 [2024-10-07T11:27:05.383Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:16:23.672 Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:16:23.672 Verification LBA range: start 0x0 length 0x2000 00:16:23.672 TLSTESTn1 : 10.02 3898.32 15.23 0.00 0.00 32771.94 7268.54 30742.34 00:16:23.672 [2024-10-07T11:27:05.383Z] =================================================================================================================== 00:16:23.672 [2024-10-07T11:27:05.383Z] Total : 3898.32 15.23 0.00 0.00 32771.94 7268.54 30742.34 00:16:23.672 { 00:16:23.672 "results": [ 00:16:23.672 { 00:16:23.672 "job": "TLSTESTn1", 00:16:23.672 "core_mask": "0x4", 00:16:23.672 "workload": "verify", 00:16:23.672 "status": "finished", 00:16:23.672 "verify_range": { 00:16:23.672 "start": 0, 00:16:23.672 "length": 8192 00:16:23.672 }, 00:16:23.672 "queue_depth": 128, 00:16:23.672 "io_size": 4096, 00:16:23.672 "runtime": 10.018932, 00:16:23.672 "iops": 3898.3197011417983, 00:16:23.672 "mibps": 15.22781133258515, 00:16:23.672 "io_failed": 0, 00:16:23.672 "io_timeout": 0, 00:16:23.672 "avg_latency_us": 32771.939768776174, 00:16:23.672 "min_latency_us": 7268.538181818182, 00:16:23.672 "max_latency_us": 30742.34181818182 00:16:23.672 } 00:16:23.672 ], 00:16:23.672 "core_count": 1 00:16:23.672 } 00:16:23.672 11:27:05 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@45 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:16:23.672 11:27:05 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@46 -- # killprocess 84099 00:16:23.672 11:27:05 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@950 -- # '[' -z 84099 ']' 00:16:23.672 11:27:05 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@954 -- # kill -0 84099 00:16:23.672 11:27:05 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # uname 00:16:23.672 11:27:05 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:16:23.672 11:27:05 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 84099 00:16:23.672 11:27:05 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # process_name=reactor_2 00:16:23.672 11:27:05 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@960 -- # '[' reactor_2 = sudo ']' 00:16:23.672 killing process with pid 84099 00:16:23.672 11:27:05 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@968 -- # echo 'killing process with pid 84099' 00:16:23.672 11:27:05 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@969 -- # kill 84099 00:16:23.672 Received shutdown signal, test time was about 10.000000 seconds 00:16:23.672 00:16:23.672 Latency(us) 00:16:23.672 [2024-10-07T11:27:05.383Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:16:23.672 [2024-10-07T11:27:05.383Z] =================================================================================================================== 00:16:23.672 [2024-10-07T11:27:05.383Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:16:23.672 11:27:05 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@974 -- # wait 84099 00:16:23.930 11:27:05 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@171 -- # chmod 0666 /tmp/tmp.PjWRSOdBbt 00:16:23.930 11:27:05 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@172 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /tmp/tmp.PjWRSOdBbt 00:16:23.930 11:27:05 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@650 -- # local es=0 00:16:23.930 11:27:05 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /tmp/tmp.PjWRSOdBbt 00:16:23.930 11:27:05 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:16:23.930 11:27:05 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:16:23.930 11:27:05 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:16:23.930 11:27:05 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:16:23.930 11:27:05 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /tmp/tmp.PjWRSOdBbt 00:16:23.930 11:27:05 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:16:23.930 11:27:05 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:16:23.930 11:27:05 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:16:23.930 11:27:05 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@23 -- # psk=/tmp/tmp.PjWRSOdBbt 00:16:23.930 11:27:05 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:16:23.930 11:27:05 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@28 -- # bdevperf_pid=84259 00:16:23.930 11:27:05 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:16:23.930 11:27:05 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@27 -- # /home/vagrant/spdk_repo/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:16:23.930 11:27:05 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@31 -- # waitforlisten 84259 /var/tmp/bdevperf.sock 00:16:23.930 11:27:05 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@831 -- # '[' -z 84259 ']' 00:16:23.930 11:27:05 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:16:23.930 11:27:05 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@836 -- # local max_retries=100 00:16:23.930 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:16:23.930 11:27:05 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:16:23.930 11:27:05 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@840 -- # xtrace_disable 00:16:23.930 11:27:05 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:16:23.930 [2024-10-07 11:27:05.592807] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:16:23.930 [2024-10-07 11:27:05.593263] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid84259 ] 00:16:24.188 [2024-10-07 11:27:05.743516] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:24.446 [2024-10-07 11:27:05.906119] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:16:25.012 11:27:06 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:16:25.012 11:27:06 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@864 -- # return 0 00:16:25.012 11:27:06 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@33 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock keyring_file_add_key key0 /tmp/tmp.PjWRSOdBbt 00:16:25.270 [2024-10-07 11:27:06.886872] keyring.c: 36:keyring_file_check_path: *ERROR*: Invalid permissions for key file '/tmp/tmp.PjWRSOdBbt': 0100666 00:16:25.270 [2024-10-07 11:27:06.886935] keyring.c: 126:spdk_keyring_add_key: *ERROR*: Failed to add key 'key0' to the keyring 00:16:25.270 2024/10/07 11:27:06 error on JSON-RPC call, method: keyring_file_add_key, params: map[name:key0 path:/tmp/tmp.PjWRSOdBbt], err: error received for keyring_file_add_key method, err: Code=-1 Msg=Operation not permitted 00:16:25.270 request: 00:16:25.270 { 00:16:25.270 "method": "keyring_file_add_key", 00:16:25.270 "params": { 00:16:25.270 "name": "key0", 00:16:25.270 "path": "/tmp/tmp.PjWRSOdBbt" 00:16:25.270 } 00:16:25.270 } 00:16:25.270 Got JSON-RPC error response 00:16:25.270 GoRPCClient: error on JSON-RPC call 00:16:25.270 11:27:06 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@35 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.3 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk key0 00:16:25.528 [2024-10-07 11:27:07.163093] bdev_nvme_rpc.c: 514:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:16:25.528 [2024-10-07 11:27:07.163201] bdev_nvme.c:6391:spdk_bdev_nvme_create: *ERROR*: Could not load PSK: key0 00:16:25.528 2024/10/07 11:27:07 error on JSON-RPC call, method: bdev_nvme_attach_controller, params: map[adrfam:ipv4 allow_unrecognized_csi:%!s(bool=false) ddgst:%!s(bool=false) hdgst:%!s(bool=false) hostnqn:nqn.2016-06.io.spdk:host1 name:TLSTEST prchk_guard:%!s(bool=false) prchk_reftag:%!s(bool=false) psk:key0 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.3 trsvcid:4420 trtype:tcp], err: error received for bdev_nvme_attach_controller method, err: Code=-126 Msg=Required key not available 00:16:25.528 request: 00:16:25.528 { 00:16:25.528 "method": "bdev_nvme_attach_controller", 00:16:25.528 "params": { 00:16:25.528 "name": "TLSTEST", 00:16:25.528 "trtype": "tcp", 00:16:25.528 "traddr": "10.0.0.3", 00:16:25.528 "adrfam": "ipv4", 00:16:25.528 "trsvcid": "4420", 00:16:25.528 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:16:25.528 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:16:25.528 "prchk_reftag": false, 00:16:25.528 "prchk_guard": false, 00:16:25.528 "hdgst": false, 00:16:25.528 "ddgst": false, 00:16:25.528 "psk": "key0", 00:16:25.528 "allow_unrecognized_csi": false 00:16:25.528 } 00:16:25.528 } 00:16:25.528 Got JSON-RPC error response 00:16:25.528 GoRPCClient: error on JSON-RPC call 00:16:25.528 11:27:07 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@37 -- # killprocess 84259 00:16:25.528 11:27:07 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@950 -- # '[' -z 84259 ']' 00:16:25.528 11:27:07 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@954 -- # kill -0 84259 00:16:25.528 11:27:07 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # uname 00:16:25.528 11:27:07 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:16:25.529 11:27:07 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 84259 00:16:25.787 11:27:07 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # process_name=reactor_2 00:16:25.787 11:27:07 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@960 -- # '[' reactor_2 = sudo ']' 00:16:25.787 killing process with pid 84259 00:16:25.787 11:27:07 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@968 -- # echo 'killing process with pid 84259' 00:16:25.787 11:27:07 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@969 -- # kill 84259 00:16:25.787 Received shutdown signal, test time was about 10.000000 seconds 00:16:25.787 00:16:25.787 Latency(us) 00:16:25.787 [2024-10-07T11:27:07.498Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:16:25.787 [2024-10-07T11:27:07.498Z] =================================================================================================================== 00:16:25.787 [2024-10-07T11:27:07.498Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:16:25.787 11:27:07 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@974 -- # wait 84259 00:16:26.045 11:27:07 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@38 -- # return 1 00:16:26.045 11:27:07 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@653 -- # es=1 00:16:26.045 11:27:07 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:16:26.045 11:27:07 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:16:26.045 11:27:07 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:16:26.045 11:27:07 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@175 -- # killprocess 83983 00:16:26.045 11:27:07 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@950 -- # '[' -z 83983 ']' 00:16:26.045 11:27:07 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@954 -- # kill -0 83983 00:16:26.045 11:27:07 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # uname 00:16:26.045 11:27:07 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:16:26.045 11:27:07 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 83983 00:16:26.045 11:27:07 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # process_name=reactor_1 00:16:26.045 11:27:07 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@960 -- # '[' reactor_1 = sudo ']' 00:16:26.045 killing process with pid 83983 00:16:26.045 11:27:07 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@968 -- # echo 'killing process with pid 83983' 00:16:26.045 11:27:07 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@969 -- # kill 83983 00:16:26.045 11:27:07 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@974 -- # wait 83983 00:16:26.303 11:27:07 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@176 -- # nvmfappstart -m 0x2 00:16:26.303 11:27:07 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:16:26.303 11:27:07 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@724 -- # xtrace_disable 00:16:26.303 11:27:07 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:16:26.303 11:27:07 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@507 -- # nvmfpid=84328 00:16:26.303 11:27:07 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@506 -- # ip netns exec nvmf_tgt_ns_spdk /home/vagrant/spdk_repo/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:16:26.303 11:27:07 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@508 -- # waitforlisten 84328 00:16:26.303 11:27:07 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@831 -- # '[' -z 84328 ']' 00:16:26.303 11:27:07 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:26.303 11:27:07 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@836 -- # local max_retries=100 00:16:26.303 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:26.303 11:27:07 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:26.303 11:27:07 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@840 -- # xtrace_disable 00:16:26.303 11:27:07 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:16:26.303 [2024-10-07 11:27:08.006384] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:16:26.303 [2024-10-07 11:27:08.006529] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:26.561 [2024-10-07 11:27:08.140506] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:26.842 [2024-10-07 11:27:08.312954] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:26.842 [2024-10-07 11:27:08.313044] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:26.842 [2024-10-07 11:27:08.313057] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:16:26.842 [2024-10-07 11:27:08.313066] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:16:26.842 [2024-10-07 11:27:08.313074] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:26.842 [2024-10-07 11:27:08.313568] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:16:27.407 11:27:09 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:16:27.407 11:27:09 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@864 -- # return 0 00:16:27.407 11:27:09 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:16:27.407 11:27:09 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@730 -- # xtrace_disable 00:16:27.407 11:27:09 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:16:27.407 11:27:09 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:27.407 11:27:09 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@178 -- # NOT setup_nvmf_tgt /tmp/tmp.PjWRSOdBbt 00:16:27.407 11:27:09 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@650 -- # local es=0 00:16:27.407 11:27:09 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@652 -- # valid_exec_arg setup_nvmf_tgt /tmp/tmp.PjWRSOdBbt 00:16:27.407 11:27:09 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@638 -- # local arg=setup_nvmf_tgt 00:16:27.665 11:27:09 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:16:27.665 11:27:09 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@642 -- # type -t setup_nvmf_tgt 00:16:27.665 11:27:09 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:16:27.665 11:27:09 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@653 -- # setup_nvmf_tgt /tmp/tmp.PjWRSOdBbt 00:16:27.665 11:27:09 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@50 -- # local key=/tmp/tmp.PjWRSOdBbt 00:16:27.665 11:27:09 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@52 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:16:27.922 [2024-10-07 11:27:09.387733] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:16:27.922 11:27:09 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@53 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:16:28.180 11:27:09 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@54 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4420 -k 00:16:28.439 [2024-10-07 11:27:10.003894] tcp.c:1031:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:16:28.439 [2024-10-07 11:27:10.004185] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:16:28.439 11:27:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@56 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:16:28.699 malloc0 00:16:28.699 11:27:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@57 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:16:28.958 11:27:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@58 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py keyring_file_add_key key0 /tmp/tmp.PjWRSOdBbt 00:16:29.225 [2024-10-07 11:27:10.886151] keyring.c: 36:keyring_file_check_path: *ERROR*: Invalid permissions for key file '/tmp/tmp.PjWRSOdBbt': 0100666 00:16:29.225 [2024-10-07 11:27:10.886214] keyring.c: 126:spdk_keyring_add_key: *ERROR*: Failed to add key 'key0' to the keyring 00:16:29.225 2024/10/07 11:27:10 error on JSON-RPC call, method: keyring_file_add_key, params: map[name:key0 path:/tmp/tmp.PjWRSOdBbt], err: error received for keyring_file_add_key method, err: Code=-1 Msg=Operation not permitted 00:16:29.225 request: 00:16:29.225 { 00:16:29.225 "method": "keyring_file_add_key", 00:16:29.225 "params": { 00:16:29.225 "name": "key0", 00:16:29.225 "path": "/tmp/tmp.PjWRSOdBbt" 00:16:29.225 } 00:16:29.225 } 00:16:29.225 Got JSON-RPC error response 00:16:29.225 GoRPCClient: error on JSON-RPC call 00:16:29.226 11:27:10 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@59 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk key0 00:16:29.484 [2024-10-07 11:27:11.166241] tcp.c:3792:nvmf_tcp_subsystem_add_host: *ERROR*: Key 'key0' does not exist 00:16:29.484 [2024-10-07 11:27:11.166336] subsystem.c:1055:spdk_nvmf_subsystem_add_host_ext: *ERROR*: Unable to add host to TCP transport 00:16:29.484 2024/10/07 11:27:11 error on JSON-RPC call, method: nvmf_subsystem_add_host, params: map[host:nqn.2016-06.io.spdk:host1 nqn:nqn.2016-06.io.spdk:cnode1 psk:key0], err: error received for nvmf_subsystem_add_host method, err: Code=-32603 Msg=Internal error 00:16:29.484 request: 00:16:29.484 { 00:16:29.484 "method": "nvmf_subsystem_add_host", 00:16:29.484 "params": { 00:16:29.484 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:16:29.484 "host": "nqn.2016-06.io.spdk:host1", 00:16:29.484 "psk": "key0" 00:16:29.484 } 00:16:29.484 } 00:16:29.484 Got JSON-RPC error response 00:16:29.484 GoRPCClient: error on JSON-RPC call 00:16:29.484 11:27:11 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@653 -- # es=1 00:16:29.484 11:27:11 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:16:29.484 11:27:11 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:16:29.484 11:27:11 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:16:29.484 11:27:11 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@181 -- # killprocess 84328 00:16:29.484 11:27:11 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@950 -- # '[' -z 84328 ']' 00:16:29.484 11:27:11 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@954 -- # kill -0 84328 00:16:29.484 11:27:11 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # uname 00:16:29.742 11:27:11 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:16:29.742 11:27:11 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 84328 00:16:29.742 11:27:11 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # process_name=reactor_1 00:16:29.742 11:27:11 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@960 -- # '[' reactor_1 = sudo ']' 00:16:29.742 killing process with pid 84328 00:16:29.742 11:27:11 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@968 -- # echo 'killing process with pid 84328' 00:16:29.742 11:27:11 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@969 -- # kill 84328 00:16:29.742 11:27:11 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@974 -- # wait 84328 00:16:30.000 11:27:11 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@182 -- # chmod 0600 /tmp/tmp.PjWRSOdBbt 00:16:30.000 11:27:11 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@185 -- # nvmfappstart -m 0x2 00:16:30.000 11:27:11 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:16:30.000 11:27:11 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@724 -- # xtrace_disable 00:16:30.000 11:27:11 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:16:30.000 11:27:11 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@507 -- # nvmfpid=84451 00:16:30.000 11:27:11 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@506 -- # ip netns exec nvmf_tgt_ns_spdk /home/vagrant/spdk_repo/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:16:30.000 11:27:11 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@508 -- # waitforlisten 84451 00:16:30.000 11:27:11 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@831 -- # '[' -z 84451 ']' 00:16:30.000 11:27:11 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:30.000 11:27:11 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@836 -- # local max_retries=100 00:16:30.000 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:30.000 11:27:11 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:30.000 11:27:11 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@840 -- # xtrace_disable 00:16:30.000 11:27:11 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:16:30.000 [2024-10-07 11:27:11.664253] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:16:30.000 [2024-10-07 11:27:11.664451] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:30.259 [2024-10-07 11:27:11.808195] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:30.517 [2024-10-07 11:27:11.972921] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:30.517 [2024-10-07 11:27:11.972983] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:30.517 [2024-10-07 11:27:11.972995] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:16:30.517 [2024-10-07 11:27:11.973004] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:16:30.517 [2024-10-07 11:27:11.973011] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:30.517 [2024-10-07 11:27:11.973526] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:16:31.082 11:27:12 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:16:31.082 11:27:12 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@864 -- # return 0 00:16:31.082 11:27:12 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:16:31.082 11:27:12 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@730 -- # xtrace_disable 00:16:31.082 11:27:12 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:16:31.340 11:27:12 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:31.340 11:27:12 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@186 -- # setup_nvmf_tgt /tmp/tmp.PjWRSOdBbt 00:16:31.341 11:27:12 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@50 -- # local key=/tmp/tmp.PjWRSOdBbt 00:16:31.341 11:27:12 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@52 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:16:31.599 [2024-10-07 11:27:13.147525] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:16:31.599 11:27:13 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@53 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:16:31.857 11:27:13 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@54 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4420 -k 00:16:32.116 [2024-10-07 11:27:13.711609] tcp.c:1031:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:16:32.116 [2024-10-07 11:27:13.711921] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:16:32.116 11:27:13 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@56 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:16:32.374 malloc0 00:16:32.374 11:27:14 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@57 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:16:32.939 11:27:14 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@58 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py keyring_file_add_key key0 /tmp/tmp.PjWRSOdBbt 00:16:32.939 11:27:14 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@59 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk key0 00:16:33.525 11:27:15 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@189 -- # bdevperf_pid=84572 00:16:33.525 11:27:15 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@188 -- # /home/vagrant/spdk_repo/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:16:33.525 11:27:15 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@191 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:16:33.525 11:27:15 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@192 -- # waitforlisten 84572 /var/tmp/bdevperf.sock 00:16:33.525 11:27:15 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@831 -- # '[' -z 84572 ']' 00:16:33.525 11:27:15 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:16:33.525 11:27:15 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@836 -- # local max_retries=100 00:16:33.525 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:16:33.525 11:27:15 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:16:33.525 11:27:15 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@840 -- # xtrace_disable 00:16:33.525 11:27:15 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:16:33.525 [2024-10-07 11:27:15.131684] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:16:33.525 [2024-10-07 11:27:15.131845] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid84572 ] 00:16:33.784 [2024-10-07 11:27:15.281063] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:33.784 [2024-10-07 11:27:15.458501] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:16:34.727 11:27:16 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:16:34.727 11:27:16 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@864 -- # return 0 00:16:34.727 11:27:16 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@193 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock keyring_file_add_key key0 /tmp/tmp.PjWRSOdBbt 00:16:34.985 11:27:16 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@194 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.3 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk key0 00:16:35.242 [2024-10-07 11:27:16.754346] bdev_nvme_rpc.c: 514:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:16:35.242 TLSTESTn1 00:16:35.242 11:27:16 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@198 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py save_config 00:16:35.501 11:27:17 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@198 -- # tgtconf='{ 00:16:35.501 "subsystems": [ 00:16:35.501 { 00:16:35.501 "subsystem": "keyring", 00:16:35.501 "config": [ 00:16:35.501 { 00:16:35.501 "method": "keyring_file_add_key", 00:16:35.501 "params": { 00:16:35.501 "name": "key0", 00:16:35.501 "path": "/tmp/tmp.PjWRSOdBbt" 00:16:35.501 } 00:16:35.501 } 00:16:35.501 ] 00:16:35.501 }, 00:16:35.501 { 00:16:35.501 "subsystem": "iobuf", 00:16:35.501 "config": [ 00:16:35.501 { 00:16:35.501 "method": "iobuf_set_options", 00:16:35.501 "params": { 00:16:35.501 "large_bufsize": 135168, 00:16:35.501 "large_pool_count": 1024, 00:16:35.501 "small_bufsize": 8192, 00:16:35.501 "small_pool_count": 8192 00:16:35.501 } 00:16:35.501 } 00:16:35.501 ] 00:16:35.501 }, 00:16:35.501 { 00:16:35.501 "subsystem": "sock", 00:16:35.501 "config": [ 00:16:35.501 { 00:16:35.501 "method": "sock_set_default_impl", 00:16:35.501 "params": { 00:16:35.501 "impl_name": "posix" 00:16:35.501 } 00:16:35.501 }, 00:16:35.501 { 00:16:35.501 "method": "sock_impl_set_options", 00:16:35.501 "params": { 00:16:35.501 "enable_ktls": false, 00:16:35.501 "enable_placement_id": 0, 00:16:35.501 "enable_quickack": false, 00:16:35.501 "enable_recv_pipe": true, 00:16:35.501 "enable_zerocopy_send_client": false, 00:16:35.501 "enable_zerocopy_send_server": true, 00:16:35.501 "impl_name": "ssl", 00:16:35.501 "recv_buf_size": 4096, 00:16:35.501 "send_buf_size": 4096, 00:16:35.501 "tls_version": 0, 00:16:35.501 "zerocopy_threshold": 0 00:16:35.501 } 00:16:35.501 }, 00:16:35.501 { 00:16:35.501 "method": "sock_impl_set_options", 00:16:35.501 "params": { 00:16:35.501 "enable_ktls": false, 00:16:35.501 "enable_placement_id": 0, 00:16:35.501 "enable_quickack": false, 00:16:35.501 "enable_recv_pipe": true, 00:16:35.501 "enable_zerocopy_send_client": false, 00:16:35.501 "enable_zerocopy_send_server": true, 00:16:35.501 "impl_name": "posix", 00:16:35.501 "recv_buf_size": 2097152, 00:16:35.501 "send_buf_size": 2097152, 00:16:35.501 "tls_version": 0, 00:16:35.501 "zerocopy_threshold": 0 00:16:35.501 } 00:16:35.501 } 00:16:35.501 ] 00:16:35.501 }, 00:16:35.501 { 00:16:35.501 "subsystem": "vmd", 00:16:35.501 "config": [] 00:16:35.501 }, 00:16:35.501 { 00:16:35.501 "subsystem": "accel", 00:16:35.501 "config": [ 00:16:35.501 { 00:16:35.501 "method": "accel_set_options", 00:16:35.501 "params": { 00:16:35.501 "buf_count": 2048, 00:16:35.501 "large_cache_size": 16, 00:16:35.501 "sequence_count": 2048, 00:16:35.501 "small_cache_size": 128, 00:16:35.501 "task_count": 2048 00:16:35.501 } 00:16:35.501 } 00:16:35.501 ] 00:16:35.501 }, 00:16:35.501 { 00:16:35.501 "subsystem": "bdev", 00:16:35.501 "config": [ 00:16:35.501 { 00:16:35.501 "method": "bdev_set_options", 00:16:35.501 "params": { 00:16:35.501 "bdev_auto_examine": true, 00:16:35.501 "bdev_io_cache_size": 256, 00:16:35.501 "bdev_io_pool_size": 65535, 00:16:35.501 "iobuf_large_cache_size": 16, 00:16:35.501 "iobuf_small_cache_size": 128 00:16:35.501 } 00:16:35.501 }, 00:16:35.501 { 00:16:35.501 "method": "bdev_raid_set_options", 00:16:35.501 "params": { 00:16:35.501 "process_max_bandwidth_mb_sec": 0, 00:16:35.501 "process_window_size_kb": 1024 00:16:35.501 } 00:16:35.501 }, 00:16:35.501 { 00:16:35.501 "method": "bdev_iscsi_set_options", 00:16:35.501 "params": { 00:16:35.501 "timeout_sec": 30 00:16:35.501 } 00:16:35.501 }, 00:16:35.501 { 00:16:35.501 "method": "bdev_nvme_set_options", 00:16:35.501 "params": { 00:16:35.501 "action_on_timeout": "none", 00:16:35.501 "allow_accel_sequence": false, 00:16:35.501 "arbitration_burst": 0, 00:16:35.501 "bdev_retry_count": 3, 00:16:35.501 "ctrlr_loss_timeout_sec": 0, 00:16:35.501 "delay_cmd_submit": true, 00:16:35.501 "dhchap_dhgroups": [ 00:16:35.501 "null", 00:16:35.501 "ffdhe2048", 00:16:35.501 "ffdhe3072", 00:16:35.501 "ffdhe4096", 00:16:35.501 "ffdhe6144", 00:16:35.501 "ffdhe8192" 00:16:35.501 ], 00:16:35.501 "dhchap_digests": [ 00:16:35.501 "sha256", 00:16:35.501 "sha384", 00:16:35.501 "sha512" 00:16:35.501 ], 00:16:35.501 "disable_auto_failback": false, 00:16:35.501 "fast_io_fail_timeout_sec": 0, 00:16:35.502 "generate_uuids": false, 00:16:35.502 "high_priority_weight": 0, 00:16:35.502 "io_path_stat": false, 00:16:35.502 "io_queue_requests": 0, 00:16:35.502 "keep_alive_timeout_ms": 10000, 00:16:35.502 "low_priority_weight": 0, 00:16:35.502 "medium_priority_weight": 0, 00:16:35.502 "nvme_adminq_poll_period_us": 10000, 00:16:35.502 "nvme_error_stat": false, 00:16:35.502 "nvme_ioq_poll_period_us": 0, 00:16:35.502 "rdma_cm_event_timeout_ms": 0, 00:16:35.502 "rdma_max_cq_size": 0, 00:16:35.502 "rdma_srq_size": 0, 00:16:35.502 "reconnect_delay_sec": 0, 00:16:35.502 "timeout_admin_us": 0, 00:16:35.502 "timeout_us": 0, 00:16:35.502 "transport_ack_timeout": 0, 00:16:35.502 "transport_retry_count": 4, 00:16:35.502 "transport_tos": 0 00:16:35.502 } 00:16:35.502 }, 00:16:35.502 { 00:16:35.502 "method": "bdev_nvme_set_hotplug", 00:16:35.502 "params": { 00:16:35.502 "enable": false, 00:16:35.502 "period_us": 100000 00:16:35.502 } 00:16:35.502 }, 00:16:35.502 { 00:16:35.502 "method": "bdev_malloc_create", 00:16:35.502 "params": { 00:16:35.502 "block_size": 4096, 00:16:35.502 "dif_is_head_of_md": false, 00:16:35.502 "dif_pi_format": 0, 00:16:35.502 "dif_type": 0, 00:16:35.502 "md_size": 0, 00:16:35.502 "name": "malloc0", 00:16:35.502 "num_blocks": 8192, 00:16:35.502 "optimal_io_boundary": 0, 00:16:35.502 "physical_block_size": 4096, 00:16:35.502 "uuid": "e0be3861-dfdd-4cb7-82ef-7746755f9718" 00:16:35.502 } 00:16:35.502 }, 00:16:35.502 { 00:16:35.502 "method": "bdev_wait_for_examine" 00:16:35.502 } 00:16:35.502 ] 00:16:35.502 }, 00:16:35.502 { 00:16:35.502 "subsystem": "nbd", 00:16:35.502 "config": [] 00:16:35.502 }, 00:16:35.502 { 00:16:35.502 "subsystem": "scheduler", 00:16:35.502 "config": [ 00:16:35.502 { 00:16:35.502 "method": "framework_set_scheduler", 00:16:35.502 "params": { 00:16:35.502 "name": "static" 00:16:35.502 } 00:16:35.502 } 00:16:35.502 ] 00:16:35.502 }, 00:16:35.502 { 00:16:35.502 "subsystem": "nvmf", 00:16:35.502 "config": [ 00:16:35.502 { 00:16:35.502 "method": "nvmf_set_config", 00:16:35.502 "params": { 00:16:35.502 "admin_cmd_passthru": { 00:16:35.502 "identify_ctrlr": false 00:16:35.502 }, 00:16:35.502 "dhchap_dhgroups": [ 00:16:35.502 "null", 00:16:35.502 "ffdhe2048", 00:16:35.502 "ffdhe3072", 00:16:35.502 "ffdhe4096", 00:16:35.502 "ffdhe6144", 00:16:35.502 "ffdhe8192" 00:16:35.502 ], 00:16:35.502 "dhchap_digests": [ 00:16:35.502 "sha256", 00:16:35.502 "sha384", 00:16:35.502 "sha512" 00:16:35.502 ], 00:16:35.502 "discovery_filter": "match_any" 00:16:35.502 } 00:16:35.502 }, 00:16:35.502 { 00:16:35.502 "method": "nvmf_set_max_subsystems", 00:16:35.502 "params": { 00:16:35.502 "max_subsystems": 1024 00:16:35.502 } 00:16:35.502 }, 00:16:35.502 { 00:16:35.502 "method": "nvmf_set_crdt", 00:16:35.502 "params": { 00:16:35.502 "crdt1": 0, 00:16:35.502 "crdt2": 0, 00:16:35.502 "crdt3": 0 00:16:35.502 } 00:16:35.502 }, 00:16:35.502 { 00:16:35.502 "method": "nvmf_create_transport", 00:16:35.502 "params": { 00:16:35.502 "abort_timeout_sec": 1, 00:16:35.502 "ack_timeout": 0, 00:16:35.502 "buf_cache_size": 4294967295, 00:16:35.502 "c2h_success": false, 00:16:35.502 "data_wr_pool_size": 0, 00:16:35.502 "dif_insert_or_strip": false, 00:16:35.502 "in_capsule_data_size": 4096, 00:16:35.502 "io_unit_size": 131072, 00:16:35.502 "max_aq_depth": 128, 00:16:35.502 "max_io_qpairs_per_ctrlr": 127, 00:16:35.502 "max_io_size": 131072, 00:16:35.502 "max_queue_depth": 128, 00:16:35.502 "num_shared_buffers": 511, 00:16:35.502 "sock_priority": 0, 00:16:35.502 "trtype": "TCP", 00:16:35.502 "zcopy": false 00:16:35.502 } 00:16:35.502 }, 00:16:35.502 { 00:16:35.502 "method": "nvmf_create_subsystem", 00:16:35.502 "params": { 00:16:35.502 "allow_any_host": false, 00:16:35.502 "ana_reporting": false, 00:16:35.502 "max_cntlid": 65519, 00:16:35.502 "max_namespaces": 10, 00:16:35.502 "min_cntlid": 1, 00:16:35.502 "model_number": "SPDK bdev Controller", 00:16:35.502 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:16:35.502 "serial_number": "SPDK00000000000001" 00:16:35.502 } 00:16:35.502 }, 00:16:35.502 { 00:16:35.502 "method": "nvmf_subsystem_add_host", 00:16:35.502 "params": { 00:16:35.502 "host": "nqn.2016-06.io.spdk:host1", 00:16:35.502 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:16:35.502 "psk": "key0" 00:16:35.502 } 00:16:35.502 }, 00:16:35.502 { 00:16:35.502 "method": "nvmf_subsystem_add_ns", 00:16:35.502 "params": { 00:16:35.502 "namespace": { 00:16:35.502 "bdev_name": "malloc0", 00:16:35.502 "nguid": "E0BE3861DFDD4CB782EF7746755F9718", 00:16:35.502 "no_auto_visible": false, 00:16:35.502 "nsid": 1, 00:16:35.502 "uuid": "e0be3861-dfdd-4cb7-82ef-7746755f9718" 00:16:35.502 }, 00:16:35.502 "nqn": "nqn.2016-06.io.spdk:cnode1" 00:16:35.502 } 00:16:35.502 }, 00:16:35.502 { 00:16:35.502 "method": "nvmf_subsystem_add_listener", 00:16:35.502 "params": { 00:16:35.502 "listen_address": { 00:16:35.502 "adrfam": "IPv4", 00:16:35.502 "traddr": "10.0.0.3", 00:16:35.502 "trsvcid": "4420", 00:16:35.502 "trtype": "TCP" 00:16:35.502 }, 00:16:35.502 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:16:35.502 "secure_channel": true 00:16:35.502 } 00:16:35.502 } 00:16:35.502 ] 00:16:35.502 } 00:16:35.502 ] 00:16:35.502 }' 00:16:35.502 11:27:17 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@199 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock save_config 00:16:36.069 11:27:17 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@199 -- # bdevperfconf='{ 00:16:36.069 "subsystems": [ 00:16:36.069 { 00:16:36.069 "subsystem": "keyring", 00:16:36.069 "config": [ 00:16:36.069 { 00:16:36.069 "method": "keyring_file_add_key", 00:16:36.069 "params": { 00:16:36.069 "name": "key0", 00:16:36.069 "path": "/tmp/tmp.PjWRSOdBbt" 00:16:36.069 } 00:16:36.069 } 00:16:36.069 ] 00:16:36.069 }, 00:16:36.069 { 00:16:36.069 "subsystem": "iobuf", 00:16:36.069 "config": [ 00:16:36.069 { 00:16:36.069 "method": "iobuf_set_options", 00:16:36.069 "params": { 00:16:36.069 "large_bufsize": 135168, 00:16:36.069 "large_pool_count": 1024, 00:16:36.069 "small_bufsize": 8192, 00:16:36.069 "small_pool_count": 8192 00:16:36.069 } 00:16:36.069 } 00:16:36.069 ] 00:16:36.069 }, 00:16:36.069 { 00:16:36.069 "subsystem": "sock", 00:16:36.069 "config": [ 00:16:36.069 { 00:16:36.069 "method": "sock_set_default_impl", 00:16:36.069 "params": { 00:16:36.069 "impl_name": "posix" 00:16:36.069 } 00:16:36.069 }, 00:16:36.069 { 00:16:36.069 "method": "sock_impl_set_options", 00:16:36.069 "params": { 00:16:36.069 "enable_ktls": false, 00:16:36.069 "enable_placement_id": 0, 00:16:36.069 "enable_quickack": false, 00:16:36.069 "enable_recv_pipe": true, 00:16:36.069 "enable_zerocopy_send_client": false, 00:16:36.069 "enable_zerocopy_send_server": true, 00:16:36.069 "impl_name": "ssl", 00:16:36.069 "recv_buf_size": 4096, 00:16:36.069 "send_buf_size": 4096, 00:16:36.069 "tls_version": 0, 00:16:36.069 "zerocopy_threshold": 0 00:16:36.069 } 00:16:36.069 }, 00:16:36.069 { 00:16:36.069 "method": "sock_impl_set_options", 00:16:36.069 "params": { 00:16:36.069 "enable_ktls": false, 00:16:36.069 "enable_placement_id": 0, 00:16:36.069 "enable_quickack": false, 00:16:36.069 "enable_recv_pipe": true, 00:16:36.069 "enable_zerocopy_send_client": false, 00:16:36.069 "enable_zerocopy_send_server": true, 00:16:36.069 "impl_name": "posix", 00:16:36.069 "recv_buf_size": 2097152, 00:16:36.069 "send_buf_size": 2097152, 00:16:36.069 "tls_version": 0, 00:16:36.069 "zerocopy_threshold": 0 00:16:36.069 } 00:16:36.069 } 00:16:36.069 ] 00:16:36.069 }, 00:16:36.069 { 00:16:36.069 "subsystem": "vmd", 00:16:36.069 "config": [] 00:16:36.069 }, 00:16:36.069 { 00:16:36.069 "subsystem": "accel", 00:16:36.069 "config": [ 00:16:36.069 { 00:16:36.069 "method": "accel_set_options", 00:16:36.069 "params": { 00:16:36.069 "buf_count": 2048, 00:16:36.069 "large_cache_size": 16, 00:16:36.069 "sequence_count": 2048, 00:16:36.069 "small_cache_size": 128, 00:16:36.069 "task_count": 2048 00:16:36.069 } 00:16:36.069 } 00:16:36.069 ] 00:16:36.069 }, 00:16:36.069 { 00:16:36.069 "subsystem": "bdev", 00:16:36.069 "config": [ 00:16:36.069 { 00:16:36.069 "method": "bdev_set_options", 00:16:36.069 "params": { 00:16:36.069 "bdev_auto_examine": true, 00:16:36.069 "bdev_io_cache_size": 256, 00:16:36.069 "bdev_io_pool_size": 65535, 00:16:36.069 "iobuf_large_cache_size": 16, 00:16:36.069 "iobuf_small_cache_size": 128 00:16:36.069 } 00:16:36.069 }, 00:16:36.069 { 00:16:36.069 "method": "bdev_raid_set_options", 00:16:36.069 "params": { 00:16:36.069 "process_max_bandwidth_mb_sec": 0, 00:16:36.069 "process_window_size_kb": 1024 00:16:36.069 } 00:16:36.069 }, 00:16:36.069 { 00:16:36.069 "method": "bdev_iscsi_set_options", 00:16:36.069 "params": { 00:16:36.069 "timeout_sec": 30 00:16:36.069 } 00:16:36.069 }, 00:16:36.069 { 00:16:36.069 "method": "bdev_nvme_set_options", 00:16:36.069 "params": { 00:16:36.069 "action_on_timeout": "none", 00:16:36.069 "allow_accel_sequence": false, 00:16:36.069 "arbitration_burst": 0, 00:16:36.069 "bdev_retry_count": 3, 00:16:36.069 "ctrlr_loss_timeout_sec": 0, 00:16:36.069 "delay_cmd_submit": true, 00:16:36.069 "dhchap_dhgroups": [ 00:16:36.069 "null", 00:16:36.069 "ffdhe2048", 00:16:36.069 "ffdhe3072", 00:16:36.069 "ffdhe4096", 00:16:36.069 "ffdhe6144", 00:16:36.069 "ffdhe8192" 00:16:36.069 ], 00:16:36.069 "dhchap_digests": [ 00:16:36.069 "sha256", 00:16:36.069 "sha384", 00:16:36.069 "sha512" 00:16:36.069 ], 00:16:36.069 "disable_auto_failback": false, 00:16:36.069 "fast_io_fail_timeout_sec": 0, 00:16:36.069 "generate_uuids": false, 00:16:36.069 "high_priority_weight": 0, 00:16:36.069 "io_path_stat": false, 00:16:36.069 "io_queue_requests": 512, 00:16:36.069 "keep_alive_timeout_ms": 10000, 00:16:36.069 "low_priority_weight": 0, 00:16:36.069 "medium_priority_weight": 0, 00:16:36.069 "nvme_adminq_poll_period_us": 10000, 00:16:36.069 "nvme_error_stat": false, 00:16:36.069 "nvme_ioq_poll_period_us": 0, 00:16:36.069 "rdma_cm_event_timeout_ms": 0, 00:16:36.069 "rdma_max_cq_size": 0, 00:16:36.069 "rdma_srq_size": 0, 00:16:36.069 "reconnect_delay_sec": 0, 00:16:36.069 "timeout_admin_us": 0, 00:16:36.069 "timeout_us": 0, 00:16:36.069 "transport_ack_timeout": 0, 00:16:36.069 "transport_retry_count": 4, 00:16:36.069 "transport_tos": 0 00:16:36.069 } 00:16:36.069 }, 00:16:36.069 { 00:16:36.069 "method": "bdev_nvme_attach_controller", 00:16:36.069 "params": { 00:16:36.069 "adrfam": "IPv4", 00:16:36.069 "ctrlr_loss_timeout_sec": 0, 00:16:36.069 "ddgst": false, 00:16:36.069 "fast_io_fail_timeout_sec": 0, 00:16:36.069 "hdgst": false, 00:16:36.069 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:16:36.069 "multipath": "multipath", 00:16:36.069 "name": "TLSTEST", 00:16:36.069 "prchk_guard": false, 00:16:36.069 "prchk_reftag": false, 00:16:36.069 "psk": "key0", 00:16:36.069 "reconnect_delay_sec": 0, 00:16:36.069 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:16:36.069 "traddr": "10.0.0.3", 00:16:36.069 "trsvcid": "4420", 00:16:36.069 "trtype": "TCP" 00:16:36.069 } 00:16:36.069 }, 00:16:36.069 { 00:16:36.069 "method": "bdev_nvme_set_hotplug", 00:16:36.069 "params": { 00:16:36.069 "enable": false, 00:16:36.069 "period_us": 100000 00:16:36.069 } 00:16:36.069 }, 00:16:36.069 { 00:16:36.069 "method": "bdev_wait_for_examine" 00:16:36.069 } 00:16:36.069 ] 00:16:36.069 }, 00:16:36.069 { 00:16:36.069 "subsystem": "nbd", 00:16:36.069 "config": [] 00:16:36.069 } 00:16:36.069 ] 00:16:36.069 }' 00:16:36.069 11:27:17 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@201 -- # killprocess 84572 00:16:36.069 11:27:17 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@950 -- # '[' -z 84572 ']' 00:16:36.069 11:27:17 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@954 -- # kill -0 84572 00:16:36.069 11:27:17 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # uname 00:16:36.069 11:27:17 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:16:36.069 11:27:17 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 84572 00:16:36.069 11:27:17 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # process_name=reactor_2 00:16:36.069 11:27:17 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@960 -- # '[' reactor_2 = sudo ']' 00:16:36.069 killing process with pid 84572 00:16:36.069 11:27:17 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@968 -- # echo 'killing process with pid 84572' 00:16:36.070 Received shutdown signal, test time was about 10.000000 seconds 00:16:36.070 00:16:36.070 Latency(us) 00:16:36.070 [2024-10-07T11:27:17.781Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:16:36.070 [2024-10-07T11:27:17.781Z] =================================================================================================================== 00:16:36.070 [2024-10-07T11:27:17.781Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:16:36.070 11:27:17 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@969 -- # kill 84572 00:16:36.070 11:27:17 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@974 -- # wait 84572 00:16:36.327 11:27:17 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@202 -- # killprocess 84451 00:16:36.327 11:27:17 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@950 -- # '[' -z 84451 ']' 00:16:36.327 11:27:17 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@954 -- # kill -0 84451 00:16:36.327 11:27:17 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # uname 00:16:36.327 11:27:17 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:16:36.327 11:27:17 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 84451 00:16:36.327 11:27:17 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # process_name=reactor_1 00:16:36.327 11:27:17 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@960 -- # '[' reactor_1 = sudo ']' 00:16:36.327 killing process with pid 84451 00:16:36.327 11:27:17 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@968 -- # echo 'killing process with pid 84451' 00:16:36.327 11:27:17 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@969 -- # kill 84451 00:16:36.327 11:27:17 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@974 -- # wait 84451 00:16:36.585 11:27:18 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@205 -- # nvmfappstart -m 0x2 -c /dev/fd/62 00:16:36.585 11:27:18 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:16:36.585 11:27:18 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@205 -- # echo '{ 00:16:36.585 "subsystems": [ 00:16:36.585 { 00:16:36.585 "subsystem": "keyring", 00:16:36.585 "config": [ 00:16:36.585 { 00:16:36.585 "method": "keyring_file_add_key", 00:16:36.585 "params": { 00:16:36.585 "name": "key0", 00:16:36.585 "path": "/tmp/tmp.PjWRSOdBbt" 00:16:36.585 } 00:16:36.585 } 00:16:36.585 ] 00:16:36.585 }, 00:16:36.585 { 00:16:36.585 "subsystem": "iobuf", 00:16:36.585 "config": [ 00:16:36.585 { 00:16:36.585 "method": "iobuf_set_options", 00:16:36.585 "params": { 00:16:36.585 "large_bufsize": 135168, 00:16:36.585 "large_pool_count": 1024, 00:16:36.585 "small_bufsize": 8192, 00:16:36.585 "small_pool_count": 8192 00:16:36.585 } 00:16:36.585 } 00:16:36.585 ] 00:16:36.585 }, 00:16:36.585 { 00:16:36.585 "subsystem": "sock", 00:16:36.585 "config": [ 00:16:36.585 { 00:16:36.585 "method": "sock_set_default_impl", 00:16:36.585 "params": { 00:16:36.585 "impl_name": "posix" 00:16:36.585 } 00:16:36.585 }, 00:16:36.585 { 00:16:36.585 "method": "sock_impl_set_options", 00:16:36.585 "params": { 00:16:36.585 "enable_ktls": false, 00:16:36.585 "enable_placement_id": 0, 00:16:36.585 "enable_quickack": false, 00:16:36.585 "enable_recv_pipe": true, 00:16:36.585 "enable_zerocopy_send_client": false, 00:16:36.585 "enable_zerocopy_send_server": true, 00:16:36.585 "impl_name": "ssl", 00:16:36.585 "recv_buf_size": 4096, 00:16:36.585 "send_buf_size": 4096, 00:16:36.585 "tls_version": 0, 00:16:36.585 "zerocopy_threshold": 0 00:16:36.585 } 00:16:36.585 }, 00:16:36.585 { 00:16:36.585 "method": "sock_impl_set_options", 00:16:36.585 "params": { 00:16:36.585 "enable_ktls": false, 00:16:36.585 "enable_placement_id": 0, 00:16:36.585 "enable_quickack": false, 00:16:36.585 "enable_recv_pipe": true, 00:16:36.585 "enable_zerocopy_send_client": false, 00:16:36.585 "enable_zerocopy_send_server": true, 00:16:36.585 "impl_name": "posix", 00:16:36.585 "recv_buf_size": 2097152, 00:16:36.586 "send_buf_size": 2097152, 00:16:36.586 "tls_version": 0, 00:16:36.586 "zerocopy_threshold": 0 00:16:36.586 } 00:16:36.586 } 00:16:36.586 ] 00:16:36.586 }, 00:16:36.586 { 00:16:36.586 "subsystem": "vmd", 00:16:36.586 "config": [] 00:16:36.586 }, 00:16:36.586 { 00:16:36.586 "subsystem": "accel", 00:16:36.586 "config": [ 00:16:36.586 { 00:16:36.586 "method": "accel_set_options", 00:16:36.586 "params": { 00:16:36.586 "buf_count": 2048, 00:16:36.586 "large_cache_size": 16, 00:16:36.586 "sequence_count": 2048, 00:16:36.586 "small_cache_size": 128, 00:16:36.586 "task_count": 2048 00:16:36.586 } 00:16:36.586 } 00:16:36.586 ] 00:16:36.586 }, 00:16:36.586 { 00:16:36.586 "subsystem": "bdev", 00:16:36.586 "config": [ 00:16:36.586 { 00:16:36.586 "method": "bdev_set_options", 00:16:36.586 "params": { 00:16:36.586 "bdev_auto_examine": true, 00:16:36.586 "bdev_io_cache_size": 256, 00:16:36.586 "bdev_io_pool_size": 65535, 00:16:36.586 "iobuf_large_cache_size": 16, 00:16:36.586 "iobuf_small_cache_size": 128 00:16:36.586 } 00:16:36.586 }, 00:16:36.586 { 00:16:36.586 "method": "bdev_raid_set_options", 00:16:36.586 "params": { 00:16:36.586 "process_max_bandwidth_mb_sec": 0, 00:16:36.586 "process_window_size_kb": 1024 00:16:36.586 } 00:16:36.586 }, 00:16:36.586 { 00:16:36.586 "method": "bdev_iscsi_set_options", 00:16:36.586 "params": { 00:16:36.586 "timeout_sec": 30 00:16:36.586 } 00:16:36.586 }, 00:16:36.586 { 00:16:36.586 "method": "bdev_nvme_set_options", 00:16:36.586 "params": { 00:16:36.586 "action_on_timeout": "none", 00:16:36.586 "allow_accel_sequence": false, 00:16:36.586 "arbitration_burst": 0, 00:16:36.586 "bdev_retry_count": 3, 00:16:36.586 "ctrlr_loss_timeout_sec": 0, 00:16:36.586 "delay_cmd_submit": true, 00:16:36.586 "dhchap_dhgroups": [ 00:16:36.586 "null", 00:16:36.586 "ffdhe2048", 00:16:36.586 "ffdhe3072", 00:16:36.586 "ffdhe4096", 00:16:36.586 "ffdhe6144", 00:16:36.586 "ffdhe8192" 00:16:36.586 ], 00:16:36.586 "dhchap_digests": [ 00:16:36.586 "sha256", 00:16:36.586 "sha384", 00:16:36.586 "sha512" 00:16:36.586 ], 00:16:36.586 "disable_auto_failback": false, 00:16:36.586 "fast_io_fail_timeout_sec": 0, 00:16:36.586 "generate_uuids": false, 00:16:36.586 "high_priority_weight": 0, 00:16:36.586 "io_path_stat": false, 00:16:36.586 "io_queue_requests": 0, 00:16:36.586 "keep_alive_timeout_ms": 10000, 00:16:36.586 "low_priority_weight": 0, 00:16:36.586 "medium_priority_weight": 0, 00:16:36.586 "nvme_adminq_poll_period_us": 10000, 00:16:36.586 "nvme_error_stat": false, 00:16:36.586 "nvme_ioq_poll_period_us": 0, 00:16:36.586 "rdma_cm_event_timeout_ms": 0, 00:16:36.586 "rdma_max_cq_size": 0, 00:16:36.586 "rdma_srq_size": 0, 00:16:36.586 "reconnect_delay_sec": 0, 00:16:36.586 "timeout_admin_us": 0, 00:16:36.586 "timeout_us": 0, 00:16:36.586 "transport_ack_timeout": 0, 00:16:36.586 "transport_retry_count": 4, 00:16:36.586 "transport_tos": 0 00:16:36.586 } 00:16:36.586 }, 00:16:36.586 { 00:16:36.586 "method": "bdev_nvme_set_hotplug", 00:16:36.586 "params": { 00:16:36.586 "enable": false, 00:16:36.586 "period_us": 100000 00:16:36.586 } 00:16:36.586 }, 00:16:36.586 { 00:16:36.586 "method": "bdev_malloc_create", 00:16:36.586 "params": { 00:16:36.586 "block_size": 4096, 00:16:36.586 "dif_is_head_of_md": false, 00:16:36.586 "dif_pi_format": 0, 00:16:36.586 "dif_type": 0, 00:16:36.586 "md_size": 0, 00:16:36.586 "name": "malloc0", 00:16:36.586 "num_blocks": 8192, 00:16:36.586 "optimal_io_boundary": 0, 00:16:36.586 "physical_block_size": 4096, 00:16:36.586 "uuid": "e0be3861-dfdd-4cb7-82ef-7746755f9718" 00:16:36.586 } 00:16:36.586 }, 00:16:36.586 { 00:16:36.586 "method": "bdev_wait_for_examine" 00:16:36.586 } 00:16:36.586 ] 00:16:36.586 }, 00:16:36.586 { 00:16:36.586 "subsystem": "nbd", 00:16:36.586 "config": [] 00:16:36.586 }, 00:16:36.586 { 00:16:36.586 "subsystem": "scheduler", 00:16:36.586 "config": [ 00:16:36.586 { 00:16:36.586 "method": "framework_set_scheduler", 00:16:36.586 "params": { 00:16:36.586 "name": "static" 00:16:36.586 } 00:16:36.586 } 00:16:36.586 ] 00:16:36.586 }, 00:16:36.586 { 00:16:36.586 "subsystem": "nvmf", 00:16:36.586 "config": [ 00:16:36.586 { 00:16:36.586 "method": "nvmf_set_config", 00:16:36.586 "params": { 00:16:36.586 "admin_cmd_passthru": { 00:16:36.586 "identify_ctrlr": false 00:16:36.586 }, 00:16:36.586 "dhchap_dhgroups": [ 00:16:36.586 "null", 00:16:36.586 "ffdhe2048", 00:16:36.586 "ffdhe3072", 00:16:36.586 "ffdhe4096", 00:16:36.586 "ffdhe6144", 00:16:36.586 "ffdhe8192" 00:16:36.586 ], 00:16:36.586 "dhchap_digests": [ 00:16:36.586 "sha256", 00:16:36.586 "sha384", 00:16:36.586 "sha512" 00:16:36.586 ], 00:16:36.586 "discovery_filter": "match_any" 00:16:36.586 } 00:16:36.586 }, 00:16:36.586 { 00:16:36.586 "method": "nvmf_set_max_subsystems", 00:16:36.586 "params": { 00:16:36.586 "max_subsystems": 1024 00:16:36.586 } 00:16:36.586 }, 00:16:36.586 { 00:16:36.586 "method": "nvmf_set_crdt", 00:16:36.586 "params": { 00:16:36.586 "crdt1": 0, 00:16:36.586 "crdt2": 0, 00:16:36.586 "crdt3": 0 00:16:36.586 } 00:16:36.586 }, 00:16:36.586 { 00:16:36.586 "method": "nvmf_create_transport", 00:16:36.586 "params": { 00:16:36.586 "abort_timeout_sec": 1, 00:16:36.586 "ack_timeout": 0, 00:16:36.586 "buf_cache_size": 4294967295, 00:16:36.586 "c2h_success": false, 00:16:36.586 "data_wr_pool_size": 0, 00:16:36.586 "dif_insert_or_strip": false, 00:16:36.586 "in_capsule_data_size": 4096, 00:16:36.586 "io_unit_size": 131072, 00:16:36.586 "max_aq_depth": 128, 00:16:36.586 "max_io_qpairs_per_ctrlr": 127, 00:16:36.586 "max_io_size": 131072, 00:16:36.586 "max_queue_depth": 128, 00:16:36.586 "num_shared_buffers": 511, 00:16:36.586 "sock_priority": 0, 00:16:36.586 "trtype": "TCP", 00:16:36.586 "zcopy": false 00:16:36.586 } 00:16:36.586 }, 00:16:36.586 { 00:16:36.586 "method": "nvmf_create_subsystem", 00:16:36.586 "params": { 00:16:36.586 "allow_any_host": false, 00:16:36.586 "ana_reporting": false, 00:16:36.586 "max_cntlid": 65519, 00:16:36.586 "max_namespaces": 10, 00:16:36.586 "min_cntlid": 1, 00:16:36.586 "model_number": "SPDK bdev Controller", 00:16:36.586 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:16:36.586 "serial_number": "SPDK00000000000001" 00:16:36.586 } 00:16:36.586 }, 00:16:36.586 { 00:16:36.586 "method": "nvmf_subsystem_add_host", 00:16:36.586 "params": { 00:16:36.586 "host": "nqn.2016-06.io.spdk:host1", 00:16:36.586 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:16:36.586 "psk": "key0" 00:16:36.586 } 00:16:36.586 }, 00:16:36.586 { 00:16:36.586 "method": "nvmf_subsystem_add_ns", 00:16:36.586 "params": { 00:16:36.586 "namespace": { 00:16:36.586 "bdev_name": "malloc0", 00:16:36.586 "nguid": "E0BE3861DFDD4CB782EF7746755F9718", 00:16:36.586 "no_auto_visible": false, 00:16:36.586 "nsid": 1, 00:16:36.586 "uuid": "e0be3861-dfdd-4cb7-82ef-7746755f9718" 00:16:36.586 }, 00:16:36.586 "nqn": "nqn.2016-06.io.spdk:cnode1" 00:16:36.586 } 00:16:36.586 }, 00:16:36.586 { 00:16:36.586 "method": "nvmf_subsystem_add_listener", 00:16:36.586 "params": { 00:16:36.586 "listen_address": { 00:16:36.586 "adrfam": "IPv4", 00:16:36.586 "traddr": "10.0.0.3", 00:16:36.586 "trsvcid": "4420", 00:16:36.586 "trtype": "TCP" 00:16:36.586 }, 00:16:36.586 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:16:36.586 "secure_channel": true 00:16:36.586 } 00:16:36.586 } 00:16:36.586 ] 00:16:36.586 } 00:16:36.586 ] 00:16:36.586 }' 00:16:36.586 11:27:18 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@724 -- # xtrace_disable 00:16:36.586 11:27:18 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:16:36.586 11:27:18 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@507 -- # nvmfpid=84664 00:16:36.586 11:27:18 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@508 -- # waitforlisten 84664 00:16:36.587 11:27:18 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@506 -- # ip netns exec nvmf_tgt_ns_spdk /home/vagrant/spdk_repo/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 -c /dev/fd/62 00:16:36.587 11:27:18 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@831 -- # '[' -z 84664 ']' 00:16:36.587 11:27:18 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:36.587 11:27:18 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@836 -- # local max_retries=100 00:16:36.587 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:36.587 11:27:18 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:36.587 11:27:18 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@840 -- # xtrace_disable 00:16:36.587 11:27:18 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:16:36.848 [2024-10-07 11:27:18.349843] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:16:36.848 [2024-10-07 11:27:18.349952] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:36.848 [2024-10-07 11:27:18.490171] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:37.105 [2024-10-07 11:27:18.614852] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:37.105 [2024-10-07 11:27:18.614925] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:37.105 [2024-10-07 11:27:18.614940] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:16:37.105 [2024-10-07 11:27:18.614951] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:16:37.105 [2024-10-07 11:27:18.614961] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:37.105 [2024-10-07 11:27:18.615535] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:16:37.363 [2024-10-07 11:27:18.858267] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:16:37.363 [2024-10-07 11:27:18.896127] tcp.c:1031:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:16:37.363 [2024-10-07 11:27:18.896347] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:16:37.621 11:27:19 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:16:37.621 11:27:19 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@864 -- # return 0 00:16:37.621 11:27:19 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:16:37.879 11:27:19 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@730 -- # xtrace_disable 00:16:37.879 11:27:19 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:16:37.879 11:27:19 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:37.879 11:27:19 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@209 -- # bdevperf_pid=84708 00:16:37.879 11:27:19 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@210 -- # waitforlisten 84708 /var/tmp/bdevperf.sock 00:16:37.879 11:27:19 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@831 -- # '[' -z 84708 ']' 00:16:37.879 11:27:19 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@206 -- # /home/vagrant/spdk_repo/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 -c /dev/fd/63 00:16:37.879 11:27:19 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@206 -- # echo '{ 00:16:37.879 "subsystems": [ 00:16:37.879 { 00:16:37.879 "subsystem": "keyring", 00:16:37.879 "config": [ 00:16:37.879 { 00:16:37.879 "method": "keyring_file_add_key", 00:16:37.879 "params": { 00:16:37.879 "name": "key0", 00:16:37.879 "path": "/tmp/tmp.PjWRSOdBbt" 00:16:37.879 } 00:16:37.879 } 00:16:37.879 ] 00:16:37.879 }, 00:16:37.879 { 00:16:37.879 "subsystem": "iobuf", 00:16:37.879 "config": [ 00:16:37.879 { 00:16:37.879 "method": "iobuf_set_options", 00:16:37.879 "params": { 00:16:37.879 "large_bufsize": 135168, 00:16:37.879 "large_pool_count": 1024, 00:16:37.879 "small_bufsize": 8192, 00:16:37.879 "small_pool_count": 8192 00:16:37.879 } 00:16:37.879 } 00:16:37.879 ] 00:16:37.879 }, 00:16:37.879 { 00:16:37.879 "subsystem": "sock", 00:16:37.879 "config": [ 00:16:37.879 { 00:16:37.879 "method": "sock_set_default_impl", 00:16:37.879 "params": { 00:16:37.879 "impl_name": "posix" 00:16:37.879 } 00:16:37.879 }, 00:16:37.879 { 00:16:37.879 "method": "sock_impl_set_options", 00:16:37.879 "params": { 00:16:37.879 "enable_ktls": false, 00:16:37.879 "enable_placement_id": 0, 00:16:37.879 "enable_quickack": false, 00:16:37.879 "enable_recv_pipe": true, 00:16:37.879 "enable_zerocopy_send_client": false, 00:16:37.879 "enable_zerocopy_send_server": true, 00:16:37.879 "impl_name": "ssl", 00:16:37.879 "recv_buf_size": 4096, 00:16:37.879 "send_buf_size": 4096, 00:16:37.879 "tls_version": 0, 00:16:37.879 "zerocopy_threshold": 0 00:16:37.879 } 00:16:37.879 }, 00:16:37.879 { 00:16:37.879 "method": "sock_impl_set_options", 00:16:37.879 "params": { 00:16:37.879 "enable_ktls": false, 00:16:37.879 "enable_placement_id": 0, 00:16:37.879 "enable_quickack": false, 00:16:37.879 "enable_recv_pipe": true, 00:16:37.879 "enable_zerocopy_send_client": false, 00:16:37.879 "enable_zerocopy_send_server": true, 00:16:37.879 "impl_name": "posix", 00:16:37.879 "recv_buf_size": 2097152, 00:16:37.879 "send_buf_size": 2097152, 00:16:37.879 "tls_version": 0, 00:16:37.879 "zerocopy_threshold": 0 00:16:37.879 } 00:16:37.879 } 00:16:37.879 ] 00:16:37.879 }, 00:16:37.879 { 00:16:37.879 "subsystem": "vmd", 00:16:37.879 "config": [] 00:16:37.879 }, 00:16:37.879 { 00:16:37.879 "subsystem": "accel", 00:16:37.879 "config": [ 00:16:37.879 { 00:16:37.879 "method": "accel_set_options", 00:16:37.879 "params": { 00:16:37.879 "buf_count": 2048, 00:16:37.879 "large_cache_size": 16, 00:16:37.879 "sequence_count": 2048, 00:16:37.879 "small_cache_size": 128, 00:16:37.879 "task_count": 2048 00:16:37.879 } 00:16:37.879 } 00:16:37.879 ] 00:16:37.879 }, 00:16:37.879 { 00:16:37.879 "subsystem": "bdev", 00:16:37.879 "config": [ 00:16:37.879 { 00:16:37.879 "method": "bdev_set_options", 00:16:37.879 "params": { 00:16:37.879 "bdev_auto_examine": true, 00:16:37.879 "bdev_io_cache_size": 256, 00:16:37.879 "bdev_io_pool_size": 65535, 00:16:37.879 "iobuf_large_cache_size": 16, 00:16:37.879 "iobuf_small_cache_size": 128 00:16:37.879 } 00:16:37.879 }, 00:16:37.879 { 00:16:37.879 "method": "bdev_raid_set_options", 00:16:37.879 "params": { 00:16:37.879 "process_max_bandwidth_mb_sec": 0, 00:16:37.879 "process_window_size_kb": 1024 00:16:37.879 } 00:16:37.879 }, 00:16:37.879 { 00:16:37.879 "method": "bdev_iscsi_set_options", 00:16:37.879 "params": { 00:16:37.879 "timeout_sec": 30 00:16:37.879 } 00:16:37.879 }, 00:16:37.879 { 00:16:37.879 "method": "bdev_nvme_set_options", 00:16:37.879 "params": { 00:16:37.879 "action_on_timeout": "none", 00:16:37.879 "allow_accel_sequence": false, 00:16:37.879 "arbitration_burst": 0, 00:16:37.879 "bdev_retry_count": 3, 00:16:37.879 "ctrlr_loss_timeout_sec": 0, 00:16:37.879 "delay_cmd_submit": true, 00:16:37.879 "dhchap_dhgroups": [ 00:16:37.880 "null", 00:16:37.880 "ffdhe2048", 00:16:37.880 "ffdhe3072", 00:16:37.880 "ffdhe4096", 00:16:37.880 "ffdhe6144", 00:16:37.880 "ffdhe8192" 00:16:37.880 ], 00:16:37.880 "dhchap_digests": [ 00:16:37.880 "sha256", 00:16:37.880 "sha384", 00:16:37.880 "sha512" 00:16:37.880 ], 00:16:37.880 "disable_auto_failback": false, 00:16:37.880 "fast_io_fail_timeout_sec": 0, 00:16:37.880 "generate_uuids": false, 00:16:37.880 "high_priority_weight": 0, 00:16:37.880 "io_path_stat": false, 00:16:37.880 "io_queue_requests": 512, 00:16:37.880 "keep_alive_timeout_ms": 10000, 00:16:37.880 "low_priority_weight": 0, 00:16:37.880 "medium_priority_weight": 0, 00:16:37.880 "nvme_adminq_poll_period_us": 10000, 00:16:37.880 "nvme_error_stat": false, 00:16:37.880 "nvme_ioq_poll_period_us": 0, 00:16:37.880 "rdma_cm_event_timeout_ms": 0, 00:16:37.880 "rdma_max_cq_size": 0, 00:16:37.880 "rdma_srq_size": 0, 00:16:37.880 "reconnect_delay_sec": 0, 00:16:37.880 "timeout_admin_us": 0, 00:16:37.880 "timeout_us": 0, 00:16:37.880 "transport_ack_timeout": 0, 00:16:37.880 "transport_retry_count": 4, 00:16:37.880 "transport_tos": 0 00:16:37.880 } 00:16:37.880 }, 00:16:37.880 { 00:16:37.880 "method": "bdev_nvme_attach_controller", 00:16:37.880 "params": { 00:16:37.880 "adrfam": "IPv4", 00:16:37.880 "ctrlr_loss_timeout_sec": 0, 00:16:37.880 "ddgst": false, 00:16:37.880 "fast_io_fail_timeout_sec": 0, 00:16:37.880 "hdgst": false, 00:16:37.880 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:16:37.880 "multipath": "multipath", 00:16:37.880 "name": "TLSTEST", 00:16:37.880 "prchk_guard": false, 00:16:37.880 "prchk_reftag": false, 00:16:37.880 "psk": "key0", 00:16:37.880 "reconnect_delay_sec": 0, 00:16:37.880 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:16:37.880 "traddr": "10.0.0.3", 00:16:37.880 "trsvcid": "4420", 00:16:37.880 "trtype": "TCP" 00:16:37.880 } 00:16:37.880 }, 00:16:37.880 { 00:16:37.880 "method": "bdev_nvme_set_hotplug", 00:16:37.880 "params": { 00:16:37.880 "enable": false, 00:16:37.880 "period_us": 100000 00:16:37.880 } 00:16:37.880 }, 00:16:37.880 { 00:16:37.880 "method": "bdev_wait_for_examine" 00:16:37.880 } 00:16:37.880 ] 00:16:37.880 }, 00:16:37.880 { 00:16:37.880 "subsystem": "nbd", 00:16:37.880 "config": [] 00:16:37.880 } 00:16:37.880 ] 00:16:37.880 }' 00:16:37.880 11:27:19 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:16:37.880 11:27:19 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@836 -- # local max_retries=100 00:16:37.880 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:16:37.880 11:27:19 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:16:37.880 11:27:19 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@840 -- # xtrace_disable 00:16:37.880 11:27:19 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:16:37.880 [2024-10-07 11:27:19.424450] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:16:37.880 [2024-10-07 11:27:19.424570] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid84708 ] 00:16:37.880 [2024-10-07 11:27:19.555659] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:38.138 [2024-10-07 11:27:19.720395] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:16:38.395 [2024-10-07 11:27:19.929012] bdev_nvme_rpc.c: 514:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:16:38.962 11:27:20 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:16:38.962 11:27:20 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@864 -- # return 0 00:16:38.962 11:27:20 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@213 -- # /home/vagrant/spdk_repo/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:16:38.962 Running I/O for 10 seconds... 00:16:41.265 3744.00 IOPS, 14.62 MiB/s [2024-10-07T11:27:23.913Z] 3799.50 IOPS, 14.84 MiB/s [2024-10-07T11:27:24.846Z] 3835.00 IOPS, 14.98 MiB/s [2024-10-07T11:27:25.779Z] 3820.50 IOPS, 14.92 MiB/s [2024-10-07T11:27:26.737Z] 3806.80 IOPS, 14.87 MiB/s [2024-10-07T11:27:27.680Z] 3804.33 IOPS, 14.86 MiB/s [2024-10-07T11:27:29.050Z] 3818.43 IOPS, 14.92 MiB/s [2024-10-07T11:27:29.985Z] 3827.75 IOPS, 14.95 MiB/s [2024-10-07T11:27:30.920Z] 3838.00 IOPS, 14.99 MiB/s [2024-10-07T11:27:30.920Z] 3833.70 IOPS, 14.98 MiB/s 00:16:49.209 Latency(us) 00:16:49.209 [2024-10-07T11:27:30.920Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:16:49.209 Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:16:49.209 Verification LBA range: start 0x0 length 0x2000 00:16:49.209 TLSTESTn1 : 10.02 3839.21 15.00 0.00 0.00 33276.56 6970.65 33602.09 00:16:49.209 [2024-10-07T11:27:30.920Z] =================================================================================================================== 00:16:49.209 [2024-10-07T11:27:30.920Z] Total : 3839.21 15.00 0.00 0.00 33276.56 6970.65 33602.09 00:16:49.209 { 00:16:49.209 "results": [ 00:16:49.209 { 00:16:49.209 "job": "TLSTESTn1", 00:16:49.209 "core_mask": "0x4", 00:16:49.209 "workload": "verify", 00:16:49.209 "status": "finished", 00:16:49.209 "verify_range": { 00:16:49.209 "start": 0, 00:16:49.209 "length": 8192 00:16:49.209 }, 00:16:49.209 "queue_depth": 128, 00:16:49.209 "io_size": 4096, 00:16:49.209 "runtime": 10.018457, 00:16:49.209 "iops": 3839.2139627888805, 00:16:49.209 "mibps": 14.996929542144064, 00:16:49.209 "io_failed": 0, 00:16:49.209 "io_timeout": 0, 00:16:49.209 "avg_latency_us": 33276.556389068115, 00:16:49.209 "min_latency_us": 6970.647272727273, 00:16:49.209 "max_latency_us": 33602.09454545454 00:16:49.209 } 00:16:49.209 ], 00:16:49.209 "core_count": 1 00:16:49.209 } 00:16:49.209 11:27:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@215 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:16:49.209 11:27:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@216 -- # killprocess 84708 00:16:49.209 11:27:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@950 -- # '[' -z 84708 ']' 00:16:49.209 11:27:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@954 -- # kill -0 84708 00:16:49.209 11:27:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # uname 00:16:49.209 11:27:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:16:49.209 11:27:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 84708 00:16:49.209 11:27:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # process_name=reactor_2 00:16:49.209 11:27:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@960 -- # '[' reactor_2 = sudo ']' 00:16:49.209 killing process with pid 84708 00:16:49.209 11:27:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@968 -- # echo 'killing process with pid 84708' 00:16:49.209 11:27:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@969 -- # kill 84708 00:16:49.209 Received shutdown signal, test time was about 10.000000 seconds 00:16:49.209 00:16:49.209 Latency(us) 00:16:49.209 [2024-10-07T11:27:30.920Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:16:49.209 [2024-10-07T11:27:30.920Z] =================================================================================================================== 00:16:49.209 [2024-10-07T11:27:30.920Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:16:49.209 11:27:30 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@974 -- # wait 84708 00:16:49.467 11:27:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@217 -- # killprocess 84664 00:16:49.467 11:27:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@950 -- # '[' -z 84664 ']' 00:16:49.467 11:27:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@954 -- # kill -0 84664 00:16:49.467 11:27:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # uname 00:16:49.467 11:27:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:16:49.467 11:27:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 84664 00:16:49.467 11:27:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # process_name=reactor_1 00:16:49.467 11:27:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@960 -- # '[' reactor_1 = sudo ']' 00:16:49.467 killing process with pid 84664 00:16:49.467 11:27:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@968 -- # echo 'killing process with pid 84664' 00:16:49.467 11:27:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@969 -- # kill 84664 00:16:49.467 11:27:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@974 -- # wait 84664 00:16:49.725 11:27:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@220 -- # nvmfappstart 00:16:49.725 11:27:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:16:49.725 11:27:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@724 -- # xtrace_disable 00:16:49.725 11:27:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:16:49.725 11:27:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@507 -- # nvmfpid=84856 00:16:49.725 11:27:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@508 -- # waitforlisten 84856 00:16:49.725 11:27:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@506 -- # ip netns exec nvmf_tgt_ns_spdk /home/vagrant/spdk_repo/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF 00:16:49.725 11:27:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@831 -- # '[' -z 84856 ']' 00:16:49.725 11:27:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:49.725 11:27:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@836 -- # local max_retries=100 00:16:49.725 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:49.725 11:27:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:49.725 11:27:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@840 -- # xtrace_disable 00:16:49.725 11:27:31 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:16:49.725 [2024-10-07 11:27:31.411158] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:16:49.725 [2024-10-07 11:27:31.411276] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:49.983 [2024-10-07 11:27:31.555602] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:50.241 [2024-10-07 11:27:31.706476] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:50.241 [2024-10-07 11:27:31.706558] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:50.241 [2024-10-07 11:27:31.706572] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:16:50.241 [2024-10-07 11:27:31.706584] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:16:50.241 [2024-10-07 11:27:31.706594] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:50.241 [2024-10-07 11:27:31.707151] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:16:50.806 11:27:32 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:16:50.806 11:27:32 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@864 -- # return 0 00:16:50.806 11:27:32 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:16:50.806 11:27:32 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@730 -- # xtrace_disable 00:16:50.806 11:27:32 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:16:51.065 11:27:32 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:51.065 11:27:32 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@221 -- # setup_nvmf_tgt /tmp/tmp.PjWRSOdBbt 00:16:51.065 11:27:32 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@50 -- # local key=/tmp/tmp.PjWRSOdBbt 00:16:51.065 11:27:32 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@52 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:16:51.322 [2024-10-07 11:27:32.886511] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:16:51.322 11:27:32 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@53 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:16:51.580 11:27:33 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@54 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4420 -k 00:16:51.837 [2024-10-07 11:27:33.422574] tcp.c:1031:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:16:51.837 [2024-10-07 11:27:33.422912] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:16:51.837 11:27:33 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@56 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:16:52.104 malloc0 00:16:52.104 11:27:33 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@57 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:16:52.385 11:27:33 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@58 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py keyring_file_add_key key0 /tmp/tmp.PjWRSOdBbt 00:16:52.642 11:27:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@59 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk key0 00:16:52.900 11:27:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@224 -- # bdevperf_pid=84976 00:16:52.900 11:27:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@222 -- # /home/vagrant/spdk_repo/spdk/build/examples/bdevperf -m 2 -z -r /var/tmp/bdevperf.sock -q 128 -o 4k -w verify -t 1 00:16:52.900 11:27:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@226 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:16:52.900 11:27:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@227 -- # waitforlisten 84976 /var/tmp/bdevperf.sock 00:16:52.900 11:27:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@831 -- # '[' -z 84976 ']' 00:16:52.900 11:27:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:16:52.900 11:27:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@836 -- # local max_retries=100 00:16:52.900 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:16:52.900 11:27:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:16:52.900 11:27:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@840 -- # xtrace_disable 00:16:52.900 11:27:34 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:16:52.900 [2024-10-07 11:27:34.558724] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:16:52.900 [2024-10-07 11:27:34.558816] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid84976 ] 00:16:53.158 [2024-10-07 11:27:34.696941] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:53.158 [2024-10-07 11:27:34.823464] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:16:54.091 11:27:35 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:16:54.091 11:27:35 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@864 -- # return 0 00:16:54.091 11:27:35 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@229 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock keyring_file_add_key key0 /tmp/tmp.PjWRSOdBbt 00:16:54.348 11:27:35 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@230 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b nvme0 -t tcp -a 10.0.0.3 -s 4420 -f ipv4 --psk key0 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 00:16:54.605 [2024-10-07 11:27:36.161267] bdev_nvme_rpc.c: 514:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:16:54.605 nvme0n1 00:16:54.605 11:27:36 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@234 -- # /home/vagrant/spdk_repo/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:16:54.862 Running I/O for 1 seconds... 00:16:55.795 3832.00 IOPS, 14.97 MiB/s 00:16:55.795 Latency(us) 00:16:55.795 [2024-10-07T11:27:37.506Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:16:55.795 Job: nvme0n1 (Core Mask 0x2, workload: verify, depth: 128, IO size: 4096) 00:16:55.795 Verification LBA range: start 0x0 length 0x2000 00:16:55.795 nvme0n1 : 1.02 3882.60 15.17 0.00 0.00 32617.26 7477.06 26333.56 00:16:55.795 [2024-10-07T11:27:37.506Z] =================================================================================================================== 00:16:55.795 [2024-10-07T11:27:37.506Z] Total : 3882.60 15.17 0.00 0.00 32617.26 7477.06 26333.56 00:16:55.795 { 00:16:55.795 "results": [ 00:16:55.795 { 00:16:55.795 "job": "nvme0n1", 00:16:55.795 "core_mask": "0x2", 00:16:55.795 "workload": "verify", 00:16:55.795 "status": "finished", 00:16:55.795 "verify_range": { 00:16:55.795 "start": 0, 00:16:55.795 "length": 8192 00:16:55.795 }, 00:16:55.795 "queue_depth": 128, 00:16:55.795 "io_size": 4096, 00:16:55.795 "runtime": 1.019936, 00:16:55.795 "iops": 3882.5965550779656, 00:16:55.795 "mibps": 15.166392793273303, 00:16:55.795 "io_failed": 0, 00:16:55.795 "io_timeout": 0, 00:16:55.795 "avg_latency_us": 32617.256668503218, 00:16:55.795 "min_latency_us": 7477.061818181818, 00:16:55.795 "max_latency_us": 26333.556363636362 00:16:55.795 } 00:16:55.795 ], 00:16:55.795 "core_count": 1 00:16:55.795 } 00:16:55.795 11:27:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@236 -- # killprocess 84976 00:16:55.795 11:27:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@950 -- # '[' -z 84976 ']' 00:16:55.795 11:27:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@954 -- # kill -0 84976 00:16:55.795 11:27:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # uname 00:16:55.795 11:27:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:16:55.795 11:27:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 84976 00:16:55.795 11:27:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # process_name=reactor_1 00:16:55.795 11:27:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@960 -- # '[' reactor_1 = sudo ']' 00:16:55.795 killing process with pid 84976 00:16:55.795 11:27:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@968 -- # echo 'killing process with pid 84976' 00:16:55.795 Received shutdown signal, test time was about 1.000000 seconds 00:16:55.795 00:16:55.795 Latency(us) 00:16:55.795 [2024-10-07T11:27:37.506Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:16:55.795 [2024-10-07T11:27:37.506Z] =================================================================================================================== 00:16:55.795 [2024-10-07T11:27:37.506Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:16:55.795 11:27:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@969 -- # kill 84976 00:16:55.795 11:27:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@974 -- # wait 84976 00:16:56.053 11:27:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@237 -- # killprocess 84856 00:16:56.053 11:27:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@950 -- # '[' -z 84856 ']' 00:16:56.053 11:27:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@954 -- # kill -0 84856 00:16:56.053 11:27:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # uname 00:16:56.053 11:27:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:16:56.053 11:27:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 84856 00:16:56.053 11:27:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:16:56.053 11:27:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:16:56.053 killing process with pid 84856 00:16:56.053 11:27:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@968 -- # echo 'killing process with pid 84856' 00:16:56.053 11:27:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@969 -- # kill 84856 00:16:56.053 11:27:37 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@974 -- # wait 84856 00:16:56.619 11:27:38 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@242 -- # nvmfappstart 00:16:56.619 11:27:38 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:16:56.619 11:27:38 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@724 -- # xtrace_disable 00:16:56.619 11:27:38 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:16:56.619 11:27:38 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@507 -- # nvmfpid=85047 00:16:56.619 11:27:38 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@508 -- # waitforlisten 85047 00:16:56.619 11:27:38 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@506 -- # ip netns exec nvmf_tgt_ns_spdk /home/vagrant/spdk_repo/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF 00:16:56.619 11:27:38 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@831 -- # '[' -z 85047 ']' 00:16:56.619 11:27:38 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:56.619 11:27:38 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@836 -- # local max_retries=100 00:16:56.619 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:56.619 11:27:38 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:56.619 11:27:38 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@840 -- # xtrace_disable 00:16:56.619 11:27:38 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:16:56.619 [2024-10-07 11:27:38.102328] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:16:56.619 [2024-10-07 11:27:38.102448] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:56.619 [2024-10-07 11:27:38.241563] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:56.876 [2024-10-07 11:27:38.391258] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:56.876 [2024-10-07 11:27:38.391343] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:56.876 [2024-10-07 11:27:38.391357] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:16:56.876 [2024-10-07 11:27:38.391366] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:16:56.876 [2024-10-07 11:27:38.391373] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:56.876 [2024-10-07 11:27:38.391890] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:16:56.876 11:27:38 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:16:56.876 11:27:38 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@864 -- # return 0 00:16:56.876 11:27:38 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:16:56.876 11:27:38 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@730 -- # xtrace_disable 00:16:56.876 11:27:38 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:16:57.133 11:27:38 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:57.133 11:27:38 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@243 -- # rpc_cmd 00:16:57.133 11:27:38 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:57.133 11:27:38 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:16:57.133 [2024-10-07 11:27:38.612127] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:16:57.133 malloc0 00:16:57.133 [2024-10-07 11:27:38.646796] tcp.c:1031:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:16:57.133 [2024-10-07 11:27:38.647133] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:16:57.133 11:27:38 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:57.133 11:27:38 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@256 -- # bdevperf_pid=85089 00:16:57.133 11:27:38 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@254 -- # /home/vagrant/spdk_repo/spdk/build/examples/bdevperf -m 2 -z -r /var/tmp/bdevperf.sock -q 128 -o 4k -w verify -t 1 00:16:57.133 11:27:38 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@258 -- # waitforlisten 85089 /var/tmp/bdevperf.sock 00:16:57.133 11:27:38 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@831 -- # '[' -z 85089 ']' 00:16:57.133 11:27:38 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:16:57.133 11:27:38 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@836 -- # local max_retries=100 00:16:57.133 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:16:57.133 11:27:38 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:16:57.133 11:27:38 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@840 -- # xtrace_disable 00:16:57.133 11:27:38 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:16:57.133 [2024-10-07 11:27:38.737178] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:16:57.133 [2024-10-07 11:27:38.737291] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid85089 ] 00:16:57.390 [2024-10-07 11:27:38.878226] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:57.390 [2024-10-07 11:27:39.003370] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:16:58.323 11:27:39 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:16:58.323 11:27:39 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@864 -- # return 0 00:16:58.323 11:27:39 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@259 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock keyring_file_add_key key0 /tmp/tmp.PjWRSOdBbt 00:16:58.581 11:27:40 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@260 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b nvme0 -t tcp -a 10.0.0.3 -s 4420 -f ipv4 --psk key0 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 00:16:58.838 [2024-10-07 11:27:40.489503] bdev_nvme_rpc.c: 514:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:16:59.096 nvme0n1 00:16:59.096 11:27:40 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@264 -- # /home/vagrant/spdk_repo/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:16:59.096 Running I/O for 1 seconds... 00:17:00.029 3584.00 IOPS, 14.00 MiB/s 00:17:00.029 Latency(us) 00:17:00.029 [2024-10-07T11:27:41.740Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:00.029 Job: nvme0n1 (Core Mask 0x2, workload: verify, depth: 128, IO size: 4096) 00:17:00.029 Verification LBA range: start 0x0 length 0x2000 00:17:00.029 nvme0n1 : 1.03 3611.47 14.11 0.00 0.00 35035.61 10545.34 24546.21 00:17:00.029 [2024-10-07T11:27:41.740Z] =================================================================================================================== 00:17:00.029 [2024-10-07T11:27:41.740Z] Total : 3611.47 14.11 0.00 0.00 35035.61 10545.34 24546.21 00:17:00.029 { 00:17:00.029 "results": [ 00:17:00.029 { 00:17:00.029 "job": "nvme0n1", 00:17:00.029 "core_mask": "0x2", 00:17:00.029 "workload": "verify", 00:17:00.029 "status": "finished", 00:17:00.029 "verify_range": { 00:17:00.029 "start": 0, 00:17:00.029 "length": 8192 00:17:00.029 }, 00:17:00.029 "queue_depth": 128, 00:17:00.029 "io_size": 4096, 00:17:00.029 "runtime": 1.027835, 00:17:00.029 "iops": 3611.474604386891, 00:17:00.029 "mibps": 14.107322673386292, 00:17:00.029 "io_failed": 0, 00:17:00.029 "io_timeout": 0, 00:17:00.029 "avg_latency_us": 35035.61429467084, 00:17:00.029 "min_latency_us": 10545.338181818182, 00:17:00.029 "max_latency_us": 24546.21090909091 00:17:00.029 } 00:17:00.029 ], 00:17:00.029 "core_count": 1 00:17:00.029 } 00:17:00.287 11:27:41 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@267 -- # rpc_cmd save_config 00:17:00.287 11:27:41 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:00.287 11:27:41 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:17:00.287 11:27:41 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:00.287 11:27:41 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@267 -- # tgtcfg='{ 00:17:00.287 "subsystems": [ 00:17:00.287 { 00:17:00.287 "subsystem": "keyring", 00:17:00.287 "config": [ 00:17:00.287 { 00:17:00.287 "method": "keyring_file_add_key", 00:17:00.287 "params": { 00:17:00.287 "name": "key0", 00:17:00.287 "path": "/tmp/tmp.PjWRSOdBbt" 00:17:00.287 } 00:17:00.287 } 00:17:00.287 ] 00:17:00.287 }, 00:17:00.287 { 00:17:00.287 "subsystem": "iobuf", 00:17:00.287 "config": [ 00:17:00.287 { 00:17:00.287 "method": "iobuf_set_options", 00:17:00.287 "params": { 00:17:00.287 "large_bufsize": 135168, 00:17:00.287 "large_pool_count": 1024, 00:17:00.287 "small_bufsize": 8192, 00:17:00.287 "small_pool_count": 8192 00:17:00.287 } 00:17:00.287 } 00:17:00.287 ] 00:17:00.287 }, 00:17:00.287 { 00:17:00.287 "subsystem": "sock", 00:17:00.287 "config": [ 00:17:00.287 { 00:17:00.287 "method": "sock_set_default_impl", 00:17:00.287 "params": { 00:17:00.287 "impl_name": "posix" 00:17:00.287 } 00:17:00.287 }, 00:17:00.287 { 00:17:00.287 "method": "sock_impl_set_options", 00:17:00.287 "params": { 00:17:00.287 "enable_ktls": false, 00:17:00.287 "enable_placement_id": 0, 00:17:00.287 "enable_quickack": false, 00:17:00.287 "enable_recv_pipe": true, 00:17:00.287 "enable_zerocopy_send_client": false, 00:17:00.287 "enable_zerocopy_send_server": true, 00:17:00.287 "impl_name": "ssl", 00:17:00.287 "recv_buf_size": 4096, 00:17:00.287 "send_buf_size": 4096, 00:17:00.287 "tls_version": 0, 00:17:00.287 "zerocopy_threshold": 0 00:17:00.287 } 00:17:00.287 }, 00:17:00.287 { 00:17:00.287 "method": "sock_impl_set_options", 00:17:00.287 "params": { 00:17:00.287 "enable_ktls": false, 00:17:00.287 "enable_placement_id": 0, 00:17:00.287 "enable_quickack": false, 00:17:00.287 "enable_recv_pipe": true, 00:17:00.287 "enable_zerocopy_send_client": false, 00:17:00.287 "enable_zerocopy_send_server": true, 00:17:00.287 "impl_name": "posix", 00:17:00.287 "recv_buf_size": 2097152, 00:17:00.287 "send_buf_size": 2097152, 00:17:00.287 "tls_version": 0, 00:17:00.287 "zerocopy_threshold": 0 00:17:00.287 } 00:17:00.287 } 00:17:00.287 ] 00:17:00.287 }, 00:17:00.287 { 00:17:00.287 "subsystem": "vmd", 00:17:00.287 "config": [] 00:17:00.287 }, 00:17:00.287 { 00:17:00.287 "subsystem": "accel", 00:17:00.287 "config": [ 00:17:00.287 { 00:17:00.287 "method": "accel_set_options", 00:17:00.287 "params": { 00:17:00.287 "buf_count": 2048, 00:17:00.287 "large_cache_size": 16, 00:17:00.287 "sequence_count": 2048, 00:17:00.287 "small_cache_size": 128, 00:17:00.287 "task_count": 2048 00:17:00.287 } 00:17:00.287 } 00:17:00.287 ] 00:17:00.287 }, 00:17:00.287 { 00:17:00.287 "subsystem": "bdev", 00:17:00.287 "config": [ 00:17:00.287 { 00:17:00.287 "method": "bdev_set_options", 00:17:00.287 "params": { 00:17:00.287 "bdev_auto_examine": true, 00:17:00.287 "bdev_io_cache_size": 256, 00:17:00.287 "bdev_io_pool_size": 65535, 00:17:00.287 "iobuf_large_cache_size": 16, 00:17:00.287 "iobuf_small_cache_size": 128 00:17:00.287 } 00:17:00.287 }, 00:17:00.287 { 00:17:00.287 "method": "bdev_raid_set_options", 00:17:00.287 "params": { 00:17:00.287 "process_max_bandwidth_mb_sec": 0, 00:17:00.287 "process_window_size_kb": 1024 00:17:00.287 } 00:17:00.287 }, 00:17:00.287 { 00:17:00.287 "method": "bdev_iscsi_set_options", 00:17:00.287 "params": { 00:17:00.287 "timeout_sec": 30 00:17:00.287 } 00:17:00.287 }, 00:17:00.287 { 00:17:00.287 "method": "bdev_nvme_set_options", 00:17:00.287 "params": { 00:17:00.287 "action_on_timeout": "none", 00:17:00.287 "allow_accel_sequence": false, 00:17:00.287 "arbitration_burst": 0, 00:17:00.287 "bdev_retry_count": 3, 00:17:00.287 "ctrlr_loss_timeout_sec": 0, 00:17:00.287 "delay_cmd_submit": true, 00:17:00.287 "dhchap_dhgroups": [ 00:17:00.287 "null", 00:17:00.287 "ffdhe2048", 00:17:00.287 "ffdhe3072", 00:17:00.287 "ffdhe4096", 00:17:00.287 "ffdhe6144", 00:17:00.287 "ffdhe8192" 00:17:00.287 ], 00:17:00.287 "dhchap_digests": [ 00:17:00.287 "sha256", 00:17:00.287 "sha384", 00:17:00.287 "sha512" 00:17:00.287 ], 00:17:00.287 "disable_auto_failback": false, 00:17:00.287 "fast_io_fail_timeout_sec": 0, 00:17:00.287 "generate_uuids": false, 00:17:00.287 "high_priority_weight": 0, 00:17:00.287 "io_path_stat": false, 00:17:00.287 "io_queue_requests": 0, 00:17:00.287 "keep_alive_timeout_ms": 10000, 00:17:00.287 "low_priority_weight": 0, 00:17:00.287 "medium_priority_weight": 0, 00:17:00.287 "nvme_adminq_poll_period_us": 10000, 00:17:00.287 "nvme_error_stat": false, 00:17:00.287 "nvme_ioq_poll_period_us": 0, 00:17:00.287 "rdma_cm_event_timeout_ms": 0, 00:17:00.287 "rdma_max_cq_size": 0, 00:17:00.287 "rdma_srq_size": 0, 00:17:00.287 "reconnect_delay_sec": 0, 00:17:00.287 "timeout_admin_us": 0, 00:17:00.287 "timeout_us": 0, 00:17:00.287 "transport_ack_timeout": 0, 00:17:00.287 "transport_retry_count": 4, 00:17:00.287 "transport_tos": 0 00:17:00.287 } 00:17:00.287 }, 00:17:00.287 { 00:17:00.287 "method": "bdev_nvme_set_hotplug", 00:17:00.287 "params": { 00:17:00.287 "enable": false, 00:17:00.287 "period_us": 100000 00:17:00.287 } 00:17:00.287 }, 00:17:00.287 { 00:17:00.287 "method": "bdev_malloc_create", 00:17:00.287 "params": { 00:17:00.287 "block_size": 4096, 00:17:00.287 "dif_is_head_of_md": false, 00:17:00.287 "dif_pi_format": 0, 00:17:00.287 "dif_type": 0, 00:17:00.287 "md_size": 0, 00:17:00.287 "name": "malloc0", 00:17:00.287 "num_blocks": 8192, 00:17:00.287 "optimal_io_boundary": 0, 00:17:00.287 "physical_block_size": 4096, 00:17:00.287 "uuid": "5e8b6f0d-bcc4-452f-ad81-35ae1ca8cbf2" 00:17:00.287 } 00:17:00.287 }, 00:17:00.287 { 00:17:00.287 "method": "bdev_wait_for_examine" 00:17:00.287 } 00:17:00.287 ] 00:17:00.287 }, 00:17:00.287 { 00:17:00.287 "subsystem": "nbd", 00:17:00.287 "config": [] 00:17:00.287 }, 00:17:00.287 { 00:17:00.287 "subsystem": "scheduler", 00:17:00.287 "config": [ 00:17:00.287 { 00:17:00.287 "method": "framework_set_scheduler", 00:17:00.288 "params": { 00:17:00.288 "name": "static" 00:17:00.288 } 00:17:00.288 } 00:17:00.288 ] 00:17:00.288 }, 00:17:00.288 { 00:17:00.288 "subsystem": "nvmf", 00:17:00.288 "config": [ 00:17:00.288 { 00:17:00.288 "method": "nvmf_set_config", 00:17:00.288 "params": { 00:17:00.288 "admin_cmd_passthru": { 00:17:00.288 "identify_ctrlr": false 00:17:00.288 }, 00:17:00.288 "dhchap_dhgroups": [ 00:17:00.288 "null", 00:17:00.288 "ffdhe2048", 00:17:00.288 "ffdhe3072", 00:17:00.288 "ffdhe4096", 00:17:00.288 "ffdhe6144", 00:17:00.288 "ffdhe8192" 00:17:00.288 ], 00:17:00.288 "dhchap_digests": [ 00:17:00.288 "sha256", 00:17:00.288 "sha384", 00:17:00.288 "sha512" 00:17:00.288 ], 00:17:00.288 "discovery_filter": "match_any" 00:17:00.288 } 00:17:00.288 }, 00:17:00.288 { 00:17:00.288 "method": "nvmf_set_max_subsystems", 00:17:00.288 "params": { 00:17:00.288 "max_subsystems": 1024 00:17:00.288 } 00:17:00.288 }, 00:17:00.288 { 00:17:00.288 "method": "nvmf_set_crdt", 00:17:00.288 "params": { 00:17:00.288 "crdt1": 0, 00:17:00.288 "crdt2": 0, 00:17:00.288 "crdt3": 0 00:17:00.288 } 00:17:00.288 }, 00:17:00.288 { 00:17:00.288 "method": "nvmf_create_transport", 00:17:00.288 "params": { 00:17:00.288 "abort_timeout_sec": 1, 00:17:00.288 "ack_timeout": 0, 00:17:00.288 "buf_cache_size": 4294967295, 00:17:00.288 "c2h_success": false, 00:17:00.288 "data_wr_pool_size": 0, 00:17:00.288 "dif_insert_or_strip": false, 00:17:00.288 "in_capsule_data_size": 4096, 00:17:00.288 "io_unit_size": 131072, 00:17:00.288 "max_aq_depth": 128, 00:17:00.288 "max_io_qpairs_per_ctrlr": 127, 00:17:00.288 "max_io_size": 131072, 00:17:00.288 "max_queue_depth": 128, 00:17:00.288 "num_shared_buffers": 511, 00:17:00.288 "sock_priority": 0, 00:17:00.288 "trtype": "TCP", 00:17:00.288 "zcopy": false 00:17:00.288 } 00:17:00.288 }, 00:17:00.288 { 00:17:00.288 "method": "nvmf_create_subsystem", 00:17:00.288 "params": { 00:17:00.288 "allow_any_host": false, 00:17:00.288 "ana_reporting": false, 00:17:00.288 "max_cntlid": 65519, 00:17:00.288 "max_namespaces": 32, 00:17:00.288 "min_cntlid": 1, 00:17:00.288 "model_number": "SPDK bdev Controller", 00:17:00.288 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:17:00.288 "serial_number": "00000000000000000000" 00:17:00.288 } 00:17:00.288 }, 00:17:00.288 { 00:17:00.288 "method": "nvmf_subsystem_add_host", 00:17:00.288 "params": { 00:17:00.288 "host": "nqn.2016-06.io.spdk:host1", 00:17:00.288 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:17:00.288 "psk": "key0" 00:17:00.288 } 00:17:00.288 }, 00:17:00.288 { 00:17:00.288 "method": "nvmf_subsystem_add_ns", 00:17:00.288 "params": { 00:17:00.288 "namespace": { 00:17:00.288 "bdev_name": "malloc0", 00:17:00.288 "nguid": "5E8B6F0DBCC4452FAD8135AE1CA8CBF2", 00:17:00.288 "no_auto_visible": false, 00:17:00.288 "nsid": 1, 00:17:00.288 "uuid": "5e8b6f0d-bcc4-452f-ad81-35ae1ca8cbf2" 00:17:00.288 }, 00:17:00.288 "nqn": "nqn.2016-06.io.spdk:cnode1" 00:17:00.288 } 00:17:00.288 }, 00:17:00.288 { 00:17:00.288 "method": "nvmf_subsystem_add_listener", 00:17:00.288 "params": { 00:17:00.288 "listen_address": { 00:17:00.288 "adrfam": "IPv4", 00:17:00.288 "traddr": "10.0.0.3", 00:17:00.288 "trsvcid": "4420", 00:17:00.288 "trtype": "TCP" 00:17:00.288 }, 00:17:00.288 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:17:00.288 "secure_channel": false, 00:17:00.288 "sock_impl": "ssl" 00:17:00.288 } 00:17:00.288 } 00:17:00.288 ] 00:17:00.288 } 00:17:00.288 ] 00:17:00.288 }' 00:17:00.288 11:27:41 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@268 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock save_config 00:17:00.546 11:27:42 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@268 -- # bperfcfg='{ 00:17:00.546 "subsystems": [ 00:17:00.546 { 00:17:00.546 "subsystem": "keyring", 00:17:00.546 "config": [ 00:17:00.546 { 00:17:00.546 "method": "keyring_file_add_key", 00:17:00.546 "params": { 00:17:00.546 "name": "key0", 00:17:00.546 "path": "/tmp/tmp.PjWRSOdBbt" 00:17:00.546 } 00:17:00.546 } 00:17:00.546 ] 00:17:00.546 }, 00:17:00.546 { 00:17:00.546 "subsystem": "iobuf", 00:17:00.546 "config": [ 00:17:00.546 { 00:17:00.546 "method": "iobuf_set_options", 00:17:00.546 "params": { 00:17:00.546 "large_bufsize": 135168, 00:17:00.546 "large_pool_count": 1024, 00:17:00.546 "small_bufsize": 8192, 00:17:00.546 "small_pool_count": 8192 00:17:00.546 } 00:17:00.546 } 00:17:00.546 ] 00:17:00.546 }, 00:17:00.546 { 00:17:00.547 "subsystem": "sock", 00:17:00.547 "config": [ 00:17:00.547 { 00:17:00.547 "method": "sock_set_default_impl", 00:17:00.547 "params": { 00:17:00.547 "impl_name": "posix" 00:17:00.547 } 00:17:00.547 }, 00:17:00.547 { 00:17:00.547 "method": "sock_impl_set_options", 00:17:00.547 "params": { 00:17:00.547 "enable_ktls": false, 00:17:00.547 "enable_placement_id": 0, 00:17:00.547 "enable_quickack": false, 00:17:00.547 "enable_recv_pipe": true, 00:17:00.547 "enable_zerocopy_send_client": false, 00:17:00.547 "enable_zerocopy_send_server": true, 00:17:00.547 "impl_name": "ssl", 00:17:00.547 "recv_buf_size": 4096, 00:17:00.547 "send_buf_size": 4096, 00:17:00.547 "tls_version": 0, 00:17:00.547 "zerocopy_threshold": 0 00:17:00.547 } 00:17:00.547 }, 00:17:00.547 { 00:17:00.547 "method": "sock_impl_set_options", 00:17:00.547 "params": { 00:17:00.547 "enable_ktls": false, 00:17:00.547 "enable_placement_id": 0, 00:17:00.547 "enable_quickack": false, 00:17:00.547 "enable_recv_pipe": true, 00:17:00.547 "enable_zerocopy_send_client": false, 00:17:00.547 "enable_zerocopy_send_server": true, 00:17:00.547 "impl_name": "posix", 00:17:00.547 "recv_buf_size": 2097152, 00:17:00.547 "send_buf_size": 2097152, 00:17:00.547 "tls_version": 0, 00:17:00.547 "zerocopy_threshold": 0 00:17:00.547 } 00:17:00.547 } 00:17:00.547 ] 00:17:00.547 }, 00:17:00.547 { 00:17:00.547 "subsystem": "vmd", 00:17:00.547 "config": [] 00:17:00.547 }, 00:17:00.547 { 00:17:00.547 "subsystem": "accel", 00:17:00.547 "config": [ 00:17:00.547 { 00:17:00.547 "method": "accel_set_options", 00:17:00.547 "params": { 00:17:00.547 "buf_count": 2048, 00:17:00.547 "large_cache_size": 16, 00:17:00.547 "sequence_count": 2048, 00:17:00.547 "small_cache_size": 128, 00:17:00.547 "task_count": 2048 00:17:00.547 } 00:17:00.547 } 00:17:00.547 ] 00:17:00.547 }, 00:17:00.547 { 00:17:00.547 "subsystem": "bdev", 00:17:00.547 "config": [ 00:17:00.547 { 00:17:00.547 "method": "bdev_set_options", 00:17:00.547 "params": { 00:17:00.547 "bdev_auto_examine": true, 00:17:00.547 "bdev_io_cache_size": 256, 00:17:00.547 "bdev_io_pool_size": 65535, 00:17:00.547 "iobuf_large_cache_size": 16, 00:17:00.547 "iobuf_small_cache_size": 128 00:17:00.547 } 00:17:00.547 }, 00:17:00.547 { 00:17:00.547 "method": "bdev_raid_set_options", 00:17:00.547 "params": { 00:17:00.547 "process_max_bandwidth_mb_sec": 0, 00:17:00.547 "process_window_size_kb": 1024 00:17:00.547 } 00:17:00.547 }, 00:17:00.547 { 00:17:00.547 "method": "bdev_iscsi_set_options", 00:17:00.547 "params": { 00:17:00.547 "timeout_sec": 30 00:17:00.547 } 00:17:00.547 }, 00:17:00.547 { 00:17:00.547 "method": "bdev_nvme_set_options", 00:17:00.547 "params": { 00:17:00.547 "action_on_timeout": "none", 00:17:00.547 "allow_accel_sequence": false, 00:17:00.547 "arbitration_burst": 0, 00:17:00.547 "bdev_retry_count": 3, 00:17:00.547 "ctrlr_loss_timeout_sec": 0, 00:17:00.547 "delay_cmd_submit": true, 00:17:00.547 "dhchap_dhgroups": [ 00:17:00.547 "null", 00:17:00.547 "ffdhe2048", 00:17:00.547 "ffdhe3072", 00:17:00.547 "ffdhe4096", 00:17:00.547 "ffdhe6144", 00:17:00.547 "ffdhe8192" 00:17:00.547 ], 00:17:00.547 "dhchap_digests": [ 00:17:00.547 "sha256", 00:17:00.547 "sha384", 00:17:00.547 "sha512" 00:17:00.547 ], 00:17:00.547 "disable_auto_failback": false, 00:17:00.547 "fast_io_fail_timeout_sec": 0, 00:17:00.547 "generate_uuids": false, 00:17:00.547 "high_priority_weight": 0, 00:17:00.547 "io_path_stat": false, 00:17:00.547 "io_queue_requests": 512, 00:17:00.547 "keep_alive_timeout_ms": 10000, 00:17:00.547 "low_priority_weight": 0, 00:17:00.547 "medium_priority_weight": 0, 00:17:00.547 "nvme_adminq_poll_period_us": 10000, 00:17:00.547 "nvme_error_stat": false, 00:17:00.547 "nvme_ioq_poll_period_us": 0, 00:17:00.547 "rdma_cm_event_timeout_ms": 0, 00:17:00.547 "rdma_max_cq_size": 0, 00:17:00.547 "rdma_srq_size": 0, 00:17:00.547 "reconnect_delay_sec": 0, 00:17:00.547 "timeout_admin_us": 0, 00:17:00.547 "timeout_us": 0, 00:17:00.547 "transport_ack_timeout": 0, 00:17:00.547 "transport_retry_count": 4, 00:17:00.547 "transport_tos": 0 00:17:00.547 } 00:17:00.547 }, 00:17:00.547 { 00:17:00.547 "method": "bdev_nvme_attach_controller", 00:17:00.547 "params": { 00:17:00.547 "adrfam": "IPv4", 00:17:00.547 "ctrlr_loss_timeout_sec": 0, 00:17:00.547 "ddgst": false, 00:17:00.547 "fast_io_fail_timeout_sec": 0, 00:17:00.547 "hdgst": false, 00:17:00.547 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:00.547 "multipath": "multipath", 00:17:00.547 "name": "nvme0", 00:17:00.547 "prchk_guard": false, 00:17:00.547 "prchk_reftag": false, 00:17:00.547 "psk": "key0", 00:17:00.547 "reconnect_delay_sec": 0, 00:17:00.547 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:00.547 "traddr": "10.0.0.3", 00:17:00.547 "trsvcid": "4420", 00:17:00.547 "trtype": "TCP" 00:17:00.547 } 00:17:00.547 }, 00:17:00.547 { 00:17:00.547 "method": "bdev_nvme_set_hotplug", 00:17:00.547 "params": { 00:17:00.547 "enable": false, 00:17:00.547 "period_us": 100000 00:17:00.547 } 00:17:00.547 }, 00:17:00.547 { 00:17:00.547 "method": "bdev_enable_histogram", 00:17:00.547 "params": { 00:17:00.547 "enable": true, 00:17:00.547 "name": "nvme0n1" 00:17:00.547 } 00:17:00.547 }, 00:17:00.547 { 00:17:00.547 "method": "bdev_wait_for_examine" 00:17:00.547 } 00:17:00.547 ] 00:17:00.547 }, 00:17:00.547 { 00:17:00.547 "subsystem": "nbd", 00:17:00.547 "config": [] 00:17:00.547 } 00:17:00.547 ] 00:17:00.547 }' 00:17:00.547 11:27:42 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@270 -- # killprocess 85089 00:17:00.547 11:27:42 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@950 -- # '[' -z 85089 ']' 00:17:00.547 11:27:42 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@954 -- # kill -0 85089 00:17:00.547 11:27:42 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # uname 00:17:00.547 11:27:42 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:17:00.547 11:27:42 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 85089 00:17:00.547 11:27:42 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # process_name=reactor_1 00:17:00.547 killing process with pid 85089 00:17:00.547 11:27:42 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@960 -- # '[' reactor_1 = sudo ']' 00:17:00.547 11:27:42 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@968 -- # echo 'killing process with pid 85089' 00:17:00.547 Received shutdown signal, test time was about 1.000000 seconds 00:17:00.547 00:17:00.547 Latency(us) 00:17:00.547 [2024-10-07T11:27:42.258Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:00.547 [2024-10-07T11:27:42.258Z] =================================================================================================================== 00:17:00.547 [2024-10-07T11:27:42.258Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:17:00.547 11:27:42 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@969 -- # kill 85089 00:17:00.547 11:27:42 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@974 -- # wait 85089 00:17:00.805 11:27:42 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@271 -- # killprocess 85047 00:17:00.805 11:27:42 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@950 -- # '[' -z 85047 ']' 00:17:00.805 11:27:42 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@954 -- # kill -0 85047 00:17:00.805 11:27:42 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # uname 00:17:00.805 11:27:42 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:17:00.805 11:27:42 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 85047 00:17:00.805 11:27:42 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:17:00.805 11:27:42 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:17:00.805 killing process with pid 85047 00:17:00.805 11:27:42 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@968 -- # echo 'killing process with pid 85047' 00:17:00.805 11:27:42 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@969 -- # kill 85047 00:17:00.805 11:27:42 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@974 -- # wait 85047 00:17:01.371 11:27:42 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@273 -- # nvmfappstart -c /dev/fd/62 00:17:01.371 11:27:42 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:17:01.371 11:27:42 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@724 -- # xtrace_disable 00:17:01.371 11:27:42 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@273 -- # echo '{ 00:17:01.371 "subsystems": [ 00:17:01.371 { 00:17:01.371 "subsystem": "keyring", 00:17:01.371 "config": [ 00:17:01.371 { 00:17:01.371 "method": "keyring_file_add_key", 00:17:01.371 "params": { 00:17:01.371 "name": "key0", 00:17:01.371 "path": "/tmp/tmp.PjWRSOdBbt" 00:17:01.371 } 00:17:01.371 } 00:17:01.371 ] 00:17:01.371 }, 00:17:01.371 { 00:17:01.371 "subsystem": "iobuf", 00:17:01.371 "config": [ 00:17:01.371 { 00:17:01.371 "method": "iobuf_set_options", 00:17:01.371 "params": { 00:17:01.371 "large_bufsize": 135168, 00:17:01.371 "large_pool_count": 1024, 00:17:01.371 "small_bufsize": 8192, 00:17:01.371 "small_pool_count": 8192 00:17:01.371 } 00:17:01.371 } 00:17:01.371 ] 00:17:01.371 }, 00:17:01.371 { 00:17:01.371 "subsystem": "sock", 00:17:01.371 "config": [ 00:17:01.371 { 00:17:01.371 "method": "sock_set_default_impl", 00:17:01.371 "params": { 00:17:01.371 "impl_name": "posix" 00:17:01.371 } 00:17:01.371 }, 00:17:01.371 { 00:17:01.371 "method": "sock_impl_set_options", 00:17:01.371 "params": { 00:17:01.371 "enable_ktls": false, 00:17:01.371 "enable_placement_id": 0, 00:17:01.371 "enable_quickack": false, 00:17:01.371 "enable_recv_pipe": true, 00:17:01.371 "enable_zerocopy_send_client": false, 00:17:01.371 "enable_zerocopy_send_server": true, 00:17:01.371 "impl_name": "ssl", 00:17:01.371 "recv_buf_size": 4096, 00:17:01.371 "send_buf_size": 4096, 00:17:01.371 "tls_version": 0, 00:17:01.371 "zerocopy_threshold": 0 00:17:01.371 } 00:17:01.371 }, 00:17:01.371 { 00:17:01.371 "method": "sock_impl_set_options", 00:17:01.371 "params": { 00:17:01.371 "enable_ktls": false, 00:17:01.371 "enable_placement_id": 0, 00:17:01.371 "enable_quickack": false, 00:17:01.371 "enable_recv_pipe": true, 00:17:01.371 "enable_zerocopy_send_client": false, 00:17:01.371 "enable_zerocopy_send_server": true, 00:17:01.371 "impl_name": "posix", 00:17:01.371 "recv_buf_size": 2097152, 00:17:01.371 "send_buf_size": 2097152, 00:17:01.371 "tls_version": 0, 00:17:01.371 "zerocopy_threshold": 0 00:17:01.371 } 00:17:01.371 } 00:17:01.371 ] 00:17:01.371 }, 00:17:01.371 { 00:17:01.371 "subsystem": "vmd", 00:17:01.371 "config": [] 00:17:01.371 }, 00:17:01.371 { 00:17:01.371 "subsystem": "accel", 00:17:01.371 "config": [ 00:17:01.371 { 00:17:01.371 "method": "accel_set_options", 00:17:01.371 "params": { 00:17:01.371 "buf_count": 2048, 00:17:01.371 "large_cache_size": 16, 00:17:01.371 "sequence_count": 2048, 00:17:01.371 "small_cache_size": 128, 00:17:01.371 "task_count": 2048 00:17:01.371 } 00:17:01.371 } 00:17:01.371 ] 00:17:01.371 }, 00:17:01.371 { 00:17:01.371 "subsystem": "bdev", 00:17:01.371 "config": [ 00:17:01.371 { 00:17:01.371 "method": "bdev_set_options", 00:17:01.371 "params": { 00:17:01.371 "bdev_auto_examine": true, 00:17:01.371 "bdev_io_cache_size": 256, 00:17:01.371 "bdev_io_pool_size": 65535, 00:17:01.371 "iobuf_large_cache_size": 16, 00:17:01.371 "iobuf_small_cache_size": 128 00:17:01.371 } 00:17:01.371 }, 00:17:01.371 { 00:17:01.371 "method": "bdev_raid_set_options", 00:17:01.371 "params": { 00:17:01.371 "process_max_bandwidth_mb_sec": 0, 00:17:01.371 "process_window_size_kb": 1024 00:17:01.371 } 00:17:01.371 }, 00:17:01.371 { 00:17:01.371 "method": "bdev_iscsi_set_options", 00:17:01.371 "params": { 00:17:01.371 "timeout_sec": 30 00:17:01.371 } 00:17:01.371 }, 00:17:01.371 { 00:17:01.371 "method": "bdev_nvme_set_options", 00:17:01.371 "params": { 00:17:01.371 "action_on_timeout": "none", 00:17:01.371 "allow_accel_sequence": false, 00:17:01.371 "arbitration_burst": 0, 00:17:01.371 "bdev_retry_count": 3, 00:17:01.371 "ctrlr_loss_timeout_sec": 0, 00:17:01.372 "delay_cmd_submit": true, 00:17:01.372 "dhchap_dhgroups": [ 00:17:01.372 "null", 00:17:01.372 "ffdhe2048", 00:17:01.372 "ffdhe3072", 00:17:01.372 "ffdhe4096", 00:17:01.372 "ffdhe6144", 00:17:01.372 "ffdhe8192" 00:17:01.372 ], 00:17:01.372 "dhchap_digests": [ 00:17:01.372 "sha256", 00:17:01.372 "sha384", 00:17:01.372 "sha512" 00:17:01.372 ], 00:17:01.372 "disable_auto_failback": false, 00:17:01.372 "fast_io_fail_timeout_sec": 0, 00:17:01.372 "generate_uuids": false, 00:17:01.372 "high_priority_weight": 0, 00:17:01.372 "io_path_stat": false, 00:17:01.372 "io_queue_requests": 0, 00:17:01.372 "keep_alive_timeout_ms": 10000, 00:17:01.372 "low_priority_weight": 0, 00:17:01.372 "medium_priority_weight": 0, 00:17:01.372 "nvme_adminq_poll_period_us": 10000, 00:17:01.372 "nvme_error_stat": false, 00:17:01.372 "nvme_ioq_poll_period_us": 0, 00:17:01.372 "rdma_cm_event_timeout_ms": 0, 00:17:01.372 "rdma_max_cq_size": 0, 00:17:01.372 "rdma_srq_size": 0, 00:17:01.372 "reconnect_delay_sec": 0, 00:17:01.372 "timeout_admin_us": 0, 00:17:01.372 "timeout_us": 0, 00:17:01.372 "transport_ack_timeout": 0, 00:17:01.372 "transport_retry_count": 4, 00:17:01.372 "transport_tos": 0 00:17:01.372 } 00:17:01.372 }, 00:17:01.372 { 00:17:01.372 "method": "bdev_nvme_set_hotplug", 00:17:01.372 "params": { 00:17:01.372 "enable": false, 00:17:01.372 "period_us": 100000 00:17:01.372 } 00:17:01.372 }, 00:17:01.372 { 00:17:01.372 "method": "bdev_malloc_create", 00:17:01.372 "params": { 00:17:01.372 "block_size": 4096, 00:17:01.372 "dif_is_head_of_md": false, 00:17:01.372 "dif_pi_format": 0, 00:17:01.372 "dif_type": 0, 00:17:01.372 "md_size": 0, 00:17:01.372 "name": "malloc0", 00:17:01.372 "num_blocks": 8192, 00:17:01.372 "optimal_io_boundary": 0, 00:17:01.372 "physical_block_size": 4096, 00:17:01.372 "uuid": "5e8b6f0d-bcc4-452f-ad81-35ae1ca8cbf2" 00:17:01.372 } 00:17:01.372 }, 00:17:01.372 { 00:17:01.372 "method": "bdev_wait_for_examine" 00:17:01.372 } 00:17:01.372 ] 00:17:01.372 }, 00:17:01.372 { 00:17:01.372 "subsystem": "nbd", 00:17:01.372 "config": [] 00:17:01.372 }, 00:17:01.372 { 00:17:01.372 "subsystem": "scheduler", 00:17:01.372 "config": [ 00:17:01.372 { 00:17:01.372 "method": "framework_set_scheduler", 00:17:01.372 "params": { 00:17:01.372 "name": "static" 00:17:01.372 } 00:17:01.372 } 00:17:01.372 ] 00:17:01.372 }, 00:17:01.372 { 00:17:01.372 "subsystem": "nvmf", 00:17:01.372 "config": [ 00:17:01.372 { 00:17:01.372 "method": "nvmf_set_config", 00:17:01.372 "params": { 00:17:01.372 "admin_cmd_passthru": { 00:17:01.372 "identify_ctrlr": false 00:17:01.372 }, 00:17:01.372 "dhchap_dhgroups": [ 00:17:01.372 "null", 00:17:01.372 "ffdhe2048", 00:17:01.372 "ffdhe3072", 00:17:01.372 "ffdhe4096", 00:17:01.372 "ffdhe6144", 00:17:01.372 "ffdhe8192" 00:17:01.372 ], 00:17:01.372 "dhchap_digests": [ 00:17:01.372 "sha256", 00:17:01.372 "sha384", 00:17:01.372 "sha512" 00:17:01.372 ], 00:17:01.372 "discovery_filter": "match_any" 00:17:01.372 } 00:17:01.372 }, 00:17:01.372 { 00:17:01.372 "method": "nvmf_set_max_subsystems", 00:17:01.372 "params": { 00:17:01.372 "max_subsystems": 1024 00:17:01.372 } 00:17:01.372 }, 00:17:01.372 { 00:17:01.372 "method": "nvmf_set_crdt", 00:17:01.372 "params": { 00:17:01.372 "crdt1": 0, 00:17:01.372 "crdt2": 0, 00:17:01.372 "crdt3": 0 00:17:01.372 } 00:17:01.372 }, 00:17:01.372 { 00:17:01.372 "method": "nvmf_create_transport", 00:17:01.372 "params": { 00:17:01.372 "abort_timeout_sec": 1, 00:17:01.372 "ack_timeout": 0, 00:17:01.372 "buf_cache_size": 4294967295, 00:17:01.372 "c2h_success": false, 00:17:01.372 "data_wr_pool_size": 0, 00:17:01.372 "dif_insert_or_strip": false, 00:17:01.372 "in_capsule_data_size": 4096, 00:17:01.372 "io_unit_size": 131072, 00:17:01.372 "max_aq_depth": 128, 00:17:01.372 "max_io_qpairs_per_ctrlr": 127, 00:17:01.372 "max_io_size": 131072, 00:17:01.372 "max_queue_depth": 128, 00:17:01.372 "num_shared_buffers": 511, 00:17:01.372 "sock_priority": 0, 00:17:01.372 "trtype": "TCP", 00:17:01.372 "zcopy": false 00:17:01.372 } 00:17:01.372 }, 00:17:01.372 { 00:17:01.372 "method": "nvmf_create_subsystem", 00:17:01.372 "params": { 00:17:01.372 "allow_any_host": false, 00:17:01.372 "ana_reporting": false, 00:17:01.372 "max_cntlid": 65519, 00:17:01.372 "max_namespaces": 32, 00:17:01.372 "min_cntlid": 1, 00:17:01.372 "model_number": "SPDK bdev Controller", 00:17:01.372 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:17:01.372 "serial_number": "00000000000000000000" 00:17:01.372 } 00:17:01.372 }, 00:17:01.372 { 00:17:01.372 "method": "nvmf_subsystem_add_host", 00:17:01.372 "params": { 00:17:01.372 "host": "nqn.2016-06.io.spdk:host1", 00:17:01.372 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:17:01.372 "psk": "key0" 00:17:01.372 } 00:17:01.372 }, 00:17:01.372 { 00:17:01.372 "method": "nvmf_subsystem_add_ns", 00:17:01.372 "params": { 00:17:01.372 "namespace": { 00:17:01.372 "bdev_name": "malloc0", 00:17:01.372 "nguid": "5E8B6F0DBCC4452FAD8135AE1CA8CBF2", 00:17:01.372 "no_auto_visible": false, 00:17:01.372 "nsid": 1, 00:17:01.372 "uuid": "5e8b6f0d-bcc4-452f-ad81-35ae1ca8cbf2" 00:17:01.372 }, 00:17:01.372 "nqn": "nqn.2016-06.io.spdk:cnode1" 00:17:01.372 } 00:17:01.372 }, 00:17:01.372 { 00:17:01.372 "method": "nvmf_subsystem_add_listener", 00:17:01.372 "params": { 00:17:01.372 "listen_address": { 00:17:01.372 "adrfam": "IPv4", 00:17:01.372 "traddr": "10.0.0.3", 00:17:01.372 "trsvcid": "4420", 00:17:01.372 "trtype": "TCP" 00:17:01.372 }, 00:17:01.372 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:17:01.372 "secure_channel": false, 00:17:01.372 "sock_impl": "ssl" 00:17:01.372 } 00:17:01.372 } 00:17:01.372 ] 00:17:01.372 } 00:17:01.372 ] 00:17:01.372 }' 00:17:01.372 11:27:42 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:17:01.372 11:27:42 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@507 -- # nvmfpid=85184 00:17:01.372 11:27:42 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@506 -- # ip netns exec nvmf_tgt_ns_spdk /home/vagrant/spdk_repo/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -c /dev/fd/62 00:17:01.372 11:27:42 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@508 -- # waitforlisten 85184 00:17:01.372 11:27:42 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@831 -- # '[' -z 85184 ']' 00:17:01.372 11:27:42 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:01.372 11:27:42 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@836 -- # local max_retries=100 00:17:01.372 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:01.372 11:27:42 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:01.372 11:27:42 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@840 -- # xtrace_disable 00:17:01.372 11:27:42 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:17:01.372 [2024-10-07 11:27:42.912961] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:17:01.372 [2024-10-07 11:27:42.913086] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:01.372 [2024-10-07 11:27:43.051392] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:01.630 [2024-10-07 11:27:43.199382] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:01.630 [2024-10-07 11:27:43.199463] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:01.630 [2024-10-07 11:27:43.199475] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:17:01.630 [2024-10-07 11:27:43.199484] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:17:01.630 [2024-10-07 11:27:43.199492] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:01.630 [2024-10-07 11:27:43.200035] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:17:01.888 [2024-10-07 11:27:43.476116] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:01.888 [2024-10-07 11:27:43.515275] tcp.c:1031:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:17:01.888 [2024-10-07 11:27:43.515614] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:17:02.456 11:27:44 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:17:02.456 11:27:44 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@864 -- # return 0 00:17:02.456 11:27:44 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:17:02.456 11:27:44 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@730 -- # xtrace_disable 00:17:02.456 11:27:44 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:17:02.456 11:27:44 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:02.456 11:27:44 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@276 -- # bdevperf_pid=85228 00:17:02.456 11:27:44 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@277 -- # waitforlisten 85228 /var/tmp/bdevperf.sock 00:17:02.456 11:27:44 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@831 -- # '[' -z 85228 ']' 00:17:02.456 11:27:44 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:02.456 11:27:44 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@274 -- # /home/vagrant/spdk_repo/spdk/build/examples/bdevperf -m 2 -z -r /var/tmp/bdevperf.sock -q 128 -o 4k -w verify -t 1 -c /dev/fd/63 00:17:02.456 11:27:44 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@836 -- # local max_retries=100 00:17:02.456 11:27:44 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@274 -- # echo '{ 00:17:02.456 "subsystems": [ 00:17:02.456 { 00:17:02.456 "subsystem": "keyring", 00:17:02.456 "config": [ 00:17:02.456 { 00:17:02.456 "method": "keyring_file_add_key", 00:17:02.456 "params": { 00:17:02.456 "name": "key0", 00:17:02.456 "path": "/tmp/tmp.PjWRSOdBbt" 00:17:02.456 } 00:17:02.456 } 00:17:02.456 ] 00:17:02.456 }, 00:17:02.456 { 00:17:02.456 "subsystem": "iobuf", 00:17:02.456 "config": [ 00:17:02.456 { 00:17:02.456 "method": "iobuf_set_options", 00:17:02.456 "params": { 00:17:02.456 "large_bufsize": 135168, 00:17:02.456 "large_pool_count": 1024, 00:17:02.456 "small_bufsize": 8192, 00:17:02.456 "small_pool_count": 8192 00:17:02.456 } 00:17:02.456 } 00:17:02.456 ] 00:17:02.456 }, 00:17:02.456 { 00:17:02.456 "subsystem": "sock", 00:17:02.456 "config": [ 00:17:02.456 { 00:17:02.456 "method": "sock_set_default_impl", 00:17:02.456 "params": { 00:17:02.456 "impl_name": "posix" 00:17:02.456 } 00:17:02.456 }, 00:17:02.456 { 00:17:02.456 "method": "sock_impl_set_options", 00:17:02.456 "params": { 00:17:02.456 "enable_ktls": false, 00:17:02.456 "enable_placement_id": 0, 00:17:02.456 "enable_quickack": false, 00:17:02.456 "enable_recv_pipe": true, 00:17:02.456 "enable_zerocopy_send_client": false, 00:17:02.456 "enable_zerocopy_send_server": true, 00:17:02.456 "impl_name": "ssl", 00:17:02.456 "recv_buf_size": 4096, 00:17:02.456 "send_buf_size": 4096, 00:17:02.456 "tls_version": 0, 00:17:02.456 "zerocopy_threshold": 0 00:17:02.456 } 00:17:02.456 }, 00:17:02.456 { 00:17:02.456 "method": "sock_impl_set_options", 00:17:02.456 "params": { 00:17:02.456 "enable_ktls": false, 00:17:02.456 "enable_placement_id": 0, 00:17:02.456 "enable_quickack": false, 00:17:02.456 "enable_recv_pipe": true, 00:17:02.456 "enable_zerocopy_send_client": false, 00:17:02.456 "enable_zerocopy_send_server": true, 00:17:02.456 "impl_name": "posix", 00:17:02.456 "recv_buf_size": 2097152, 00:17:02.456 "send_buf_size": 2097152, 00:17:02.456 "tls_version": 0, 00:17:02.456 "zerocopy_threshold": 0 00:17:02.456 } 00:17:02.456 } 00:17:02.456 ] 00:17:02.456 }, 00:17:02.456 { 00:17:02.456 "subsystem": "vmd", 00:17:02.456 "config": [] 00:17:02.456 }, 00:17:02.456 { 00:17:02.456 "subsystem": "accel", 00:17:02.456 "config": [ 00:17:02.456 { 00:17:02.456 "method": "accel_set_options", 00:17:02.456 "params": { 00:17:02.456 "buf_count": 2048, 00:17:02.456 "large_cache_size": 16, 00:17:02.456 "sequence_count": 2048, 00:17:02.456 "small_cache_size": 128, 00:17:02.456 "task_count": 2048 00:17:02.456 } 00:17:02.456 } 00:17:02.456 ] 00:17:02.456 }, 00:17:02.456 { 00:17:02.456 "subsystem": "bdev", 00:17:02.456 "config": [ 00:17:02.456 { 00:17:02.456 "method": "bdev_set_options", 00:17:02.456 "params": { 00:17:02.456 "bdev_auto_examine": true, 00:17:02.456 "bdev_io_cache_size": 256, 00:17:02.456 "bdev_io_pool_size": 65535, 00:17:02.456 "iobuf_large_cache_size": 16, 00:17:02.457 "iobuf_small_cache_size": 128 00:17:02.457 } 00:17:02.457 }, 00:17:02.457 { 00:17:02.457 "method": "bdev_raid_set_options", 00:17:02.457 "params": { 00:17:02.457 "process_max_bandwidth_mb_sec": 0, 00:17:02.457 "process_window_size_kb": 1024 00:17:02.457 } 00:17:02.457 }, 00:17:02.457 { 00:17:02.457 "method": "bdev_iscsi_set_options", 00:17:02.457 "params": { 00:17:02.457 "timeout_sec": 30 00:17:02.457 } 00:17:02.457 }, 00:17:02.457 { 00:17:02.457 "method": "bdev_nvme_set_options", 00:17:02.457 "params": { 00:17:02.457 "action_on_timeout": "none", 00:17:02.457 "allow_accel_sequence": false, 00:17:02.457 "arbitration_burst": 0, 00:17:02.457 "bdev_retry_count": 3, 00:17:02.457 "ctrlr_loss_timeout_sec": 0, 00:17:02.457 "delay_cmd_submit": true, 00:17:02.457 "dhchap_dhgroups": [ 00:17:02.457 "null", 00:17:02.457 "ffdhe2048", 00:17:02.457 "ffdhe3072", 00:17:02.457 "ffdhe4096", 00:17:02.457 "ffdhe6144", 00:17:02.457 "ffdhe8192" 00:17:02.457 ], 00:17:02.457 "dhchap_digests": [ 00:17:02.457 "sha256", 00:17:02.457 "sha384", 00:17:02.457 "sha512" 00:17:02.457 ], 00:17:02.457 "disable_auto_failback": false, 00:17:02.457 "fast_io_fail_timeout_sec": 0, 00:17:02.457 "generate_uuids": false, 00:17:02.457 "high_priority_weight": 0, 00:17:02.457 "io_path_stat": false, 00:17:02.457 "io_queue_requests": 512, 00:17:02.457 "keep_alive_timeout_ms": 10000, 00:17:02.457 "low_priority_weight": 0, 00:17:02.457 "medium_priority_weight": 0, 00:17:02.457 "nvme_adminq_poll_period_us": 10000, 00:17:02.457 "nvme_error_stat": false, 00:17:02.457 "nvme_ioq_poll_period_us": 0, 00:17:02.457 "rdma_cm_event_timeout_ms": 0, 00:17:02.457 "rdma_max_cq_size": 0, 00:17:02.457 "rdma_srq_size": 0, 00:17:02.457 "reconnect_delay_sec": 0, 00:17:02.457 "timeout_admin_us": 0, 00:17:02.457 "timeout_us": 0, 00:17:02.457 "transport_ack_timeout": 0, 00:17:02.457 "transport_retry_count": 4, 00:17:02.457 "transport_tos": 0 00:17:02.457 } 00:17:02.457 }, 00:17:02.457 { 00:17:02.457 "method": "bdev_nvme_attach_controller", 00:17:02.457 "params": { 00:17:02.457 "adrfam": "IPv4", 00:17:02.457 "ctrlr_loss_timeout_sec": 0, 00:17:02.457 "ddgst": false, 00:17:02.457 "fast_io_fail_timeout_sec": 0, 00:17:02.457 "hdgst": false, 00:17:02.457 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:02.457 "multipath": "multipath", 00:17:02.457 "name": "nvme0", 00:17:02.457 "prchk_guard": false, 00:17:02.457 "prchk_reftag": false, 00:17:02.457 "psk": "key0", 00:17:02.457 "reconnect_delay_sec": 0, 00:17:02.457 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:02.457 "traddr": "10.0.0.3", 00:17:02.457 "trsvcid": "4420", 00:17:02.457 "trtype": "TCP" 00:17:02.457 } 00:17:02.457 }, 00:17:02.457 { 00:17:02.457 "method": "bdev_nvme_set_hotplug", 00:17:02.457 "params": { 00:17:02.457 "enable": false, 00:17:02.457 "period_us": 100000 00:17:02.457 } 00:17:02.457 }, 00:17:02.457 { 00:17:02.457 "method": "bdev_enable_histogram", 00:17:02.457 "params": { 00:17:02.457 "enable": true, 00:17:02.457 "name": "nvme0n1" 00:17:02.457 } 00:17:02.457 }, 00:17:02.457 { 00:17:02.457 "method": "bdev_wait_for_examine" 00:17:02.457 } 00:17:02.457 ] 00:17:02.457 }, 00:17:02.457 { 00:17:02.457 "subsystem": "nbd", 00:17:02.457 "config": [] 00:17:02.457 } 00:17:02.457 ] 00:17:02.457 }' 00:17:02.457 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:02.457 11:27:44 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:02.457 11:27:44 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@840 -- # xtrace_disable 00:17:02.457 11:27:44 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:17:02.457 [2024-10-07 11:27:44.147005] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:17:02.457 [2024-10-07 11:27:44.147138] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid85228 ] 00:17:02.714 [2024-10-07 11:27:44.286284] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:02.714 [2024-10-07 11:27:44.413002] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:17:02.972 [2024-10-07 11:27:44.592510] bdev_nvme_rpc.c: 514:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:03.904 11:27:45 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:17:03.904 11:27:45 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@864 -- # return 0 00:17:03.904 11:27:45 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@279 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:17:03.904 11:27:45 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@279 -- # jq -r '.[].name' 00:17:03.904 11:27:45 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@279 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:17:03.904 11:27:45 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@280 -- # /home/vagrant/spdk_repo/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:17:04.162 Running I/O for 1 seconds... 00:17:05.093 3644.00 IOPS, 14.23 MiB/s 00:17:05.094 Latency(us) 00:17:05.094 [2024-10-07T11:27:46.805Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:05.094 Job: nvme0n1 (Core Mask 0x2, workload: verify, depth: 128, IO size: 4096) 00:17:05.094 Verification LBA range: start 0x0 length 0x2000 00:17:05.094 nvme0n1 : 1.02 3701.81 14.46 0.00 0.00 34191.72 6225.92 27286.81 00:17:05.094 [2024-10-07T11:27:46.805Z] =================================================================================================================== 00:17:05.094 [2024-10-07T11:27:46.805Z] Total : 3701.81 14.46 0.00 0.00 34191.72 6225.92 27286.81 00:17:05.094 { 00:17:05.094 "results": [ 00:17:05.094 { 00:17:05.094 "job": "nvme0n1", 00:17:05.094 "core_mask": "0x2", 00:17:05.094 "workload": "verify", 00:17:05.094 "status": "finished", 00:17:05.094 "verify_range": { 00:17:05.094 "start": 0, 00:17:05.094 "length": 8192 00:17:05.094 }, 00:17:05.094 "queue_depth": 128, 00:17:05.094 "io_size": 4096, 00:17:05.094 "runtime": 1.01896, 00:17:05.094 "iops": 3701.8136138808195, 00:17:05.094 "mibps": 14.460209429221951, 00:17:05.094 "io_failed": 0, 00:17:05.094 "io_timeout": 0, 00:17:05.094 "avg_latency_us": 34191.7203200617, 00:17:05.094 "min_latency_us": 6225.92, 00:17:05.094 "max_latency_us": 27286.807272727274 00:17:05.094 } 00:17:05.094 ], 00:17:05.094 "core_count": 1 00:17:05.094 } 00:17:05.094 11:27:46 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@282 -- # trap - SIGINT SIGTERM EXIT 00:17:05.094 11:27:46 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@283 -- # cleanup 00:17:05.094 11:27:46 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@15 -- # process_shm --id 0 00:17:05.094 11:27:46 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@808 -- # type=--id 00:17:05.094 11:27:46 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@809 -- # id=0 00:17:05.094 11:27:46 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@810 -- # '[' --id = --pid ']' 00:17:05.094 11:27:46 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@814 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:17:05.094 11:27:46 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@814 -- # shm_files=nvmf_trace.0 00:17:05.094 11:27:46 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@816 -- # [[ -z nvmf_trace.0 ]] 00:17:05.094 11:27:46 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@820 -- # for n in $shm_files 00:17:05.094 11:27:46 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@821 -- # tar -C /dev/shm/ -cvzf /home/vagrant/spdk_repo/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:17:05.094 nvmf_trace.0 00:17:05.351 11:27:46 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@823 -- # return 0 00:17:05.351 11:27:46 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@16 -- # killprocess 85228 00:17:05.351 11:27:46 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@950 -- # '[' -z 85228 ']' 00:17:05.351 11:27:46 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@954 -- # kill -0 85228 00:17:05.351 11:27:46 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # uname 00:17:05.351 11:27:46 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:17:05.351 11:27:46 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 85228 00:17:05.351 11:27:46 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # process_name=reactor_1 00:17:05.351 killing process with pid 85228 00:17:05.351 11:27:46 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@960 -- # '[' reactor_1 = sudo ']' 00:17:05.351 11:27:46 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@968 -- # echo 'killing process with pid 85228' 00:17:05.351 11:27:46 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@969 -- # kill 85228 00:17:05.351 Received shutdown signal, test time was about 1.000000 seconds 00:17:05.351 00:17:05.351 Latency(us) 00:17:05.351 [2024-10-07T11:27:47.062Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:05.351 [2024-10-07T11:27:47.062Z] =================================================================================================================== 00:17:05.351 [2024-10-07T11:27:47.062Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:17:05.351 11:27:46 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@974 -- # wait 85228 00:17:05.608 11:27:47 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@17 -- # nvmftestfini 00:17:05.608 11:27:47 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@514 -- # nvmfcleanup 00:17:05.608 11:27:47 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@121 -- # sync 00:17:05.608 11:27:47 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:17:05.608 11:27:47 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@124 -- # set +e 00:17:05.608 11:27:47 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@125 -- # for i in {1..20} 00:17:05.608 11:27:47 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:17:05.608 rmmod nvme_tcp 00:17:05.867 rmmod nvme_fabrics 00:17:05.867 rmmod nvme_keyring 00:17:05.867 11:27:47 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:17:05.867 11:27:47 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@128 -- # set -e 00:17:05.867 11:27:47 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@129 -- # return 0 00:17:05.867 11:27:47 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@515 -- # '[' -n 85184 ']' 00:17:05.867 11:27:47 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@516 -- # killprocess 85184 00:17:05.867 11:27:47 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@950 -- # '[' -z 85184 ']' 00:17:05.867 11:27:47 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@954 -- # kill -0 85184 00:17:05.867 11:27:47 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # uname 00:17:05.867 11:27:47 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:17:05.867 11:27:47 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 85184 00:17:05.867 11:27:47 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:17:05.867 11:27:47 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:17:05.867 killing process with pid 85184 00:17:05.867 11:27:47 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@968 -- # echo 'killing process with pid 85184' 00:17:05.867 11:27:47 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@969 -- # kill 85184 00:17:05.867 11:27:47 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@974 -- # wait 85184 00:17:06.124 11:27:47 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:17:06.124 11:27:47 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:17:06.124 11:27:47 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:17:06.124 11:27:47 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@297 -- # iptr 00:17:06.124 11:27:47 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:17:06.124 11:27:47 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@789 -- # iptables-save 00:17:06.124 11:27:47 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@789 -- # iptables-restore 00:17:06.125 11:27:47 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@298 -- # [[ nvmf_tgt_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:17:06.125 11:27:47 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@299 -- # nvmf_veth_fini 00:17:06.125 11:27:47 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@233 -- # ip link set nvmf_init_br nomaster 00:17:06.125 11:27:47 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@234 -- # ip link set nvmf_init_br2 nomaster 00:17:06.125 11:27:47 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@235 -- # ip link set nvmf_tgt_br nomaster 00:17:06.125 11:27:47 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@236 -- # ip link set nvmf_tgt_br2 nomaster 00:17:06.125 11:27:47 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@237 -- # ip link set nvmf_init_br down 00:17:06.125 11:27:47 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@238 -- # ip link set nvmf_init_br2 down 00:17:06.125 11:27:47 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@239 -- # ip link set nvmf_tgt_br down 00:17:06.125 11:27:47 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@240 -- # ip link set nvmf_tgt_br2 down 00:17:06.382 11:27:47 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@241 -- # ip link delete nvmf_br type bridge 00:17:06.382 11:27:47 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@242 -- # ip link delete nvmf_init_if 00:17:06.382 11:27:47 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@243 -- # ip link delete nvmf_init_if2 00:17:06.382 11:27:47 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@244 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:17:06.382 11:27:47 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@245 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:17:06.382 11:27:47 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@246 -- # remove_spdk_ns 00:17:06.382 11:27:47 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:06.382 11:27:47 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:17:06.382 11:27:47 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:06.382 11:27:47 nvmf_tcp.nvmf_target_extra.nvmf_tls -- nvmf/common.sh@300 -- # return 0 00:17:06.382 11:27:47 nvmf_tcp.nvmf_target_extra.nvmf_tls -- target/tls.sh@18 -- # rm -f /tmp/tmp.V7HBwO5RcH /tmp/tmp.fabY5wQYeq /tmp/tmp.PjWRSOdBbt 00:17:06.382 00:17:06.382 real 1m37.765s 00:17:06.382 user 2m41.754s 00:17:06.382 sys 0m30.236s 00:17:06.382 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@1126 -- # xtrace_disable 00:17:06.382 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_tls -- common/autotest_common.sh@10 -- # set +x 00:17:06.382 ************************************ 00:17:06.382 END TEST nvmf_tls 00:17:06.382 ************************************ 00:17:06.382 11:27:48 nvmf_tcp.nvmf_target_extra -- nvmf/nvmf_target_extra.sh@42 -- # run_test nvmf_fips /home/vagrant/spdk_repo/spdk/test/nvmf/fips/fips.sh --transport=tcp 00:17:06.382 11:27:48 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:17:06.382 11:27:48 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1107 -- # xtrace_disable 00:17:06.382 11:27:48 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@10 -- # set +x 00:17:06.382 ************************************ 00:17:06.382 START TEST nvmf_fips 00:17:06.382 ************************************ 00:17:06.382 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/nvmf/fips/fips.sh --transport=tcp 00:17:06.639 * Looking for test storage... 00:17:06.639 * Found test storage at /home/vagrant/spdk_repo/spdk/test/nvmf/fips 00:17:06.639 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:17:06.639 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@1681 -- # lcov --version 00:17:06.639 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:17:06.639 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:17:06.639 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:17:06.639 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@333 -- # local ver1 ver1_l 00:17:06.639 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@334 -- # local ver2 ver2_l 00:17:06.639 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@336 -- # IFS=.-: 00:17:06.639 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@336 -- # read -ra ver1 00:17:06.639 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@337 -- # IFS=.-: 00:17:06.639 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@337 -- # read -ra ver2 00:17:06.639 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@338 -- # local 'op=<' 00:17:06.639 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@340 -- # ver1_l=2 00:17:06.639 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@341 -- # ver2_l=1 00:17:06.639 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:17:06.639 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@344 -- # case "$op" in 00:17:06.639 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@345 -- # : 1 00:17:06.639 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@364 -- # (( v = 0 )) 00:17:06.639 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:17:06.639 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@365 -- # decimal 1 00:17:06.639 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@353 -- # local d=1 00:17:06.639 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:17:06.639 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@355 -- # echo 1 00:17:06.639 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@365 -- # ver1[v]=1 00:17:06.639 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@366 -- # decimal 2 00:17:06.639 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@353 -- # local d=2 00:17:06.639 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:17:06.639 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@355 -- # echo 2 00:17:06.639 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@366 -- # ver2[v]=2 00:17:06.639 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:17:06.640 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:17:06.640 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@368 -- # return 0 00:17:06.640 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:17:06.640 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:17:06.640 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:06.640 --rc genhtml_branch_coverage=1 00:17:06.640 --rc genhtml_function_coverage=1 00:17:06.640 --rc genhtml_legend=1 00:17:06.640 --rc geninfo_all_blocks=1 00:17:06.640 --rc geninfo_unexecuted_blocks=1 00:17:06.640 00:17:06.640 ' 00:17:06.640 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:17:06.640 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:06.640 --rc genhtml_branch_coverage=1 00:17:06.640 --rc genhtml_function_coverage=1 00:17:06.640 --rc genhtml_legend=1 00:17:06.640 --rc geninfo_all_blocks=1 00:17:06.640 --rc geninfo_unexecuted_blocks=1 00:17:06.640 00:17:06.640 ' 00:17:06.640 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:17:06.640 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:06.640 --rc genhtml_branch_coverage=1 00:17:06.640 --rc genhtml_function_coverage=1 00:17:06.640 --rc genhtml_legend=1 00:17:06.640 --rc geninfo_all_blocks=1 00:17:06.640 --rc geninfo_unexecuted_blocks=1 00:17:06.640 00:17:06.640 ' 00:17:06.640 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:17:06.640 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:06.640 --rc genhtml_branch_coverage=1 00:17:06.640 --rc genhtml_function_coverage=1 00:17:06.640 --rc genhtml_legend=1 00:17:06.640 --rc geninfo_all_blocks=1 00:17:06.640 --rc geninfo_unexecuted_blocks=1 00:17:06.640 00:17:06.640 ' 00:17:06.640 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@11 -- # source /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh 00:17:06.640 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@7 -- # uname -s 00:17:06.640 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:06.640 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:06.640 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:06.640 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:06.640 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:06.640 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:06.640 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:06.640 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:06.640 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:06.640 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:06.640 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:17:06.640 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@18 -- # NVME_HOSTID=3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:17:06.640 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:06.640 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:06.640 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@21 -- # NET_TYPE=virt 00:17:06.640 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:17:06.640 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@49 -- # source /home/vagrant/spdk_repo/spdk/scripts/common.sh 00:17:06.640 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@15 -- # shopt -s extglob 00:17:06.640 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:06.640 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:06.640 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:06.640 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:06.640 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:06.640 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:06.640 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- paths/export.sh@5 -- # export PATH 00:17:06.640 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:06.640 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@51 -- # : 0 00:17:06.640 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:17:06.640 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:17:06.640 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:17:06.640 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:06.640 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:06.640 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:17:06.640 /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:17:06.640 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:17:06.640 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:17:06.640 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@55 -- # have_pci_nics=0 00:17:06.640 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@12 -- # rpc_py=/home/vagrant/spdk_repo/spdk/scripts/rpc.py 00:17:06.640 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@90 -- # check_openssl_version 00:17:06.640 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@84 -- # local target=3.0.0 00:17:06.640 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@86 -- # openssl version 00:17:06.640 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@86 -- # awk '{print $2}' 00:17:06.640 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@86 -- # ge 3.1.1 3.0.0 00:17:06.640 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@376 -- # cmp_versions 3.1.1 '>=' 3.0.0 00:17:06.640 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@333 -- # local ver1 ver1_l 00:17:06.640 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@334 -- # local ver2 ver2_l 00:17:06.640 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@336 -- # IFS=.-: 00:17:06.640 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@336 -- # read -ra ver1 00:17:06.640 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@337 -- # IFS=.-: 00:17:06.640 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@337 -- # read -ra ver2 00:17:06.640 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@338 -- # local 'op=>=' 00:17:06.640 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@340 -- # ver1_l=3 00:17:06.640 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@341 -- # ver2_l=3 00:17:06.640 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:17:06.640 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@344 -- # case "$op" in 00:17:06.640 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@348 -- # : 1 00:17:06.640 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@364 -- # (( v = 0 )) 00:17:06.640 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:17:06.640 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@365 -- # decimal 3 00:17:06.640 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@353 -- # local d=3 00:17:06.640 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@354 -- # [[ 3 =~ ^[0-9]+$ ]] 00:17:06.640 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@355 -- # echo 3 00:17:06.640 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@365 -- # ver1[v]=3 00:17:06.640 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@366 -- # decimal 3 00:17:06.640 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@353 -- # local d=3 00:17:06.640 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@354 -- # [[ 3 =~ ^[0-9]+$ ]] 00:17:06.640 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@355 -- # echo 3 00:17:06.640 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@366 -- # ver2[v]=3 00:17:06.640 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:17:06.640 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:17:06.640 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@364 -- # (( v++ )) 00:17:06.640 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:17:06.640 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@365 -- # decimal 1 00:17:06.640 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@353 -- # local d=1 00:17:06.640 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:17:06.640 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@355 -- # echo 1 00:17:06.640 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@365 -- # ver1[v]=1 00:17:06.640 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@366 -- # decimal 0 00:17:06.640 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@353 -- # local d=0 00:17:06.640 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@354 -- # [[ 0 =~ ^[0-9]+$ ]] 00:17:06.640 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@355 -- # echo 0 00:17:06.640 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@366 -- # ver2[v]=0 00:17:06.640 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:17:06.640 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- scripts/common.sh@367 -- # return 0 00:17:06.640 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@96 -- # openssl info -modulesdir 00:17:06.640 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@96 -- # [[ ! -f /usr/lib64/ossl-modules/fips.so ]] 00:17:06.640 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@101 -- # openssl fipsinstall -help 00:17:06.897 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@101 -- # warn='This command is not enabled in the Red Hat Enterprise Linux OpenSSL build, please consult Red Hat documentation to learn how to enable FIPS mode' 00:17:06.897 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@102 -- # [[ This command is not enabled in the Red Hat Enterprise Linux OpenSSL build, please consult Red Hat documentation to learn how to enable FIPS mode == \T\h\i\s\ \c\o\m\m\a\n\d\ \i\s\ \n\o\t\ \e\n\a\b\l\e\d* ]] 00:17:06.897 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@105 -- # export callback=build_openssl_config 00:17:06.898 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@105 -- # callback=build_openssl_config 00:17:06.898 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@114 -- # build_openssl_config 00:17:06.898 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@38 -- # cat 00:17:06.898 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@58 -- # [[ ! -t 0 ]] 00:17:06.898 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@59 -- # cat - 00:17:06.898 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@115 -- # export OPENSSL_CONF=spdk_fips.conf 00:17:06.898 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@115 -- # OPENSSL_CONF=spdk_fips.conf 00:17:06.898 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@117 -- # mapfile -t providers 00:17:06.898 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@117 -- # openssl list -providers 00:17:06.898 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@117 -- # grep name 00:17:06.898 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@121 -- # (( 2 != 2 )) 00:17:06.898 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@121 -- # [[ name: openssl base provider != *base* ]] 00:17:06.898 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@121 -- # [[ name: red hat enterprise linux 9 - openssl fips provider != *fips* ]] 00:17:06.898 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@128 -- # NOT openssl md5 /dev/fd/62 00:17:06.898 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@128 -- # : 00:17:06.898 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@650 -- # local es=0 00:17:06.898 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@652 -- # valid_exec_arg openssl md5 /dev/fd/62 00:17:06.898 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@638 -- # local arg=openssl 00:17:06.898 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:06.898 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@642 -- # type -t openssl 00:17:06.898 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:06.898 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@644 -- # type -P openssl 00:17:06.898 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:06.898 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@644 -- # arg=/usr/bin/openssl 00:17:06.898 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@644 -- # [[ -x /usr/bin/openssl ]] 00:17:06.898 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@653 -- # openssl md5 /dev/fd/62 00:17:06.898 Error setting digest 00:17:06.898 40F26D7A577F0000:error:0308010C:digital envelope routines:inner_evp_generic_fetch:unsupported:crypto/evp/evp_fetch.c:341:Global default library context, Algorithm (MD5 : 95), Properties () 00:17:06.898 40F26D7A577F0000:error:03000086:digital envelope routines:evp_md_init_internal:initialization error:crypto/evp/digest.c:272: 00:17:06.898 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@653 -- # es=1 00:17:06.898 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:17:06.898 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:17:06.898 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:17:06.898 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@131 -- # nvmftestinit 00:17:06.898 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:17:06.898 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:06.898 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@474 -- # prepare_net_devs 00:17:06.898 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@436 -- # local -g is_hw=no 00:17:06.898 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@438 -- # remove_spdk_ns 00:17:06.898 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:06.898 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:17:06.898 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:06.898 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@440 -- # [[ virt != virt ]] 00:17:06.898 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@442 -- # [[ no == yes ]] 00:17:06.898 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@449 -- # [[ virt == phy ]] 00:17:06.898 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@452 -- # [[ virt == phy-fallback ]] 00:17:06.898 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@457 -- # [[ tcp == tcp ]] 00:17:06.898 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@458 -- # nvmf_veth_init 00:17:06.898 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@145 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:17:06.898 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@146 -- # NVMF_SECOND_INITIATOR_IP=10.0.0.2 00:17:06.898 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@147 -- # NVMF_FIRST_TARGET_IP=10.0.0.3 00:17:06.898 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@148 -- # NVMF_SECOND_TARGET_IP=10.0.0.4 00:17:06.898 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@149 -- # NVMF_INITIATOR_IP=10.0.0.1 00:17:06.898 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@150 -- # NVMF_BRIDGE=nvmf_br 00:17:06.898 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@151 -- # NVMF_INITIATOR_INTERFACE=nvmf_init_if 00:17:06.898 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@152 -- # NVMF_INITIATOR_INTERFACE2=nvmf_init_if2 00:17:06.898 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@153 -- # NVMF_INITIATOR_BRIDGE=nvmf_init_br 00:17:06.898 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@154 -- # NVMF_INITIATOR_BRIDGE2=nvmf_init_br2 00:17:06.898 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@155 -- # NVMF_TARGET_NAMESPACE=nvmf_tgt_ns_spdk 00:17:06.898 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@156 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:17:06.898 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@157 -- # NVMF_TARGET_INTERFACE=nvmf_tgt_if 00:17:06.898 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@158 -- # NVMF_TARGET_INTERFACE2=nvmf_tgt_if2 00:17:06.898 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@159 -- # NVMF_TARGET_BRIDGE=nvmf_tgt_br 00:17:06.898 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@160 -- # NVMF_TARGET_BRIDGE2=nvmf_tgt_br2 00:17:06.898 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@162 -- # ip link set nvmf_init_br nomaster 00:17:06.898 Cannot find device "nvmf_init_br" 00:17:06.898 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@162 -- # true 00:17:06.898 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@163 -- # ip link set nvmf_init_br2 nomaster 00:17:06.898 Cannot find device "nvmf_init_br2" 00:17:06.898 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@163 -- # true 00:17:06.898 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@164 -- # ip link set nvmf_tgt_br nomaster 00:17:06.898 Cannot find device "nvmf_tgt_br" 00:17:06.898 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@164 -- # true 00:17:06.898 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@165 -- # ip link set nvmf_tgt_br2 nomaster 00:17:06.898 Cannot find device "nvmf_tgt_br2" 00:17:06.898 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@165 -- # true 00:17:06.898 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@166 -- # ip link set nvmf_init_br down 00:17:06.898 Cannot find device "nvmf_init_br" 00:17:06.898 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@166 -- # true 00:17:06.898 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@167 -- # ip link set nvmf_init_br2 down 00:17:06.898 Cannot find device "nvmf_init_br2" 00:17:06.898 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@167 -- # true 00:17:06.898 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@168 -- # ip link set nvmf_tgt_br down 00:17:06.898 Cannot find device "nvmf_tgt_br" 00:17:06.898 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@168 -- # true 00:17:06.898 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@169 -- # ip link set nvmf_tgt_br2 down 00:17:06.898 Cannot find device "nvmf_tgt_br2" 00:17:06.898 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@169 -- # true 00:17:06.898 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@170 -- # ip link delete nvmf_br type bridge 00:17:06.898 Cannot find device "nvmf_br" 00:17:06.898 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@170 -- # true 00:17:06.898 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@171 -- # ip link delete nvmf_init_if 00:17:06.898 Cannot find device "nvmf_init_if" 00:17:06.898 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@171 -- # true 00:17:06.898 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@172 -- # ip link delete nvmf_init_if2 00:17:07.173 Cannot find device "nvmf_init_if2" 00:17:07.173 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@172 -- # true 00:17:07.173 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@173 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:17:07.173 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:17:07.173 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@173 -- # true 00:17:07.173 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@174 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:17:07.173 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:17:07.173 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@174 -- # true 00:17:07.173 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@177 -- # ip netns add nvmf_tgt_ns_spdk 00:17:07.173 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@180 -- # ip link add nvmf_init_if type veth peer name nvmf_init_br 00:17:07.173 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@181 -- # ip link add nvmf_init_if2 type veth peer name nvmf_init_br2 00:17:07.173 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@182 -- # ip link add nvmf_tgt_if type veth peer name nvmf_tgt_br 00:17:07.173 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@183 -- # ip link add nvmf_tgt_if2 type veth peer name nvmf_tgt_br2 00:17:07.173 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@186 -- # ip link set nvmf_tgt_if netns nvmf_tgt_ns_spdk 00:17:07.173 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@187 -- # ip link set nvmf_tgt_if2 netns nvmf_tgt_ns_spdk 00:17:07.173 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@190 -- # ip addr add 10.0.0.1/24 dev nvmf_init_if 00:17:07.173 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@191 -- # ip addr add 10.0.0.2/24 dev nvmf_init_if2 00:17:07.173 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@192 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.3/24 dev nvmf_tgt_if 00:17:07.173 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@193 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.4/24 dev nvmf_tgt_if2 00:17:07.173 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@196 -- # ip link set nvmf_init_if up 00:17:07.173 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@197 -- # ip link set nvmf_init_if2 up 00:17:07.173 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@198 -- # ip link set nvmf_init_br up 00:17:07.173 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@199 -- # ip link set nvmf_init_br2 up 00:17:07.173 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@200 -- # ip link set nvmf_tgt_br up 00:17:07.173 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@201 -- # ip link set nvmf_tgt_br2 up 00:17:07.173 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@202 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if up 00:17:07.173 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@203 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if2 up 00:17:07.173 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@204 -- # ip netns exec nvmf_tgt_ns_spdk ip link set lo up 00:17:07.173 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@207 -- # ip link add nvmf_br type bridge 00:17:07.173 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@208 -- # ip link set nvmf_br up 00:17:07.173 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@211 -- # ip link set nvmf_init_br master nvmf_br 00:17:07.173 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@212 -- # ip link set nvmf_init_br2 master nvmf_br 00:17:07.173 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@213 -- # ip link set nvmf_tgt_br master nvmf_br 00:17:07.173 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@214 -- # ip link set nvmf_tgt_br2 master nvmf_br 00:17:07.173 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@217 -- # ipts -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT 00:17:07.173 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT' 00:17:07.173 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@218 -- # ipts -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT 00:17:07.173 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT' 00:17:07.173 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@219 -- # ipts -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT 00:17:07.174 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@788 -- # iptables -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT -m comment --comment 'SPDK_NVMF:-A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT' 00:17:07.174 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@222 -- # ping -c 1 10.0.0.3 00:17:07.174 PING 10.0.0.3 (10.0.0.3) 56(84) bytes of data. 00:17:07.174 64 bytes from 10.0.0.3: icmp_seq=1 ttl=64 time=0.110 ms 00:17:07.174 00:17:07.174 --- 10.0.0.3 ping statistics --- 00:17:07.174 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:07.174 rtt min/avg/max/mdev = 0.110/0.110/0.110/0.000 ms 00:17:07.174 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@223 -- # ping -c 1 10.0.0.4 00:17:07.174 PING 10.0.0.4 (10.0.0.4) 56(84) bytes of data. 00:17:07.174 64 bytes from 10.0.0.4: icmp_seq=1 ttl=64 time=0.085 ms 00:17:07.174 00:17:07.174 --- 10.0.0.4 ping statistics --- 00:17:07.174 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:07.174 rtt min/avg/max/mdev = 0.085/0.085/0.085/0.000 ms 00:17:07.174 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@224 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.1 00:17:07.174 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:17:07.174 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.046 ms 00:17:07.174 00:17:07.174 --- 10.0.0.1 ping statistics --- 00:17:07.174 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:07.174 rtt min/avg/max/mdev = 0.046/0.046/0.046/0.000 ms 00:17:07.174 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@225 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.2 00:17:07.174 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:17:07.174 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.112 ms 00:17:07.174 00:17:07.174 --- 10.0.0.2 ping statistics --- 00:17:07.174 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:07.174 rtt min/avg/max/mdev = 0.112/0.112/0.112/0.000 ms 00:17:07.174 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@227 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:17:07.174 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@459 -- # return 0 00:17:07.174 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:17:07.174 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:17:07.174 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:17:07.174 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:17:07.174 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:17:07.174 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:17:07.174 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:17:07.433 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@132 -- # nvmfappstart -m 0x2 00:17:07.433 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:17:07.433 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@724 -- # xtrace_disable 00:17:07.433 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@10 -- # set +x 00:17:07.433 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@507 -- # nvmfpid=85574 00:17:07.433 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@506 -- # ip netns exec nvmf_tgt_ns_spdk /home/vagrant/spdk_repo/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:17:07.433 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@508 -- # waitforlisten 85574 00:17:07.433 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@831 -- # '[' -z 85574 ']' 00:17:07.433 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:07.433 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@836 -- # local max_retries=100 00:17:07.433 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:07.433 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:07.433 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@840 -- # xtrace_disable 00:17:07.433 11:27:48 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@10 -- # set +x 00:17:07.433 [2024-10-07 11:27:48.998501] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:17:07.433 [2024-10-07 11:27:48.998613] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:07.433 [2024-10-07 11:27:49.142829] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:07.692 [2024-10-07 11:27:49.297257] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:07.692 [2024-10-07 11:27:49.297355] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:07.692 [2024-10-07 11:27:49.297368] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:17:07.692 [2024-10-07 11:27:49.297377] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:17:07.692 [2024-10-07 11:27:49.297384] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:07.692 [2024-10-07 11:27:49.297877] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:17:08.624 11:27:50 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:17:08.624 11:27:50 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@864 -- # return 0 00:17:08.624 11:27:50 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:17:08.624 11:27:50 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@730 -- # xtrace_disable 00:17:08.624 11:27:50 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@10 -- # set +x 00:17:08.624 11:27:50 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:08.624 11:27:50 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@134 -- # trap cleanup EXIT 00:17:08.624 11:27:50 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@137 -- # key=NVMeTLSkey-1:01:VRLbtnN9AQb2WXW3c9+wEf/DRLz0QuLdbYvEhwtdWwNf9LrZ: 00:17:08.624 11:27:50 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@138 -- # mktemp -t spdk-psk.XXX 00:17:08.624 11:27:50 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@138 -- # key_path=/tmp/spdk-psk.r7I 00:17:08.624 11:27:50 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@139 -- # echo -n NVMeTLSkey-1:01:VRLbtnN9AQb2WXW3c9+wEf/DRLz0QuLdbYvEhwtdWwNf9LrZ: 00:17:08.624 11:27:50 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@140 -- # chmod 0600 /tmp/spdk-psk.r7I 00:17:08.624 11:27:50 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@142 -- # setup_nvmf_tgt_conf /tmp/spdk-psk.r7I 00:17:08.624 11:27:50 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@22 -- # local key=/tmp/spdk-psk.r7I 00:17:08.624 11:27:50 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@24 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py 00:17:08.881 [2024-10-07 11:27:50.397845] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:08.881 [2024-10-07 11:27:50.413844] tcp.c:1031:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:17:08.881 [2024-10-07 11:27:50.414196] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:17:08.881 malloc0 00:17:08.881 11:27:50 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@145 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:08.881 11:27:50 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@148 -- # bdevperf_pid=85630 00:17:08.881 11:27:50 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@146 -- # /home/vagrant/spdk_repo/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:08.881 11:27:50 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@149 -- # waitforlisten 85630 /var/tmp/bdevperf.sock 00:17:08.881 11:27:50 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@831 -- # '[' -z 85630 ']' 00:17:08.881 11:27:50 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:08.881 11:27:50 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@836 -- # local max_retries=100 00:17:08.881 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:08.881 11:27:50 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:08.881 11:27:50 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@840 -- # xtrace_disable 00:17:08.881 11:27:50 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@10 -- # set +x 00:17:09.139 [2024-10-07 11:27:50.632941] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:17:09.139 [2024-10-07 11:27:50.633055] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid85630 ] 00:17:09.139 [2024-10-07 11:27:50.767904] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:09.396 [2024-10-07 11:27:50.941138] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:17:10.329 11:27:51 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:17:10.329 11:27:51 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@864 -- # return 0 00:17:10.329 11:27:51 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@151 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock keyring_file_add_key key0 /tmp/spdk-psk.r7I 00:17:10.329 11:27:52 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@152 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.3 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk key0 00:17:10.586 [2024-10-07 11:27:52.256465] bdev_nvme_rpc.c: 514:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:10.844 TLSTESTn1 00:17:10.844 11:27:52 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@156 -- # /home/vagrant/spdk_repo/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:17:10.844 Running I/O for 10 seconds... 00:17:13.149 3966.00 IOPS, 15.49 MiB/s [2024-10-07T11:27:55.815Z] 3968.00 IOPS, 15.50 MiB/s [2024-10-07T11:27:56.748Z] 3999.67 IOPS, 15.62 MiB/s [2024-10-07T11:27:57.699Z] 4009.00 IOPS, 15.66 MiB/s [2024-10-07T11:27:58.650Z] 4017.40 IOPS, 15.69 MiB/s [2024-10-07T11:27:59.583Z] 4017.33 IOPS, 15.69 MiB/s [2024-10-07T11:28:00.514Z] 4020.00 IOPS, 15.70 MiB/s [2024-10-07T11:28:01.886Z] 4015.00 IOPS, 15.68 MiB/s [2024-10-07T11:28:02.449Z] 4012.00 IOPS, 15.67 MiB/s [2024-10-07T11:28:02.707Z] 4009.60 IOPS, 15.66 MiB/s 00:17:20.996 Latency(us) 00:17:20.996 [2024-10-07T11:28:02.707Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:20.996 Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:17:20.996 Verification LBA range: start 0x0 length 0x2000 00:17:20.996 TLSTESTn1 : 10.02 4015.74 15.69 0.00 0.00 31817.64 5123.72 23473.80 00:17:20.996 [2024-10-07T11:28:02.707Z] =================================================================================================================== 00:17:20.996 [2024-10-07T11:28:02.707Z] Total : 4015.74 15.69 0.00 0.00 31817.64 5123.72 23473.80 00:17:20.996 { 00:17:20.996 "results": [ 00:17:20.996 { 00:17:20.996 "job": "TLSTESTn1", 00:17:20.996 "core_mask": "0x4", 00:17:20.996 "workload": "verify", 00:17:20.996 "status": "finished", 00:17:20.996 "verify_range": { 00:17:20.996 "start": 0, 00:17:20.996 "length": 8192 00:17:20.996 }, 00:17:20.996 "queue_depth": 128, 00:17:20.996 "io_size": 4096, 00:17:20.996 "runtime": 10.016086, 00:17:20.996 "iops": 4015.740280185294, 00:17:20.996 "mibps": 15.686485469473805, 00:17:20.996 "io_failed": 0, 00:17:20.996 "io_timeout": 0, 00:17:20.996 "avg_latency_us": 31817.64008878, 00:17:20.996 "min_latency_us": 5123.723636363637, 00:17:20.996 "max_latency_us": 23473.803636363635 00:17:20.996 } 00:17:20.996 ], 00:17:20.996 "core_count": 1 00:17:20.996 } 00:17:20.996 11:28:02 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@1 -- # cleanup 00:17:20.996 11:28:02 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@15 -- # process_shm --id 0 00:17:20.996 11:28:02 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@808 -- # type=--id 00:17:20.996 11:28:02 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@809 -- # id=0 00:17:20.996 11:28:02 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@810 -- # '[' --id = --pid ']' 00:17:20.996 11:28:02 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@814 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:17:20.997 11:28:02 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@814 -- # shm_files=nvmf_trace.0 00:17:20.997 11:28:02 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@816 -- # [[ -z nvmf_trace.0 ]] 00:17:20.997 11:28:02 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@820 -- # for n in $shm_files 00:17:20.997 11:28:02 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@821 -- # tar -C /dev/shm/ -cvzf /home/vagrant/spdk_repo/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:17:20.997 nvmf_trace.0 00:17:20.997 11:28:02 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@823 -- # return 0 00:17:20.997 11:28:02 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@16 -- # killprocess 85630 00:17:20.997 11:28:02 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@950 -- # '[' -z 85630 ']' 00:17:20.997 11:28:02 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@954 -- # kill -0 85630 00:17:20.997 11:28:02 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@955 -- # uname 00:17:20.997 11:28:02 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:17:20.997 11:28:02 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 85630 00:17:20.997 11:28:02 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@956 -- # process_name=reactor_2 00:17:20.997 11:28:02 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@960 -- # '[' reactor_2 = sudo ']' 00:17:20.997 11:28:02 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@968 -- # echo 'killing process with pid 85630' 00:17:20.997 killing process with pid 85630 00:17:20.997 11:28:02 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@969 -- # kill 85630 00:17:20.997 Received shutdown signal, test time was about 10.000000 seconds 00:17:20.997 00:17:20.997 Latency(us) 00:17:20.997 [2024-10-07T11:28:02.708Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:20.997 [2024-10-07T11:28:02.708Z] =================================================================================================================== 00:17:20.997 [2024-10-07T11:28:02.708Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:17:20.997 11:28:02 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@974 -- # wait 85630 00:17:21.255 11:28:02 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@17 -- # nvmftestfini 00:17:21.255 11:28:02 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@514 -- # nvmfcleanup 00:17:21.255 11:28:02 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@121 -- # sync 00:17:21.513 11:28:02 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:17:21.513 11:28:02 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@124 -- # set +e 00:17:21.513 11:28:02 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@125 -- # for i in {1..20} 00:17:21.513 11:28:02 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:17:21.513 rmmod nvme_tcp 00:17:21.513 rmmod nvme_fabrics 00:17:21.513 rmmod nvme_keyring 00:17:21.513 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:17:21.513 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@128 -- # set -e 00:17:21.513 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@129 -- # return 0 00:17:21.513 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@515 -- # '[' -n 85574 ']' 00:17:21.513 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@516 -- # killprocess 85574 00:17:21.513 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@950 -- # '[' -z 85574 ']' 00:17:21.513 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@954 -- # kill -0 85574 00:17:21.513 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@955 -- # uname 00:17:21.513 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:17:21.513 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 85574 00:17:21.513 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@956 -- # process_name=reactor_1 00:17:21.513 killing process with pid 85574 00:17:21.513 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@960 -- # '[' reactor_1 = sudo ']' 00:17:21.513 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@968 -- # echo 'killing process with pid 85574' 00:17:21.513 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@969 -- # kill 85574 00:17:21.513 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@974 -- # wait 85574 00:17:21.770 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:17:21.770 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:17:21.770 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:17:21.770 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@297 -- # iptr 00:17:21.770 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@789 -- # iptables-save 00:17:21.770 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:17:21.770 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@789 -- # iptables-restore 00:17:21.770 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@298 -- # [[ nvmf_tgt_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:17:21.770 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@299 -- # nvmf_veth_fini 00:17:21.770 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@233 -- # ip link set nvmf_init_br nomaster 00:17:21.770 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@234 -- # ip link set nvmf_init_br2 nomaster 00:17:21.770 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@235 -- # ip link set nvmf_tgt_br nomaster 00:17:21.770 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@236 -- # ip link set nvmf_tgt_br2 nomaster 00:17:22.028 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@237 -- # ip link set nvmf_init_br down 00:17:22.028 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@238 -- # ip link set nvmf_init_br2 down 00:17:22.028 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@239 -- # ip link set nvmf_tgt_br down 00:17:22.028 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@240 -- # ip link set nvmf_tgt_br2 down 00:17:22.028 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@241 -- # ip link delete nvmf_br type bridge 00:17:22.028 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@242 -- # ip link delete nvmf_init_if 00:17:22.028 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@243 -- # ip link delete nvmf_init_if2 00:17:22.028 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@244 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:17:22.028 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@245 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:17:22.028 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@246 -- # remove_spdk_ns 00:17:22.028 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:22.028 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:17:22.028 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:22.028 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- nvmf/common.sh@300 -- # return 0 00:17:22.028 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- fips/fips.sh@18 -- # rm -f /tmp/spdk-psk.r7I 00:17:22.028 00:17:22.028 real 0m15.632s 00:17:22.028 user 0m21.932s 00:17:22.028 sys 0m6.011s 00:17:22.028 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@1126 -- # xtrace_disable 00:17:22.028 ************************************ 00:17:22.028 END TEST nvmf_fips 00:17:22.028 ************************************ 00:17:22.028 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_fips -- common/autotest_common.sh@10 -- # set +x 00:17:22.028 11:28:03 nvmf_tcp.nvmf_target_extra -- nvmf/nvmf_target_extra.sh@43 -- # run_test nvmf_control_msg_list /home/vagrant/spdk_repo/spdk/test/nvmf/target/control_msg_list.sh --transport=tcp 00:17:22.028 11:28:03 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:17:22.028 11:28:03 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1107 -- # xtrace_disable 00:17:22.028 11:28:03 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@10 -- # set +x 00:17:22.287 ************************************ 00:17:22.287 START TEST nvmf_control_msg_list 00:17:22.287 ************************************ 00:17:22.287 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/nvmf/target/control_msg_list.sh --transport=tcp 00:17:22.287 * Looking for test storage... 00:17:22.287 * Found test storage at /home/vagrant/spdk_repo/spdk/test/nvmf/target 00:17:22.287 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:17:22.287 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:17:22.287 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@1681 -- # lcov --version 00:17:22.287 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:17:22.287 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:17:22.287 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- scripts/common.sh@333 -- # local ver1 ver1_l 00:17:22.287 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- scripts/common.sh@334 -- # local ver2 ver2_l 00:17:22.287 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- scripts/common.sh@336 -- # IFS=.-: 00:17:22.287 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- scripts/common.sh@336 -- # read -ra ver1 00:17:22.287 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- scripts/common.sh@337 -- # IFS=.-: 00:17:22.287 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- scripts/common.sh@337 -- # read -ra ver2 00:17:22.287 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- scripts/common.sh@338 -- # local 'op=<' 00:17:22.287 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- scripts/common.sh@340 -- # ver1_l=2 00:17:22.287 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- scripts/common.sh@341 -- # ver2_l=1 00:17:22.287 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:17:22.287 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- scripts/common.sh@344 -- # case "$op" in 00:17:22.287 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- scripts/common.sh@345 -- # : 1 00:17:22.287 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- scripts/common.sh@364 -- # (( v = 0 )) 00:17:22.287 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:17:22.287 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- scripts/common.sh@365 -- # decimal 1 00:17:22.287 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- scripts/common.sh@353 -- # local d=1 00:17:22.287 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:17:22.287 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- scripts/common.sh@355 -- # echo 1 00:17:22.287 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- scripts/common.sh@365 -- # ver1[v]=1 00:17:22.287 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- scripts/common.sh@366 -- # decimal 2 00:17:22.287 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- scripts/common.sh@353 -- # local d=2 00:17:22.287 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:17:22.287 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- scripts/common.sh@355 -- # echo 2 00:17:22.287 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- scripts/common.sh@366 -- # ver2[v]=2 00:17:22.287 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:17:22.287 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:17:22.287 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- scripts/common.sh@368 -- # return 0 00:17:22.287 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:17:22.287 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:17:22.287 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:22.287 --rc genhtml_branch_coverage=1 00:17:22.287 --rc genhtml_function_coverage=1 00:17:22.287 --rc genhtml_legend=1 00:17:22.287 --rc geninfo_all_blocks=1 00:17:22.287 --rc geninfo_unexecuted_blocks=1 00:17:22.287 00:17:22.287 ' 00:17:22.287 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:17:22.287 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:22.287 --rc genhtml_branch_coverage=1 00:17:22.287 --rc genhtml_function_coverage=1 00:17:22.287 --rc genhtml_legend=1 00:17:22.287 --rc geninfo_all_blocks=1 00:17:22.287 --rc geninfo_unexecuted_blocks=1 00:17:22.287 00:17:22.287 ' 00:17:22.287 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:17:22.287 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:22.287 --rc genhtml_branch_coverage=1 00:17:22.287 --rc genhtml_function_coverage=1 00:17:22.287 --rc genhtml_legend=1 00:17:22.287 --rc geninfo_all_blocks=1 00:17:22.287 --rc geninfo_unexecuted_blocks=1 00:17:22.287 00:17:22.287 ' 00:17:22.287 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:17:22.287 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:22.287 --rc genhtml_branch_coverage=1 00:17:22.287 --rc genhtml_function_coverage=1 00:17:22.287 --rc genhtml_legend=1 00:17:22.287 --rc geninfo_all_blocks=1 00:17:22.287 --rc geninfo_unexecuted_blocks=1 00:17:22.287 00:17:22.287 ' 00:17:22.287 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- target/control_msg_list.sh@10 -- # source /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh 00:17:22.287 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@7 -- # uname -s 00:17:22.287 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:22.287 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:22.287 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:22.287 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:22.287 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:22.287 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:22.287 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:22.287 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:22.287 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:22.287 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:22.287 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:17:22.287 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@18 -- # NVME_HOSTID=3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:17:22.287 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:22.287 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:22.287 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@21 -- # NET_TYPE=virt 00:17:22.287 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:17:22.287 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@49 -- # source /home/vagrant/spdk_repo/spdk/scripts/common.sh 00:17:22.287 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- scripts/common.sh@15 -- # shopt -s extglob 00:17:22.288 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:22.288 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:22.288 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:22.288 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:22.288 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:22.288 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:22.288 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- paths/export.sh@5 -- # export PATH 00:17:22.288 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:22.288 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@51 -- # : 0 00:17:22.288 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:17:22.288 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:17:22.288 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:17:22.288 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:22.288 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:22.288 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:17:22.288 /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:17:22.288 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:17:22.288 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:17:22.288 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@55 -- # have_pci_nics=0 00:17:22.288 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- target/control_msg_list.sh@12 -- # nvmftestinit 00:17:22.288 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:17:22.288 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:22.288 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@474 -- # prepare_net_devs 00:17:22.288 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@436 -- # local -g is_hw=no 00:17:22.288 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@438 -- # remove_spdk_ns 00:17:22.288 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:22.288 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:17:22.288 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:22.288 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@440 -- # [[ virt != virt ]] 00:17:22.288 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@442 -- # [[ no == yes ]] 00:17:22.288 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@449 -- # [[ virt == phy ]] 00:17:22.288 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@452 -- # [[ virt == phy-fallback ]] 00:17:22.288 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@457 -- # [[ tcp == tcp ]] 00:17:22.288 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@458 -- # nvmf_veth_init 00:17:22.288 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@145 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:17:22.288 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@146 -- # NVMF_SECOND_INITIATOR_IP=10.0.0.2 00:17:22.288 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@147 -- # NVMF_FIRST_TARGET_IP=10.0.0.3 00:17:22.288 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@148 -- # NVMF_SECOND_TARGET_IP=10.0.0.4 00:17:22.288 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@149 -- # NVMF_INITIATOR_IP=10.0.0.1 00:17:22.288 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@150 -- # NVMF_BRIDGE=nvmf_br 00:17:22.288 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@151 -- # NVMF_INITIATOR_INTERFACE=nvmf_init_if 00:17:22.288 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@152 -- # NVMF_INITIATOR_INTERFACE2=nvmf_init_if2 00:17:22.288 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@153 -- # NVMF_INITIATOR_BRIDGE=nvmf_init_br 00:17:22.288 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@154 -- # NVMF_INITIATOR_BRIDGE2=nvmf_init_br2 00:17:22.288 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@155 -- # NVMF_TARGET_NAMESPACE=nvmf_tgt_ns_spdk 00:17:22.288 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@156 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:17:22.288 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@157 -- # NVMF_TARGET_INTERFACE=nvmf_tgt_if 00:17:22.288 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@158 -- # NVMF_TARGET_INTERFACE2=nvmf_tgt_if2 00:17:22.288 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@159 -- # NVMF_TARGET_BRIDGE=nvmf_tgt_br 00:17:22.288 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@160 -- # NVMF_TARGET_BRIDGE2=nvmf_tgt_br2 00:17:22.288 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@162 -- # ip link set nvmf_init_br nomaster 00:17:22.288 Cannot find device "nvmf_init_br" 00:17:22.288 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@162 -- # true 00:17:22.288 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@163 -- # ip link set nvmf_init_br2 nomaster 00:17:22.288 Cannot find device "nvmf_init_br2" 00:17:22.288 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@163 -- # true 00:17:22.288 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@164 -- # ip link set nvmf_tgt_br nomaster 00:17:22.546 Cannot find device "nvmf_tgt_br" 00:17:22.546 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@164 -- # true 00:17:22.546 11:28:03 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@165 -- # ip link set nvmf_tgt_br2 nomaster 00:17:22.546 Cannot find device "nvmf_tgt_br2" 00:17:22.546 11:28:04 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@165 -- # true 00:17:22.546 11:28:04 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@166 -- # ip link set nvmf_init_br down 00:17:22.546 Cannot find device "nvmf_init_br" 00:17:22.546 11:28:04 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@166 -- # true 00:17:22.546 11:28:04 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@167 -- # ip link set nvmf_init_br2 down 00:17:22.546 Cannot find device "nvmf_init_br2" 00:17:22.546 11:28:04 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@167 -- # true 00:17:22.546 11:28:04 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@168 -- # ip link set nvmf_tgt_br down 00:17:22.546 Cannot find device "nvmf_tgt_br" 00:17:22.546 11:28:04 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@168 -- # true 00:17:22.546 11:28:04 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@169 -- # ip link set nvmf_tgt_br2 down 00:17:22.546 Cannot find device "nvmf_tgt_br2" 00:17:22.546 11:28:04 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@169 -- # true 00:17:22.546 11:28:04 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@170 -- # ip link delete nvmf_br type bridge 00:17:22.546 Cannot find device "nvmf_br" 00:17:22.546 11:28:04 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@170 -- # true 00:17:22.546 11:28:04 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@171 -- # ip link delete nvmf_init_if 00:17:22.546 Cannot find device "nvmf_init_if" 00:17:22.547 11:28:04 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@171 -- # true 00:17:22.547 11:28:04 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@172 -- # ip link delete nvmf_init_if2 00:17:22.547 Cannot find device "nvmf_init_if2" 00:17:22.547 11:28:04 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@172 -- # true 00:17:22.547 11:28:04 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@173 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:17:22.547 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:17:22.547 11:28:04 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@173 -- # true 00:17:22.547 11:28:04 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@174 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:17:22.547 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:17:22.547 11:28:04 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@174 -- # true 00:17:22.547 11:28:04 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@177 -- # ip netns add nvmf_tgt_ns_spdk 00:17:22.547 11:28:04 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@180 -- # ip link add nvmf_init_if type veth peer name nvmf_init_br 00:17:22.547 11:28:04 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@181 -- # ip link add nvmf_init_if2 type veth peer name nvmf_init_br2 00:17:22.547 11:28:04 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@182 -- # ip link add nvmf_tgt_if type veth peer name nvmf_tgt_br 00:17:22.547 11:28:04 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@183 -- # ip link add nvmf_tgt_if2 type veth peer name nvmf_tgt_br2 00:17:22.547 11:28:04 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@186 -- # ip link set nvmf_tgt_if netns nvmf_tgt_ns_spdk 00:17:22.547 11:28:04 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@187 -- # ip link set nvmf_tgt_if2 netns nvmf_tgt_ns_spdk 00:17:22.547 11:28:04 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@190 -- # ip addr add 10.0.0.1/24 dev nvmf_init_if 00:17:22.547 11:28:04 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@191 -- # ip addr add 10.0.0.2/24 dev nvmf_init_if2 00:17:22.547 11:28:04 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@192 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.3/24 dev nvmf_tgt_if 00:17:22.547 11:28:04 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@193 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.4/24 dev nvmf_tgt_if2 00:17:22.547 11:28:04 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@196 -- # ip link set nvmf_init_if up 00:17:22.547 11:28:04 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@197 -- # ip link set nvmf_init_if2 up 00:17:22.547 11:28:04 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@198 -- # ip link set nvmf_init_br up 00:17:22.547 11:28:04 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@199 -- # ip link set nvmf_init_br2 up 00:17:22.547 11:28:04 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@200 -- # ip link set nvmf_tgt_br up 00:17:22.547 11:28:04 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@201 -- # ip link set nvmf_tgt_br2 up 00:17:22.547 11:28:04 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@202 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if up 00:17:22.547 11:28:04 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@203 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if2 up 00:17:22.547 11:28:04 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@204 -- # ip netns exec nvmf_tgt_ns_spdk ip link set lo up 00:17:22.547 11:28:04 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@207 -- # ip link add nvmf_br type bridge 00:17:22.547 11:28:04 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@208 -- # ip link set nvmf_br up 00:17:22.805 11:28:04 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@211 -- # ip link set nvmf_init_br master nvmf_br 00:17:22.805 11:28:04 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@212 -- # ip link set nvmf_init_br2 master nvmf_br 00:17:22.805 11:28:04 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@213 -- # ip link set nvmf_tgt_br master nvmf_br 00:17:22.805 11:28:04 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@214 -- # ip link set nvmf_tgt_br2 master nvmf_br 00:17:22.805 11:28:04 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@217 -- # ipts -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT 00:17:22.805 11:28:04 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT' 00:17:22.805 11:28:04 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@218 -- # ipts -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT 00:17:22.805 11:28:04 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT' 00:17:22.805 11:28:04 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@219 -- # ipts -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT 00:17:22.805 11:28:04 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@788 -- # iptables -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT -m comment --comment 'SPDK_NVMF:-A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT' 00:17:22.805 11:28:04 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@222 -- # ping -c 1 10.0.0.3 00:17:22.805 PING 10.0.0.3 (10.0.0.3) 56(84) bytes of data. 00:17:22.805 64 bytes from 10.0.0.3: icmp_seq=1 ttl=64 time=0.126 ms 00:17:22.805 00:17:22.805 --- 10.0.0.3 ping statistics --- 00:17:22.805 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:22.805 rtt min/avg/max/mdev = 0.126/0.126/0.126/0.000 ms 00:17:22.805 11:28:04 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@223 -- # ping -c 1 10.0.0.4 00:17:22.805 PING 10.0.0.4 (10.0.0.4) 56(84) bytes of data. 00:17:22.805 64 bytes from 10.0.0.4: icmp_seq=1 ttl=64 time=0.078 ms 00:17:22.805 00:17:22.805 --- 10.0.0.4 ping statistics --- 00:17:22.805 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:22.805 rtt min/avg/max/mdev = 0.078/0.078/0.078/0.000 ms 00:17:22.805 11:28:04 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@224 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.1 00:17:22.805 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:17:22.805 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.045 ms 00:17:22.805 00:17:22.805 --- 10.0.0.1 ping statistics --- 00:17:22.805 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:22.805 rtt min/avg/max/mdev = 0.045/0.045/0.045/0.000 ms 00:17:22.805 11:28:04 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@225 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.2 00:17:22.805 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:17:22.805 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.114 ms 00:17:22.805 00:17:22.805 --- 10.0.0.2 ping statistics --- 00:17:22.805 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:22.805 rtt min/avg/max/mdev = 0.114/0.114/0.114/0.000 ms 00:17:22.805 11:28:04 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@227 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:17:22.805 11:28:04 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@459 -- # return 0 00:17:22.805 11:28:04 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:17:22.805 11:28:04 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:17:22.805 11:28:04 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:17:22.805 11:28:04 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:17:22.805 11:28:04 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:17:22.805 11:28:04 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:17:22.805 11:28:04 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:17:22.805 11:28:04 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- target/control_msg_list.sh@13 -- # nvmfappstart 00:17:22.805 11:28:04 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:17:22.805 11:28:04 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@724 -- # xtrace_disable 00:17:22.805 11:28:04 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@10 -- # set +x 00:17:22.805 11:28:04 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@507 -- # nvmfpid=86051 00:17:22.805 11:28:04 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@506 -- # ip netns exec nvmf_tgt_ns_spdk /home/vagrant/spdk_repo/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF 00:17:22.805 11:28:04 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@508 -- # waitforlisten 86051 00:17:22.805 11:28:04 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@831 -- # '[' -z 86051 ']' 00:17:22.805 11:28:04 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:22.805 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:22.805 11:28:04 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@836 -- # local max_retries=100 00:17:22.805 11:28:04 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:22.805 11:28:04 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@840 -- # xtrace_disable 00:17:22.805 11:28:04 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@10 -- # set +x 00:17:22.805 [2024-10-07 11:28:04.481982] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:17:22.805 [2024-10-07 11:28:04.482134] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:23.064 [2024-10-07 11:28:04.620555] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:23.322 [2024-10-07 11:28:04.775537] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:23.322 [2024-10-07 11:28:04.775619] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:23.322 [2024-10-07 11:28:04.775633] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:17:23.322 [2024-10-07 11:28:04.775642] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:17:23.322 [2024-10-07 11:28:04.775651] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:23.322 [2024-10-07 11:28:04.776154] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:17:23.889 11:28:05 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:17:23.889 11:28:05 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@864 -- # return 0 00:17:23.889 11:28:05 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:17:23.889 11:28:05 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@730 -- # xtrace_disable 00:17:23.889 11:28:05 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@10 -- # set +x 00:17:23.889 11:28:05 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:23.889 11:28:05 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- target/control_msg_list.sh@15 -- # subnqn=nqn.2024-07.io.spdk:cnode0 00:17:23.889 11:28:05 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- target/control_msg_list.sh@16 -- # perf=/home/vagrant/spdk_repo/spdk/build/bin/spdk_nvme_perf 00:17:23.889 11:28:05 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- target/control_msg_list.sh@19 -- # rpc_cmd nvmf_create_transport '-t tcp -o' --in-capsule-data-size 768 --control-msg-num 1 00:17:23.889 11:28:05 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:23.889 11:28:05 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@10 -- # set +x 00:17:23.889 [2024-10-07 11:28:05.537890] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:23.889 11:28:05 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:23.889 11:28:05 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- target/control_msg_list.sh@20 -- # rpc_cmd nvmf_create_subsystem nqn.2024-07.io.spdk:cnode0 -a 00:17:23.889 11:28:05 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:23.889 11:28:05 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@10 -- # set +x 00:17:23.889 11:28:05 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:23.889 11:28:05 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- target/control_msg_list.sh@21 -- # rpc_cmd bdev_malloc_create -b Malloc0 32 512 00:17:23.889 11:28:05 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:23.889 11:28:05 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@10 -- # set +x 00:17:23.889 Malloc0 00:17:23.889 11:28:05 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:23.889 11:28:05 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- target/control_msg_list.sh@22 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2024-07.io.spdk:cnode0 Malloc0 00:17:23.889 11:28:05 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:23.889 11:28:05 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@10 -- # set +x 00:17:23.889 11:28:05 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:23.889 11:28:05 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- target/control_msg_list.sh@23 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2024-07.io.spdk:cnode0 -t tcp -a 10.0.0.3 -s 4420 00:17:23.889 11:28:05 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:23.889 11:28:05 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@10 -- # set +x 00:17:23.889 [2024-10-07 11:28:05.592974] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:17:23.889 11:28:05 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:23.889 11:28:05 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- target/control_msg_list.sh@27 -- # perf_pid1=86101 00:17:23.889 11:28:05 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- target/control_msg_list.sh@26 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_nvme_perf -c 0x2 -q 1 -o 4096 -w randread -t 1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.3 trsvcid:4420' 00:17:24.147 11:28:05 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- target/control_msg_list.sh@29 -- # perf_pid2=86102 00:17:24.147 11:28:05 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- target/control_msg_list.sh@28 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_nvme_perf -c 0x4 -q 1 -o 4096 -w randread -t 1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.3 trsvcid:4420' 00:17:24.147 11:28:05 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- target/control_msg_list.sh@31 -- # perf_pid3=86103 00:17:24.147 11:28:05 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- target/control_msg_list.sh@30 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_nvme_perf -c 0x8 -q 1 -o 4096 -w randread -t 1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.3 trsvcid:4420' 00:17:24.147 11:28:05 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- target/control_msg_list.sh@33 -- # wait 86101 00:17:24.147 [2024-10-07 11:28:05.763382] subsystem.c:1641:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on TCP/10.0.0.3/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:17:24.147 [2024-10-07 11:28:05.783975] subsystem.c:1641:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on TCP/10.0.0.3/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:17:24.147 [2024-10-07 11:28:05.784540] subsystem.c:1641:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on TCP/10.0.0.3/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:17:25.519 Initializing NVMe Controllers 00:17:25.519 Attached to NVMe over Fabrics controller at 10.0.0.3:4420: nqn.2024-07.io.spdk:cnode0 00:17:25.519 Associating TCP (addr:10.0.0.3 subnqn:nqn.2024-07.io.spdk:cnode0) NSID 1 with lcore 2 00:17:25.519 Initialization complete. Launching workers. 00:17:25.519 ======================================================== 00:17:25.519 Latency(us) 00:17:25.519 Device Information : IOPS MiB/s Average min max 00:17:25.519 TCP (addr:10.0.0.3 subnqn:nqn.2024-07.io.spdk:cnode0) NSID 1 from core 2: 3187.00 12.45 313.35 143.58 1038.58 00:17:25.519 ======================================================== 00:17:25.519 Total : 3187.00 12.45 313.35 143.58 1038.58 00:17:25.519 00:17:25.519 Initializing NVMe Controllers 00:17:25.519 Attached to NVMe over Fabrics controller at 10.0.0.3:4420: nqn.2024-07.io.spdk:cnode0 00:17:25.519 Associating TCP (addr:10.0.0.3 subnqn:nqn.2024-07.io.spdk:cnode0) NSID 1 with lcore 1 00:17:25.519 Initialization complete. Launching workers. 00:17:25.519 ======================================================== 00:17:25.519 Latency(us) 00:17:25.519 Device Information : IOPS MiB/s Average min max 00:17:25.519 TCP (addr:10.0.0.3 subnqn:nqn.2024-07.io.spdk:cnode0) NSID 1 from core 1: 3180.97 12.43 314.04 178.86 579.01 00:17:25.519 ======================================================== 00:17:25.519 Total : 3180.97 12.43 314.04 178.86 579.01 00:17:25.519 00:17:25.519 Initializing NVMe Controllers 00:17:25.519 Attached to NVMe over Fabrics controller at 10.0.0.3:4420: nqn.2024-07.io.spdk:cnode0 00:17:25.519 Associating TCP (addr:10.0.0.3 subnqn:nqn.2024-07.io.spdk:cnode0) NSID 1 with lcore 3 00:17:25.519 Initialization complete. Launching workers. 00:17:25.519 ======================================================== 00:17:25.519 Latency(us) 00:17:25.520 Device Information : IOPS MiB/s Average min max 00:17:25.520 TCP (addr:10.0.0.3 subnqn:nqn.2024-07.io.spdk:cnode0) NSID 1 from core 3: 3179.00 12.42 314.27 211.70 595.53 00:17:25.520 ======================================================== 00:17:25.520 Total : 3179.00 12.42 314.27 211.70 595.53 00:17:25.520 00:17:25.520 11:28:06 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- target/control_msg_list.sh@34 -- # wait 86102 00:17:25.520 11:28:06 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- target/control_msg_list.sh@35 -- # wait 86103 00:17:25.520 11:28:06 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- target/control_msg_list.sh@37 -- # trap - SIGINT SIGTERM EXIT 00:17:25.520 11:28:06 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- target/control_msg_list.sh@38 -- # nvmftestfini 00:17:25.520 11:28:06 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@514 -- # nvmfcleanup 00:17:25.520 11:28:06 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@121 -- # sync 00:17:25.520 11:28:06 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:17:25.520 11:28:06 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@124 -- # set +e 00:17:25.520 11:28:06 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@125 -- # for i in {1..20} 00:17:25.520 11:28:06 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:17:25.520 rmmod nvme_tcp 00:17:25.520 rmmod nvme_fabrics 00:17:25.520 rmmod nvme_keyring 00:17:25.520 11:28:06 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:17:25.520 11:28:06 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@128 -- # set -e 00:17:25.520 11:28:06 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@129 -- # return 0 00:17:25.520 11:28:06 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@515 -- # '[' -n 86051 ']' 00:17:25.520 11:28:06 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@516 -- # killprocess 86051 00:17:25.520 11:28:06 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@950 -- # '[' -z 86051 ']' 00:17:25.520 11:28:06 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@954 -- # kill -0 86051 00:17:25.520 11:28:06 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@955 -- # uname 00:17:25.520 11:28:06 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:17:25.520 11:28:06 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 86051 00:17:25.520 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:17:25.520 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:17:25.520 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@968 -- # echo 'killing process with pid 86051' 00:17:25.520 killing process with pid 86051 00:17:25.520 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@969 -- # kill 86051 00:17:25.520 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@974 -- # wait 86051 00:17:25.778 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:17:25.778 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:17:25.778 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:17:25.778 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@297 -- # iptr 00:17:25.778 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@789 -- # iptables-save 00:17:25.778 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@789 -- # iptables-restore 00:17:25.778 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:17:25.778 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@298 -- # [[ nvmf_tgt_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:17:25.778 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@299 -- # nvmf_veth_fini 00:17:25.778 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@233 -- # ip link set nvmf_init_br nomaster 00:17:25.778 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@234 -- # ip link set nvmf_init_br2 nomaster 00:17:25.778 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@235 -- # ip link set nvmf_tgt_br nomaster 00:17:25.778 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@236 -- # ip link set nvmf_tgt_br2 nomaster 00:17:25.778 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@237 -- # ip link set nvmf_init_br down 00:17:25.778 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@238 -- # ip link set nvmf_init_br2 down 00:17:25.778 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@239 -- # ip link set nvmf_tgt_br down 00:17:25.778 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@240 -- # ip link set nvmf_tgt_br2 down 00:17:25.778 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@241 -- # ip link delete nvmf_br type bridge 00:17:25.778 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@242 -- # ip link delete nvmf_init_if 00:17:26.037 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@243 -- # ip link delete nvmf_init_if2 00:17:26.037 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@244 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:17:26.037 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@245 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:17:26.037 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@246 -- # remove_spdk_ns 00:17:26.037 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:26.037 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:17:26.037 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:26.037 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- nvmf/common.sh@300 -- # return 0 00:17:26.037 00:17:26.037 real 0m3.867s 00:17:26.037 user 0m5.751s 00:17:26.037 sys 0m1.533s 00:17:26.037 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@1126 -- # xtrace_disable 00:17:26.037 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_control_msg_list -- common/autotest_common.sh@10 -- # set +x 00:17:26.037 ************************************ 00:17:26.037 END TEST nvmf_control_msg_list 00:17:26.037 ************************************ 00:17:26.037 11:28:07 nvmf_tcp.nvmf_target_extra -- nvmf/nvmf_target_extra.sh@44 -- # run_test nvmf_wait_for_buf /home/vagrant/spdk_repo/spdk/test/nvmf/target/wait_for_buf.sh --transport=tcp 00:17:26.037 11:28:07 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:17:26.037 11:28:07 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1107 -- # xtrace_disable 00:17:26.037 11:28:07 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@10 -- # set +x 00:17:26.037 ************************************ 00:17:26.037 START TEST nvmf_wait_for_buf 00:17:26.037 ************************************ 00:17:26.037 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/nvmf/target/wait_for_buf.sh --transport=tcp 00:17:26.037 * Looking for test storage... 00:17:26.296 * Found test storage at /home/vagrant/spdk_repo/spdk/test/nvmf/target 00:17:26.296 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:17:26.296 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@1681 -- # lcov --version 00:17:26.296 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:17:26.296 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:17:26.296 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:17:26.296 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- scripts/common.sh@333 -- # local ver1 ver1_l 00:17:26.296 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- scripts/common.sh@334 -- # local ver2 ver2_l 00:17:26.296 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- scripts/common.sh@336 -- # IFS=.-: 00:17:26.296 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- scripts/common.sh@336 -- # read -ra ver1 00:17:26.296 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- scripts/common.sh@337 -- # IFS=.-: 00:17:26.296 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- scripts/common.sh@337 -- # read -ra ver2 00:17:26.296 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- scripts/common.sh@338 -- # local 'op=<' 00:17:26.296 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- scripts/common.sh@340 -- # ver1_l=2 00:17:26.296 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- scripts/common.sh@341 -- # ver2_l=1 00:17:26.296 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:17:26.296 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- scripts/common.sh@344 -- # case "$op" in 00:17:26.296 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- scripts/common.sh@345 -- # : 1 00:17:26.296 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- scripts/common.sh@364 -- # (( v = 0 )) 00:17:26.296 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:17:26.296 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- scripts/common.sh@365 -- # decimal 1 00:17:26.296 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- scripts/common.sh@353 -- # local d=1 00:17:26.296 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:17:26.296 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- scripts/common.sh@355 -- # echo 1 00:17:26.296 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- scripts/common.sh@365 -- # ver1[v]=1 00:17:26.296 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- scripts/common.sh@366 -- # decimal 2 00:17:26.296 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- scripts/common.sh@353 -- # local d=2 00:17:26.296 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:17:26.296 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- scripts/common.sh@355 -- # echo 2 00:17:26.296 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- scripts/common.sh@366 -- # ver2[v]=2 00:17:26.296 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:17:26.296 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:17:26.296 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- scripts/common.sh@368 -- # return 0 00:17:26.296 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:17:26.296 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:17:26.296 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:26.296 --rc genhtml_branch_coverage=1 00:17:26.296 --rc genhtml_function_coverage=1 00:17:26.296 --rc genhtml_legend=1 00:17:26.296 --rc geninfo_all_blocks=1 00:17:26.296 --rc geninfo_unexecuted_blocks=1 00:17:26.296 00:17:26.296 ' 00:17:26.296 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:17:26.296 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:26.296 --rc genhtml_branch_coverage=1 00:17:26.296 --rc genhtml_function_coverage=1 00:17:26.296 --rc genhtml_legend=1 00:17:26.296 --rc geninfo_all_blocks=1 00:17:26.296 --rc geninfo_unexecuted_blocks=1 00:17:26.296 00:17:26.296 ' 00:17:26.296 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:17:26.296 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:26.296 --rc genhtml_branch_coverage=1 00:17:26.296 --rc genhtml_function_coverage=1 00:17:26.296 --rc genhtml_legend=1 00:17:26.296 --rc geninfo_all_blocks=1 00:17:26.296 --rc geninfo_unexecuted_blocks=1 00:17:26.296 00:17:26.296 ' 00:17:26.296 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:17:26.296 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:26.296 --rc genhtml_branch_coverage=1 00:17:26.296 --rc genhtml_function_coverage=1 00:17:26.296 --rc genhtml_legend=1 00:17:26.296 --rc geninfo_all_blocks=1 00:17:26.296 --rc geninfo_unexecuted_blocks=1 00:17:26.296 00:17:26.296 ' 00:17:26.296 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- target/wait_for_buf.sh@10 -- # source /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh 00:17:26.296 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@7 -- # uname -s 00:17:26.296 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:26.296 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:26.296 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:26.296 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:26.296 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:26.296 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:26.296 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:26.296 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:26.296 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:26.296 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:26.296 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:17:26.296 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@18 -- # NVME_HOSTID=3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:17:26.296 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:26.296 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:26.296 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@21 -- # NET_TYPE=virt 00:17:26.296 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:17:26.296 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@49 -- # source /home/vagrant/spdk_repo/spdk/scripts/common.sh 00:17:26.296 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- scripts/common.sh@15 -- # shopt -s extglob 00:17:26.296 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:26.296 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:26.296 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:26.296 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:26.296 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:26.296 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:26.297 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- paths/export.sh@5 -- # export PATH 00:17:26.297 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:26.297 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@51 -- # : 0 00:17:26.297 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:17:26.297 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:17:26.297 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:17:26.297 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:26.297 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:26.297 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:17:26.297 /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:17:26.297 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:17:26.297 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:17:26.297 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@55 -- # have_pci_nics=0 00:17:26.297 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- target/wait_for_buf.sh@12 -- # nvmftestinit 00:17:26.297 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:17:26.297 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:26.297 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@474 -- # prepare_net_devs 00:17:26.297 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@436 -- # local -g is_hw=no 00:17:26.297 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@438 -- # remove_spdk_ns 00:17:26.297 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:26.297 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:17:26.297 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:26.297 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@440 -- # [[ virt != virt ]] 00:17:26.297 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@442 -- # [[ no == yes ]] 00:17:26.297 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@449 -- # [[ virt == phy ]] 00:17:26.297 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@452 -- # [[ virt == phy-fallback ]] 00:17:26.297 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@457 -- # [[ tcp == tcp ]] 00:17:26.297 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@458 -- # nvmf_veth_init 00:17:26.297 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@145 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:17:26.297 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@146 -- # NVMF_SECOND_INITIATOR_IP=10.0.0.2 00:17:26.297 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@147 -- # NVMF_FIRST_TARGET_IP=10.0.0.3 00:17:26.297 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@148 -- # NVMF_SECOND_TARGET_IP=10.0.0.4 00:17:26.297 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@149 -- # NVMF_INITIATOR_IP=10.0.0.1 00:17:26.297 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@150 -- # NVMF_BRIDGE=nvmf_br 00:17:26.297 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@151 -- # NVMF_INITIATOR_INTERFACE=nvmf_init_if 00:17:26.297 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@152 -- # NVMF_INITIATOR_INTERFACE2=nvmf_init_if2 00:17:26.297 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@153 -- # NVMF_INITIATOR_BRIDGE=nvmf_init_br 00:17:26.297 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@154 -- # NVMF_INITIATOR_BRIDGE2=nvmf_init_br2 00:17:26.297 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@155 -- # NVMF_TARGET_NAMESPACE=nvmf_tgt_ns_spdk 00:17:26.297 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@156 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:17:26.297 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@157 -- # NVMF_TARGET_INTERFACE=nvmf_tgt_if 00:17:26.297 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@158 -- # NVMF_TARGET_INTERFACE2=nvmf_tgt_if2 00:17:26.297 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@159 -- # NVMF_TARGET_BRIDGE=nvmf_tgt_br 00:17:26.297 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@160 -- # NVMF_TARGET_BRIDGE2=nvmf_tgt_br2 00:17:26.297 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@162 -- # ip link set nvmf_init_br nomaster 00:17:26.297 Cannot find device "nvmf_init_br" 00:17:26.297 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@162 -- # true 00:17:26.297 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@163 -- # ip link set nvmf_init_br2 nomaster 00:17:26.297 Cannot find device "nvmf_init_br2" 00:17:26.297 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@163 -- # true 00:17:26.297 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@164 -- # ip link set nvmf_tgt_br nomaster 00:17:26.297 Cannot find device "nvmf_tgt_br" 00:17:26.297 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@164 -- # true 00:17:26.297 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@165 -- # ip link set nvmf_tgt_br2 nomaster 00:17:26.297 Cannot find device "nvmf_tgt_br2" 00:17:26.297 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@165 -- # true 00:17:26.297 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@166 -- # ip link set nvmf_init_br down 00:17:26.297 Cannot find device "nvmf_init_br" 00:17:26.297 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@166 -- # true 00:17:26.297 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@167 -- # ip link set nvmf_init_br2 down 00:17:26.297 Cannot find device "nvmf_init_br2" 00:17:26.297 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@167 -- # true 00:17:26.297 11:28:07 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@168 -- # ip link set nvmf_tgt_br down 00:17:26.297 Cannot find device "nvmf_tgt_br" 00:17:26.297 11:28:08 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@168 -- # true 00:17:26.297 11:28:08 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@169 -- # ip link set nvmf_tgt_br2 down 00:17:26.555 Cannot find device "nvmf_tgt_br2" 00:17:26.555 11:28:08 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@169 -- # true 00:17:26.555 11:28:08 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@170 -- # ip link delete nvmf_br type bridge 00:17:26.555 Cannot find device "nvmf_br" 00:17:26.555 11:28:08 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@170 -- # true 00:17:26.555 11:28:08 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@171 -- # ip link delete nvmf_init_if 00:17:26.555 Cannot find device "nvmf_init_if" 00:17:26.555 11:28:08 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@171 -- # true 00:17:26.555 11:28:08 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@172 -- # ip link delete nvmf_init_if2 00:17:26.555 Cannot find device "nvmf_init_if2" 00:17:26.555 11:28:08 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@172 -- # true 00:17:26.555 11:28:08 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@173 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:17:26.555 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:17:26.555 11:28:08 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@173 -- # true 00:17:26.555 11:28:08 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@174 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:17:26.555 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:17:26.555 11:28:08 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@174 -- # true 00:17:26.555 11:28:08 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@177 -- # ip netns add nvmf_tgt_ns_spdk 00:17:26.555 11:28:08 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@180 -- # ip link add nvmf_init_if type veth peer name nvmf_init_br 00:17:26.555 11:28:08 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@181 -- # ip link add nvmf_init_if2 type veth peer name nvmf_init_br2 00:17:26.555 11:28:08 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@182 -- # ip link add nvmf_tgt_if type veth peer name nvmf_tgt_br 00:17:26.555 11:28:08 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@183 -- # ip link add nvmf_tgt_if2 type veth peer name nvmf_tgt_br2 00:17:26.555 11:28:08 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@186 -- # ip link set nvmf_tgt_if netns nvmf_tgt_ns_spdk 00:17:26.555 11:28:08 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@187 -- # ip link set nvmf_tgt_if2 netns nvmf_tgt_ns_spdk 00:17:26.555 11:28:08 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@190 -- # ip addr add 10.0.0.1/24 dev nvmf_init_if 00:17:26.555 11:28:08 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@191 -- # ip addr add 10.0.0.2/24 dev nvmf_init_if2 00:17:26.555 11:28:08 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@192 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.3/24 dev nvmf_tgt_if 00:17:26.555 11:28:08 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@193 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.4/24 dev nvmf_tgt_if2 00:17:26.555 11:28:08 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@196 -- # ip link set nvmf_init_if up 00:17:26.555 11:28:08 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@197 -- # ip link set nvmf_init_if2 up 00:17:26.555 11:28:08 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@198 -- # ip link set nvmf_init_br up 00:17:26.555 11:28:08 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@199 -- # ip link set nvmf_init_br2 up 00:17:26.555 11:28:08 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@200 -- # ip link set nvmf_tgt_br up 00:17:26.555 11:28:08 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@201 -- # ip link set nvmf_tgt_br2 up 00:17:26.555 11:28:08 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@202 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if up 00:17:26.817 11:28:08 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@203 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if2 up 00:17:26.817 11:28:08 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@204 -- # ip netns exec nvmf_tgt_ns_spdk ip link set lo up 00:17:26.817 11:28:08 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@207 -- # ip link add nvmf_br type bridge 00:17:26.817 11:28:08 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@208 -- # ip link set nvmf_br up 00:17:26.817 11:28:08 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@211 -- # ip link set nvmf_init_br master nvmf_br 00:17:26.817 11:28:08 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@212 -- # ip link set nvmf_init_br2 master nvmf_br 00:17:26.817 11:28:08 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@213 -- # ip link set nvmf_tgt_br master nvmf_br 00:17:26.817 11:28:08 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@214 -- # ip link set nvmf_tgt_br2 master nvmf_br 00:17:26.817 11:28:08 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@217 -- # ipts -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT 00:17:26.817 11:28:08 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT' 00:17:26.817 11:28:08 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@218 -- # ipts -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT 00:17:26.817 11:28:08 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT' 00:17:26.817 11:28:08 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@219 -- # ipts -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT 00:17:26.817 11:28:08 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@788 -- # iptables -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT -m comment --comment 'SPDK_NVMF:-A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT' 00:17:26.817 11:28:08 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@222 -- # ping -c 1 10.0.0.3 00:17:26.817 PING 10.0.0.3 (10.0.0.3) 56(84) bytes of data. 00:17:26.817 64 bytes from 10.0.0.3: icmp_seq=1 ttl=64 time=0.083 ms 00:17:26.817 00:17:26.817 --- 10.0.0.3 ping statistics --- 00:17:26.817 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:26.817 rtt min/avg/max/mdev = 0.083/0.083/0.083/0.000 ms 00:17:26.817 11:28:08 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@223 -- # ping -c 1 10.0.0.4 00:17:26.817 PING 10.0.0.4 (10.0.0.4) 56(84) bytes of data. 00:17:26.817 64 bytes from 10.0.0.4: icmp_seq=1 ttl=64 time=0.051 ms 00:17:26.817 00:17:26.817 --- 10.0.0.4 ping statistics --- 00:17:26.817 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:26.817 rtt min/avg/max/mdev = 0.051/0.051/0.051/0.000 ms 00:17:26.817 11:28:08 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@224 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.1 00:17:26.817 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:17:26.817 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.024 ms 00:17:26.817 00:17:26.817 --- 10.0.0.1 ping statistics --- 00:17:26.817 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:26.817 rtt min/avg/max/mdev = 0.024/0.024/0.024/0.000 ms 00:17:26.817 11:28:08 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@225 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.2 00:17:26.817 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:17:26.817 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.084 ms 00:17:26.817 00:17:26.817 --- 10.0.0.2 ping statistics --- 00:17:26.817 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:26.817 rtt min/avg/max/mdev = 0.084/0.084/0.084/0.000 ms 00:17:26.817 11:28:08 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@227 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:17:26.817 11:28:08 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@459 -- # return 0 00:17:26.817 11:28:08 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:17:26.817 11:28:08 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:17:26.817 11:28:08 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:17:26.817 11:28:08 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:17:26.817 11:28:08 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:17:26.817 11:28:08 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:17:26.817 11:28:08 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:17:26.817 11:28:08 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- target/wait_for_buf.sh@13 -- # nvmfappstart --wait-for-rpc 00:17:26.817 11:28:08 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:17:26.817 11:28:08 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@724 -- # xtrace_disable 00:17:26.817 11:28:08 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@10 -- # set +x 00:17:26.817 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:26.817 11:28:08 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@507 -- # nvmfpid=86343 00:17:26.817 11:28:08 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@508 -- # waitforlisten 86343 00:17:26.817 11:28:08 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@831 -- # '[' -z 86343 ']' 00:17:26.817 11:28:08 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:26.817 11:28:08 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@506 -- # ip netns exec nvmf_tgt_ns_spdk /home/vagrant/spdk_repo/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --wait-for-rpc 00:17:26.817 11:28:08 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@836 -- # local max_retries=100 00:17:26.817 11:28:08 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:26.817 11:28:08 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@840 -- # xtrace_disable 00:17:26.817 11:28:08 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@10 -- # set +x 00:17:26.817 [2024-10-07 11:28:08.512343] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:17:26.817 [2024-10-07 11:28:08.512522] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:27.076 [2024-10-07 11:28:08.656405] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:27.334 [2024-10-07 11:28:08.793805] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:27.334 [2024-10-07 11:28:08.793880] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:27.334 [2024-10-07 11:28:08.793894] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:17:27.334 [2024-10-07 11:28:08.793905] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:17:27.334 [2024-10-07 11:28:08.793915] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:27.334 [2024-10-07 11:28:08.794463] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:17:28.269 11:28:09 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:17:28.269 11:28:09 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@864 -- # return 0 00:17:28.269 11:28:09 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:17:28.269 11:28:09 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@730 -- # xtrace_disable 00:17:28.269 11:28:09 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@10 -- # set +x 00:17:28.269 11:28:09 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:28.269 11:28:09 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- target/wait_for_buf.sh@15 -- # subnqn=nqn.2024-07.io.spdk:cnode0 00:17:28.269 11:28:09 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- target/wait_for_buf.sh@16 -- # perf=/home/vagrant/spdk_repo/spdk/build/bin/spdk_nvme_perf 00:17:28.269 11:28:09 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- target/wait_for_buf.sh@19 -- # rpc_cmd accel_set_options --small-cache-size 0 --large-cache-size 0 00:17:28.269 11:28:09 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:28.269 11:28:09 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@10 -- # set +x 00:17:28.269 11:28:09 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:28.269 11:28:09 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- target/wait_for_buf.sh@20 -- # rpc_cmd iobuf_set_options --small-pool-count 154 --small_bufsize=8192 00:17:28.269 11:28:09 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:28.269 11:28:09 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@10 -- # set +x 00:17:28.269 11:28:09 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:28.269 11:28:09 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- target/wait_for_buf.sh@21 -- # rpc_cmd framework_start_init 00:17:28.269 11:28:09 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:28.269 11:28:09 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@10 -- # set +x 00:17:28.269 11:28:09 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:28.269 11:28:09 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- target/wait_for_buf.sh@22 -- # rpc_cmd bdev_malloc_create -b Malloc0 32 512 00:17:28.269 11:28:09 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:28.269 11:28:09 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@10 -- # set +x 00:17:28.269 Malloc0 00:17:28.269 11:28:09 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:28.269 11:28:09 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- target/wait_for_buf.sh@23 -- # rpc_cmd nvmf_create_transport '-t tcp -o' -u 8192 -n 24 -b 24 00:17:28.269 11:28:09 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:28.269 11:28:09 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@10 -- # set +x 00:17:28.269 [2024-10-07 11:28:09.849125] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:28.269 11:28:09 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:28.269 11:28:09 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- target/wait_for_buf.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2024-07.io.spdk:cnode0 -a -s SPDK00000000000001 00:17:28.269 11:28:09 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:28.269 11:28:09 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@10 -- # set +x 00:17:28.269 11:28:09 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:28.269 11:28:09 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- target/wait_for_buf.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2024-07.io.spdk:cnode0 Malloc0 00:17:28.269 11:28:09 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:28.269 11:28:09 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@10 -- # set +x 00:17:28.269 11:28:09 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:28.269 11:28:09 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- target/wait_for_buf.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2024-07.io.spdk:cnode0 -t tcp -a 10.0.0.3 -s 4420 00:17:28.269 11:28:09 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:28.269 11:28:09 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@10 -- # set +x 00:17:28.269 [2024-10-07 11:28:09.873284] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:17:28.269 11:28:09 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:28.269 11:28:09 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- target/wait_for_buf.sh@30 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_nvme_perf -q 4 -o 131072 -w randread -t 1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.3 trsvcid:4420' 00:17:28.527 [2024-10-07 11:28:10.065641] subsystem.c:1641:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on TCP/10.0.0.3/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:17:29.902 Initializing NVMe Controllers 00:17:29.902 Attached to NVMe over Fabrics controller at 10.0.0.3:4420: nqn.2024-07.io.spdk:cnode0 00:17:29.902 Associating TCP (addr:10.0.0.3 subnqn:nqn.2024-07.io.spdk:cnode0) NSID 1 with lcore 0 00:17:29.902 Initialization complete. Launching workers. 00:17:29.902 ======================================================== 00:17:29.903 Latency(us) 00:17:29.903 Device Information : IOPS MiB/s Average min max 00:17:29.903 TCP (addr:10.0.0.3 subnqn:nqn.2024-07.io.spdk:cnode0) NSID 1 from core 0: 128.87 16.11 32200.12 8003.64 67008.09 00:17:29.903 ======================================================== 00:17:29.903 Total : 128.87 16.11 32200.12 8003.64 67008.09 00:17:29.903 00:17:29.903 11:28:11 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- target/wait_for_buf.sh@32 -- # jq -r '.[] | select(.module == "nvmf_TCP") | .small_pool.retry' 00:17:29.903 11:28:11 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- target/wait_for_buf.sh@32 -- # rpc_cmd iobuf_get_stats 00:17:29.903 11:28:11 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:29.903 11:28:11 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@10 -- # set +x 00:17:29.903 11:28:11 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:29.903 11:28:11 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- target/wait_for_buf.sh@32 -- # retry_count=2038 00:17:29.903 11:28:11 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- target/wait_for_buf.sh@33 -- # [[ 2038 -eq 0 ]] 00:17:29.903 11:28:11 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- target/wait_for_buf.sh@37 -- # trap - SIGINT SIGTERM EXIT 00:17:29.903 11:28:11 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- target/wait_for_buf.sh@38 -- # nvmftestfini 00:17:29.903 11:28:11 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@514 -- # nvmfcleanup 00:17:29.903 11:28:11 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@121 -- # sync 00:17:29.903 11:28:11 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:17:29.903 11:28:11 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@124 -- # set +e 00:17:29.903 11:28:11 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@125 -- # for i in {1..20} 00:17:29.903 11:28:11 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:17:29.903 rmmod nvme_tcp 00:17:29.903 rmmod nvme_fabrics 00:17:29.903 rmmod nvme_keyring 00:17:29.903 11:28:11 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:17:29.903 11:28:11 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@128 -- # set -e 00:17:29.903 11:28:11 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@129 -- # return 0 00:17:29.903 11:28:11 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@515 -- # '[' -n 86343 ']' 00:17:29.903 11:28:11 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@516 -- # killprocess 86343 00:17:29.903 11:28:11 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@950 -- # '[' -z 86343 ']' 00:17:29.903 11:28:11 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@954 -- # kill -0 86343 00:17:29.903 11:28:11 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@955 -- # uname 00:17:29.903 11:28:11 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:17:29.903 11:28:11 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 86343 00:17:30.161 killing process with pid 86343 00:17:30.161 11:28:11 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:17:30.161 11:28:11 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:17:30.161 11:28:11 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@968 -- # echo 'killing process with pid 86343' 00:17:30.161 11:28:11 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@969 -- # kill 86343 00:17:30.161 11:28:11 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@974 -- # wait 86343 00:17:30.418 11:28:11 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:17:30.418 11:28:11 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:17:30.418 11:28:11 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:17:30.418 11:28:11 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@297 -- # iptr 00:17:30.418 11:28:11 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@789 -- # iptables-save 00:17:30.418 11:28:11 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:17:30.418 11:28:11 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@789 -- # iptables-restore 00:17:30.418 11:28:11 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@298 -- # [[ nvmf_tgt_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:17:30.418 11:28:11 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@299 -- # nvmf_veth_fini 00:17:30.418 11:28:11 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@233 -- # ip link set nvmf_init_br nomaster 00:17:30.418 11:28:11 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@234 -- # ip link set nvmf_init_br2 nomaster 00:17:30.418 11:28:11 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@235 -- # ip link set nvmf_tgt_br nomaster 00:17:30.418 11:28:11 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@236 -- # ip link set nvmf_tgt_br2 nomaster 00:17:30.418 11:28:12 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@237 -- # ip link set nvmf_init_br down 00:17:30.418 11:28:12 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@238 -- # ip link set nvmf_init_br2 down 00:17:30.418 11:28:12 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@239 -- # ip link set nvmf_tgt_br down 00:17:30.418 11:28:12 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@240 -- # ip link set nvmf_tgt_br2 down 00:17:30.418 11:28:12 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@241 -- # ip link delete nvmf_br type bridge 00:17:30.418 11:28:12 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@242 -- # ip link delete nvmf_init_if 00:17:30.418 11:28:12 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@243 -- # ip link delete nvmf_init_if2 00:17:30.418 11:28:12 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@244 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:17:30.675 11:28:12 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@245 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:17:30.676 11:28:12 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@246 -- # remove_spdk_ns 00:17:30.676 11:28:12 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:30.676 11:28:12 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:17:30.676 11:28:12 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:30.676 11:28:12 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- nvmf/common.sh@300 -- # return 0 00:17:30.676 00:17:30.676 real 0m4.526s 00:17:30.676 user 0m4.000s 00:17:30.676 sys 0m0.991s 00:17:30.676 ************************************ 00:17:30.676 END TEST nvmf_wait_for_buf 00:17:30.676 ************************************ 00:17:30.676 11:28:12 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@1126 -- # xtrace_disable 00:17:30.676 11:28:12 nvmf_tcp.nvmf_target_extra.nvmf_wait_for_buf -- common/autotest_common.sh@10 -- # set +x 00:17:30.676 11:28:12 nvmf_tcp.nvmf_target_extra -- nvmf/nvmf_target_extra.sh@47 -- # '[' 0 -eq 1 ']' 00:17:30.676 11:28:12 nvmf_tcp.nvmf_target_extra -- nvmf/nvmf_target_extra.sh@53 -- # [[ virt == phy ]] 00:17:30.676 11:28:12 nvmf_tcp.nvmf_target_extra -- nvmf/nvmf_target_extra.sh@68 -- # trap - SIGINT SIGTERM EXIT 00:17:30.676 ************************************ 00:17:30.676 END TEST nvmf_target_extra 00:17:30.676 ************************************ 00:17:30.676 00:17:30.676 real 7m48.480s 00:17:30.676 user 18m50.951s 00:17:30.676 sys 1m32.754s 00:17:30.676 11:28:12 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@1126 -- # xtrace_disable 00:17:30.676 11:28:12 nvmf_tcp.nvmf_target_extra -- common/autotest_common.sh@10 -- # set +x 00:17:30.676 11:28:12 nvmf_tcp -- nvmf/nvmf.sh@16 -- # run_test nvmf_host /home/vagrant/spdk_repo/spdk/test/nvmf/nvmf_host.sh --transport=tcp 00:17:30.676 11:28:12 nvmf_tcp -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:17:30.676 11:28:12 nvmf_tcp -- common/autotest_common.sh@1107 -- # xtrace_disable 00:17:30.676 11:28:12 nvmf_tcp -- common/autotest_common.sh@10 -- # set +x 00:17:30.676 ************************************ 00:17:30.676 START TEST nvmf_host 00:17:30.676 ************************************ 00:17:30.676 11:28:12 nvmf_tcp.nvmf_host -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/nvmf/nvmf_host.sh --transport=tcp 00:17:30.676 * Looking for test storage... 00:17:30.676 * Found test storage at /home/vagrant/spdk_repo/spdk/test/nvmf 00:17:30.676 11:28:12 nvmf_tcp.nvmf_host -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:17:30.676 11:28:12 nvmf_tcp.nvmf_host -- common/autotest_common.sh@1681 -- # lcov --version 00:17:30.676 11:28:12 nvmf_tcp.nvmf_host -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:17:30.934 11:28:12 nvmf_tcp.nvmf_host -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:17:30.934 11:28:12 nvmf_tcp.nvmf_host -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:17:30.934 11:28:12 nvmf_tcp.nvmf_host -- scripts/common.sh@333 -- # local ver1 ver1_l 00:17:30.934 11:28:12 nvmf_tcp.nvmf_host -- scripts/common.sh@334 -- # local ver2 ver2_l 00:17:30.934 11:28:12 nvmf_tcp.nvmf_host -- scripts/common.sh@336 -- # IFS=.-: 00:17:30.934 11:28:12 nvmf_tcp.nvmf_host -- scripts/common.sh@336 -- # read -ra ver1 00:17:30.934 11:28:12 nvmf_tcp.nvmf_host -- scripts/common.sh@337 -- # IFS=.-: 00:17:30.934 11:28:12 nvmf_tcp.nvmf_host -- scripts/common.sh@337 -- # read -ra ver2 00:17:30.934 11:28:12 nvmf_tcp.nvmf_host -- scripts/common.sh@338 -- # local 'op=<' 00:17:30.934 11:28:12 nvmf_tcp.nvmf_host -- scripts/common.sh@340 -- # ver1_l=2 00:17:30.934 11:28:12 nvmf_tcp.nvmf_host -- scripts/common.sh@341 -- # ver2_l=1 00:17:30.934 11:28:12 nvmf_tcp.nvmf_host -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:17:30.934 11:28:12 nvmf_tcp.nvmf_host -- scripts/common.sh@344 -- # case "$op" in 00:17:30.934 11:28:12 nvmf_tcp.nvmf_host -- scripts/common.sh@345 -- # : 1 00:17:30.934 11:28:12 nvmf_tcp.nvmf_host -- scripts/common.sh@364 -- # (( v = 0 )) 00:17:30.934 11:28:12 nvmf_tcp.nvmf_host -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:17:30.934 11:28:12 nvmf_tcp.nvmf_host -- scripts/common.sh@365 -- # decimal 1 00:17:30.934 11:28:12 nvmf_tcp.nvmf_host -- scripts/common.sh@353 -- # local d=1 00:17:30.934 11:28:12 nvmf_tcp.nvmf_host -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:17:30.934 11:28:12 nvmf_tcp.nvmf_host -- scripts/common.sh@355 -- # echo 1 00:17:30.934 11:28:12 nvmf_tcp.nvmf_host -- scripts/common.sh@365 -- # ver1[v]=1 00:17:30.934 11:28:12 nvmf_tcp.nvmf_host -- scripts/common.sh@366 -- # decimal 2 00:17:30.934 11:28:12 nvmf_tcp.nvmf_host -- scripts/common.sh@353 -- # local d=2 00:17:30.934 11:28:12 nvmf_tcp.nvmf_host -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:17:30.934 11:28:12 nvmf_tcp.nvmf_host -- scripts/common.sh@355 -- # echo 2 00:17:30.934 11:28:12 nvmf_tcp.nvmf_host -- scripts/common.sh@366 -- # ver2[v]=2 00:17:30.934 11:28:12 nvmf_tcp.nvmf_host -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:17:30.934 11:28:12 nvmf_tcp.nvmf_host -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:17:30.934 11:28:12 nvmf_tcp.nvmf_host -- scripts/common.sh@368 -- # return 0 00:17:30.934 11:28:12 nvmf_tcp.nvmf_host -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:17:30.934 11:28:12 nvmf_tcp.nvmf_host -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:17:30.934 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:30.934 --rc genhtml_branch_coverage=1 00:17:30.934 --rc genhtml_function_coverage=1 00:17:30.934 --rc genhtml_legend=1 00:17:30.934 --rc geninfo_all_blocks=1 00:17:30.934 --rc geninfo_unexecuted_blocks=1 00:17:30.934 00:17:30.934 ' 00:17:30.934 11:28:12 nvmf_tcp.nvmf_host -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:17:30.934 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:30.934 --rc genhtml_branch_coverage=1 00:17:30.934 --rc genhtml_function_coverage=1 00:17:30.934 --rc genhtml_legend=1 00:17:30.934 --rc geninfo_all_blocks=1 00:17:30.934 --rc geninfo_unexecuted_blocks=1 00:17:30.934 00:17:30.934 ' 00:17:30.934 11:28:12 nvmf_tcp.nvmf_host -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:17:30.934 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:30.934 --rc genhtml_branch_coverage=1 00:17:30.934 --rc genhtml_function_coverage=1 00:17:30.934 --rc genhtml_legend=1 00:17:30.934 --rc geninfo_all_blocks=1 00:17:30.934 --rc geninfo_unexecuted_blocks=1 00:17:30.934 00:17:30.934 ' 00:17:30.934 11:28:12 nvmf_tcp.nvmf_host -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:17:30.934 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:30.934 --rc genhtml_branch_coverage=1 00:17:30.934 --rc genhtml_function_coverage=1 00:17:30.934 --rc genhtml_legend=1 00:17:30.934 --rc geninfo_all_blocks=1 00:17:30.934 --rc geninfo_unexecuted_blocks=1 00:17:30.934 00:17:30.934 ' 00:17:30.934 11:28:12 nvmf_tcp.nvmf_host -- nvmf/nvmf_host.sh@9 -- # source /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh 00:17:30.934 11:28:12 nvmf_tcp.nvmf_host -- nvmf/common.sh@7 -- # uname -s 00:17:30.934 11:28:12 nvmf_tcp.nvmf_host -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:30.934 11:28:12 nvmf_tcp.nvmf_host -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:30.934 11:28:12 nvmf_tcp.nvmf_host -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:30.934 11:28:12 nvmf_tcp.nvmf_host -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:30.934 11:28:12 nvmf_tcp.nvmf_host -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:30.934 11:28:12 nvmf_tcp.nvmf_host -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:30.934 11:28:12 nvmf_tcp.nvmf_host -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:30.934 11:28:12 nvmf_tcp.nvmf_host -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:30.934 11:28:12 nvmf_tcp.nvmf_host -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:30.934 11:28:12 nvmf_tcp.nvmf_host -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:30.934 11:28:12 nvmf_tcp.nvmf_host -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:17:30.934 11:28:12 nvmf_tcp.nvmf_host -- nvmf/common.sh@18 -- # NVME_HOSTID=3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:17:30.934 11:28:12 nvmf_tcp.nvmf_host -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:30.934 11:28:12 nvmf_tcp.nvmf_host -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:30.934 11:28:12 nvmf_tcp.nvmf_host -- nvmf/common.sh@21 -- # NET_TYPE=virt 00:17:30.934 11:28:12 nvmf_tcp.nvmf_host -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:17:30.934 11:28:12 nvmf_tcp.nvmf_host -- nvmf/common.sh@49 -- # source /home/vagrant/spdk_repo/spdk/scripts/common.sh 00:17:30.934 11:28:12 nvmf_tcp.nvmf_host -- scripts/common.sh@15 -- # shopt -s extglob 00:17:30.934 11:28:12 nvmf_tcp.nvmf_host -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:30.934 11:28:12 nvmf_tcp.nvmf_host -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:30.934 11:28:12 nvmf_tcp.nvmf_host -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:30.934 11:28:12 nvmf_tcp.nvmf_host -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:30.934 11:28:12 nvmf_tcp.nvmf_host -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:30.934 11:28:12 nvmf_tcp.nvmf_host -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:30.934 11:28:12 nvmf_tcp.nvmf_host -- paths/export.sh@5 -- # export PATH 00:17:30.934 11:28:12 nvmf_tcp.nvmf_host -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:30.934 11:28:12 nvmf_tcp.nvmf_host -- nvmf/common.sh@51 -- # : 0 00:17:30.934 11:28:12 nvmf_tcp.nvmf_host -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:17:30.934 11:28:12 nvmf_tcp.nvmf_host -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:17:30.934 11:28:12 nvmf_tcp.nvmf_host -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:17:30.934 11:28:12 nvmf_tcp.nvmf_host -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:30.934 11:28:12 nvmf_tcp.nvmf_host -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:30.934 11:28:12 nvmf_tcp.nvmf_host -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:17:30.934 /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:17:30.934 11:28:12 nvmf_tcp.nvmf_host -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:17:30.934 11:28:12 nvmf_tcp.nvmf_host -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:17:30.934 11:28:12 nvmf_tcp.nvmf_host -- nvmf/common.sh@55 -- # have_pci_nics=0 00:17:30.934 11:28:12 nvmf_tcp.nvmf_host -- nvmf/nvmf_host.sh@11 -- # trap 'exit 1' SIGINT SIGTERM EXIT 00:17:30.934 11:28:12 nvmf_tcp.nvmf_host -- nvmf/nvmf_host.sh@13 -- # TEST_ARGS=("$@") 00:17:30.934 11:28:12 nvmf_tcp.nvmf_host -- nvmf/nvmf_host.sh@15 -- # [[ 0 -eq 0 ]] 00:17:30.935 11:28:12 nvmf_tcp.nvmf_host -- nvmf/nvmf_host.sh@16 -- # run_test nvmf_multicontroller /home/vagrant/spdk_repo/spdk/test/nvmf/host/multicontroller.sh --transport=tcp 00:17:30.935 11:28:12 nvmf_tcp.nvmf_host -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:17:30.935 11:28:12 nvmf_tcp.nvmf_host -- common/autotest_common.sh@1107 -- # xtrace_disable 00:17:30.935 11:28:12 nvmf_tcp.nvmf_host -- common/autotest_common.sh@10 -- # set +x 00:17:30.935 ************************************ 00:17:30.935 START TEST nvmf_multicontroller 00:17:30.935 ************************************ 00:17:30.935 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/nvmf/host/multicontroller.sh --transport=tcp 00:17:30.935 * Looking for test storage... 00:17:30.935 * Found test storage at /home/vagrant/spdk_repo/spdk/test/nvmf/host 00:17:30.935 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:17:30.935 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@1681 -- # lcov --version 00:17:30.935 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:17:31.194 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:17:31.194 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:17:31.194 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- scripts/common.sh@333 -- # local ver1 ver1_l 00:17:31.194 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- scripts/common.sh@334 -- # local ver2 ver2_l 00:17:31.194 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- scripts/common.sh@336 -- # IFS=.-: 00:17:31.194 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- scripts/common.sh@336 -- # read -ra ver1 00:17:31.194 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- scripts/common.sh@337 -- # IFS=.-: 00:17:31.194 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- scripts/common.sh@337 -- # read -ra ver2 00:17:31.194 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- scripts/common.sh@338 -- # local 'op=<' 00:17:31.194 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- scripts/common.sh@340 -- # ver1_l=2 00:17:31.194 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- scripts/common.sh@341 -- # ver2_l=1 00:17:31.194 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:17:31.194 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- scripts/common.sh@344 -- # case "$op" in 00:17:31.194 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- scripts/common.sh@345 -- # : 1 00:17:31.194 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- scripts/common.sh@364 -- # (( v = 0 )) 00:17:31.194 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:17:31.194 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- scripts/common.sh@365 -- # decimal 1 00:17:31.194 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- scripts/common.sh@353 -- # local d=1 00:17:31.194 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:17:31.194 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- scripts/common.sh@355 -- # echo 1 00:17:31.194 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- scripts/common.sh@365 -- # ver1[v]=1 00:17:31.194 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- scripts/common.sh@366 -- # decimal 2 00:17:31.194 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- scripts/common.sh@353 -- # local d=2 00:17:31.194 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:17:31.194 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- scripts/common.sh@355 -- # echo 2 00:17:31.194 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- scripts/common.sh@366 -- # ver2[v]=2 00:17:31.194 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:17:31.194 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:17:31.194 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- scripts/common.sh@368 -- # return 0 00:17:31.194 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:17:31.194 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:17:31.194 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:31.194 --rc genhtml_branch_coverage=1 00:17:31.194 --rc genhtml_function_coverage=1 00:17:31.194 --rc genhtml_legend=1 00:17:31.194 --rc geninfo_all_blocks=1 00:17:31.194 --rc geninfo_unexecuted_blocks=1 00:17:31.194 00:17:31.194 ' 00:17:31.194 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:17:31.194 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:31.194 --rc genhtml_branch_coverage=1 00:17:31.194 --rc genhtml_function_coverage=1 00:17:31.194 --rc genhtml_legend=1 00:17:31.194 --rc geninfo_all_blocks=1 00:17:31.194 --rc geninfo_unexecuted_blocks=1 00:17:31.194 00:17:31.194 ' 00:17:31.194 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:17:31.194 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:31.194 --rc genhtml_branch_coverage=1 00:17:31.194 --rc genhtml_function_coverage=1 00:17:31.194 --rc genhtml_legend=1 00:17:31.194 --rc geninfo_all_blocks=1 00:17:31.194 --rc geninfo_unexecuted_blocks=1 00:17:31.194 00:17:31.194 ' 00:17:31.194 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:17:31.194 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:31.194 --rc genhtml_branch_coverage=1 00:17:31.194 --rc genhtml_function_coverage=1 00:17:31.194 --rc genhtml_legend=1 00:17:31.194 --rc geninfo_all_blocks=1 00:17:31.194 --rc geninfo_unexecuted_blocks=1 00:17:31.194 00:17:31.194 ' 00:17:31.194 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@9 -- # source /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh 00:17:31.194 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@7 -- # uname -s 00:17:31.194 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:31.194 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:31.194 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:31.194 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:31.194 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:31.194 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:31.194 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:31.194 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:31.194 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:31.194 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:31.194 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:17:31.194 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@18 -- # NVME_HOSTID=3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:17:31.194 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:31.194 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:31.194 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@21 -- # NET_TYPE=virt 00:17:31.194 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:17:31.194 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@49 -- # source /home/vagrant/spdk_repo/spdk/scripts/common.sh 00:17:31.194 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- scripts/common.sh@15 -- # shopt -s extglob 00:17:31.194 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:31.194 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:31.194 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:31.194 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:31.194 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:31.194 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:31.194 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- paths/export.sh@5 -- # export PATH 00:17:31.194 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:31.194 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@51 -- # : 0 00:17:31.195 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:17:31.195 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:17:31.195 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:17:31.195 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:31.195 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:31.195 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:17:31.195 /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:17:31.195 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:17:31.195 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:17:31.195 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@55 -- # have_pci_nics=0 00:17:31.195 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@11 -- # MALLOC_BDEV_SIZE=64 00:17:31.195 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:17:31.195 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@13 -- # NVMF_HOST_FIRST_PORT=60000 00:17:31.195 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@14 -- # NVMF_HOST_SECOND_PORT=60001 00:17:31.195 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@16 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:31.195 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@18 -- # '[' tcp == rdma ']' 00:17:31.195 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@23 -- # nvmftestinit 00:17:31.195 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:17:31.195 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:31.195 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@474 -- # prepare_net_devs 00:17:31.195 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@436 -- # local -g is_hw=no 00:17:31.195 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@438 -- # remove_spdk_ns 00:17:31.195 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:31.195 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:17:31.195 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:31.195 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@440 -- # [[ virt != virt ]] 00:17:31.195 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@442 -- # [[ no == yes ]] 00:17:31.195 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@449 -- # [[ virt == phy ]] 00:17:31.195 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@452 -- # [[ virt == phy-fallback ]] 00:17:31.195 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@457 -- # [[ tcp == tcp ]] 00:17:31.195 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@458 -- # nvmf_veth_init 00:17:31.195 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@145 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:17:31.195 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@146 -- # NVMF_SECOND_INITIATOR_IP=10.0.0.2 00:17:31.195 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@147 -- # NVMF_FIRST_TARGET_IP=10.0.0.3 00:17:31.195 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@148 -- # NVMF_SECOND_TARGET_IP=10.0.0.4 00:17:31.195 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@149 -- # NVMF_INITIATOR_IP=10.0.0.1 00:17:31.195 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@150 -- # NVMF_BRIDGE=nvmf_br 00:17:31.195 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@151 -- # NVMF_INITIATOR_INTERFACE=nvmf_init_if 00:17:31.195 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@152 -- # NVMF_INITIATOR_INTERFACE2=nvmf_init_if2 00:17:31.195 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@153 -- # NVMF_INITIATOR_BRIDGE=nvmf_init_br 00:17:31.195 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@154 -- # NVMF_INITIATOR_BRIDGE2=nvmf_init_br2 00:17:31.195 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@155 -- # NVMF_TARGET_NAMESPACE=nvmf_tgt_ns_spdk 00:17:31.195 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@156 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:17:31.195 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@157 -- # NVMF_TARGET_INTERFACE=nvmf_tgt_if 00:17:31.195 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@158 -- # NVMF_TARGET_INTERFACE2=nvmf_tgt_if2 00:17:31.195 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@159 -- # NVMF_TARGET_BRIDGE=nvmf_tgt_br 00:17:31.195 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@160 -- # NVMF_TARGET_BRIDGE2=nvmf_tgt_br2 00:17:31.195 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@162 -- # ip link set nvmf_init_br nomaster 00:17:31.195 Cannot find device "nvmf_init_br" 00:17:31.195 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@162 -- # true 00:17:31.195 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@163 -- # ip link set nvmf_init_br2 nomaster 00:17:31.195 Cannot find device "nvmf_init_br2" 00:17:31.195 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@163 -- # true 00:17:31.195 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@164 -- # ip link set nvmf_tgt_br nomaster 00:17:31.195 Cannot find device "nvmf_tgt_br" 00:17:31.195 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@164 -- # true 00:17:31.195 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@165 -- # ip link set nvmf_tgt_br2 nomaster 00:17:31.195 Cannot find device "nvmf_tgt_br2" 00:17:31.195 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@165 -- # true 00:17:31.195 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@166 -- # ip link set nvmf_init_br down 00:17:31.195 Cannot find device "nvmf_init_br" 00:17:31.195 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@166 -- # true 00:17:31.195 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@167 -- # ip link set nvmf_init_br2 down 00:17:31.195 Cannot find device "nvmf_init_br2" 00:17:31.195 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@167 -- # true 00:17:31.195 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@168 -- # ip link set nvmf_tgt_br down 00:17:31.195 Cannot find device "nvmf_tgt_br" 00:17:31.195 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@168 -- # true 00:17:31.195 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@169 -- # ip link set nvmf_tgt_br2 down 00:17:31.195 Cannot find device "nvmf_tgt_br2" 00:17:31.195 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@169 -- # true 00:17:31.195 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@170 -- # ip link delete nvmf_br type bridge 00:17:31.195 Cannot find device "nvmf_br" 00:17:31.195 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@170 -- # true 00:17:31.195 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@171 -- # ip link delete nvmf_init_if 00:17:31.195 Cannot find device "nvmf_init_if" 00:17:31.195 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@171 -- # true 00:17:31.195 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@172 -- # ip link delete nvmf_init_if2 00:17:31.195 Cannot find device "nvmf_init_if2" 00:17:31.195 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@172 -- # true 00:17:31.195 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@173 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:17:31.195 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:17:31.195 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@173 -- # true 00:17:31.195 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@174 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:17:31.195 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:17:31.195 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@174 -- # true 00:17:31.195 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@177 -- # ip netns add nvmf_tgt_ns_spdk 00:17:31.195 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@180 -- # ip link add nvmf_init_if type veth peer name nvmf_init_br 00:17:31.195 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@181 -- # ip link add nvmf_init_if2 type veth peer name nvmf_init_br2 00:17:31.195 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@182 -- # ip link add nvmf_tgt_if type veth peer name nvmf_tgt_br 00:17:31.454 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@183 -- # ip link add nvmf_tgt_if2 type veth peer name nvmf_tgt_br2 00:17:31.454 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@186 -- # ip link set nvmf_tgt_if netns nvmf_tgt_ns_spdk 00:17:31.454 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@187 -- # ip link set nvmf_tgt_if2 netns nvmf_tgt_ns_spdk 00:17:31.454 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@190 -- # ip addr add 10.0.0.1/24 dev nvmf_init_if 00:17:31.454 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@191 -- # ip addr add 10.0.0.2/24 dev nvmf_init_if2 00:17:31.454 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@192 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.3/24 dev nvmf_tgt_if 00:17:31.454 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@193 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.4/24 dev nvmf_tgt_if2 00:17:31.454 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@196 -- # ip link set nvmf_init_if up 00:17:31.454 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@197 -- # ip link set nvmf_init_if2 up 00:17:31.454 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@198 -- # ip link set nvmf_init_br up 00:17:31.454 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@199 -- # ip link set nvmf_init_br2 up 00:17:31.454 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@200 -- # ip link set nvmf_tgt_br up 00:17:31.454 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@201 -- # ip link set nvmf_tgt_br2 up 00:17:31.454 11:28:12 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@202 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if up 00:17:31.454 11:28:13 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@203 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if2 up 00:17:31.454 11:28:13 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@204 -- # ip netns exec nvmf_tgt_ns_spdk ip link set lo up 00:17:31.454 11:28:13 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@207 -- # ip link add nvmf_br type bridge 00:17:31.454 11:28:13 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@208 -- # ip link set nvmf_br up 00:17:31.454 11:28:13 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@211 -- # ip link set nvmf_init_br master nvmf_br 00:17:31.454 11:28:13 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@212 -- # ip link set nvmf_init_br2 master nvmf_br 00:17:31.454 11:28:13 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@213 -- # ip link set nvmf_tgt_br master nvmf_br 00:17:31.454 11:28:13 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@214 -- # ip link set nvmf_tgt_br2 master nvmf_br 00:17:31.454 11:28:13 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@217 -- # ipts -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT 00:17:31.454 11:28:13 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT' 00:17:31.454 11:28:13 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@218 -- # ipts -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT 00:17:31.454 11:28:13 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT' 00:17:31.454 11:28:13 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@219 -- # ipts -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT 00:17:31.454 11:28:13 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@788 -- # iptables -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT -m comment --comment 'SPDK_NVMF:-A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT' 00:17:31.454 11:28:13 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@222 -- # ping -c 1 10.0.0.3 00:17:31.454 PING 10.0.0.3 (10.0.0.3) 56(84) bytes of data. 00:17:31.454 64 bytes from 10.0.0.3: icmp_seq=1 ttl=64 time=0.118 ms 00:17:31.454 00:17:31.454 --- 10.0.0.3 ping statistics --- 00:17:31.454 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:31.454 rtt min/avg/max/mdev = 0.118/0.118/0.118/0.000 ms 00:17:31.454 11:28:13 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@223 -- # ping -c 1 10.0.0.4 00:17:31.454 PING 10.0.0.4 (10.0.0.4) 56(84) bytes of data. 00:17:31.454 64 bytes from 10.0.0.4: icmp_seq=1 ttl=64 time=0.069 ms 00:17:31.454 00:17:31.454 --- 10.0.0.4 ping statistics --- 00:17:31.454 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:31.454 rtt min/avg/max/mdev = 0.069/0.069/0.069/0.000 ms 00:17:31.454 11:28:13 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@224 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.1 00:17:31.454 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:17:31.454 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.049 ms 00:17:31.454 00:17:31.454 --- 10.0.0.1 ping statistics --- 00:17:31.454 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:31.454 rtt min/avg/max/mdev = 0.049/0.049/0.049/0.000 ms 00:17:31.454 11:28:13 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@225 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.2 00:17:31.454 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:17:31.454 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.048 ms 00:17:31.454 00:17:31.454 --- 10.0.0.2 ping statistics --- 00:17:31.454 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:31.454 rtt min/avg/max/mdev = 0.048/0.048/0.048/0.000 ms 00:17:31.454 11:28:13 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@227 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:17:31.454 11:28:13 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@459 -- # return 0 00:17:31.454 11:28:13 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:17:31.454 11:28:13 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:17:31.454 11:28:13 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:17:31.454 11:28:13 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:17:31.454 11:28:13 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:17:31.454 11:28:13 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:17:31.454 11:28:13 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:17:31.454 11:28:13 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@25 -- # nvmfappstart -m 0xE 00:17:31.454 11:28:13 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:17:31.454 11:28:13 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@724 -- # xtrace_disable 00:17:31.454 11:28:13 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@10 -- # set +x 00:17:31.712 11:28:13 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@507 -- # nvmfpid=86711 00:17:31.712 11:28:13 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@506 -- # ip netns exec nvmf_tgt_ns_spdk /home/vagrant/spdk_repo/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:17:31.712 11:28:13 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@508 -- # waitforlisten 86711 00:17:31.712 11:28:13 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@831 -- # '[' -z 86711 ']' 00:17:31.712 11:28:13 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:31.712 11:28:13 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@836 -- # local max_retries=100 00:17:31.712 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:31.712 11:28:13 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:31.712 11:28:13 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@840 -- # xtrace_disable 00:17:31.712 11:28:13 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@10 -- # set +x 00:17:31.712 [2024-10-07 11:28:13.229566] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:17:31.712 [2024-10-07 11:28:13.229693] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:31.712 [2024-10-07 11:28:13.362511] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 3 00:17:31.970 [2024-10-07 11:28:13.534998] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:31.970 [2024-10-07 11:28:13.535135] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:31.970 [2024-10-07 11:28:13.535152] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:17:31.970 [2024-10-07 11:28:13.535166] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:17:31.970 [2024-10-07 11:28:13.535177] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:31.970 [2024-10-07 11:28:13.535998] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:17:31.970 [2024-10-07 11:28:13.536053] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 3 00:17:31.970 [2024-10-07 11:28:13.536057] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:17:32.913 11:28:14 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:17:32.913 11:28:14 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@864 -- # return 0 00:17:32.913 11:28:14 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:17:32.913 11:28:14 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@730 -- # xtrace_disable 00:17:32.913 11:28:14 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@10 -- # set +x 00:17:32.913 11:28:14 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:32.913 11:28:14 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@27 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:17:32.913 11:28:14 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:32.913 11:28:14 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@10 -- # set +x 00:17:32.913 [2024-10-07 11:28:14.453091] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:32.913 11:28:14 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:32.913 11:28:14 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@29 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:17:32.913 11:28:14 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:32.913 11:28:14 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@10 -- # set +x 00:17:32.914 Malloc0 00:17:32.914 11:28:14 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:32.914 11:28:14 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@30 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:17:32.914 11:28:14 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:32.914 11:28:14 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@10 -- # set +x 00:17:32.914 11:28:14 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:32.914 11:28:14 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@31 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:17:32.914 11:28:14 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:32.914 11:28:14 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@10 -- # set +x 00:17:32.914 11:28:14 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:32.914 11:28:14 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@33 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4420 00:17:32.914 11:28:14 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:32.914 11:28:14 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@10 -- # set +x 00:17:32.914 [2024-10-07 11:28:14.527191] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:17:32.914 11:28:14 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:32.914 11:28:14 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@34 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4421 00:17:32.914 11:28:14 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:32.914 11:28:14 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@10 -- # set +x 00:17:32.914 [2024-10-07 11:28:14.535139] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4421 *** 00:17:32.914 11:28:14 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:32.914 11:28:14 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@36 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:17:32.914 11:28:14 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:32.914 11:28:14 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@10 -- # set +x 00:17:32.914 Malloc1 00:17:32.914 11:28:14 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:32.914 11:28:14 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@37 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000002 00:17:32.914 11:28:14 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:32.914 11:28:14 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@10 -- # set +x 00:17:32.914 11:28:14 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:32.914 11:28:14 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@38 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc1 00:17:32.914 11:28:14 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:32.914 11:28:14 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@10 -- # set +x 00:17:32.914 11:28:14 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:32.914 11:28:14 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@40 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.3 -s 4420 00:17:32.914 11:28:14 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:32.914 11:28:14 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@10 -- # set +x 00:17:32.914 11:28:14 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:32.914 11:28:14 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@41 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.3 -s 4421 00:17:32.914 11:28:14 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:32.914 11:28:14 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@10 -- # set +x 00:17:32.914 11:28:14 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:32.914 11:28:14 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@44 -- # bdevperf_pid=86773 00:17:32.914 11:28:14 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@46 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; pap "$testdir/try.txt"; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:17:32.914 11:28:14 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@43 -- # /home/vagrant/spdk_repo/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w write -t 1 -f 00:17:32.914 11:28:14 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@47 -- # waitforlisten 86773 /var/tmp/bdevperf.sock 00:17:32.914 11:28:14 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@831 -- # '[' -z 86773 ']' 00:17:32.914 11:28:14 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:32.914 11:28:14 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@836 -- # local max_retries=100 00:17:32.914 11:28:14 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:32.914 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:32.914 11:28:14 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@840 -- # xtrace_disable 00:17:32.914 11:28:14 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@10 -- # set +x 00:17:33.481 11:28:15 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:17:33.481 11:28:15 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@864 -- # return 0 00:17:33.481 11:28:15 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@50 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.3 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.1 00:17:33.481 11:28:15 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:33.481 11:28:15 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@10 -- # set +x 00:17:33.481 NVMe0n1 00:17:33.481 11:28:15 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:33.481 11:28:15 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@54 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:17:33.481 11:28:15 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:33.481 11:28:15 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@54 -- # grep -c NVMe 00:17:33.481 11:28:15 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@10 -- # set +x 00:17:33.481 11:28:15 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:33.481 1 00:17:33.481 11:28:15 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@60 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.3 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.1 -q nqn.2021-09-7.io.spdk:00001 00:17:33.481 11:28:15 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@650 -- # local es=0 00:17:33.481 11:28:15 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.3 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.1 -q nqn.2021-09-7.io.spdk:00001 00:17:33.481 11:28:15 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:17:33.481 11:28:15 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:33.481 11:28:15 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:17:33.481 11:28:15 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:33.481 11:28:15 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.3 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.1 -q nqn.2021-09-7.io.spdk:00001 00:17:33.481 11:28:15 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:33.481 11:28:15 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@10 -- # set +x 00:17:33.481 2024/10/07 11:28:15 error on JSON-RPC call, method: bdev_nvme_attach_controller, params: map[adrfam:ipv4 allow_unrecognized_csi:%!s(bool=false) ddgst:%!s(bool=false) hdgst:%!s(bool=false) hostaddr:10.0.0.1 hostnqn:nqn.2021-09-7.io.spdk:00001 name:NVMe0 prchk_guard:%!s(bool=false) prchk_reftag:%!s(bool=false) subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.3 trsvcid:4420 trtype:tcp], err: error received for bdev_nvme_attach_controller method, err: Code=-114 Msg=A controller named NVMe0 already exists with the specified network path 00:17:33.481 request: 00:17:33.481 { 00:17:33.481 "method": "bdev_nvme_attach_controller", 00:17:33.481 "params": { 00:17:33.481 "name": "NVMe0", 00:17:33.481 "trtype": "tcp", 00:17:33.481 "traddr": "10.0.0.3", 00:17:33.481 "adrfam": "ipv4", 00:17:33.481 "trsvcid": "4420", 00:17:33.481 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:33.481 "hostnqn": "nqn.2021-09-7.io.spdk:00001", 00:17:33.481 "hostaddr": "10.0.0.1", 00:17:33.481 "prchk_reftag": false, 00:17:33.481 "prchk_guard": false, 00:17:33.481 "hdgst": false, 00:17:33.481 "ddgst": false, 00:17:33.481 "allow_unrecognized_csi": false 00:17:33.481 } 00:17:33.481 } 00:17:33.481 Got JSON-RPC error response 00:17:33.481 GoRPCClient: error on JSON-RPC call 00:17:33.481 11:28:15 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:17:33.481 11:28:15 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@653 -- # es=1 00:17:33.481 11:28:15 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:17:33.481 11:28:15 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:17:33.481 11:28:15 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:17:33.481 11:28:15 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@65 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.3 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.1 00:17:33.481 11:28:15 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@650 -- # local es=0 00:17:33.481 11:28:15 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.3 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.1 00:17:33.481 11:28:15 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:17:33.481 11:28:15 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:33.481 11:28:15 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:17:33.481 11:28:15 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:33.481 11:28:15 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.3 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.1 00:17:33.482 11:28:15 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:33.482 11:28:15 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@10 -- # set +x 00:17:33.482 2024/10/07 11:28:15 error on JSON-RPC call, method: bdev_nvme_attach_controller, params: map[adrfam:ipv4 allow_unrecognized_csi:%!s(bool=false) ddgst:%!s(bool=false) hdgst:%!s(bool=false) hostaddr:10.0.0.1 name:NVMe0 prchk_guard:%!s(bool=false) prchk_reftag:%!s(bool=false) subnqn:nqn.2016-06.io.spdk:cnode2 traddr:10.0.0.3 trsvcid:4420 trtype:tcp], err: error received for bdev_nvme_attach_controller method, err: Code=-114 Msg=A controller named NVMe0 already exists with the specified network path 00:17:33.482 request: 00:17:33.482 { 00:17:33.482 "method": "bdev_nvme_attach_controller", 00:17:33.482 "params": { 00:17:33.482 "name": "NVMe0", 00:17:33.482 "trtype": "tcp", 00:17:33.482 "traddr": "10.0.0.3", 00:17:33.482 "adrfam": "ipv4", 00:17:33.482 "trsvcid": "4420", 00:17:33.482 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:17:33.482 "hostaddr": "10.0.0.1", 00:17:33.482 "prchk_reftag": false, 00:17:33.482 "prchk_guard": false, 00:17:33.482 "hdgst": false, 00:17:33.482 "ddgst": false, 00:17:33.482 "allow_unrecognized_csi": false 00:17:33.482 } 00:17:33.482 } 00:17:33.482 Got JSON-RPC error response 00:17:33.482 GoRPCClient: error on JSON-RPC call 00:17:33.482 11:28:15 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:17:33.482 11:28:15 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@653 -- # es=1 00:17:33.482 11:28:15 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:17:33.482 11:28:15 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:17:33.482 11:28:15 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:17:33.482 11:28:15 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@69 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.3 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.1 -x disable 00:17:33.482 11:28:15 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@650 -- # local es=0 00:17:33.482 11:28:15 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.3 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.1 -x disable 00:17:33.482 11:28:15 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:17:33.482 11:28:15 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:33.482 11:28:15 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:17:33.482 11:28:15 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:33.482 11:28:15 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.3 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.1 -x disable 00:17:33.482 11:28:15 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:33.482 11:28:15 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@10 -- # set +x 00:17:33.482 2024/10/07 11:28:15 error on JSON-RPC call, method: bdev_nvme_attach_controller, params: map[adrfam:ipv4 allow_unrecognized_csi:%!s(bool=false) ddgst:%!s(bool=false) hdgst:%!s(bool=false) hostaddr:10.0.0.1 multipath:disable name:NVMe0 prchk_guard:%!s(bool=false) prchk_reftag:%!s(bool=false) subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.3 trsvcid:4420 trtype:tcp], err: error received for bdev_nvme_attach_controller method, err: Code=-114 Msg=A controller named NVMe0 already exists and multipath is disabled 00:17:33.482 request: 00:17:33.482 { 00:17:33.482 "method": "bdev_nvme_attach_controller", 00:17:33.482 "params": { 00:17:33.482 "name": "NVMe0", 00:17:33.482 "trtype": "tcp", 00:17:33.482 "traddr": "10.0.0.3", 00:17:33.482 "adrfam": "ipv4", 00:17:33.482 "trsvcid": "4420", 00:17:33.482 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:33.482 "hostaddr": "10.0.0.1", 00:17:33.482 "prchk_reftag": false, 00:17:33.482 "prchk_guard": false, 00:17:33.482 "hdgst": false, 00:17:33.482 "ddgst": false, 00:17:33.482 "multipath": "disable", 00:17:33.482 "allow_unrecognized_csi": false 00:17:33.482 } 00:17:33.482 } 00:17:33.482 Got JSON-RPC error response 00:17:33.482 GoRPCClient: error on JSON-RPC call 00:17:33.482 11:28:15 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:17:33.482 11:28:15 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@653 -- # es=1 00:17:33.482 11:28:15 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:17:33.740 11:28:15 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:17:33.740 11:28:15 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:17:33.740 11:28:15 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@74 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.3 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.1 -x failover 00:17:33.740 11:28:15 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@650 -- # local es=0 00:17:33.740 11:28:15 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.3 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.1 -x failover 00:17:33.740 11:28:15 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:17:33.740 11:28:15 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:33.740 11:28:15 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:17:33.740 11:28:15 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:33.740 11:28:15 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.3 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.1 -x failover 00:17:33.740 11:28:15 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:33.740 11:28:15 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@10 -- # set +x 00:17:33.740 2024/10/07 11:28:15 error on JSON-RPC call, method: bdev_nvme_attach_controller, params: map[adrfam:ipv4 allow_unrecognized_csi:%!s(bool=false) ddgst:%!s(bool=false) hdgst:%!s(bool=false) hostaddr:10.0.0.1 multipath:failover name:NVMe0 prchk_guard:%!s(bool=false) prchk_reftag:%!s(bool=false) subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.3 trsvcid:4420 trtype:tcp], err: error received for bdev_nvme_attach_controller method, err: Code=-114 Msg=A controller named NVMe0 already exists with the specified network path 00:17:33.740 request: 00:17:33.740 { 00:17:33.740 "method": "bdev_nvme_attach_controller", 00:17:33.740 "params": { 00:17:33.741 "name": "NVMe0", 00:17:33.741 "trtype": "tcp", 00:17:33.741 "traddr": "10.0.0.3", 00:17:33.741 "adrfam": "ipv4", 00:17:33.741 "trsvcid": "4420", 00:17:33.741 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:33.741 "hostaddr": "10.0.0.1", 00:17:33.741 "prchk_reftag": false, 00:17:33.741 "prchk_guard": false, 00:17:33.741 "hdgst": false, 00:17:33.741 "ddgst": false, 00:17:33.741 "multipath": "failover", 00:17:33.741 "allow_unrecognized_csi": false 00:17:33.741 } 00:17:33.741 } 00:17:33.741 Got JSON-RPC error response 00:17:33.741 GoRPCClient: error on JSON-RPC call 00:17:33.741 11:28:15 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:17:33.741 11:28:15 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@653 -- # es=1 00:17:33.741 11:28:15 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:17:33.741 11:28:15 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:17:33.741 11:28:15 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:17:33.741 11:28:15 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@79 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.3 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:17:33.741 11:28:15 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:33.741 11:28:15 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@10 -- # set +x 00:17:33.741 NVMe0n1 00:17:33.741 11:28:15 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:33.741 11:28:15 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@83 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.3 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:17:33.741 11:28:15 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:33.741 11:28:15 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@10 -- # set +x 00:17:33.741 11:28:15 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:33.741 11:28:15 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@87 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe1 -t tcp -a 10.0.0.3 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.1 00:17:33.741 11:28:15 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:33.741 11:28:15 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@10 -- # set +x 00:17:33.741 00:17:33.741 11:28:15 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:33.741 11:28:15 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@90 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:17:33.741 11:28:15 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:33.741 11:28:15 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@10 -- # set +x 00:17:33.741 11:28:15 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@90 -- # grep -c NVMe 00:17:33.741 11:28:15 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:33.741 11:28:15 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@90 -- # '[' 2 '!=' 2 ']' 00:17:33.741 11:28:15 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@95 -- # /home/vagrant/spdk_repo/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:17:35.114 { 00:17:35.114 "results": [ 00:17:35.114 { 00:17:35.114 "job": "NVMe0n1", 00:17:35.114 "core_mask": "0x1", 00:17:35.114 "workload": "write", 00:17:35.114 "status": "finished", 00:17:35.114 "queue_depth": 128, 00:17:35.114 "io_size": 4096, 00:17:35.114 "runtime": 1.00499, 00:17:35.114 "iops": 17915.6011502602, 00:17:35.114 "mibps": 69.98281699320391, 00:17:35.114 "io_failed": 0, 00:17:35.114 "io_timeout": 0, 00:17:35.114 "avg_latency_us": 7132.3215454293, 00:17:35.114 "min_latency_us": 2651.2290909090907, 00:17:35.114 "max_latency_us": 12928.465454545454 00:17:35.114 } 00:17:35.114 ], 00:17:35.114 "core_count": 1 00:17:35.114 } 00:17:35.114 11:28:16 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@98 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe1 00:17:35.114 11:28:16 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:35.114 11:28:16 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@10 -- # set +x 00:17:35.114 11:28:16 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:35.114 11:28:16 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@100 -- # [[ -n 10.0.0.2 ]] 00:17:35.114 11:28:16 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@102 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b nvme1 -t tcp -a 10.0.0.3 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.1 00:17:35.114 11:28:16 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:35.114 11:28:16 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@10 -- # set +x 00:17:35.114 nvme1n1 00:17:35.114 11:28:16 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:35.114 11:28:16 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@106 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2016-06.io.spdk:cnode2 00:17:35.114 11:28:16 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@106 -- # jq -r '.[].peer_address.traddr' 00:17:35.114 11:28:16 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:35.114 11:28:16 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@10 -- # set +x 00:17:35.115 11:28:16 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:35.115 11:28:16 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@106 -- # [[ 10.0.0.1 == \1\0\.\0\.\0\.\1 ]] 00:17:35.115 11:28:16 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@107 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller nvme1 00:17:35.115 11:28:16 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:35.115 11:28:16 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@10 -- # set +x 00:17:35.115 11:28:16 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:35.115 11:28:16 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@109 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b nvme1 -t tcp -a 10.0.0.3 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 00:17:35.115 11:28:16 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:35.115 11:28:16 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@10 -- # set +x 00:17:35.115 nvme1n1 00:17:35.115 11:28:16 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:35.115 11:28:16 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@113 -- # jq -r '.[].peer_address.traddr' 00:17:35.115 11:28:16 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@113 -- # rpc_cmd nvmf_subsystem_get_qpairs nqn.2016-06.io.spdk:cnode2 00:17:35.115 11:28:16 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:35.115 11:28:16 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@10 -- # set +x 00:17:35.115 11:28:16 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:35.373 11:28:16 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@113 -- # [[ 10.0.0.2 == \1\0\.\0\.\0\.\2 ]] 00:17:35.373 11:28:16 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@116 -- # killprocess 86773 00:17:35.373 11:28:16 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@950 -- # '[' -z 86773 ']' 00:17:35.373 11:28:16 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@954 -- # kill -0 86773 00:17:35.373 11:28:16 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@955 -- # uname 00:17:35.373 11:28:16 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:17:35.373 11:28:16 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 86773 00:17:35.373 killing process with pid 86773 00:17:35.373 11:28:16 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:17:35.373 11:28:16 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:17:35.373 11:28:16 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@968 -- # echo 'killing process with pid 86773' 00:17:35.373 11:28:16 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@969 -- # kill 86773 00:17:35.373 11:28:16 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@974 -- # wait 86773 00:17:35.631 11:28:17 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@118 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:17:35.631 11:28:17 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:35.631 11:28:17 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@10 -- # set +x 00:17:35.631 11:28:17 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:35.631 11:28:17 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@119 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:17:35.631 11:28:17 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:35.631 11:28:17 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@10 -- # set +x 00:17:35.631 11:28:17 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:35.631 11:28:17 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@121 -- # trap - SIGINT SIGTERM EXIT 00:17:35.631 11:28:17 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@123 -- # pap /home/vagrant/spdk_repo/spdk/test/nvmf/host/try.txt 00:17:35.631 11:28:17 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@1597 -- # read -r file 00:17:35.631 11:28:17 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@1596 -- # sort -u 00:17:35.631 11:28:17 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@1596 -- # find /home/vagrant/spdk_repo/spdk/test/nvmf/host/try.txt -type f 00:17:35.631 11:28:17 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@1598 -- # cat 00:17:35.631 --- /home/vagrant/spdk_repo/spdk/test/nvmf/host/try.txt --- 00:17:35.631 [2024-10-07 11:28:14.674442] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:17:35.631 [2024-10-07 11:28:14.675019] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid86773 ] 00:17:35.631 [2024-10-07 11:28:14.808148] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:35.631 [2024-10-07 11:28:14.928502] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:17:35.631 [2024-10-07 11:28:15.361207] bdev.c:4701:bdev_name_add: *ERROR*: Bdev name 42b4a83a-63e2-4826-b3bd-7bc269b397e0 already exists 00:17:35.631 [2024-10-07 11:28:15.361298] bdev.c:7846:bdev_register: *ERROR*: Unable to add uuid:42b4a83a-63e2-4826-b3bd-7bc269b397e0 alias for bdev NVMe1n1 00:17:35.631 [2024-10-07 11:28:15.361322] bdev_nvme.c:4483:nvme_bdev_create: *ERROR*: spdk_bdev_register() failed 00:17:35.631 Running I/O for 1 seconds... 00:17:35.631 17877.00 IOPS, 69.83 MiB/s 00:17:35.631 Latency(us) 00:17:35.631 [2024-10-07T11:28:17.342Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:35.631 Job: NVMe0n1 (Core Mask 0x1, workload: write, depth: 128, IO size: 4096) 00:17:35.631 NVMe0n1 : 1.00 17915.60 69.98 0.00 0.00 7132.32 2651.23 12928.47 00:17:35.631 [2024-10-07T11:28:17.342Z] =================================================================================================================== 00:17:35.631 [2024-10-07T11:28:17.342Z] Total : 17915.60 69.98 0.00 0.00 7132.32 2651.23 12928.47 00:17:35.631 Received shutdown signal, test time was about 1.000000 seconds 00:17:35.631 00:17:35.631 Latency(us) 00:17:35.631 [2024-10-07T11:28:17.342Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:35.631 [2024-10-07T11:28:17.343Z] =================================================================================================================== 00:17:35.632 [2024-10-07T11:28:17.343Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:17:35.632 --- /home/vagrant/spdk_repo/spdk/test/nvmf/host/try.txt --- 00:17:35.632 11:28:17 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@1603 -- # rm -f /home/vagrant/spdk_repo/spdk/test/nvmf/host/try.txt 00:17:35.632 11:28:17 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@1597 -- # read -r file 00:17:35.632 11:28:17 nvmf_tcp.nvmf_host.nvmf_multicontroller -- host/multicontroller.sh@124 -- # nvmftestfini 00:17:35.632 11:28:17 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@514 -- # nvmfcleanup 00:17:35.632 11:28:17 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@121 -- # sync 00:17:35.632 11:28:17 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:17:35.632 11:28:17 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@124 -- # set +e 00:17:35.632 11:28:17 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@125 -- # for i in {1..20} 00:17:35.632 11:28:17 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:17:35.632 rmmod nvme_tcp 00:17:35.632 rmmod nvme_fabrics 00:17:35.632 rmmod nvme_keyring 00:17:35.632 11:28:17 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:17:35.632 11:28:17 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@128 -- # set -e 00:17:35.632 11:28:17 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@129 -- # return 0 00:17:35.632 11:28:17 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@515 -- # '[' -n 86711 ']' 00:17:35.632 11:28:17 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@516 -- # killprocess 86711 00:17:35.632 11:28:17 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@950 -- # '[' -z 86711 ']' 00:17:35.632 11:28:17 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@954 -- # kill -0 86711 00:17:35.632 11:28:17 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@955 -- # uname 00:17:35.632 11:28:17 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:17:35.632 11:28:17 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 86711 00:17:35.632 11:28:17 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@956 -- # process_name=reactor_1 00:17:35.632 11:28:17 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@960 -- # '[' reactor_1 = sudo ']' 00:17:35.632 killing process with pid 86711 00:17:35.632 11:28:17 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@968 -- # echo 'killing process with pid 86711' 00:17:35.632 11:28:17 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@969 -- # kill 86711 00:17:35.632 11:28:17 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@974 -- # wait 86711 00:17:36.202 11:28:17 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:17:36.202 11:28:17 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:17:36.202 11:28:17 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:17:36.202 11:28:17 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@297 -- # iptr 00:17:36.202 11:28:17 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@789 -- # iptables-save 00:17:36.202 11:28:17 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:17:36.202 11:28:17 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@789 -- # iptables-restore 00:17:36.202 11:28:17 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@298 -- # [[ nvmf_tgt_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:17:36.202 11:28:17 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@299 -- # nvmf_veth_fini 00:17:36.202 11:28:17 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@233 -- # ip link set nvmf_init_br nomaster 00:17:36.202 11:28:17 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@234 -- # ip link set nvmf_init_br2 nomaster 00:17:36.202 11:28:17 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@235 -- # ip link set nvmf_tgt_br nomaster 00:17:36.202 11:28:17 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@236 -- # ip link set nvmf_tgt_br2 nomaster 00:17:36.202 11:28:17 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@237 -- # ip link set nvmf_init_br down 00:17:36.202 11:28:17 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@238 -- # ip link set nvmf_init_br2 down 00:17:36.202 11:28:17 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@239 -- # ip link set nvmf_tgt_br down 00:17:36.202 11:28:17 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@240 -- # ip link set nvmf_tgt_br2 down 00:17:36.202 11:28:17 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@241 -- # ip link delete nvmf_br type bridge 00:17:36.202 11:28:17 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@242 -- # ip link delete nvmf_init_if 00:17:36.202 11:28:17 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@243 -- # ip link delete nvmf_init_if2 00:17:36.202 11:28:17 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@244 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:17:36.461 11:28:17 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@245 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:17:36.461 11:28:17 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@246 -- # remove_spdk_ns 00:17:36.461 11:28:17 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:36.461 11:28:17 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:17:36.461 11:28:17 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:36.461 11:28:17 nvmf_tcp.nvmf_host.nvmf_multicontroller -- nvmf/common.sh@300 -- # return 0 00:17:36.461 00:17:36.461 real 0m5.454s 00:17:36.461 user 0m15.417s 00:17:36.461 sys 0m1.473s 00:17:36.461 11:28:17 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@1126 -- # xtrace_disable 00:17:36.461 11:28:17 nvmf_tcp.nvmf_host.nvmf_multicontroller -- common/autotest_common.sh@10 -- # set +x 00:17:36.461 ************************************ 00:17:36.461 END TEST nvmf_multicontroller 00:17:36.461 ************************************ 00:17:36.461 11:28:18 nvmf_tcp.nvmf_host -- nvmf/nvmf_host.sh@17 -- # run_test nvmf_aer /home/vagrant/spdk_repo/spdk/test/nvmf/host/aer.sh --transport=tcp 00:17:36.461 11:28:18 nvmf_tcp.nvmf_host -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:17:36.461 11:28:18 nvmf_tcp.nvmf_host -- common/autotest_common.sh@1107 -- # xtrace_disable 00:17:36.461 11:28:18 nvmf_tcp.nvmf_host -- common/autotest_common.sh@10 -- # set +x 00:17:36.461 ************************************ 00:17:36.461 START TEST nvmf_aer 00:17:36.461 ************************************ 00:17:36.461 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/nvmf/host/aer.sh --transport=tcp 00:17:36.461 * Looking for test storage... 00:17:36.461 * Found test storage at /home/vagrant/spdk_repo/spdk/test/nvmf/host 00:17:36.461 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:17:36.461 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@1681 -- # lcov --version 00:17:36.461 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:17:36.720 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:17:36.720 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:17:36.720 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- scripts/common.sh@333 -- # local ver1 ver1_l 00:17:36.720 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- scripts/common.sh@334 -- # local ver2 ver2_l 00:17:36.720 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- scripts/common.sh@336 -- # IFS=.-: 00:17:36.720 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- scripts/common.sh@336 -- # read -ra ver1 00:17:36.720 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- scripts/common.sh@337 -- # IFS=.-: 00:17:36.720 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- scripts/common.sh@337 -- # read -ra ver2 00:17:36.720 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- scripts/common.sh@338 -- # local 'op=<' 00:17:36.720 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- scripts/common.sh@340 -- # ver1_l=2 00:17:36.720 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- scripts/common.sh@341 -- # ver2_l=1 00:17:36.720 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:17:36.720 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- scripts/common.sh@344 -- # case "$op" in 00:17:36.720 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- scripts/common.sh@345 -- # : 1 00:17:36.720 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- scripts/common.sh@364 -- # (( v = 0 )) 00:17:36.720 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:17:36.720 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- scripts/common.sh@365 -- # decimal 1 00:17:36.720 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- scripts/common.sh@353 -- # local d=1 00:17:36.720 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:17:36.720 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- scripts/common.sh@355 -- # echo 1 00:17:36.720 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- scripts/common.sh@365 -- # ver1[v]=1 00:17:36.720 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- scripts/common.sh@366 -- # decimal 2 00:17:36.720 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- scripts/common.sh@353 -- # local d=2 00:17:36.720 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:17:36.720 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- scripts/common.sh@355 -- # echo 2 00:17:36.720 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- scripts/common.sh@366 -- # ver2[v]=2 00:17:36.720 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:17:36.720 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:17:36.720 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- scripts/common.sh@368 -- # return 0 00:17:36.720 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:17:36.720 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:17:36.720 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:36.720 --rc genhtml_branch_coverage=1 00:17:36.720 --rc genhtml_function_coverage=1 00:17:36.720 --rc genhtml_legend=1 00:17:36.720 --rc geninfo_all_blocks=1 00:17:36.720 --rc geninfo_unexecuted_blocks=1 00:17:36.720 00:17:36.720 ' 00:17:36.720 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:17:36.720 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:36.720 --rc genhtml_branch_coverage=1 00:17:36.720 --rc genhtml_function_coverage=1 00:17:36.720 --rc genhtml_legend=1 00:17:36.720 --rc geninfo_all_blocks=1 00:17:36.720 --rc geninfo_unexecuted_blocks=1 00:17:36.720 00:17:36.720 ' 00:17:36.720 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:17:36.720 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:36.720 --rc genhtml_branch_coverage=1 00:17:36.721 --rc genhtml_function_coverage=1 00:17:36.721 --rc genhtml_legend=1 00:17:36.721 --rc geninfo_all_blocks=1 00:17:36.721 --rc geninfo_unexecuted_blocks=1 00:17:36.721 00:17:36.721 ' 00:17:36.721 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:17:36.721 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:36.721 --rc genhtml_branch_coverage=1 00:17:36.721 --rc genhtml_function_coverage=1 00:17:36.721 --rc genhtml_legend=1 00:17:36.721 --rc geninfo_all_blocks=1 00:17:36.721 --rc geninfo_unexecuted_blocks=1 00:17:36.721 00:17:36.721 ' 00:17:36.721 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- host/aer.sh@9 -- # source /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh 00:17:36.721 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@7 -- # uname -s 00:17:36.721 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:36.721 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:36.721 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:36.721 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:36.721 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:36.721 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:36.721 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:36.721 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:36.721 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:36.721 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:36.721 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:17:36.721 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@18 -- # NVME_HOSTID=3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:17:36.721 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:36.721 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:36.721 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@21 -- # NET_TYPE=virt 00:17:36.721 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:17:36.721 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@49 -- # source /home/vagrant/spdk_repo/spdk/scripts/common.sh 00:17:36.721 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- scripts/common.sh@15 -- # shopt -s extglob 00:17:36.721 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:36.721 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:36.721 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:36.721 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:36.721 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:36.721 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:36.721 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- paths/export.sh@5 -- # export PATH 00:17:36.721 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:36.721 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@51 -- # : 0 00:17:36.721 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:17:36.721 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:17:36.721 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:17:36.721 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:36.721 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:36.721 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:17:36.721 /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:17:36.721 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:17:36.721 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:17:36.721 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@55 -- # have_pci_nics=0 00:17:36.721 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- host/aer.sh@11 -- # nvmftestinit 00:17:36.721 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:17:36.721 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:36.721 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@474 -- # prepare_net_devs 00:17:36.721 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@436 -- # local -g is_hw=no 00:17:36.721 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@438 -- # remove_spdk_ns 00:17:36.721 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:36.721 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:17:36.721 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:36.721 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@440 -- # [[ virt != virt ]] 00:17:36.721 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@442 -- # [[ no == yes ]] 00:17:36.721 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@449 -- # [[ virt == phy ]] 00:17:36.721 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@452 -- # [[ virt == phy-fallback ]] 00:17:36.721 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@457 -- # [[ tcp == tcp ]] 00:17:36.721 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@458 -- # nvmf_veth_init 00:17:36.721 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@145 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:17:36.721 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@146 -- # NVMF_SECOND_INITIATOR_IP=10.0.0.2 00:17:36.721 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@147 -- # NVMF_FIRST_TARGET_IP=10.0.0.3 00:17:36.721 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@148 -- # NVMF_SECOND_TARGET_IP=10.0.0.4 00:17:36.721 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@149 -- # NVMF_INITIATOR_IP=10.0.0.1 00:17:36.721 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@150 -- # NVMF_BRIDGE=nvmf_br 00:17:36.721 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@151 -- # NVMF_INITIATOR_INTERFACE=nvmf_init_if 00:17:36.721 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@152 -- # NVMF_INITIATOR_INTERFACE2=nvmf_init_if2 00:17:36.721 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@153 -- # NVMF_INITIATOR_BRIDGE=nvmf_init_br 00:17:36.721 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@154 -- # NVMF_INITIATOR_BRIDGE2=nvmf_init_br2 00:17:36.721 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@155 -- # NVMF_TARGET_NAMESPACE=nvmf_tgt_ns_spdk 00:17:36.721 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@156 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:17:36.721 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@157 -- # NVMF_TARGET_INTERFACE=nvmf_tgt_if 00:17:36.721 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@158 -- # NVMF_TARGET_INTERFACE2=nvmf_tgt_if2 00:17:36.721 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@159 -- # NVMF_TARGET_BRIDGE=nvmf_tgt_br 00:17:36.721 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@160 -- # NVMF_TARGET_BRIDGE2=nvmf_tgt_br2 00:17:36.721 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@162 -- # ip link set nvmf_init_br nomaster 00:17:36.721 Cannot find device "nvmf_init_br" 00:17:36.722 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@162 -- # true 00:17:36.722 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@163 -- # ip link set nvmf_init_br2 nomaster 00:17:36.722 Cannot find device "nvmf_init_br2" 00:17:36.722 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@163 -- # true 00:17:36.722 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@164 -- # ip link set nvmf_tgt_br nomaster 00:17:36.722 Cannot find device "nvmf_tgt_br" 00:17:36.722 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@164 -- # true 00:17:36.722 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@165 -- # ip link set nvmf_tgt_br2 nomaster 00:17:36.722 Cannot find device "nvmf_tgt_br2" 00:17:36.722 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@165 -- # true 00:17:36.722 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@166 -- # ip link set nvmf_init_br down 00:17:36.722 Cannot find device "nvmf_init_br" 00:17:36.722 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@166 -- # true 00:17:36.722 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@167 -- # ip link set nvmf_init_br2 down 00:17:36.722 Cannot find device "nvmf_init_br2" 00:17:36.722 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@167 -- # true 00:17:36.722 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@168 -- # ip link set nvmf_tgt_br down 00:17:36.722 Cannot find device "nvmf_tgt_br" 00:17:36.722 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@168 -- # true 00:17:36.722 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@169 -- # ip link set nvmf_tgt_br2 down 00:17:36.722 Cannot find device "nvmf_tgt_br2" 00:17:36.722 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@169 -- # true 00:17:36.722 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@170 -- # ip link delete nvmf_br type bridge 00:17:36.722 Cannot find device "nvmf_br" 00:17:36.722 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@170 -- # true 00:17:36.722 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@171 -- # ip link delete nvmf_init_if 00:17:36.722 Cannot find device "nvmf_init_if" 00:17:36.722 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@171 -- # true 00:17:36.722 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@172 -- # ip link delete nvmf_init_if2 00:17:36.722 Cannot find device "nvmf_init_if2" 00:17:36.722 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@172 -- # true 00:17:36.722 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@173 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:17:36.722 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:17:36.722 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@173 -- # true 00:17:36.722 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@174 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:17:36.722 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:17:36.722 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@174 -- # true 00:17:36.722 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@177 -- # ip netns add nvmf_tgt_ns_spdk 00:17:36.979 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@180 -- # ip link add nvmf_init_if type veth peer name nvmf_init_br 00:17:36.979 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@181 -- # ip link add nvmf_init_if2 type veth peer name nvmf_init_br2 00:17:36.979 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@182 -- # ip link add nvmf_tgt_if type veth peer name nvmf_tgt_br 00:17:36.979 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@183 -- # ip link add nvmf_tgt_if2 type veth peer name nvmf_tgt_br2 00:17:36.979 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@186 -- # ip link set nvmf_tgt_if netns nvmf_tgt_ns_spdk 00:17:36.979 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@187 -- # ip link set nvmf_tgt_if2 netns nvmf_tgt_ns_spdk 00:17:36.979 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@190 -- # ip addr add 10.0.0.1/24 dev nvmf_init_if 00:17:36.979 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@191 -- # ip addr add 10.0.0.2/24 dev nvmf_init_if2 00:17:36.979 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@192 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.3/24 dev nvmf_tgt_if 00:17:36.979 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@193 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.4/24 dev nvmf_tgt_if2 00:17:36.979 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@196 -- # ip link set nvmf_init_if up 00:17:36.979 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@197 -- # ip link set nvmf_init_if2 up 00:17:36.979 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@198 -- # ip link set nvmf_init_br up 00:17:36.979 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@199 -- # ip link set nvmf_init_br2 up 00:17:36.979 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@200 -- # ip link set nvmf_tgt_br up 00:17:36.979 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@201 -- # ip link set nvmf_tgt_br2 up 00:17:36.979 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@202 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if up 00:17:36.979 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@203 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if2 up 00:17:36.979 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@204 -- # ip netns exec nvmf_tgt_ns_spdk ip link set lo up 00:17:36.979 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@207 -- # ip link add nvmf_br type bridge 00:17:36.979 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@208 -- # ip link set nvmf_br up 00:17:36.979 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@211 -- # ip link set nvmf_init_br master nvmf_br 00:17:36.979 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@212 -- # ip link set nvmf_init_br2 master nvmf_br 00:17:36.979 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@213 -- # ip link set nvmf_tgt_br master nvmf_br 00:17:36.979 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@214 -- # ip link set nvmf_tgt_br2 master nvmf_br 00:17:36.979 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@217 -- # ipts -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT 00:17:36.979 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT' 00:17:36.979 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@218 -- # ipts -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT 00:17:36.979 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT' 00:17:36.979 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@219 -- # ipts -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT 00:17:36.980 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@788 -- # iptables -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT -m comment --comment 'SPDK_NVMF:-A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT' 00:17:36.980 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@222 -- # ping -c 1 10.0.0.3 00:17:36.980 PING 10.0.0.3 (10.0.0.3) 56(84) bytes of data. 00:17:36.980 64 bytes from 10.0.0.3: icmp_seq=1 ttl=64 time=0.093 ms 00:17:36.980 00:17:36.980 --- 10.0.0.3 ping statistics --- 00:17:36.980 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:36.980 rtt min/avg/max/mdev = 0.093/0.093/0.093/0.000 ms 00:17:36.980 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@223 -- # ping -c 1 10.0.0.4 00:17:36.980 PING 10.0.0.4 (10.0.0.4) 56(84) bytes of data. 00:17:36.980 64 bytes from 10.0.0.4: icmp_seq=1 ttl=64 time=0.138 ms 00:17:36.980 00:17:36.980 --- 10.0.0.4 ping statistics --- 00:17:36.980 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:36.980 rtt min/avg/max/mdev = 0.138/0.138/0.138/0.000 ms 00:17:36.980 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@224 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.1 00:17:37.237 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:17:37.237 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.042 ms 00:17:37.237 00:17:37.237 --- 10.0.0.1 ping statistics --- 00:17:37.237 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:37.237 rtt min/avg/max/mdev = 0.042/0.042/0.042/0.000 ms 00:17:37.237 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@225 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.2 00:17:37.237 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:17:37.237 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.095 ms 00:17:37.237 00:17:37.237 --- 10.0.0.2 ping statistics --- 00:17:37.237 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:37.237 rtt min/avg/max/mdev = 0.095/0.095/0.095/0.000 ms 00:17:37.237 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@227 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:17:37.237 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@459 -- # return 0 00:17:37.237 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:17:37.237 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:17:37.237 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:17:37.237 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:17:37.237 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:17:37.237 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:17:37.237 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:17:37.237 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- host/aer.sh@12 -- # nvmfappstart -m 0xF 00:17:37.237 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:17:37.237 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@724 -- # xtrace_disable 00:17:37.237 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@10 -- # set +x 00:17:37.237 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@507 -- # nvmfpid=87071 00:17:37.237 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@506 -- # ip netns exec nvmf_tgt_ns_spdk /home/vagrant/spdk_repo/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:17:37.237 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@508 -- # waitforlisten 87071 00:17:37.237 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@831 -- # '[' -z 87071 ']' 00:17:37.237 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:37.237 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@836 -- # local max_retries=100 00:17:37.237 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:37.237 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:37.237 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@840 -- # xtrace_disable 00:17:37.237 11:28:18 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@10 -- # set +x 00:17:37.237 [2024-10-07 11:28:18.820489] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:17:37.237 [2024-10-07 11:28:18.820613] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:37.494 [2024-10-07 11:28:18.965473] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 4 00:17:37.494 [2024-10-07 11:28:19.099921] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:37.494 [2024-10-07 11:28:19.099988] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:37.494 [2024-10-07 11:28:19.100002] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:17:37.494 [2024-10-07 11:28:19.100013] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:17:37.494 [2024-10-07 11:28:19.100022] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:37.494 [2024-10-07 11:28:19.101348] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:17:37.494 [2024-10-07 11:28:19.101493] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:17:37.494 [2024-10-07 11:28:19.101589] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 3 00:17:37.494 [2024-10-07 11:28:19.101591] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:17:38.427 11:28:19 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:17:38.427 11:28:19 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@864 -- # return 0 00:17:38.427 11:28:19 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:17:38.427 11:28:19 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@730 -- # xtrace_disable 00:17:38.427 11:28:19 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@10 -- # set +x 00:17:38.427 11:28:20 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:38.427 11:28:20 nvmf_tcp.nvmf_host.nvmf_aer -- host/aer.sh@14 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:17:38.427 11:28:20 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:38.427 11:28:20 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@10 -- # set +x 00:17:38.427 [2024-10-07 11:28:20.038832] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:38.427 11:28:20 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:38.427 11:28:20 nvmf_tcp.nvmf_host.nvmf_aer -- host/aer.sh@16 -- # rpc_cmd bdev_malloc_create 64 512 --name Malloc0 00:17:38.427 11:28:20 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:38.427 11:28:20 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@10 -- # set +x 00:17:38.427 Malloc0 00:17:38.427 11:28:20 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:38.427 11:28:20 nvmf_tcp.nvmf_host.nvmf_aer -- host/aer.sh@17 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 2 00:17:38.427 11:28:20 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:38.427 11:28:20 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@10 -- # set +x 00:17:38.427 11:28:20 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:38.427 11:28:20 nvmf_tcp.nvmf_host.nvmf_aer -- host/aer.sh@18 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:17:38.427 11:28:20 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:38.427 11:28:20 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@10 -- # set +x 00:17:38.427 11:28:20 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:38.427 11:28:20 nvmf_tcp.nvmf_host.nvmf_aer -- host/aer.sh@19 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4420 00:17:38.427 11:28:20 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:38.427 11:28:20 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@10 -- # set +x 00:17:38.427 [2024-10-07 11:28:20.098954] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:17:38.427 11:28:20 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:38.427 11:28:20 nvmf_tcp.nvmf_host.nvmf_aer -- host/aer.sh@21 -- # rpc_cmd nvmf_get_subsystems 00:17:38.427 11:28:20 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:38.427 11:28:20 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@10 -- # set +x 00:17:38.427 [ 00:17:38.427 { 00:17:38.427 "allow_any_host": true, 00:17:38.427 "hosts": [], 00:17:38.427 "listen_addresses": [], 00:17:38.427 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:17:38.427 "subtype": "Discovery" 00:17:38.427 }, 00:17:38.427 { 00:17:38.427 "allow_any_host": true, 00:17:38.427 "hosts": [], 00:17:38.427 "listen_addresses": [ 00:17:38.427 { 00:17:38.427 "adrfam": "IPv4", 00:17:38.427 "traddr": "10.0.0.3", 00:17:38.427 "trsvcid": "4420", 00:17:38.427 "trtype": "TCP" 00:17:38.427 } 00:17:38.427 ], 00:17:38.427 "max_cntlid": 65519, 00:17:38.427 "max_namespaces": 2, 00:17:38.427 "min_cntlid": 1, 00:17:38.427 "model_number": "SPDK bdev Controller", 00:17:38.427 "namespaces": [ 00:17:38.427 { 00:17:38.427 "bdev_name": "Malloc0", 00:17:38.427 "name": "Malloc0", 00:17:38.427 "nguid": "F60B8291C7964F44B8FDED53DF003548", 00:17:38.427 "nsid": 1, 00:17:38.427 "uuid": "f60b8291-c796-4f44-b8fd-ed53df003548" 00:17:38.427 } 00:17:38.427 ], 00:17:38.427 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:17:38.427 "serial_number": "SPDK00000000000001", 00:17:38.427 "subtype": "NVMe" 00:17:38.427 } 00:17:38.427 ] 00:17:38.427 11:28:20 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:38.428 11:28:20 nvmf_tcp.nvmf_host.nvmf_aer -- host/aer.sh@23 -- # AER_TOUCH_FILE=/tmp/aer_touch_file 00:17:38.428 11:28:20 nvmf_tcp.nvmf_host.nvmf_aer -- host/aer.sh@24 -- # rm -f /tmp/aer_touch_file 00:17:38.428 11:28:20 nvmf_tcp.nvmf_host.nvmf_aer -- host/aer.sh@33 -- # aerpid=87125 00:17:38.428 11:28:20 nvmf_tcp.nvmf_host.nvmf_aer -- host/aer.sh@36 -- # waitforfile /tmp/aer_touch_file 00:17:38.428 11:28:20 nvmf_tcp.nvmf_host.nvmf_aer -- host/aer.sh@27 -- # /home/vagrant/spdk_repo/spdk/test/nvme/aer/aer -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.3 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -n 2 -t /tmp/aer_touch_file 00:17:38.428 11:28:20 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@1265 -- # local i=0 00:17:38.428 11:28:20 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@1266 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:17:38.428 11:28:20 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@1267 -- # '[' 0 -lt 200 ']' 00:17:38.428 11:28:20 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@1268 -- # i=1 00:17:38.428 11:28:20 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@1269 -- # sleep 0.1 00:17:38.685 11:28:20 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@1266 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:17:38.685 11:28:20 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@1267 -- # '[' 1 -lt 200 ']' 00:17:38.685 11:28:20 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@1268 -- # i=2 00:17:38.685 11:28:20 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@1269 -- # sleep 0.1 00:17:38.685 11:28:20 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@1266 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:17:38.685 11:28:20 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@1272 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:17:38.685 11:28:20 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@1276 -- # return 0 00:17:38.685 11:28:20 nvmf_tcp.nvmf_host.nvmf_aer -- host/aer.sh@39 -- # rpc_cmd bdev_malloc_create 64 4096 --name Malloc1 00:17:38.685 11:28:20 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:38.685 11:28:20 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@10 -- # set +x 00:17:38.685 Malloc1 00:17:38.685 11:28:20 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:38.685 11:28:20 nvmf_tcp.nvmf_host.nvmf_aer -- host/aer.sh@40 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 2 00:17:38.685 11:28:20 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:38.686 11:28:20 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@10 -- # set +x 00:17:38.943 11:28:20 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:38.943 11:28:20 nvmf_tcp.nvmf_host.nvmf_aer -- host/aer.sh@41 -- # rpc_cmd nvmf_get_subsystems 00:17:38.943 11:28:20 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:38.943 11:28:20 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@10 -- # set +x 00:17:38.943 Asynchronous Event Request test 00:17:38.943 Attaching to 10.0.0.3 00:17:38.943 Attached to 10.0.0.3 00:17:38.943 Registering asynchronous event callbacks... 00:17:38.943 Starting namespace attribute notice tests for all controllers... 00:17:38.943 10.0.0.3: aer_cb for log page 4, aen_event_type: 0x02, aen_event_info: 0x00 00:17:38.943 aer_cb - Changed Namespace 00:17:38.943 Cleaning up... 00:17:38.943 [ 00:17:38.943 { 00:17:38.943 "allow_any_host": true, 00:17:38.943 "hosts": [], 00:17:38.943 "listen_addresses": [], 00:17:38.943 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:17:38.943 "subtype": "Discovery" 00:17:38.943 }, 00:17:38.943 { 00:17:38.943 "allow_any_host": true, 00:17:38.943 "hosts": [], 00:17:38.943 "listen_addresses": [ 00:17:38.943 { 00:17:38.943 "adrfam": "IPv4", 00:17:38.943 "traddr": "10.0.0.3", 00:17:38.943 "trsvcid": "4420", 00:17:38.943 "trtype": "TCP" 00:17:38.943 } 00:17:38.943 ], 00:17:38.943 "max_cntlid": 65519, 00:17:38.943 "max_namespaces": 2, 00:17:38.943 "min_cntlid": 1, 00:17:38.943 "model_number": "SPDK bdev Controller", 00:17:38.943 "namespaces": [ 00:17:38.943 { 00:17:38.943 "bdev_name": "Malloc0", 00:17:38.943 "name": "Malloc0", 00:17:38.943 "nguid": "F60B8291C7964F44B8FDED53DF003548", 00:17:38.943 "nsid": 1, 00:17:38.943 "uuid": "f60b8291-c796-4f44-b8fd-ed53df003548" 00:17:38.943 }, 00:17:38.943 { 00:17:38.943 "bdev_name": "Malloc1", 00:17:38.943 "name": "Malloc1", 00:17:38.943 "nguid": "A4D18A9023764214AFA85853A938BF8C", 00:17:38.943 "nsid": 2, 00:17:38.943 "uuid": "a4d18a90-2376-4214-afa8-5853a938bf8c" 00:17:38.943 } 00:17:38.943 ], 00:17:38.943 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:17:38.943 "serial_number": "SPDK00000000000001", 00:17:38.943 "subtype": "NVMe" 00:17:38.943 } 00:17:38.943 ] 00:17:38.943 11:28:20 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:38.943 11:28:20 nvmf_tcp.nvmf_host.nvmf_aer -- host/aer.sh@43 -- # wait 87125 00:17:38.943 11:28:20 nvmf_tcp.nvmf_host.nvmf_aer -- host/aer.sh@45 -- # rpc_cmd bdev_malloc_delete Malloc0 00:17:38.943 11:28:20 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:38.943 11:28:20 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@10 -- # set +x 00:17:38.943 11:28:20 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:38.943 11:28:20 nvmf_tcp.nvmf_host.nvmf_aer -- host/aer.sh@46 -- # rpc_cmd bdev_malloc_delete Malloc1 00:17:38.943 11:28:20 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:38.943 11:28:20 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@10 -- # set +x 00:17:38.943 11:28:20 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:38.943 11:28:20 nvmf_tcp.nvmf_host.nvmf_aer -- host/aer.sh@47 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:17:38.943 11:28:20 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:38.943 11:28:20 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@10 -- # set +x 00:17:38.943 11:28:20 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:38.943 11:28:20 nvmf_tcp.nvmf_host.nvmf_aer -- host/aer.sh@49 -- # trap - SIGINT SIGTERM EXIT 00:17:38.944 11:28:20 nvmf_tcp.nvmf_host.nvmf_aer -- host/aer.sh@51 -- # nvmftestfini 00:17:38.944 11:28:20 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@514 -- # nvmfcleanup 00:17:38.944 11:28:20 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@121 -- # sync 00:17:38.944 11:28:20 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:17:38.944 11:28:20 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@124 -- # set +e 00:17:38.944 11:28:20 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@125 -- # for i in {1..20} 00:17:38.944 11:28:20 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:17:38.944 rmmod nvme_tcp 00:17:38.944 rmmod nvme_fabrics 00:17:38.944 rmmod nvme_keyring 00:17:38.944 11:28:20 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:17:38.944 11:28:20 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@128 -- # set -e 00:17:38.944 11:28:20 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@129 -- # return 0 00:17:38.944 11:28:20 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@515 -- # '[' -n 87071 ']' 00:17:38.944 11:28:20 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@516 -- # killprocess 87071 00:17:38.944 11:28:20 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@950 -- # '[' -z 87071 ']' 00:17:38.944 11:28:20 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@954 -- # kill -0 87071 00:17:38.944 11:28:20 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@955 -- # uname 00:17:38.944 11:28:20 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:17:38.944 11:28:20 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 87071 00:17:39.201 killing process with pid 87071 00:17:39.201 11:28:20 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:17:39.201 11:28:20 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:17:39.201 11:28:20 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@968 -- # echo 'killing process with pid 87071' 00:17:39.201 11:28:20 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@969 -- # kill 87071 00:17:39.201 11:28:20 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@974 -- # wait 87071 00:17:39.459 11:28:20 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:17:39.459 11:28:20 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:17:39.459 11:28:20 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:17:39.459 11:28:20 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@297 -- # iptr 00:17:39.459 11:28:20 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@789 -- # iptables-save 00:17:39.459 11:28:20 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:17:39.459 11:28:20 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@789 -- # iptables-restore 00:17:39.459 11:28:20 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@298 -- # [[ nvmf_tgt_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:17:39.459 11:28:20 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@299 -- # nvmf_veth_fini 00:17:39.459 11:28:20 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@233 -- # ip link set nvmf_init_br nomaster 00:17:39.459 11:28:20 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@234 -- # ip link set nvmf_init_br2 nomaster 00:17:39.459 11:28:20 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@235 -- # ip link set nvmf_tgt_br nomaster 00:17:39.459 11:28:20 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@236 -- # ip link set nvmf_tgt_br2 nomaster 00:17:39.459 11:28:21 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@237 -- # ip link set nvmf_init_br down 00:17:39.459 11:28:21 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@238 -- # ip link set nvmf_init_br2 down 00:17:39.459 11:28:21 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@239 -- # ip link set nvmf_tgt_br down 00:17:39.459 11:28:21 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@240 -- # ip link set nvmf_tgt_br2 down 00:17:39.459 11:28:21 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@241 -- # ip link delete nvmf_br type bridge 00:17:39.459 11:28:21 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@242 -- # ip link delete nvmf_init_if 00:17:39.459 11:28:21 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@243 -- # ip link delete nvmf_init_if2 00:17:39.459 11:28:21 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@244 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:17:39.459 11:28:21 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@245 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:17:39.459 11:28:21 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@246 -- # remove_spdk_ns 00:17:39.459 11:28:21 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:39.459 11:28:21 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:17:39.459 11:28:21 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:39.721 11:28:21 nvmf_tcp.nvmf_host.nvmf_aer -- nvmf/common.sh@300 -- # return 0 00:17:39.721 00:17:39.721 real 0m3.162s 00:17:39.721 user 0m7.779s 00:17:39.721 sys 0m0.894s 00:17:39.721 11:28:21 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@1126 -- # xtrace_disable 00:17:39.721 ************************************ 00:17:39.721 END TEST nvmf_aer 00:17:39.721 ************************************ 00:17:39.721 11:28:21 nvmf_tcp.nvmf_host.nvmf_aer -- common/autotest_common.sh@10 -- # set +x 00:17:39.721 11:28:21 nvmf_tcp.nvmf_host -- nvmf/nvmf_host.sh@18 -- # run_test nvmf_async_init /home/vagrant/spdk_repo/spdk/test/nvmf/host/async_init.sh --transport=tcp 00:17:39.721 11:28:21 nvmf_tcp.nvmf_host -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:17:39.721 11:28:21 nvmf_tcp.nvmf_host -- common/autotest_common.sh@1107 -- # xtrace_disable 00:17:39.721 11:28:21 nvmf_tcp.nvmf_host -- common/autotest_common.sh@10 -- # set +x 00:17:39.721 ************************************ 00:17:39.721 START TEST nvmf_async_init 00:17:39.722 ************************************ 00:17:39.722 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/nvmf/host/async_init.sh --transport=tcp 00:17:39.722 * Looking for test storage... 00:17:39.722 * Found test storage at /home/vagrant/spdk_repo/spdk/test/nvmf/host 00:17:39.722 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:17:39.722 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:17:39.722 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@1681 -- # lcov --version 00:17:39.722 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:17:39.722 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:17:39.722 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- scripts/common.sh@333 -- # local ver1 ver1_l 00:17:39.722 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- scripts/common.sh@334 -- # local ver2 ver2_l 00:17:39.722 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- scripts/common.sh@336 -- # IFS=.-: 00:17:39.722 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- scripts/common.sh@336 -- # read -ra ver1 00:17:39.722 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- scripts/common.sh@337 -- # IFS=.-: 00:17:39.722 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- scripts/common.sh@337 -- # read -ra ver2 00:17:39.722 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- scripts/common.sh@338 -- # local 'op=<' 00:17:39.722 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- scripts/common.sh@340 -- # ver1_l=2 00:17:39.722 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- scripts/common.sh@341 -- # ver2_l=1 00:17:39.722 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:17:39.722 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- scripts/common.sh@344 -- # case "$op" in 00:17:39.722 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- scripts/common.sh@345 -- # : 1 00:17:39.722 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- scripts/common.sh@364 -- # (( v = 0 )) 00:17:39.722 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:17:39.722 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- scripts/common.sh@365 -- # decimal 1 00:17:39.722 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- scripts/common.sh@353 -- # local d=1 00:17:39.722 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:17:39.722 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- scripts/common.sh@355 -- # echo 1 00:17:39.722 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- scripts/common.sh@365 -- # ver1[v]=1 00:17:39.722 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- scripts/common.sh@366 -- # decimal 2 00:17:39.992 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- scripts/common.sh@353 -- # local d=2 00:17:39.992 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:17:39.992 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- scripts/common.sh@355 -- # echo 2 00:17:39.992 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- scripts/common.sh@366 -- # ver2[v]=2 00:17:39.992 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:17:39.992 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:17:39.992 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- scripts/common.sh@368 -- # return 0 00:17:39.992 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:17:39.992 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:17:39.992 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:39.992 --rc genhtml_branch_coverage=1 00:17:39.992 --rc genhtml_function_coverage=1 00:17:39.992 --rc genhtml_legend=1 00:17:39.992 --rc geninfo_all_blocks=1 00:17:39.992 --rc geninfo_unexecuted_blocks=1 00:17:39.992 00:17:39.992 ' 00:17:39.992 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:17:39.992 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:39.992 --rc genhtml_branch_coverage=1 00:17:39.992 --rc genhtml_function_coverage=1 00:17:39.992 --rc genhtml_legend=1 00:17:39.992 --rc geninfo_all_blocks=1 00:17:39.992 --rc geninfo_unexecuted_blocks=1 00:17:39.992 00:17:39.992 ' 00:17:39.992 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:17:39.992 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:39.992 --rc genhtml_branch_coverage=1 00:17:39.992 --rc genhtml_function_coverage=1 00:17:39.992 --rc genhtml_legend=1 00:17:39.992 --rc geninfo_all_blocks=1 00:17:39.992 --rc geninfo_unexecuted_blocks=1 00:17:39.992 00:17:39.992 ' 00:17:39.992 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:17:39.992 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:39.992 --rc genhtml_branch_coverage=1 00:17:39.992 --rc genhtml_function_coverage=1 00:17:39.992 --rc genhtml_legend=1 00:17:39.992 --rc geninfo_all_blocks=1 00:17:39.992 --rc geninfo_unexecuted_blocks=1 00:17:39.992 00:17:39.992 ' 00:17:39.992 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- host/async_init.sh@11 -- # source /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh 00:17:39.992 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@7 -- # uname -s 00:17:39.992 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:39.992 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:39.992 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:39.992 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:39.992 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:39.992 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:39.992 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:39.992 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:39.992 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:39.992 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:39.992 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:17:39.992 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@18 -- # NVME_HOSTID=3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:17:39.992 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:39.992 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:39.992 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@21 -- # NET_TYPE=virt 00:17:39.992 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:17:39.992 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@49 -- # source /home/vagrant/spdk_repo/spdk/scripts/common.sh 00:17:39.992 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- scripts/common.sh@15 -- # shopt -s extglob 00:17:39.992 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:39.992 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:39.992 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:39.992 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:39.992 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:39.992 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:39.992 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- paths/export.sh@5 -- # export PATH 00:17:39.992 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:39.992 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@51 -- # : 0 00:17:39.992 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:17:39.992 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:17:39.992 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:17:39.992 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:39.992 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:39.992 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:17:39.992 /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:17:39.992 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:17:39.992 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:17:39.992 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@55 -- # have_pci_nics=0 00:17:39.992 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- host/async_init.sh@13 -- # null_bdev_size=1024 00:17:39.992 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- host/async_init.sh@14 -- # null_block_size=512 00:17:39.992 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- host/async_init.sh@15 -- # null_bdev=null0 00:17:39.992 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- host/async_init.sh@16 -- # nvme_bdev=nvme0 00:17:39.992 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- host/async_init.sh@20 -- # uuidgen 00:17:39.992 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- host/async_init.sh@20 -- # tr -d - 00:17:39.992 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- host/async_init.sh@20 -- # nguid=9ec1e47b452d4d048bc61d2362ffd2b5 00:17:39.992 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- host/async_init.sh@22 -- # nvmftestinit 00:17:39.992 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:17:39.992 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:39.992 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@474 -- # prepare_net_devs 00:17:39.992 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@436 -- # local -g is_hw=no 00:17:39.992 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@438 -- # remove_spdk_ns 00:17:39.992 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:39.992 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:17:39.992 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:39.992 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@440 -- # [[ virt != virt ]] 00:17:39.992 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@442 -- # [[ no == yes ]] 00:17:39.992 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@449 -- # [[ virt == phy ]] 00:17:39.993 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@452 -- # [[ virt == phy-fallback ]] 00:17:39.993 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@457 -- # [[ tcp == tcp ]] 00:17:39.993 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@458 -- # nvmf_veth_init 00:17:39.993 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@145 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:17:39.993 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@146 -- # NVMF_SECOND_INITIATOR_IP=10.0.0.2 00:17:39.993 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@147 -- # NVMF_FIRST_TARGET_IP=10.0.0.3 00:17:39.993 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@148 -- # NVMF_SECOND_TARGET_IP=10.0.0.4 00:17:39.993 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@149 -- # NVMF_INITIATOR_IP=10.0.0.1 00:17:39.993 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@150 -- # NVMF_BRIDGE=nvmf_br 00:17:39.993 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@151 -- # NVMF_INITIATOR_INTERFACE=nvmf_init_if 00:17:39.993 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@152 -- # NVMF_INITIATOR_INTERFACE2=nvmf_init_if2 00:17:39.993 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@153 -- # NVMF_INITIATOR_BRIDGE=nvmf_init_br 00:17:39.993 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@154 -- # NVMF_INITIATOR_BRIDGE2=nvmf_init_br2 00:17:39.993 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@155 -- # NVMF_TARGET_NAMESPACE=nvmf_tgt_ns_spdk 00:17:39.993 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@156 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:17:39.993 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@157 -- # NVMF_TARGET_INTERFACE=nvmf_tgt_if 00:17:39.993 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@158 -- # NVMF_TARGET_INTERFACE2=nvmf_tgt_if2 00:17:39.993 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@159 -- # NVMF_TARGET_BRIDGE=nvmf_tgt_br 00:17:39.993 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@160 -- # NVMF_TARGET_BRIDGE2=nvmf_tgt_br2 00:17:39.993 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@162 -- # ip link set nvmf_init_br nomaster 00:17:39.993 Cannot find device "nvmf_init_br" 00:17:39.993 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@162 -- # true 00:17:39.993 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@163 -- # ip link set nvmf_init_br2 nomaster 00:17:39.993 Cannot find device "nvmf_init_br2" 00:17:39.993 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@163 -- # true 00:17:39.993 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@164 -- # ip link set nvmf_tgt_br nomaster 00:17:39.993 Cannot find device "nvmf_tgt_br" 00:17:39.993 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@164 -- # true 00:17:39.993 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@165 -- # ip link set nvmf_tgt_br2 nomaster 00:17:39.993 Cannot find device "nvmf_tgt_br2" 00:17:39.993 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@165 -- # true 00:17:39.993 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@166 -- # ip link set nvmf_init_br down 00:17:39.993 Cannot find device "nvmf_init_br" 00:17:39.993 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@166 -- # true 00:17:39.993 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@167 -- # ip link set nvmf_init_br2 down 00:17:39.993 Cannot find device "nvmf_init_br2" 00:17:39.993 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@167 -- # true 00:17:39.993 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@168 -- # ip link set nvmf_tgt_br down 00:17:39.993 Cannot find device "nvmf_tgt_br" 00:17:39.993 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@168 -- # true 00:17:39.993 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@169 -- # ip link set nvmf_tgt_br2 down 00:17:39.993 Cannot find device "nvmf_tgt_br2" 00:17:39.993 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@169 -- # true 00:17:39.993 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@170 -- # ip link delete nvmf_br type bridge 00:17:39.993 Cannot find device "nvmf_br" 00:17:39.993 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@170 -- # true 00:17:39.993 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@171 -- # ip link delete nvmf_init_if 00:17:39.993 Cannot find device "nvmf_init_if" 00:17:39.993 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@171 -- # true 00:17:39.993 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@172 -- # ip link delete nvmf_init_if2 00:17:39.993 Cannot find device "nvmf_init_if2" 00:17:39.993 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@172 -- # true 00:17:39.993 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@173 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:17:39.993 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:17:39.993 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@173 -- # true 00:17:39.993 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@174 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:17:39.993 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:17:39.993 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@174 -- # true 00:17:39.993 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@177 -- # ip netns add nvmf_tgt_ns_spdk 00:17:39.993 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@180 -- # ip link add nvmf_init_if type veth peer name nvmf_init_br 00:17:39.993 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@181 -- # ip link add nvmf_init_if2 type veth peer name nvmf_init_br2 00:17:39.993 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@182 -- # ip link add nvmf_tgt_if type veth peer name nvmf_tgt_br 00:17:39.993 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@183 -- # ip link add nvmf_tgt_if2 type veth peer name nvmf_tgt_br2 00:17:39.993 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@186 -- # ip link set nvmf_tgt_if netns nvmf_tgt_ns_spdk 00:17:40.251 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@187 -- # ip link set nvmf_tgt_if2 netns nvmf_tgt_ns_spdk 00:17:40.252 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@190 -- # ip addr add 10.0.0.1/24 dev nvmf_init_if 00:17:40.252 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@191 -- # ip addr add 10.0.0.2/24 dev nvmf_init_if2 00:17:40.252 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@192 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.3/24 dev nvmf_tgt_if 00:17:40.252 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@193 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.4/24 dev nvmf_tgt_if2 00:17:40.252 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@196 -- # ip link set nvmf_init_if up 00:17:40.252 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@197 -- # ip link set nvmf_init_if2 up 00:17:40.252 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@198 -- # ip link set nvmf_init_br up 00:17:40.252 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@199 -- # ip link set nvmf_init_br2 up 00:17:40.252 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@200 -- # ip link set nvmf_tgt_br up 00:17:40.252 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@201 -- # ip link set nvmf_tgt_br2 up 00:17:40.252 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@202 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if up 00:17:40.252 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@203 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if2 up 00:17:40.252 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@204 -- # ip netns exec nvmf_tgt_ns_spdk ip link set lo up 00:17:40.252 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@207 -- # ip link add nvmf_br type bridge 00:17:40.252 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@208 -- # ip link set nvmf_br up 00:17:40.252 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@211 -- # ip link set nvmf_init_br master nvmf_br 00:17:40.252 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@212 -- # ip link set nvmf_init_br2 master nvmf_br 00:17:40.252 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@213 -- # ip link set nvmf_tgt_br master nvmf_br 00:17:40.252 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@214 -- # ip link set nvmf_tgt_br2 master nvmf_br 00:17:40.252 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@217 -- # ipts -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT 00:17:40.252 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT' 00:17:40.252 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@218 -- # ipts -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT 00:17:40.252 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT' 00:17:40.252 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@219 -- # ipts -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT 00:17:40.252 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@788 -- # iptables -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT -m comment --comment 'SPDK_NVMF:-A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT' 00:17:40.252 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@222 -- # ping -c 1 10.0.0.3 00:17:40.252 PING 10.0.0.3 (10.0.0.3) 56(84) bytes of data. 00:17:40.252 64 bytes from 10.0.0.3: icmp_seq=1 ttl=64 time=0.085 ms 00:17:40.252 00:17:40.252 --- 10.0.0.3 ping statistics --- 00:17:40.252 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:40.252 rtt min/avg/max/mdev = 0.085/0.085/0.085/0.000 ms 00:17:40.252 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@223 -- # ping -c 1 10.0.0.4 00:17:40.252 PING 10.0.0.4 (10.0.0.4) 56(84) bytes of data. 00:17:40.252 64 bytes from 10.0.0.4: icmp_seq=1 ttl=64 time=0.070 ms 00:17:40.252 00:17:40.252 --- 10.0.0.4 ping statistics --- 00:17:40.252 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:40.252 rtt min/avg/max/mdev = 0.070/0.070/0.070/0.000 ms 00:17:40.252 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@224 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.1 00:17:40.252 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:17:40.252 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.021 ms 00:17:40.252 00:17:40.252 --- 10.0.0.1 ping statistics --- 00:17:40.252 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:40.252 rtt min/avg/max/mdev = 0.021/0.021/0.021/0.000 ms 00:17:40.252 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@225 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.2 00:17:40.252 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:17:40.252 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.089 ms 00:17:40.252 00:17:40.252 --- 10.0.0.2 ping statistics --- 00:17:40.252 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:40.252 rtt min/avg/max/mdev = 0.089/0.089/0.089/0.000 ms 00:17:40.252 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@227 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:17:40.252 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@459 -- # return 0 00:17:40.252 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:17:40.252 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:17:40.252 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:17:40.252 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:17:40.252 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:17:40.252 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:17:40.252 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:17:40.252 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- host/async_init.sh@23 -- # nvmfappstart -m 0x1 00:17:40.252 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:17:40.252 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@724 -- # xtrace_disable 00:17:40.252 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@10 -- # set +x 00:17:40.252 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@507 -- # nvmfpid=87355 00:17:40.252 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@508 -- # waitforlisten 87355 00:17:40.252 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@506 -- # ip netns exec nvmf_tgt_ns_spdk /home/vagrant/spdk_repo/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:17:40.252 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@831 -- # '[' -z 87355 ']' 00:17:40.252 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:40.252 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@836 -- # local max_retries=100 00:17:40.252 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:40.252 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:40.252 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@840 -- # xtrace_disable 00:17:40.252 11:28:21 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@10 -- # set +x 00:17:40.510 [2024-10-07 11:28:21.992783] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:17:40.510 [2024-10-07 11:28:21.992931] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:40.510 [2024-10-07 11:28:22.136433] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:40.768 [2024-10-07 11:28:22.307457] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:40.768 [2024-10-07 11:28:22.307809] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:40.768 [2024-10-07 11:28:22.307834] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:17:40.768 [2024-10-07 11:28:22.307847] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:17:40.768 [2024-10-07 11:28:22.307856] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:40.768 [2024-10-07 11:28:22.308542] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:17:41.702 11:28:23 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:17:41.702 11:28:23 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@864 -- # return 0 00:17:41.702 11:28:23 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:17:41.703 11:28:23 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@730 -- # xtrace_disable 00:17:41.703 11:28:23 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@10 -- # set +x 00:17:41.703 11:28:23 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:41.703 11:28:23 nvmf_tcp.nvmf_host.nvmf_async_init -- host/async_init.sh@26 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:17:41.703 11:28:23 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:41.703 11:28:23 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@10 -- # set +x 00:17:41.703 [2024-10-07 11:28:23.192579] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:41.703 11:28:23 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:41.703 11:28:23 nvmf_tcp.nvmf_host.nvmf_async_init -- host/async_init.sh@27 -- # rpc_cmd bdev_null_create null0 1024 512 00:17:41.703 11:28:23 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:41.703 11:28:23 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@10 -- # set +x 00:17:41.703 null0 00:17:41.703 11:28:23 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:41.703 11:28:23 nvmf_tcp.nvmf_host.nvmf_async_init -- host/async_init.sh@28 -- # rpc_cmd bdev_wait_for_examine 00:17:41.703 11:28:23 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:41.703 11:28:23 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@10 -- # set +x 00:17:41.703 11:28:23 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:41.703 11:28:23 nvmf_tcp.nvmf_host.nvmf_async_init -- host/async_init.sh@29 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a 00:17:41.703 11:28:23 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:41.703 11:28:23 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@10 -- # set +x 00:17:41.703 11:28:23 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:41.703 11:28:23 nvmf_tcp.nvmf_host.nvmf_async_init -- host/async_init.sh@30 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null0 -g 9ec1e47b452d4d048bc61d2362ffd2b5 00:17:41.703 11:28:23 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:41.703 11:28:23 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@10 -- # set +x 00:17:41.703 11:28:23 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:41.703 11:28:23 nvmf_tcp.nvmf_host.nvmf_async_init -- host/async_init.sh@31 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.3 -s 4420 00:17:41.703 11:28:23 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:41.703 11:28:23 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@10 -- # set +x 00:17:41.703 [2024-10-07 11:28:23.236795] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:17:41.703 11:28:23 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:41.703 11:28:23 nvmf_tcp.nvmf_host.nvmf_async_init -- host/async_init.sh@37 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -a 10.0.0.3 -f ipv4 -s 4420 -n nqn.2016-06.io.spdk:cnode0 00:17:41.703 11:28:23 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:41.703 11:28:23 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@10 -- # set +x 00:17:41.962 nvme0n1 00:17:41.962 11:28:23 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:41.962 11:28:23 nvmf_tcp.nvmf_host.nvmf_async_init -- host/async_init.sh@41 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:17:41.962 11:28:23 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:41.962 11:28:23 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@10 -- # set +x 00:17:41.962 [ 00:17:41.962 { 00:17:41.962 "aliases": [ 00:17:41.962 "9ec1e47b-452d-4d04-8bc6-1d2362ffd2b5" 00:17:41.962 ], 00:17:41.962 "assigned_rate_limits": { 00:17:41.962 "r_mbytes_per_sec": 0, 00:17:41.962 "rw_ios_per_sec": 0, 00:17:41.962 "rw_mbytes_per_sec": 0, 00:17:41.962 "w_mbytes_per_sec": 0 00:17:41.962 }, 00:17:41.962 "block_size": 512, 00:17:41.962 "claimed": false, 00:17:41.962 "driver_specific": { 00:17:41.962 "mp_policy": "active_passive", 00:17:41.962 "nvme": [ 00:17:41.962 { 00:17:41.962 "ctrlr_data": { 00:17:41.962 "ana_reporting": false, 00:17:41.962 "cntlid": 1, 00:17:41.962 "firmware_revision": "25.01", 00:17:41.962 "model_number": "SPDK bdev Controller", 00:17:41.962 "multi_ctrlr": true, 00:17:41.962 "oacs": { 00:17:41.962 "firmware": 0, 00:17:41.962 "format": 0, 00:17:41.962 "ns_manage": 0, 00:17:41.962 "security": 0 00:17:41.962 }, 00:17:41.962 "serial_number": "00000000000000000000", 00:17:41.962 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:17:41.962 "vendor_id": "0x8086" 00:17:41.962 }, 00:17:41.962 "ns_data": { 00:17:41.962 "can_share": true, 00:17:41.962 "id": 1 00:17:41.962 }, 00:17:41.962 "trid": { 00:17:41.962 "adrfam": "IPv4", 00:17:41.962 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:17:41.962 "traddr": "10.0.0.3", 00:17:41.962 "trsvcid": "4420", 00:17:41.962 "trtype": "TCP" 00:17:41.962 }, 00:17:41.962 "vs": { 00:17:41.962 "nvme_version": "1.3" 00:17:41.962 } 00:17:41.962 } 00:17:41.962 ] 00:17:41.962 }, 00:17:41.962 "memory_domains": [ 00:17:41.962 { 00:17:41.962 "dma_device_id": "system", 00:17:41.962 "dma_device_type": 1 00:17:41.962 } 00:17:41.962 ], 00:17:41.962 "name": "nvme0n1", 00:17:41.962 "num_blocks": 2097152, 00:17:41.962 "numa_id": -1, 00:17:41.962 "product_name": "NVMe disk", 00:17:41.962 "supported_io_types": { 00:17:41.962 "abort": true, 00:17:41.962 "compare": true, 00:17:41.962 "compare_and_write": true, 00:17:41.962 "copy": true, 00:17:41.962 "flush": true, 00:17:41.962 "get_zone_info": false, 00:17:41.962 "nvme_admin": true, 00:17:41.962 "nvme_io": true, 00:17:41.962 "nvme_io_md": false, 00:17:41.962 "nvme_iov_md": false, 00:17:41.962 "read": true, 00:17:41.962 "reset": true, 00:17:41.962 "seek_data": false, 00:17:41.962 "seek_hole": false, 00:17:41.962 "unmap": false, 00:17:41.962 "write": true, 00:17:41.962 "write_zeroes": true, 00:17:41.962 "zcopy": false, 00:17:41.962 "zone_append": false, 00:17:41.962 "zone_management": false 00:17:41.962 }, 00:17:41.962 "uuid": "9ec1e47b-452d-4d04-8bc6-1d2362ffd2b5", 00:17:41.962 "zoned": false 00:17:41.962 } 00:17:41.962 ] 00:17:41.962 11:28:23 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:41.962 11:28:23 nvmf_tcp.nvmf_host.nvmf_async_init -- host/async_init.sh@44 -- # rpc_cmd bdev_nvme_reset_controller nvme0 00:17:41.962 11:28:23 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:41.962 11:28:23 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@10 -- # set +x 00:17:41.962 [2024-10-07 11:28:23.512809] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:17:41.962 [2024-10-07 11:28:23.513171] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1840c00 (9): Bad file descriptor 00:17:41.962 [2024-10-07 11:28:23.655753] bdev_nvme.c:2183:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:17:41.962 11:28:23 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:41.962 11:28:23 nvmf_tcp.nvmf_host.nvmf_async_init -- host/async_init.sh@47 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:17:41.962 11:28:23 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:41.962 11:28:23 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@10 -- # set +x 00:17:41.962 [ 00:17:41.962 { 00:17:41.962 "aliases": [ 00:17:42.221 "9ec1e47b-452d-4d04-8bc6-1d2362ffd2b5" 00:17:42.221 ], 00:17:42.221 "assigned_rate_limits": { 00:17:42.221 "r_mbytes_per_sec": 0, 00:17:42.221 "rw_ios_per_sec": 0, 00:17:42.221 "rw_mbytes_per_sec": 0, 00:17:42.221 "w_mbytes_per_sec": 0 00:17:42.221 }, 00:17:42.221 "block_size": 512, 00:17:42.221 "claimed": false, 00:17:42.221 "driver_specific": { 00:17:42.221 "mp_policy": "active_passive", 00:17:42.221 "nvme": [ 00:17:42.221 { 00:17:42.221 "ctrlr_data": { 00:17:42.221 "ana_reporting": false, 00:17:42.221 "cntlid": 2, 00:17:42.221 "firmware_revision": "25.01", 00:17:42.221 "model_number": "SPDK bdev Controller", 00:17:42.221 "multi_ctrlr": true, 00:17:42.221 "oacs": { 00:17:42.221 "firmware": 0, 00:17:42.221 "format": 0, 00:17:42.221 "ns_manage": 0, 00:17:42.221 "security": 0 00:17:42.221 }, 00:17:42.221 "serial_number": "00000000000000000000", 00:17:42.221 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:17:42.221 "vendor_id": "0x8086" 00:17:42.221 }, 00:17:42.221 "ns_data": { 00:17:42.221 "can_share": true, 00:17:42.221 "id": 1 00:17:42.221 }, 00:17:42.221 "trid": { 00:17:42.221 "adrfam": "IPv4", 00:17:42.221 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:17:42.221 "traddr": "10.0.0.3", 00:17:42.221 "trsvcid": "4420", 00:17:42.221 "trtype": "TCP" 00:17:42.221 }, 00:17:42.221 "vs": { 00:17:42.221 "nvme_version": "1.3" 00:17:42.221 } 00:17:42.221 } 00:17:42.221 ] 00:17:42.221 }, 00:17:42.221 "memory_domains": [ 00:17:42.221 { 00:17:42.221 "dma_device_id": "system", 00:17:42.221 "dma_device_type": 1 00:17:42.221 } 00:17:42.221 ], 00:17:42.221 "name": "nvme0n1", 00:17:42.221 "num_blocks": 2097152, 00:17:42.221 "numa_id": -1, 00:17:42.221 "product_name": "NVMe disk", 00:17:42.221 "supported_io_types": { 00:17:42.221 "abort": true, 00:17:42.221 "compare": true, 00:17:42.221 "compare_and_write": true, 00:17:42.221 "copy": true, 00:17:42.221 "flush": true, 00:17:42.221 "get_zone_info": false, 00:17:42.221 "nvme_admin": true, 00:17:42.221 "nvme_io": true, 00:17:42.221 "nvme_io_md": false, 00:17:42.221 "nvme_iov_md": false, 00:17:42.221 "read": true, 00:17:42.221 "reset": true, 00:17:42.221 "seek_data": false, 00:17:42.221 "seek_hole": false, 00:17:42.221 "unmap": false, 00:17:42.221 "write": true, 00:17:42.221 "write_zeroes": true, 00:17:42.221 "zcopy": false, 00:17:42.221 "zone_append": false, 00:17:42.221 "zone_management": false 00:17:42.221 }, 00:17:42.221 "uuid": "9ec1e47b-452d-4d04-8bc6-1d2362ffd2b5", 00:17:42.221 "zoned": false 00:17:42.221 } 00:17:42.221 ] 00:17:42.221 11:28:23 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:42.221 11:28:23 nvmf_tcp.nvmf_host.nvmf_async_init -- host/async_init.sh@50 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:17:42.221 11:28:23 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:42.221 11:28:23 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@10 -- # set +x 00:17:42.221 11:28:23 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:42.221 11:28:23 nvmf_tcp.nvmf_host.nvmf_async_init -- host/async_init.sh@53 -- # mktemp 00:17:42.221 11:28:23 nvmf_tcp.nvmf_host.nvmf_async_init -- host/async_init.sh@53 -- # key_path=/tmp/tmp.rUTjwTqzii 00:17:42.221 11:28:23 nvmf_tcp.nvmf_host.nvmf_async_init -- host/async_init.sh@54 -- # echo -n NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:17:42.221 11:28:23 nvmf_tcp.nvmf_host.nvmf_async_init -- host/async_init.sh@55 -- # chmod 0600 /tmp/tmp.rUTjwTqzii 00:17:42.221 11:28:23 nvmf_tcp.nvmf_host.nvmf_async_init -- host/async_init.sh@56 -- # rpc_cmd keyring_file_add_key key0 /tmp/tmp.rUTjwTqzii 00:17:42.221 11:28:23 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:42.221 11:28:23 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@10 -- # set +x 00:17:42.221 11:28:23 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:42.221 11:28:23 nvmf_tcp.nvmf_host.nvmf_async_init -- host/async_init.sh@57 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode0 --disable 00:17:42.221 11:28:23 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:42.221 11:28:23 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@10 -- # set +x 00:17:42.221 11:28:23 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:42.221 11:28:23 nvmf_tcp.nvmf_host.nvmf_async_init -- host/async_init.sh@58 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.3 -s 4421 --secure-channel 00:17:42.221 11:28:23 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:42.221 11:28:23 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@10 -- # set +x 00:17:42.221 [2024-10-07 11:28:23.733193] tcp.c:1031:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:17:42.221 [2024-10-07 11:28:23.733476] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4421 *** 00:17:42.221 11:28:23 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:42.221 11:28:23 nvmf_tcp.nvmf_host.nvmf_async_init -- host/async_init.sh@60 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host1 --psk key0 00:17:42.221 11:28:23 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:42.221 11:28:23 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@10 -- # set +x 00:17:42.221 11:28:23 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:42.221 11:28:23 nvmf_tcp.nvmf_host.nvmf_async_init -- host/async_init.sh@66 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -a 10.0.0.3 -f ipv4 -s 4421 -n nqn.2016-06.io.spdk:cnode0 -q nqn.2016-06.io.spdk:host1 --psk key0 00:17:42.221 11:28:23 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:42.221 11:28:23 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@10 -- # set +x 00:17:42.221 [2024-10-07 11:28:23.749148] bdev_nvme_rpc.c: 514:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:42.221 nvme0n1 00:17:42.221 11:28:23 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:42.221 11:28:23 nvmf_tcp.nvmf_host.nvmf_async_init -- host/async_init.sh@70 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:17:42.221 11:28:23 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:42.221 11:28:23 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@10 -- # set +x 00:17:42.221 [ 00:17:42.221 { 00:17:42.221 "aliases": [ 00:17:42.221 "9ec1e47b-452d-4d04-8bc6-1d2362ffd2b5" 00:17:42.221 ], 00:17:42.221 "assigned_rate_limits": { 00:17:42.221 "r_mbytes_per_sec": 0, 00:17:42.221 "rw_ios_per_sec": 0, 00:17:42.221 "rw_mbytes_per_sec": 0, 00:17:42.221 "w_mbytes_per_sec": 0 00:17:42.221 }, 00:17:42.221 "block_size": 512, 00:17:42.221 "claimed": false, 00:17:42.221 "driver_specific": { 00:17:42.221 "mp_policy": "active_passive", 00:17:42.221 "nvme": [ 00:17:42.221 { 00:17:42.221 "ctrlr_data": { 00:17:42.221 "ana_reporting": false, 00:17:42.221 "cntlid": 3, 00:17:42.221 "firmware_revision": "25.01", 00:17:42.221 "model_number": "SPDK bdev Controller", 00:17:42.221 "multi_ctrlr": true, 00:17:42.221 "oacs": { 00:17:42.221 "firmware": 0, 00:17:42.221 "format": 0, 00:17:42.221 "ns_manage": 0, 00:17:42.221 "security": 0 00:17:42.221 }, 00:17:42.221 "serial_number": "00000000000000000000", 00:17:42.221 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:17:42.221 "vendor_id": "0x8086" 00:17:42.221 }, 00:17:42.221 "ns_data": { 00:17:42.221 "can_share": true, 00:17:42.221 "id": 1 00:17:42.221 }, 00:17:42.221 "trid": { 00:17:42.221 "adrfam": "IPv4", 00:17:42.221 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:17:42.221 "traddr": "10.0.0.3", 00:17:42.221 "trsvcid": "4421", 00:17:42.221 "trtype": "TCP" 00:17:42.221 }, 00:17:42.221 "vs": { 00:17:42.221 "nvme_version": "1.3" 00:17:42.221 } 00:17:42.221 } 00:17:42.221 ] 00:17:42.221 }, 00:17:42.221 "memory_domains": [ 00:17:42.221 { 00:17:42.221 "dma_device_id": "system", 00:17:42.221 "dma_device_type": 1 00:17:42.221 } 00:17:42.221 ], 00:17:42.221 "name": "nvme0n1", 00:17:42.221 "num_blocks": 2097152, 00:17:42.221 "numa_id": -1, 00:17:42.221 "product_name": "NVMe disk", 00:17:42.221 "supported_io_types": { 00:17:42.221 "abort": true, 00:17:42.221 "compare": true, 00:17:42.221 "compare_and_write": true, 00:17:42.221 "copy": true, 00:17:42.221 "flush": true, 00:17:42.221 "get_zone_info": false, 00:17:42.221 "nvme_admin": true, 00:17:42.221 "nvme_io": true, 00:17:42.222 "nvme_io_md": false, 00:17:42.222 "nvme_iov_md": false, 00:17:42.222 "read": true, 00:17:42.222 "reset": true, 00:17:42.222 "seek_data": false, 00:17:42.222 "seek_hole": false, 00:17:42.222 "unmap": false, 00:17:42.222 "write": true, 00:17:42.222 "write_zeroes": true, 00:17:42.222 "zcopy": false, 00:17:42.222 "zone_append": false, 00:17:42.222 "zone_management": false 00:17:42.222 }, 00:17:42.222 "uuid": "9ec1e47b-452d-4d04-8bc6-1d2362ffd2b5", 00:17:42.222 "zoned": false 00:17:42.222 } 00:17:42.222 ] 00:17:42.222 11:28:23 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:42.222 11:28:23 nvmf_tcp.nvmf_host.nvmf_async_init -- host/async_init.sh@73 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:17:42.222 11:28:23 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:42.222 11:28:23 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@10 -- # set +x 00:17:42.222 11:28:23 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:42.222 11:28:23 nvmf_tcp.nvmf_host.nvmf_async_init -- host/async_init.sh@76 -- # rm -f /tmp/tmp.rUTjwTqzii 00:17:42.222 11:28:23 nvmf_tcp.nvmf_host.nvmf_async_init -- host/async_init.sh@78 -- # trap - SIGINT SIGTERM EXIT 00:17:42.222 11:28:23 nvmf_tcp.nvmf_host.nvmf_async_init -- host/async_init.sh@79 -- # nvmftestfini 00:17:42.222 11:28:23 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@514 -- # nvmfcleanup 00:17:42.222 11:28:23 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@121 -- # sync 00:17:42.480 11:28:23 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:17:42.480 11:28:23 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@124 -- # set +e 00:17:42.480 11:28:23 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@125 -- # for i in {1..20} 00:17:42.480 11:28:23 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:17:42.480 rmmod nvme_tcp 00:17:42.480 rmmod nvme_fabrics 00:17:42.480 rmmod nvme_keyring 00:17:42.480 11:28:23 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:17:42.481 11:28:24 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@128 -- # set -e 00:17:42.481 11:28:24 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@129 -- # return 0 00:17:42.481 11:28:24 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@515 -- # '[' -n 87355 ']' 00:17:42.481 11:28:24 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@516 -- # killprocess 87355 00:17:42.481 11:28:24 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@950 -- # '[' -z 87355 ']' 00:17:42.481 11:28:24 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@954 -- # kill -0 87355 00:17:42.481 11:28:24 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@955 -- # uname 00:17:42.481 11:28:24 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:17:42.481 11:28:24 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 87355 00:17:42.481 killing process with pid 87355 00:17:42.481 11:28:24 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:17:42.481 11:28:24 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:17:42.481 11:28:24 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@968 -- # echo 'killing process with pid 87355' 00:17:42.481 11:28:24 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@969 -- # kill 87355 00:17:42.481 11:28:24 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@974 -- # wait 87355 00:17:42.739 11:28:24 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:17:42.739 11:28:24 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:17:42.739 11:28:24 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:17:42.739 11:28:24 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@297 -- # iptr 00:17:42.739 11:28:24 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@789 -- # iptables-save 00:17:42.739 11:28:24 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:17:42.739 11:28:24 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@789 -- # iptables-restore 00:17:42.739 11:28:24 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@298 -- # [[ nvmf_tgt_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:17:42.739 11:28:24 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@299 -- # nvmf_veth_fini 00:17:42.739 11:28:24 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@233 -- # ip link set nvmf_init_br nomaster 00:17:42.739 11:28:24 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@234 -- # ip link set nvmf_init_br2 nomaster 00:17:42.739 11:28:24 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@235 -- # ip link set nvmf_tgt_br nomaster 00:17:42.739 11:28:24 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@236 -- # ip link set nvmf_tgt_br2 nomaster 00:17:42.739 11:28:24 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@237 -- # ip link set nvmf_init_br down 00:17:42.739 11:28:24 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@238 -- # ip link set nvmf_init_br2 down 00:17:42.739 11:28:24 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@239 -- # ip link set nvmf_tgt_br down 00:17:42.739 11:28:24 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@240 -- # ip link set nvmf_tgt_br2 down 00:17:42.739 11:28:24 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@241 -- # ip link delete nvmf_br type bridge 00:17:42.997 11:28:24 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@242 -- # ip link delete nvmf_init_if 00:17:42.997 11:28:24 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@243 -- # ip link delete nvmf_init_if2 00:17:42.997 11:28:24 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@244 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:17:42.997 11:28:24 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@245 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:17:42.997 11:28:24 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@246 -- # remove_spdk_ns 00:17:42.997 11:28:24 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:42.997 11:28:24 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:17:42.997 11:28:24 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:42.997 11:28:24 nvmf_tcp.nvmf_host.nvmf_async_init -- nvmf/common.sh@300 -- # return 0 00:17:42.997 00:17:42.997 real 0m3.315s 00:17:42.997 user 0m2.957s 00:17:42.997 sys 0m0.877s 00:17:42.997 11:28:24 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@1126 -- # xtrace_disable 00:17:42.997 11:28:24 nvmf_tcp.nvmf_host.nvmf_async_init -- common/autotest_common.sh@10 -- # set +x 00:17:42.997 ************************************ 00:17:42.997 END TEST nvmf_async_init 00:17:42.997 ************************************ 00:17:42.997 11:28:24 nvmf_tcp.nvmf_host -- nvmf/nvmf_host.sh@19 -- # run_test dma /home/vagrant/spdk_repo/spdk/test/nvmf/host/dma.sh --transport=tcp 00:17:42.997 11:28:24 nvmf_tcp.nvmf_host -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:17:42.997 11:28:24 nvmf_tcp.nvmf_host -- common/autotest_common.sh@1107 -- # xtrace_disable 00:17:42.997 11:28:24 nvmf_tcp.nvmf_host -- common/autotest_common.sh@10 -- # set +x 00:17:42.997 ************************************ 00:17:42.997 START TEST dma 00:17:42.997 ************************************ 00:17:42.997 11:28:24 nvmf_tcp.nvmf_host.dma -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/nvmf/host/dma.sh --transport=tcp 00:17:42.997 * Looking for test storage... 00:17:42.997 * Found test storage at /home/vagrant/spdk_repo/spdk/test/nvmf/host 00:17:42.997 11:28:24 nvmf_tcp.nvmf_host.dma -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:17:42.997 11:28:24 nvmf_tcp.nvmf_host.dma -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:17:42.997 11:28:24 nvmf_tcp.nvmf_host.dma -- common/autotest_common.sh@1681 -- # lcov --version 00:17:43.256 11:28:24 nvmf_tcp.nvmf_host.dma -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:17:43.256 11:28:24 nvmf_tcp.nvmf_host.dma -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:17:43.256 11:28:24 nvmf_tcp.nvmf_host.dma -- scripts/common.sh@333 -- # local ver1 ver1_l 00:17:43.256 11:28:24 nvmf_tcp.nvmf_host.dma -- scripts/common.sh@334 -- # local ver2 ver2_l 00:17:43.256 11:28:24 nvmf_tcp.nvmf_host.dma -- scripts/common.sh@336 -- # IFS=.-: 00:17:43.256 11:28:24 nvmf_tcp.nvmf_host.dma -- scripts/common.sh@336 -- # read -ra ver1 00:17:43.256 11:28:24 nvmf_tcp.nvmf_host.dma -- scripts/common.sh@337 -- # IFS=.-: 00:17:43.256 11:28:24 nvmf_tcp.nvmf_host.dma -- scripts/common.sh@337 -- # read -ra ver2 00:17:43.256 11:28:24 nvmf_tcp.nvmf_host.dma -- scripts/common.sh@338 -- # local 'op=<' 00:17:43.256 11:28:24 nvmf_tcp.nvmf_host.dma -- scripts/common.sh@340 -- # ver1_l=2 00:17:43.256 11:28:24 nvmf_tcp.nvmf_host.dma -- scripts/common.sh@341 -- # ver2_l=1 00:17:43.256 11:28:24 nvmf_tcp.nvmf_host.dma -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:17:43.256 11:28:24 nvmf_tcp.nvmf_host.dma -- scripts/common.sh@344 -- # case "$op" in 00:17:43.256 11:28:24 nvmf_tcp.nvmf_host.dma -- scripts/common.sh@345 -- # : 1 00:17:43.256 11:28:24 nvmf_tcp.nvmf_host.dma -- scripts/common.sh@364 -- # (( v = 0 )) 00:17:43.256 11:28:24 nvmf_tcp.nvmf_host.dma -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:17:43.256 11:28:24 nvmf_tcp.nvmf_host.dma -- scripts/common.sh@365 -- # decimal 1 00:17:43.256 11:28:24 nvmf_tcp.nvmf_host.dma -- scripts/common.sh@353 -- # local d=1 00:17:43.256 11:28:24 nvmf_tcp.nvmf_host.dma -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:17:43.256 11:28:24 nvmf_tcp.nvmf_host.dma -- scripts/common.sh@355 -- # echo 1 00:17:43.256 11:28:24 nvmf_tcp.nvmf_host.dma -- scripts/common.sh@365 -- # ver1[v]=1 00:17:43.256 11:28:24 nvmf_tcp.nvmf_host.dma -- scripts/common.sh@366 -- # decimal 2 00:17:43.256 11:28:24 nvmf_tcp.nvmf_host.dma -- scripts/common.sh@353 -- # local d=2 00:17:43.256 11:28:24 nvmf_tcp.nvmf_host.dma -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:17:43.256 11:28:24 nvmf_tcp.nvmf_host.dma -- scripts/common.sh@355 -- # echo 2 00:17:43.256 11:28:24 nvmf_tcp.nvmf_host.dma -- scripts/common.sh@366 -- # ver2[v]=2 00:17:43.256 11:28:24 nvmf_tcp.nvmf_host.dma -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:17:43.256 11:28:24 nvmf_tcp.nvmf_host.dma -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:17:43.256 11:28:24 nvmf_tcp.nvmf_host.dma -- scripts/common.sh@368 -- # return 0 00:17:43.256 11:28:24 nvmf_tcp.nvmf_host.dma -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:17:43.256 11:28:24 nvmf_tcp.nvmf_host.dma -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:17:43.256 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:43.256 --rc genhtml_branch_coverage=1 00:17:43.256 --rc genhtml_function_coverage=1 00:17:43.256 --rc genhtml_legend=1 00:17:43.256 --rc geninfo_all_blocks=1 00:17:43.256 --rc geninfo_unexecuted_blocks=1 00:17:43.256 00:17:43.256 ' 00:17:43.256 11:28:24 nvmf_tcp.nvmf_host.dma -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:17:43.256 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:43.256 --rc genhtml_branch_coverage=1 00:17:43.256 --rc genhtml_function_coverage=1 00:17:43.256 --rc genhtml_legend=1 00:17:43.256 --rc geninfo_all_blocks=1 00:17:43.256 --rc geninfo_unexecuted_blocks=1 00:17:43.256 00:17:43.256 ' 00:17:43.256 11:28:24 nvmf_tcp.nvmf_host.dma -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:17:43.256 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:43.256 --rc genhtml_branch_coverage=1 00:17:43.256 --rc genhtml_function_coverage=1 00:17:43.256 --rc genhtml_legend=1 00:17:43.256 --rc geninfo_all_blocks=1 00:17:43.256 --rc geninfo_unexecuted_blocks=1 00:17:43.256 00:17:43.256 ' 00:17:43.256 11:28:24 nvmf_tcp.nvmf_host.dma -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:17:43.256 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:43.256 --rc genhtml_branch_coverage=1 00:17:43.256 --rc genhtml_function_coverage=1 00:17:43.256 --rc genhtml_legend=1 00:17:43.256 --rc geninfo_all_blocks=1 00:17:43.256 --rc geninfo_unexecuted_blocks=1 00:17:43.256 00:17:43.256 ' 00:17:43.256 11:28:24 nvmf_tcp.nvmf_host.dma -- host/dma.sh@10 -- # source /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh 00:17:43.256 11:28:24 nvmf_tcp.nvmf_host.dma -- nvmf/common.sh@7 -- # uname -s 00:17:43.256 11:28:24 nvmf_tcp.nvmf_host.dma -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:43.256 11:28:24 nvmf_tcp.nvmf_host.dma -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:43.256 11:28:24 nvmf_tcp.nvmf_host.dma -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:43.256 11:28:24 nvmf_tcp.nvmf_host.dma -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:43.256 11:28:24 nvmf_tcp.nvmf_host.dma -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:43.256 11:28:24 nvmf_tcp.nvmf_host.dma -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:43.256 11:28:24 nvmf_tcp.nvmf_host.dma -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:43.256 11:28:24 nvmf_tcp.nvmf_host.dma -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:43.256 11:28:24 nvmf_tcp.nvmf_host.dma -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:43.256 11:28:24 nvmf_tcp.nvmf_host.dma -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:43.256 11:28:24 nvmf_tcp.nvmf_host.dma -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:17:43.256 11:28:24 nvmf_tcp.nvmf_host.dma -- nvmf/common.sh@18 -- # NVME_HOSTID=3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:17:43.256 11:28:24 nvmf_tcp.nvmf_host.dma -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:43.256 11:28:24 nvmf_tcp.nvmf_host.dma -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:43.256 11:28:24 nvmf_tcp.nvmf_host.dma -- nvmf/common.sh@21 -- # NET_TYPE=virt 00:17:43.256 11:28:24 nvmf_tcp.nvmf_host.dma -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:17:43.256 11:28:24 nvmf_tcp.nvmf_host.dma -- nvmf/common.sh@49 -- # source /home/vagrant/spdk_repo/spdk/scripts/common.sh 00:17:43.256 11:28:24 nvmf_tcp.nvmf_host.dma -- scripts/common.sh@15 -- # shopt -s extglob 00:17:43.256 11:28:24 nvmf_tcp.nvmf_host.dma -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:43.256 11:28:24 nvmf_tcp.nvmf_host.dma -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:43.256 11:28:24 nvmf_tcp.nvmf_host.dma -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:43.256 11:28:24 nvmf_tcp.nvmf_host.dma -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:43.256 11:28:24 nvmf_tcp.nvmf_host.dma -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:43.256 11:28:24 nvmf_tcp.nvmf_host.dma -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:43.256 11:28:24 nvmf_tcp.nvmf_host.dma -- paths/export.sh@5 -- # export PATH 00:17:43.256 11:28:24 nvmf_tcp.nvmf_host.dma -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:43.256 11:28:24 nvmf_tcp.nvmf_host.dma -- nvmf/common.sh@51 -- # : 0 00:17:43.256 11:28:24 nvmf_tcp.nvmf_host.dma -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:17:43.256 11:28:24 nvmf_tcp.nvmf_host.dma -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:17:43.256 11:28:24 nvmf_tcp.nvmf_host.dma -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:17:43.256 11:28:24 nvmf_tcp.nvmf_host.dma -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:43.256 11:28:24 nvmf_tcp.nvmf_host.dma -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:43.256 11:28:24 nvmf_tcp.nvmf_host.dma -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:17:43.256 /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:17:43.256 11:28:24 nvmf_tcp.nvmf_host.dma -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:17:43.256 11:28:24 nvmf_tcp.nvmf_host.dma -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:17:43.256 11:28:24 nvmf_tcp.nvmf_host.dma -- nvmf/common.sh@55 -- # have_pci_nics=0 00:17:43.256 11:28:24 nvmf_tcp.nvmf_host.dma -- host/dma.sh@12 -- # '[' tcp '!=' rdma ']' 00:17:43.256 11:28:24 nvmf_tcp.nvmf_host.dma -- host/dma.sh@13 -- # exit 0 00:17:43.256 00:17:43.256 real 0m0.244s 00:17:43.256 user 0m0.153s 00:17:43.256 sys 0m0.099s 00:17:43.256 ************************************ 00:17:43.256 END TEST dma 00:17:43.256 ************************************ 00:17:43.256 11:28:24 nvmf_tcp.nvmf_host.dma -- common/autotest_common.sh@1126 -- # xtrace_disable 00:17:43.256 11:28:24 nvmf_tcp.nvmf_host.dma -- common/autotest_common.sh@10 -- # set +x 00:17:43.256 11:28:24 nvmf_tcp.nvmf_host -- nvmf/nvmf_host.sh@22 -- # run_test nvmf_identify /home/vagrant/spdk_repo/spdk/test/nvmf/host/identify.sh --transport=tcp 00:17:43.256 11:28:24 nvmf_tcp.nvmf_host -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:17:43.256 11:28:24 nvmf_tcp.nvmf_host -- common/autotest_common.sh@1107 -- # xtrace_disable 00:17:43.256 11:28:24 nvmf_tcp.nvmf_host -- common/autotest_common.sh@10 -- # set +x 00:17:43.256 ************************************ 00:17:43.256 START TEST nvmf_identify 00:17:43.257 ************************************ 00:17:43.257 11:28:24 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/nvmf/host/identify.sh --transport=tcp 00:17:43.515 * Looking for test storage... 00:17:43.515 * Found test storage at /home/vagrant/spdk_repo/spdk/test/nvmf/host 00:17:43.515 11:28:24 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:17:43.515 11:28:24 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@1681 -- # lcov --version 00:17:43.515 11:28:24 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:17:43.515 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:17:43.515 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:17:43.515 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- scripts/common.sh@333 -- # local ver1 ver1_l 00:17:43.515 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- scripts/common.sh@334 -- # local ver2 ver2_l 00:17:43.515 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- scripts/common.sh@336 -- # IFS=.-: 00:17:43.515 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- scripts/common.sh@336 -- # read -ra ver1 00:17:43.515 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- scripts/common.sh@337 -- # IFS=.-: 00:17:43.515 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- scripts/common.sh@337 -- # read -ra ver2 00:17:43.515 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- scripts/common.sh@338 -- # local 'op=<' 00:17:43.515 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- scripts/common.sh@340 -- # ver1_l=2 00:17:43.515 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- scripts/common.sh@341 -- # ver2_l=1 00:17:43.515 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:17:43.515 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- scripts/common.sh@344 -- # case "$op" in 00:17:43.515 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- scripts/common.sh@345 -- # : 1 00:17:43.515 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- scripts/common.sh@364 -- # (( v = 0 )) 00:17:43.515 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:17:43.515 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- scripts/common.sh@365 -- # decimal 1 00:17:43.515 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- scripts/common.sh@353 -- # local d=1 00:17:43.515 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:17:43.515 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- scripts/common.sh@355 -- # echo 1 00:17:43.515 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- scripts/common.sh@365 -- # ver1[v]=1 00:17:43.515 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- scripts/common.sh@366 -- # decimal 2 00:17:43.515 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- scripts/common.sh@353 -- # local d=2 00:17:43.515 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:17:43.515 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- scripts/common.sh@355 -- # echo 2 00:17:43.515 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- scripts/common.sh@366 -- # ver2[v]=2 00:17:43.515 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:17:43.515 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:17:43.515 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- scripts/common.sh@368 -- # return 0 00:17:43.515 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:17:43.515 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:17:43.515 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:43.515 --rc genhtml_branch_coverage=1 00:17:43.515 --rc genhtml_function_coverage=1 00:17:43.515 --rc genhtml_legend=1 00:17:43.515 --rc geninfo_all_blocks=1 00:17:43.515 --rc geninfo_unexecuted_blocks=1 00:17:43.515 00:17:43.515 ' 00:17:43.515 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:17:43.515 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:43.515 --rc genhtml_branch_coverage=1 00:17:43.515 --rc genhtml_function_coverage=1 00:17:43.515 --rc genhtml_legend=1 00:17:43.515 --rc geninfo_all_blocks=1 00:17:43.515 --rc geninfo_unexecuted_blocks=1 00:17:43.515 00:17:43.515 ' 00:17:43.515 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:17:43.515 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:43.515 --rc genhtml_branch_coverage=1 00:17:43.515 --rc genhtml_function_coverage=1 00:17:43.515 --rc genhtml_legend=1 00:17:43.515 --rc geninfo_all_blocks=1 00:17:43.515 --rc geninfo_unexecuted_blocks=1 00:17:43.515 00:17:43.515 ' 00:17:43.515 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:17:43.515 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:43.515 --rc genhtml_branch_coverage=1 00:17:43.515 --rc genhtml_function_coverage=1 00:17:43.515 --rc genhtml_legend=1 00:17:43.515 --rc geninfo_all_blocks=1 00:17:43.515 --rc geninfo_unexecuted_blocks=1 00:17:43.515 00:17:43.515 ' 00:17:43.515 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- host/identify.sh@9 -- # source /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh 00:17:43.515 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@7 -- # uname -s 00:17:43.515 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:43.515 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:43.515 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:43.515 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:43.515 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:43.515 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:43.515 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:43.515 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:43.515 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:43.515 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:43.515 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:17:43.515 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@18 -- # NVME_HOSTID=3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:17:43.515 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:43.515 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:43.515 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@21 -- # NET_TYPE=virt 00:17:43.515 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:17:43.515 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@49 -- # source /home/vagrant/spdk_repo/spdk/scripts/common.sh 00:17:43.515 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- scripts/common.sh@15 -- # shopt -s extglob 00:17:43.515 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:43.515 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:43.515 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:43.515 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:43.515 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:43.515 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:43.515 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- paths/export.sh@5 -- # export PATH 00:17:43.515 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:43.515 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@51 -- # : 0 00:17:43.515 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:17:43.515 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:17:43.515 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:17:43.515 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:43.516 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:43.516 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:17:43.516 /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:17:43.516 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:17:43.516 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:17:43.516 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@55 -- # have_pci_nics=0 00:17:43.516 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- host/identify.sh@11 -- # MALLOC_BDEV_SIZE=64 00:17:43.516 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- host/identify.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:17:43.516 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- host/identify.sh@14 -- # nvmftestinit 00:17:43.516 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:17:43.516 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:43.516 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@474 -- # prepare_net_devs 00:17:43.516 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@436 -- # local -g is_hw=no 00:17:43.516 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@438 -- # remove_spdk_ns 00:17:43.516 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:43.516 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:17:43.516 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:43.516 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@440 -- # [[ virt != virt ]] 00:17:43.516 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@442 -- # [[ no == yes ]] 00:17:43.516 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@449 -- # [[ virt == phy ]] 00:17:43.516 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@452 -- # [[ virt == phy-fallback ]] 00:17:43.516 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@457 -- # [[ tcp == tcp ]] 00:17:43.516 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@458 -- # nvmf_veth_init 00:17:43.516 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@145 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:17:43.516 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@146 -- # NVMF_SECOND_INITIATOR_IP=10.0.0.2 00:17:43.516 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@147 -- # NVMF_FIRST_TARGET_IP=10.0.0.3 00:17:43.516 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@148 -- # NVMF_SECOND_TARGET_IP=10.0.0.4 00:17:43.516 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@149 -- # NVMF_INITIATOR_IP=10.0.0.1 00:17:43.516 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@150 -- # NVMF_BRIDGE=nvmf_br 00:17:43.516 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@151 -- # NVMF_INITIATOR_INTERFACE=nvmf_init_if 00:17:43.516 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@152 -- # NVMF_INITIATOR_INTERFACE2=nvmf_init_if2 00:17:43.516 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@153 -- # NVMF_INITIATOR_BRIDGE=nvmf_init_br 00:17:43.516 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@154 -- # NVMF_INITIATOR_BRIDGE2=nvmf_init_br2 00:17:43.516 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@155 -- # NVMF_TARGET_NAMESPACE=nvmf_tgt_ns_spdk 00:17:43.516 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@156 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:17:43.516 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@157 -- # NVMF_TARGET_INTERFACE=nvmf_tgt_if 00:17:43.516 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@158 -- # NVMF_TARGET_INTERFACE2=nvmf_tgt_if2 00:17:43.516 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@159 -- # NVMF_TARGET_BRIDGE=nvmf_tgt_br 00:17:43.516 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@160 -- # NVMF_TARGET_BRIDGE2=nvmf_tgt_br2 00:17:43.516 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@162 -- # ip link set nvmf_init_br nomaster 00:17:43.516 Cannot find device "nvmf_init_br" 00:17:43.516 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@162 -- # true 00:17:43.516 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@163 -- # ip link set nvmf_init_br2 nomaster 00:17:43.516 Cannot find device "nvmf_init_br2" 00:17:43.516 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@163 -- # true 00:17:43.516 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@164 -- # ip link set nvmf_tgt_br nomaster 00:17:43.516 Cannot find device "nvmf_tgt_br" 00:17:43.516 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@164 -- # true 00:17:43.516 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@165 -- # ip link set nvmf_tgt_br2 nomaster 00:17:43.516 Cannot find device "nvmf_tgt_br2" 00:17:43.516 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@165 -- # true 00:17:43.516 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@166 -- # ip link set nvmf_init_br down 00:17:43.516 Cannot find device "nvmf_init_br" 00:17:43.516 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@166 -- # true 00:17:43.516 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@167 -- # ip link set nvmf_init_br2 down 00:17:43.516 Cannot find device "nvmf_init_br2" 00:17:43.516 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@167 -- # true 00:17:43.516 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@168 -- # ip link set nvmf_tgt_br down 00:17:43.516 Cannot find device "nvmf_tgt_br" 00:17:43.516 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@168 -- # true 00:17:43.516 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@169 -- # ip link set nvmf_tgt_br2 down 00:17:43.774 Cannot find device "nvmf_tgt_br2" 00:17:43.774 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@169 -- # true 00:17:43.774 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@170 -- # ip link delete nvmf_br type bridge 00:17:43.774 Cannot find device "nvmf_br" 00:17:43.774 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@170 -- # true 00:17:43.774 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@171 -- # ip link delete nvmf_init_if 00:17:43.774 Cannot find device "nvmf_init_if" 00:17:43.774 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@171 -- # true 00:17:43.774 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@172 -- # ip link delete nvmf_init_if2 00:17:43.774 Cannot find device "nvmf_init_if2" 00:17:43.774 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@172 -- # true 00:17:43.774 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@173 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:17:43.774 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:17:43.774 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@173 -- # true 00:17:43.774 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@174 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:17:43.774 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:17:43.774 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@174 -- # true 00:17:43.774 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@177 -- # ip netns add nvmf_tgt_ns_spdk 00:17:43.774 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@180 -- # ip link add nvmf_init_if type veth peer name nvmf_init_br 00:17:43.774 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@181 -- # ip link add nvmf_init_if2 type veth peer name nvmf_init_br2 00:17:43.774 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@182 -- # ip link add nvmf_tgt_if type veth peer name nvmf_tgt_br 00:17:43.774 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@183 -- # ip link add nvmf_tgt_if2 type veth peer name nvmf_tgt_br2 00:17:43.774 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@186 -- # ip link set nvmf_tgt_if netns nvmf_tgt_ns_spdk 00:17:43.774 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@187 -- # ip link set nvmf_tgt_if2 netns nvmf_tgt_ns_spdk 00:17:43.774 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@190 -- # ip addr add 10.0.0.1/24 dev nvmf_init_if 00:17:43.774 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@191 -- # ip addr add 10.0.0.2/24 dev nvmf_init_if2 00:17:43.774 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@192 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.3/24 dev nvmf_tgt_if 00:17:43.774 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@193 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.4/24 dev nvmf_tgt_if2 00:17:43.774 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@196 -- # ip link set nvmf_init_if up 00:17:43.774 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@197 -- # ip link set nvmf_init_if2 up 00:17:43.774 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@198 -- # ip link set nvmf_init_br up 00:17:43.774 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@199 -- # ip link set nvmf_init_br2 up 00:17:43.774 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@200 -- # ip link set nvmf_tgt_br up 00:17:43.774 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@201 -- # ip link set nvmf_tgt_br2 up 00:17:43.774 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@202 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if up 00:17:43.774 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@203 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if2 up 00:17:43.774 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@204 -- # ip netns exec nvmf_tgt_ns_spdk ip link set lo up 00:17:43.774 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@207 -- # ip link add nvmf_br type bridge 00:17:43.774 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@208 -- # ip link set nvmf_br up 00:17:43.774 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@211 -- # ip link set nvmf_init_br master nvmf_br 00:17:43.774 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@212 -- # ip link set nvmf_init_br2 master nvmf_br 00:17:43.774 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@213 -- # ip link set nvmf_tgt_br master nvmf_br 00:17:44.032 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@214 -- # ip link set nvmf_tgt_br2 master nvmf_br 00:17:44.032 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@217 -- # ipts -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT 00:17:44.032 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT' 00:17:44.032 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@218 -- # ipts -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT 00:17:44.032 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT' 00:17:44.032 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@219 -- # ipts -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT 00:17:44.032 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@788 -- # iptables -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT -m comment --comment 'SPDK_NVMF:-A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT' 00:17:44.032 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@222 -- # ping -c 1 10.0.0.3 00:17:44.032 PING 10.0.0.3 (10.0.0.3) 56(84) bytes of data. 00:17:44.032 64 bytes from 10.0.0.3: icmp_seq=1 ttl=64 time=0.071 ms 00:17:44.032 00:17:44.032 --- 10.0.0.3 ping statistics --- 00:17:44.033 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:44.033 rtt min/avg/max/mdev = 0.071/0.071/0.071/0.000 ms 00:17:44.033 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@223 -- # ping -c 1 10.0.0.4 00:17:44.033 PING 10.0.0.4 (10.0.0.4) 56(84) bytes of data. 00:17:44.033 64 bytes from 10.0.0.4: icmp_seq=1 ttl=64 time=0.058 ms 00:17:44.033 00:17:44.033 --- 10.0.0.4 ping statistics --- 00:17:44.033 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:44.033 rtt min/avg/max/mdev = 0.058/0.058/0.058/0.000 ms 00:17:44.033 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@224 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.1 00:17:44.033 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:17:44.033 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.023 ms 00:17:44.033 00:17:44.033 --- 10.0.0.1 ping statistics --- 00:17:44.033 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:44.033 rtt min/avg/max/mdev = 0.023/0.023/0.023/0.000 ms 00:17:44.033 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@225 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.2 00:17:44.033 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:17:44.033 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.091 ms 00:17:44.033 00:17:44.033 --- 10.0.0.2 ping statistics --- 00:17:44.033 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:44.033 rtt min/avg/max/mdev = 0.091/0.091/0.091/0.000 ms 00:17:44.033 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@227 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:17:44.033 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@459 -- # return 0 00:17:44.033 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:17:44.033 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:17:44.033 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:17:44.033 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:17:44.033 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:17:44.033 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:17:44.033 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:17:44.033 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- host/identify.sh@16 -- # timing_enter start_nvmf_tgt 00:17:44.033 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@724 -- # xtrace_disable 00:17:44.033 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@10 -- # set +x 00:17:44.033 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:44.033 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- host/identify.sh@19 -- # nvmfpid=87687 00:17:44.033 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- host/identify.sh@18 -- # ip netns exec nvmf_tgt_ns_spdk /home/vagrant/spdk_repo/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:17:44.033 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- host/identify.sh@21 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:17:44.033 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- host/identify.sh@23 -- # waitforlisten 87687 00:17:44.033 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@831 -- # '[' -z 87687 ']' 00:17:44.033 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:44.033 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@836 -- # local max_retries=100 00:17:44.033 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:44.033 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@840 -- # xtrace_disable 00:17:44.033 11:28:25 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@10 -- # set +x 00:17:44.033 [2024-10-07 11:28:25.640725] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:17:44.033 [2024-10-07 11:28:25.641057] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:44.291 [2024-10-07 11:28:25.784882] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 4 00:17:44.291 [2024-10-07 11:28:25.900981] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:44.291 [2024-10-07 11:28:25.901259] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:44.291 [2024-10-07 11:28:25.901389] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:17:44.291 [2024-10-07 11:28:25.901473] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:17:44.291 [2024-10-07 11:28:25.901572] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:44.291 [2024-10-07 11:28:25.902765] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:17:44.291 [2024-10-07 11:28:25.902910] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:17:44.291 [2024-10-07 11:28:25.902988] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:17:44.291 [2024-10-07 11:28:25.902989] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 3 00:17:45.226 11:28:26 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:17:45.226 11:28:26 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@864 -- # return 0 00:17:45.226 11:28:26 nvmf_tcp.nvmf_host.nvmf_identify -- host/identify.sh@24 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:17:45.226 11:28:26 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:45.226 11:28:26 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@10 -- # set +x 00:17:45.226 [2024-10-07 11:28:26.737590] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:45.226 11:28:26 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:45.226 11:28:26 nvmf_tcp.nvmf_host.nvmf_identify -- host/identify.sh@25 -- # timing_exit start_nvmf_tgt 00:17:45.226 11:28:26 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@730 -- # xtrace_disable 00:17:45.226 11:28:26 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@10 -- # set +x 00:17:45.226 11:28:26 nvmf_tcp.nvmf_host.nvmf_identify -- host/identify.sh@27 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:17:45.226 11:28:26 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:45.226 11:28:26 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@10 -- # set +x 00:17:45.226 Malloc0 00:17:45.226 11:28:26 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:45.226 11:28:26 nvmf_tcp.nvmf_host.nvmf_identify -- host/identify.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:17:45.226 11:28:26 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:45.226 11:28:26 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@10 -- # set +x 00:17:45.226 11:28:26 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:45.226 11:28:26 nvmf_tcp.nvmf_host.nvmf_identify -- host/identify.sh@31 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 --nguid ABCDEF0123456789ABCDEF0123456789 --eui64 ABCDEF0123456789 00:17:45.226 11:28:26 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:45.226 11:28:26 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@10 -- # set +x 00:17:45.226 11:28:26 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:45.226 11:28:26 nvmf_tcp.nvmf_host.nvmf_identify -- host/identify.sh@34 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4420 00:17:45.226 11:28:26 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:45.226 11:28:26 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@10 -- # set +x 00:17:45.226 [2024-10-07 11:28:26.852231] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:17:45.226 11:28:26 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:45.227 11:28:26 nvmf_tcp.nvmf_host.nvmf_identify -- host/identify.sh@35 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.3 -s 4420 00:17:45.227 11:28:26 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:45.227 11:28:26 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@10 -- # set +x 00:17:45.227 11:28:26 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:45.227 11:28:26 nvmf_tcp.nvmf_host.nvmf_identify -- host/identify.sh@37 -- # rpc_cmd nvmf_get_subsystems 00:17:45.227 11:28:26 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:45.227 11:28:26 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@10 -- # set +x 00:17:45.227 [ 00:17:45.227 { 00:17:45.227 "allow_any_host": true, 00:17:45.227 "hosts": [], 00:17:45.227 "listen_addresses": [ 00:17:45.227 { 00:17:45.227 "adrfam": "IPv4", 00:17:45.227 "traddr": "10.0.0.3", 00:17:45.227 "trsvcid": "4420", 00:17:45.227 "trtype": "TCP" 00:17:45.227 } 00:17:45.227 ], 00:17:45.227 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:17:45.227 "subtype": "Discovery" 00:17:45.227 }, 00:17:45.227 { 00:17:45.227 "allow_any_host": true, 00:17:45.227 "hosts": [], 00:17:45.227 "listen_addresses": [ 00:17:45.227 { 00:17:45.227 "adrfam": "IPv4", 00:17:45.227 "traddr": "10.0.0.3", 00:17:45.227 "trsvcid": "4420", 00:17:45.227 "trtype": "TCP" 00:17:45.227 } 00:17:45.227 ], 00:17:45.227 "max_cntlid": 65519, 00:17:45.227 "max_namespaces": 32, 00:17:45.227 "min_cntlid": 1, 00:17:45.227 "model_number": "SPDK bdev Controller", 00:17:45.227 "namespaces": [ 00:17:45.227 { 00:17:45.227 "bdev_name": "Malloc0", 00:17:45.227 "eui64": "ABCDEF0123456789", 00:17:45.227 "name": "Malloc0", 00:17:45.227 "nguid": "ABCDEF0123456789ABCDEF0123456789", 00:17:45.227 "nsid": 1, 00:17:45.227 "uuid": "3516ef91-10ef-4f5b-bacf-16ec3a955c59" 00:17:45.227 } 00:17:45.227 ], 00:17:45.227 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:17:45.227 "serial_number": "SPDK00000000000001", 00:17:45.227 "subtype": "NVMe" 00:17:45.227 } 00:17:45.227 ] 00:17:45.227 11:28:26 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:45.227 11:28:26 nvmf_tcp.nvmf_host.nvmf_identify -- host/identify.sh@39 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.3 trsvcid:4420 subnqn:nqn.2014-08.org.nvmexpress.discovery' -L all 00:17:45.227 [2024-10-07 11:28:26.906127] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:17:45.227 [2024-10-07 11:28:26.906179] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid87746 ] 00:17:45.488 [2024-10-07 11:28:27.040595] nvme_ctrlr.c:1563:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to connect adminq (no timeout) 00:17:45.488 [2024-10-07 11:28:27.040693] nvme_tcp.c:2349:nvme_tcp_qpair_connect_sock: *DEBUG*: adrfam 1 ai_family 2 00:17:45.488 [2024-10-07 11:28:27.040702] nvme_tcp.c:2353:nvme_tcp_qpair_connect_sock: *DEBUG*: trsvcid is 4420 00:17:45.488 [2024-10-07 11:28:27.040717] nvme_tcp.c:2374:nvme_tcp_qpair_connect_sock: *DEBUG*: sock_impl_name is (null) 00:17:45.488 [2024-10-07 11:28:27.040730] sock.c: 373:spdk_sock_connect_ext: *DEBUG*: Creating a client socket using impl posix 00:17:45.488 [2024-10-07 11:28:27.041178] nvme_ctrlr.c:1563:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for connect adminq (no timeout) 00:17:45.488 [2024-10-07 11:28:27.041255] nvme_tcp.c:1566:nvme_tcp_send_icreq_complete: *DEBUG*: Complete the icreq send for tqpair=0x18c58f0 0 00:17:45.488 [2024-10-07 11:28:27.053452] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 1 00:17:45.488 [2024-10-07 11:28:27.053482] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =1 00:17:45.488 [2024-10-07 11:28:27.053505] nvme_tcp.c:1612:nvme_tcp_icresp_handle: *DEBUG*: host_hdgst_enable: 0 00:17:45.488 [2024-10-07 11:28:27.053509] nvme_tcp.c:1613:nvme_tcp_icresp_handle: *DEBUG*: host_ddgst_enable: 0 00:17:45.488 [2024-10-07 11:28:27.053550] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:45.488 [2024-10-07 11:28:27.053558] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:45.488 [2024-10-07 11:28:27.053563] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x18c58f0) 00:17:45.488 [2024-10-07 11:28:27.053580] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x400 00:17:45.488 [2024-10-07 11:28:27.053615] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x18ec000, cid 0, qid 0 00:17:45.488 [2024-10-07 11:28:27.061450] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:45.488 [2024-10-07 11:28:27.061482] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:45.488 [2024-10-07 11:28:27.061504] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:45.488 [2024-10-07 11:28:27.061510] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x18ec000) on tqpair=0x18c58f0 00:17:45.488 [2024-10-07 11:28:27.061522] nvme_fabric.c: 621:nvme_fabric_qpair_connect_poll: *DEBUG*: CNTLID 0x0001 00:17:45.488 [2024-10-07 11:28:27.061532] nvme_ctrlr.c:1563:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read vs (no timeout) 00:17:45.488 [2024-10-07 11:28:27.061538] nvme_ctrlr.c:1563:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read vs wait for vs (no timeout) 00:17:45.488 [2024-10-07 11:28:27.061557] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:45.488 [2024-10-07 11:28:27.061562] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:45.488 [2024-10-07 11:28:27.061568] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x18c58f0) 00:17:45.488 [2024-10-07 11:28:27.061578] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:45.488 [2024-10-07 11:28:27.061609] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x18ec000, cid 0, qid 0 00:17:45.488 [2024-10-07 11:28:27.061707] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:45.488 [2024-10-07 11:28:27.061715] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:45.488 [2024-10-07 11:28:27.061719] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:45.488 [2024-10-07 11:28:27.061723] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x18ec000) on tqpair=0x18c58f0 00:17:45.488 [2024-10-07 11:28:27.061730] nvme_ctrlr.c:1563:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read cap (no timeout) 00:17:45.488 [2024-10-07 11:28:27.061738] nvme_ctrlr.c:1563:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read cap wait for cap (no timeout) 00:17:45.488 [2024-10-07 11:28:27.061747] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:45.488 [2024-10-07 11:28:27.061752] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:45.488 [2024-10-07 11:28:27.061756] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x18c58f0) 00:17:45.488 [2024-10-07 11:28:27.061764] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:45.488 [2024-10-07 11:28:27.061785] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x18ec000, cid 0, qid 0 00:17:45.488 [2024-10-07 11:28:27.061872] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:45.488 [2024-10-07 11:28:27.061879] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:45.488 [2024-10-07 11:28:27.061882] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:45.488 [2024-10-07 11:28:27.061887] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x18ec000) on tqpair=0x18c58f0 00:17:45.488 [2024-10-07 11:28:27.061893] nvme_ctrlr.c:1563:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to check en (no timeout) 00:17:45.488 [2024-10-07 11:28:27.061902] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to check en wait for cc (timeout 15000 ms) 00:17:45.488 [2024-10-07 11:28:27.061909] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:45.488 [2024-10-07 11:28:27.061914] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:45.488 [2024-10-07 11:28:27.061917] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x18c58f0) 00:17:45.488 [2024-10-07 11:28:27.061936] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:45.488 [2024-10-07 11:28:27.061983] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x18ec000, cid 0, qid 0 00:17:45.488 [2024-10-07 11:28:27.062038] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:45.488 [2024-10-07 11:28:27.062045] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:45.488 [2024-10-07 11:28:27.062049] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:45.488 [2024-10-07 11:28:27.062053] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x18ec000) on tqpair=0x18c58f0 00:17:45.488 [2024-10-07 11:28:27.062059] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:17:45.488 [2024-10-07 11:28:27.062069] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:45.488 [2024-10-07 11:28:27.062074] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:45.488 [2024-10-07 11:28:27.062078] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x18c58f0) 00:17:45.488 [2024-10-07 11:28:27.062085] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:45.488 [2024-10-07 11:28:27.062104] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x18ec000, cid 0, qid 0 00:17:45.488 [2024-10-07 11:28:27.062157] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:45.488 [2024-10-07 11:28:27.062164] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:45.488 [2024-10-07 11:28:27.062167] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:45.488 [2024-10-07 11:28:27.062171] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x18ec000) on tqpair=0x18c58f0 00:17:45.488 [2024-10-07 11:28:27.062177] nvme_ctrlr.c:3893:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CC.EN = 0 && CSTS.RDY = 0 00:17:45.488 [2024-10-07 11:28:27.062182] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to controller is disabled (timeout 15000 ms) 00:17:45.488 [2024-10-07 11:28:27.062190] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:17:45.488 [2024-10-07 11:28:27.062296] nvme_ctrlr.c:4091:nvme_ctrlr_process_init: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Setting CC.EN = 1 00:17:45.488 [2024-10-07 11:28:27.062302] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:17:45.488 [2024-10-07 11:28:27.062313] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:45.488 [2024-10-07 11:28:27.062317] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:45.488 [2024-10-07 11:28:27.062321] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x18c58f0) 00:17:45.488 [2024-10-07 11:28:27.062328] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:45.488 [2024-10-07 11:28:27.062347] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x18ec000, cid 0, qid 0 00:17:45.488 [2024-10-07 11:28:27.062398] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:45.488 [2024-10-07 11:28:27.062405] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:45.488 [2024-10-07 11:28:27.062408] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:45.488 [2024-10-07 11:28:27.062412] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x18ec000) on tqpair=0x18c58f0 00:17:45.488 [2024-10-07 11:28:27.062418] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:17:45.488 [2024-10-07 11:28:27.062428] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:45.489 [2024-10-07 11:28:27.062449] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:45.489 [2024-10-07 11:28:27.062453] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x18c58f0) 00:17:45.489 [2024-10-07 11:28:27.062461] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:45.489 [2024-10-07 11:28:27.062504] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x18ec000, cid 0, qid 0 00:17:45.489 [2024-10-07 11:28:27.062556] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:45.489 [2024-10-07 11:28:27.062563] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:45.489 [2024-10-07 11:28:27.062567] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:45.489 [2024-10-07 11:28:27.062572] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x18ec000) on tqpair=0x18c58f0 00:17:45.489 [2024-10-07 11:28:27.062577] nvme_ctrlr.c:3928:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:17:45.489 [2024-10-07 11:28:27.062583] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to reset admin queue (timeout 30000 ms) 00:17:45.489 [2024-10-07 11:28:27.062591] nvme_ctrlr.c:1563:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to identify controller (no timeout) 00:17:45.489 [2024-10-07 11:28:27.062608] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for identify controller (timeout 30000 ms) 00:17:45.489 [2024-10-07 11:28:27.062620] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:45.489 [2024-10-07 11:28:27.062625] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x18c58f0) 00:17:45.489 [2024-10-07 11:28:27.062634] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:45.489 [2024-10-07 11:28:27.062655] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x18ec000, cid 0, qid 0 00:17:45.489 [2024-10-07 11:28:27.062758] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:17:45.489 [2024-10-07 11:28:27.062765] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:17:45.489 [2024-10-07 11:28:27.062769] nvme_tcp.c:1730:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:17:45.489 [2024-10-07 11:28:27.062773] nvme_tcp.c:1731:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x18c58f0): datao=0, datal=4096, cccid=0 00:17:45.489 [2024-10-07 11:28:27.062779] nvme_tcp.c:1742:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x18ec000) on tqpair(0x18c58f0): expected_datao=0, payload_size=4096 00:17:45.489 [2024-10-07 11:28:27.062784] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:45.489 [2024-10-07 11:28:27.062809] nvme_tcp.c:1532:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:17:45.489 [2024-10-07 11:28:27.062814] nvme_tcp.c:1323:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:17:45.489 [2024-10-07 11:28:27.062823] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:45.489 [2024-10-07 11:28:27.062830] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:45.489 [2024-10-07 11:28:27.062834] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:45.489 [2024-10-07 11:28:27.062838] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x18ec000) on tqpair=0x18c58f0 00:17:45.489 [2024-10-07 11:28:27.062847] nvme_ctrlr.c:2077:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] transport max_xfer_size 4294967295 00:17:45.489 [2024-10-07 11:28:27.062853] nvme_ctrlr.c:2081:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] MDTS max_xfer_size 131072 00:17:45.489 [2024-10-07 11:28:27.062858] nvme_ctrlr.c:2084:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CNTLID 0x0001 00:17:45.489 [2024-10-07 11:28:27.062864] nvme_ctrlr.c:2108:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] transport max_sges 16 00:17:45.489 [2024-10-07 11:28:27.062869] nvme_ctrlr.c:2123:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] fuses compare and write: 1 00:17:45.489 [2024-10-07 11:28:27.062874] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to configure AER (timeout 30000 ms) 00:17:45.489 [2024-10-07 11:28:27.062883] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for configure aer (timeout 30000 ms) 00:17:45.489 [2024-10-07 11:28:27.062896] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:45.489 [2024-10-07 11:28:27.062901] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:45.489 [2024-10-07 11:28:27.062905] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x18c58f0) 00:17:45.489 [2024-10-07 11:28:27.062913] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:0 cdw10:0000000b SGL DATA BLOCK OFFSET 0x0 len:0x0 00:17:45.489 [2024-10-07 11:28:27.062935] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x18ec000, cid 0, qid 0 00:17:45.489 [2024-10-07 11:28:27.062997] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:45.489 [2024-10-07 11:28:27.063004] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:45.489 [2024-10-07 11:28:27.063008] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:45.489 [2024-10-07 11:28:27.063012] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x18ec000) on tqpair=0x18c58f0 00:17:45.489 [2024-10-07 11:28:27.063021] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:45.489 [2024-10-07 11:28:27.063025] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:45.489 [2024-10-07 11:28:27.063029] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x18c58f0) 00:17:45.489 [2024-10-07 11:28:27.063036] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:17:45.489 [2024-10-07 11:28:27.063042] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:45.489 [2024-10-07 11:28:27.063046] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:45.489 [2024-10-07 11:28:27.063050] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=1 on tqpair(0x18c58f0) 00:17:45.489 [2024-10-07 11:28:27.063056] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:17:45.489 [2024-10-07 11:28:27.063064] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:45.489 [2024-10-07 11:28:27.063068] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:45.489 [2024-10-07 11:28:27.063072] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=2 on tqpair(0x18c58f0) 00:17:45.489 [2024-10-07 11:28:27.063078] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:17:45.489 [2024-10-07 11:28:27.063084] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:45.489 [2024-10-07 11:28:27.063088] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:45.489 [2024-10-07 11:28:27.063092] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x18c58f0) 00:17:45.489 [2024-10-07 11:28:27.063097] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:17:45.489 [2024-10-07 11:28:27.063102] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to set keep alive timeout (timeout 30000 ms) 00:17:45.489 [2024-10-07 11:28:27.063116] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:17:45.489 [2024-10-07 11:28:27.063124] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:45.489 [2024-10-07 11:28:27.063128] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x18c58f0) 00:17:45.489 [2024-10-07 11:28:27.063136] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:4 cdw10:0000000f SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:45.489 [2024-10-07 11:28:27.063157] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x18ec000, cid 0, qid 0 00:17:45.489 [2024-10-07 11:28:27.063164] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x18ec180, cid 1, qid 0 00:17:45.489 [2024-10-07 11:28:27.063169] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x18ec300, cid 2, qid 0 00:17:45.489 [2024-10-07 11:28:27.063174] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x18ec480, cid 3, qid 0 00:17:45.489 [2024-10-07 11:28:27.063179] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x18ec600, cid 4, qid 0 00:17:45.489 [2024-10-07 11:28:27.063266] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:45.489 [2024-10-07 11:28:27.063273] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:45.489 [2024-10-07 11:28:27.063277] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:45.489 [2024-10-07 11:28:27.063281] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x18ec600) on tqpair=0x18c58f0 00:17:45.489 [2024-10-07 11:28:27.063287] nvme_ctrlr.c:3046:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Sending keep alive every 5000000 us 00:17:45.489 [2024-10-07 11:28:27.063293] nvme_ctrlr.c:1563:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to ready (no timeout) 00:17:45.489 [2024-10-07 11:28:27.063305] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:45.489 [2024-10-07 11:28:27.063310] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x18c58f0) 00:17:45.489 [2024-10-07 11:28:27.063317] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:45.489 [2024-10-07 11:28:27.063336] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x18ec600, cid 4, qid 0 00:17:45.489 [2024-10-07 11:28:27.063397] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:17:45.489 [2024-10-07 11:28:27.063404] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:17:45.489 [2024-10-07 11:28:27.063408] nvme_tcp.c:1730:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:17:45.489 [2024-10-07 11:28:27.063412] nvme_tcp.c:1731:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x18c58f0): datao=0, datal=4096, cccid=4 00:17:45.489 [2024-10-07 11:28:27.063417] nvme_tcp.c:1742:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x18ec600) on tqpair(0x18c58f0): expected_datao=0, payload_size=4096 00:17:45.489 [2024-10-07 11:28:27.063421] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:45.489 [2024-10-07 11:28:27.063442] nvme_tcp.c:1532:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:17:45.489 [2024-10-07 11:28:27.063448] nvme_tcp.c:1323:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:17:45.489 [2024-10-07 11:28:27.063457] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:45.489 [2024-10-07 11:28:27.063464] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:45.489 [2024-10-07 11:28:27.063468] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:45.489 [2024-10-07 11:28:27.063472] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x18ec600) on tqpair=0x18c58f0 00:17:45.489 [2024-10-07 11:28:27.063486] nvme_ctrlr.c:4189:nvme_ctrlr_process_init: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Ctrlr already in ready state 00:17:45.489 [2024-10-07 11:28:27.063543] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:45.489 [2024-10-07 11:28:27.063554] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x18c58f0) 00:17:45.489 [2024-10-07 11:28:27.063563] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:00ff0070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:45.490 [2024-10-07 11:28:27.063571] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:45.490 [2024-10-07 11:28:27.063575] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:45.490 [2024-10-07 11:28:27.063579] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x18c58f0) 00:17:45.490 [2024-10-07 11:28:27.063586] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:5 nsid:0 cdw10:00000000 cdw11:00000000 00:17:45.490 [2024-10-07 11:28:27.063618] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x18ec600, cid 4, qid 0 00:17:45.490 [2024-10-07 11:28:27.063627] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x18ec780, cid 5, qid 0 00:17:45.490 [2024-10-07 11:28:27.063746] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:17:45.490 [2024-10-07 11:28:27.063753] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:17:45.490 [2024-10-07 11:28:27.063757] nvme_tcp.c:1730:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:17:45.490 [2024-10-07 11:28:27.063760] nvme_tcp.c:1731:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x18c58f0): datao=0, datal=1024, cccid=4 00:17:45.490 [2024-10-07 11:28:27.063765] nvme_tcp.c:1742:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x18ec600) on tqpair(0x18c58f0): expected_datao=0, payload_size=1024 00:17:45.490 [2024-10-07 11:28:27.063770] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:45.490 [2024-10-07 11:28:27.063777] nvme_tcp.c:1532:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:17:45.490 [2024-10-07 11:28:27.063781] nvme_tcp.c:1323:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:17:45.490 [2024-10-07 11:28:27.063787] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:45.490 [2024-10-07 11:28:27.063810] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:45.490 [2024-10-07 11:28:27.063814] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:45.490 [2024-10-07 11:28:27.063818] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x18ec780) on tqpair=0x18c58f0 00:17:45.490 [2024-10-07 11:28:27.112437] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:45.490 [2024-10-07 11:28:27.112470] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:45.490 [2024-10-07 11:28:27.112492] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:45.490 [2024-10-07 11:28:27.112497] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x18ec600) on tqpair=0x18c58f0 00:17:45.490 [2024-10-07 11:28:27.112521] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:45.490 [2024-10-07 11:28:27.112527] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x18c58f0) 00:17:45.490 [2024-10-07 11:28:27.112537] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:02ff0070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:45.490 [2024-10-07 11:28:27.112574] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x18ec600, cid 4, qid 0 00:17:45.490 [2024-10-07 11:28:27.112656] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:17:45.490 [2024-10-07 11:28:27.112663] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:17:45.490 [2024-10-07 11:28:27.112667] nvme_tcp.c:1730:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:17:45.490 [2024-10-07 11:28:27.112671] nvme_tcp.c:1731:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x18c58f0): datao=0, datal=3072, cccid=4 00:17:45.490 [2024-10-07 11:28:27.112676] nvme_tcp.c:1742:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x18ec600) on tqpair(0x18c58f0): expected_datao=0, payload_size=3072 00:17:45.490 [2024-10-07 11:28:27.112681] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:45.490 [2024-10-07 11:28:27.112688] nvme_tcp.c:1532:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:17:45.490 [2024-10-07 11:28:27.112692] nvme_tcp.c:1323:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:17:45.490 [2024-10-07 11:28:27.112701] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:45.490 [2024-10-07 11:28:27.112724] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:45.490 [2024-10-07 11:28:27.112728] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:45.490 [2024-10-07 11:28:27.112732] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x18ec600) on tqpair=0x18c58f0 00:17:45.490 [2024-10-07 11:28:27.112744] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:45.490 [2024-10-07 11:28:27.112749] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x18c58f0) 00:17:45.490 [2024-10-07 11:28:27.112757] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:00010070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:45.490 [2024-10-07 11:28:27.112785] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x18ec600, cid 4, qid 0 00:17:45.490 [2024-10-07 11:28:27.112864] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:17:45.490 [2024-10-07 11:28:27.112871] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:17:45.490 [2024-10-07 11:28:27.112874] nvme_tcp.c:1730:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:17:45.490 [2024-10-07 11:28:27.112878] nvme_tcp.c:1731:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x18c58f0): datao=0, datal=8, cccid=4 00:17:45.490 [2024-10-07 11:28:27.112883] nvme_tcp.c:1742:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x18ec600) on tqpair(0x18c58f0): expected_datao=0, payload_size=8 00:17:45.490 [2024-10-07 11:28:27.112888] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:45.490 [2024-10-07 11:28:27.112895] nvme_tcp.c:1532:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:17:45.490 [2024-10-07 11:28:27.112899] nvme_tcp.c:1323:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:17:45.490 ===================================================== 00:17:45.490 NVMe over Fabrics controller at 10.0.0.3:4420: nqn.2014-08.org.nvmexpress.discovery 00:17:45.490 ===================================================== 00:17:45.490 Controller Capabilities/Features 00:17:45.490 ================================ 00:17:45.490 Vendor ID: 0000 00:17:45.490 Subsystem Vendor ID: 0000 00:17:45.490 Serial Number: .................... 00:17:45.490 Model Number: ........................................ 00:17:45.490 Firmware Version: 25.01 00:17:45.490 Recommended Arb Burst: 0 00:17:45.490 IEEE OUI Identifier: 00 00 00 00:17:45.490 Multi-path I/O 00:17:45.490 May have multiple subsystem ports: No 00:17:45.490 May have multiple controllers: No 00:17:45.490 Associated with SR-IOV VF: No 00:17:45.490 Max Data Transfer Size: 131072 00:17:45.490 Max Number of Namespaces: 0 00:17:45.490 Max Number of I/O Queues: 1024 00:17:45.490 NVMe Specification Version (VS): 1.3 00:17:45.490 NVMe Specification Version (Identify): 1.3 00:17:45.490 Maximum Queue Entries: 128 00:17:45.490 Contiguous Queues Required: Yes 00:17:45.490 Arbitration Mechanisms Supported 00:17:45.490 Weighted Round Robin: Not Supported 00:17:45.490 Vendor Specific: Not Supported 00:17:45.490 Reset Timeout: 15000 ms 00:17:45.490 Doorbell Stride: 4 bytes 00:17:45.490 NVM Subsystem Reset: Not Supported 00:17:45.490 Command Sets Supported 00:17:45.490 NVM Command Set: Supported 00:17:45.490 Boot Partition: Not Supported 00:17:45.490 Memory Page Size Minimum: 4096 bytes 00:17:45.490 Memory Page Size Maximum: 4096 bytes 00:17:45.490 Persistent Memory Region: Not Supported 00:17:45.490 Optional Asynchronous Events Supported 00:17:45.490 Namespace Attribute Notices: Not Supported 00:17:45.490 Firmware Activation Notices: Not Supported 00:17:45.490 ANA Change Notices: Not Supported 00:17:45.490 PLE Aggregate Log Change Notices: Not Supported 00:17:45.490 LBA Status Info Alert Notices: Not Supported 00:17:45.490 EGE Aggregate Log Change Notices: Not Supported 00:17:45.490 Normal NVM Subsystem Shutdown event: Not Supported 00:17:45.490 Zone Descriptor Change Notices: Not Supported 00:17:45.490 Discovery Log Change Notices: Supported 00:17:45.490 Controller Attributes 00:17:45.490 128-bit Host Identifier: Not Supported 00:17:45.490 Non-Operational Permissive Mode: Not Supported 00:17:45.490 NVM Sets: Not Supported 00:17:45.490 Read Recovery Levels: Not Supported 00:17:45.490 Endurance Groups: Not Supported 00:17:45.490 Predictable Latency Mode: Not Supported 00:17:45.490 Traffic Based Keep ALive: Not Supported 00:17:45.490 Namespace Granularity: Not Supported 00:17:45.490 SQ Associations: Not Supported 00:17:45.490 UUID List: Not Supported 00:17:45.490 Multi-Domain Subsystem: Not Supported 00:17:45.490 Fixed Capacity Management: Not Supported 00:17:45.490 Variable Capacity Management: Not Supported 00:17:45.490 Delete Endurance Group: Not Supported 00:17:45.490 Delete NVM Set: Not Supported 00:17:45.490 Extended LBA Formats Supported: Not Supported 00:17:45.490 Flexible Data Placement Supported: Not Supported 00:17:45.490 00:17:45.490 Controller Memory Buffer Support 00:17:45.490 ================================ 00:17:45.490 Supported: No 00:17:45.490 00:17:45.490 Persistent Memory Region Support 00:17:45.490 ================================ 00:17:45.490 Supported: No 00:17:45.490 00:17:45.490 Admin Command Set Attributes 00:17:45.490 ============================ 00:17:45.490 Security Send/Receive: Not Supported 00:17:45.490 Format NVM: Not Supported 00:17:45.490 Firmware Activate/Download: Not Supported 00:17:45.490 Namespace Management: Not Supported 00:17:45.490 Device Self-Test: Not Supported 00:17:45.490 Directives: Not Supported 00:17:45.490 NVMe-MI: Not Supported 00:17:45.490 Virtualization Management: Not Supported 00:17:45.490 Doorbell Buffer Config: Not Supported 00:17:45.490 Get LBA Status Capability: Not Supported 00:17:45.490 Command & Feature Lockdown Capability: Not Supported 00:17:45.490 Abort Command Limit: 1 00:17:45.490 Async Event Request Limit: 4 00:17:45.490 Number of Firmware Slots: N/A 00:17:45.490 Firmware Slot 1 Read-Only: N/A 00:17:45.490 Firm[2024-10-07 11:28:27.158489] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:45.490 [2024-10-07 11:28:27.158521] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:45.490 [2024-10-07 11:28:27.158527] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:45.490 [2024-10-07 11:28:27.158532] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x18ec600) on tqpair=0x18c58f0 00:17:45.490 ware Activation Without Reset: N/A 00:17:45.490 Multiple Update Detection Support: N/A 00:17:45.490 Firmware Update Granularity: No Information Provided 00:17:45.490 Per-Namespace SMART Log: No 00:17:45.490 Asymmetric Namespace Access Log Page: Not Supported 00:17:45.490 Subsystem NQN: nqn.2014-08.org.nvmexpress.discovery 00:17:45.490 Command Effects Log Page: Not Supported 00:17:45.490 Get Log Page Extended Data: Supported 00:17:45.490 Telemetry Log Pages: Not Supported 00:17:45.490 Persistent Event Log Pages: Not Supported 00:17:45.491 Supported Log Pages Log Page: May Support 00:17:45.491 Commands Supported & Effects Log Page: Not Supported 00:17:45.491 Feature Identifiers & Effects Log Page:May Support 00:17:45.491 NVMe-MI Commands & Effects Log Page: May Support 00:17:45.491 Data Area 4 for Telemetry Log: Not Supported 00:17:45.491 Error Log Page Entries Supported: 128 00:17:45.491 Keep Alive: Not Supported 00:17:45.491 00:17:45.491 NVM Command Set Attributes 00:17:45.491 ========================== 00:17:45.491 Submission Queue Entry Size 00:17:45.491 Max: 1 00:17:45.491 Min: 1 00:17:45.491 Completion Queue Entry Size 00:17:45.491 Max: 1 00:17:45.491 Min: 1 00:17:45.491 Number of Namespaces: 0 00:17:45.491 Compare Command: Not Supported 00:17:45.491 Write Uncorrectable Command: Not Supported 00:17:45.491 Dataset Management Command: Not Supported 00:17:45.491 Write Zeroes Command: Not Supported 00:17:45.491 Set Features Save Field: Not Supported 00:17:45.491 Reservations: Not Supported 00:17:45.491 Timestamp: Not Supported 00:17:45.491 Copy: Not Supported 00:17:45.491 Volatile Write Cache: Not Present 00:17:45.491 Atomic Write Unit (Normal): 1 00:17:45.491 Atomic Write Unit (PFail): 1 00:17:45.491 Atomic Compare & Write Unit: 1 00:17:45.491 Fused Compare & Write: Supported 00:17:45.491 Scatter-Gather List 00:17:45.491 SGL Command Set: Supported 00:17:45.491 SGL Keyed: Supported 00:17:45.491 SGL Bit Bucket Descriptor: Not Supported 00:17:45.491 SGL Metadata Pointer: Not Supported 00:17:45.491 Oversized SGL: Not Supported 00:17:45.491 SGL Metadata Address: Not Supported 00:17:45.491 SGL Offset: Supported 00:17:45.491 Transport SGL Data Block: Not Supported 00:17:45.491 Replay Protected Memory Block: Not Supported 00:17:45.491 00:17:45.491 Firmware Slot Information 00:17:45.491 ========================= 00:17:45.491 Active slot: 0 00:17:45.491 00:17:45.491 00:17:45.491 Error Log 00:17:45.491 ========= 00:17:45.491 00:17:45.491 Active Namespaces 00:17:45.491 ================= 00:17:45.491 Discovery Log Page 00:17:45.491 ================== 00:17:45.491 Generation Counter: 2 00:17:45.491 Number of Records: 2 00:17:45.491 Record Format: 0 00:17:45.491 00:17:45.491 Discovery Log Entry 0 00:17:45.491 ---------------------- 00:17:45.491 Transport Type: 3 (TCP) 00:17:45.491 Address Family: 1 (IPv4) 00:17:45.491 Subsystem Type: 3 (Current Discovery Subsystem) 00:17:45.491 Entry Flags: 00:17:45.491 Duplicate Returned Information: 1 00:17:45.491 Explicit Persistent Connection Support for Discovery: 1 00:17:45.491 Transport Requirements: 00:17:45.491 Secure Channel: Not Required 00:17:45.491 Port ID: 0 (0x0000) 00:17:45.491 Controller ID: 65535 (0xffff) 00:17:45.491 Admin Max SQ Size: 128 00:17:45.491 Transport Service Identifier: 4420 00:17:45.491 NVM Subsystem Qualified Name: nqn.2014-08.org.nvmexpress.discovery 00:17:45.491 Transport Address: 10.0.0.3 00:17:45.491 Discovery Log Entry 1 00:17:45.491 ---------------------- 00:17:45.491 Transport Type: 3 (TCP) 00:17:45.491 Address Family: 1 (IPv4) 00:17:45.491 Subsystem Type: 2 (NVM Subsystem) 00:17:45.491 Entry Flags: 00:17:45.491 Duplicate Returned Information: 0 00:17:45.491 Explicit Persistent Connection Support for Discovery: 0 00:17:45.491 Transport Requirements: 00:17:45.491 Secure Channel: Not Required 00:17:45.491 Port ID: 0 (0x0000) 00:17:45.491 Controller ID: 65535 (0xffff) 00:17:45.491 Admin Max SQ Size: 128 00:17:45.491 Transport Service Identifier: 4420 00:17:45.491 NVM Subsystem Qualified Name: nqn.2016-06.io.spdk:cnode1 00:17:45.491 Transport Address: 10.0.0.3 [2024-10-07 11:28:27.158652] nvme_ctrlr.c:4386:nvme_ctrlr_destruct_async: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Prepare to destruct SSD 00:17:45.491 [2024-10-07 11:28:27.158667] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x18ec000) on tqpair=0x18c58f0 00:17:45.491 [2024-10-07 11:28:27.158676] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:45.491 [2024-10-07 11:28:27.158683] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x18ec180) on tqpair=0x18c58f0 00:17:45.491 [2024-10-07 11:28:27.158688] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:45.491 [2024-10-07 11:28:27.158694] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x18ec300) on tqpair=0x18c58f0 00:17:45.491 [2024-10-07 11:28:27.158699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:45.491 [2024-10-07 11:28:27.158704] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x18ec480) on tqpair=0x18c58f0 00:17:45.491 [2024-10-07 11:28:27.158709] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:45.491 [2024-10-07 11:28:27.158721] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:45.491 [2024-10-07 11:28:27.158726] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:45.491 [2024-10-07 11:28:27.158730] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x18c58f0) 00:17:45.491 [2024-10-07 11:28:27.158739] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:45.491 [2024-10-07 11:28:27.158768] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x18ec480, cid 3, qid 0 00:17:45.491 [2024-10-07 11:28:27.158838] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:45.491 [2024-10-07 11:28:27.158851] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:45.491 [2024-10-07 11:28:27.158858] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:45.491 [2024-10-07 11:28:27.158865] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x18ec480) on tqpair=0x18c58f0 00:17:45.491 [2024-10-07 11:28:27.158875] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:45.491 [2024-10-07 11:28:27.158880] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:45.491 [2024-10-07 11:28:27.158884] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x18c58f0) 00:17:45.491 [2024-10-07 11:28:27.158892] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:45.491 [2024-10-07 11:28:27.158921] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x18ec480, cid 3, qid 0 00:17:45.491 [2024-10-07 11:28:27.158997] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:45.491 [2024-10-07 11:28:27.159004] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:45.491 [2024-10-07 11:28:27.159008] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:45.491 [2024-10-07 11:28:27.159012] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x18ec480) on tqpair=0x18c58f0 00:17:45.491 [2024-10-07 11:28:27.159018] nvme_ctrlr.c:1147:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] RTD3E = 0 us 00:17:45.491 [2024-10-07 11:28:27.159032] nvme_ctrlr.c:1150:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] shutdown timeout = 10000 ms 00:17:45.491 [2024-10-07 11:28:27.159043] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:45.491 [2024-10-07 11:28:27.159048] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:45.491 [2024-10-07 11:28:27.159052] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x18c58f0) 00:17:45.491 [2024-10-07 11:28:27.159059] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:45.491 [2024-10-07 11:28:27.159079] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x18ec480, cid 3, qid 0 00:17:45.491 [2024-10-07 11:28:27.159134] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:45.491 [2024-10-07 11:28:27.159140] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:45.491 [2024-10-07 11:28:27.159144] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:45.491 [2024-10-07 11:28:27.159149] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x18ec480) on tqpair=0x18c58f0 00:17:45.491 [2024-10-07 11:28:27.159160] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:45.491 [2024-10-07 11:28:27.159165] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:45.491 [2024-10-07 11:28:27.159169] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x18c58f0) 00:17:45.491 [2024-10-07 11:28:27.159177] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:45.491 [2024-10-07 11:28:27.159195] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x18ec480, cid 3, qid 0 00:17:45.491 [2024-10-07 11:28:27.159249] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:45.491 [2024-10-07 11:28:27.159257] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:45.491 [2024-10-07 11:28:27.159260] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:45.491 [2024-10-07 11:28:27.159265] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x18ec480) on tqpair=0x18c58f0 00:17:45.491 [2024-10-07 11:28:27.159275] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:45.491 [2024-10-07 11:28:27.159280] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:45.491 [2024-10-07 11:28:27.159284] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x18c58f0) 00:17:45.491 [2024-10-07 11:28:27.159292] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:45.491 [2024-10-07 11:28:27.159310] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x18ec480, cid 3, qid 0 00:17:45.491 [2024-10-07 11:28:27.159361] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:45.491 [2024-10-07 11:28:27.159368] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:45.491 [2024-10-07 11:28:27.159372] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:45.491 [2024-10-07 11:28:27.159376] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x18ec480) on tqpair=0x18c58f0 00:17:45.491 [2024-10-07 11:28:27.159386] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:45.491 [2024-10-07 11:28:27.159391] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:45.491 [2024-10-07 11:28:27.159395] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x18c58f0) 00:17:45.491 [2024-10-07 11:28:27.159403] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:45.491 [2024-10-07 11:28:27.159438] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x18ec480, cid 3, qid 0 00:17:45.492 [2024-10-07 11:28:27.159495] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:45.492 [2024-10-07 11:28:27.159502] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:45.492 [2024-10-07 11:28:27.159506] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:45.492 [2024-10-07 11:28:27.159510] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x18ec480) on tqpair=0x18c58f0 00:17:45.492 [2024-10-07 11:28:27.159522] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:45.492 [2024-10-07 11:28:27.159527] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:45.492 [2024-10-07 11:28:27.159530] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x18c58f0) 00:17:45.492 [2024-10-07 11:28:27.159538] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:45.492 [2024-10-07 11:28:27.159558] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x18ec480, cid 3, qid 0 00:17:45.492 [2024-10-07 11:28:27.159609] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:45.492 [2024-10-07 11:28:27.159616] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:45.492 [2024-10-07 11:28:27.159620] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:45.492 [2024-10-07 11:28:27.159624] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x18ec480) on tqpair=0x18c58f0 00:17:45.492 [2024-10-07 11:28:27.159635] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:45.492 [2024-10-07 11:28:27.159640] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:45.492 [2024-10-07 11:28:27.159644] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x18c58f0) 00:17:45.492 [2024-10-07 11:28:27.159651] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:45.492 [2024-10-07 11:28:27.159670] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x18ec480, cid 3, qid 0 00:17:45.492 [2024-10-07 11:28:27.159729] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:45.492 [2024-10-07 11:28:27.159736] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:45.492 [2024-10-07 11:28:27.159740] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:45.492 [2024-10-07 11:28:27.159744] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x18ec480) on tqpair=0x18c58f0 00:17:45.492 [2024-10-07 11:28:27.159755] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:45.492 [2024-10-07 11:28:27.159760] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:45.492 [2024-10-07 11:28:27.159764] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x18c58f0) 00:17:45.492 [2024-10-07 11:28:27.159772] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:45.492 [2024-10-07 11:28:27.159790] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x18ec480, cid 3, qid 0 00:17:45.492 [2024-10-07 11:28:27.159845] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:45.492 [2024-10-07 11:28:27.159854] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:45.492 [2024-10-07 11:28:27.159858] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:45.492 [2024-10-07 11:28:27.159862] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x18ec480) on tqpair=0x18c58f0 00:17:45.492 [2024-10-07 11:28:27.159874] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:45.492 [2024-10-07 11:28:27.159879] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:45.492 [2024-10-07 11:28:27.159883] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x18c58f0) 00:17:45.492 [2024-10-07 11:28:27.159891] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:45.492 [2024-10-07 11:28:27.159912] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x18ec480, cid 3, qid 0 00:17:45.492 [2024-10-07 11:28:27.159963] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:45.492 [2024-10-07 11:28:27.159970] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:45.492 [2024-10-07 11:28:27.159974] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:45.492 [2024-10-07 11:28:27.159978] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x18ec480) on tqpair=0x18c58f0 00:17:45.492 [2024-10-07 11:28:27.159989] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:45.492 [2024-10-07 11:28:27.159994] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:45.492 [2024-10-07 11:28:27.159998] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x18c58f0) 00:17:45.492 [2024-10-07 11:28:27.160005] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:45.492 [2024-10-07 11:28:27.160024] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x18ec480, cid 3, qid 0 00:17:45.492 [2024-10-07 11:28:27.160075] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:45.492 [2024-10-07 11:28:27.160082] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:45.492 [2024-10-07 11:28:27.160086] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:45.492 [2024-10-07 11:28:27.160090] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x18ec480) on tqpair=0x18c58f0 00:17:45.492 [2024-10-07 11:28:27.160101] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:45.492 [2024-10-07 11:28:27.160106] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:45.492 [2024-10-07 11:28:27.160110] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x18c58f0) 00:17:45.492 [2024-10-07 11:28:27.160117] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:45.492 [2024-10-07 11:28:27.160144] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x18ec480, cid 3, qid 0 00:17:45.492 [2024-10-07 11:28:27.160195] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:45.492 [2024-10-07 11:28:27.160202] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:45.492 [2024-10-07 11:28:27.160206] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:45.492 [2024-10-07 11:28:27.160210] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x18ec480) on tqpair=0x18c58f0 00:17:45.492 [2024-10-07 11:28:27.160221] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:45.492 [2024-10-07 11:28:27.160226] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:45.492 [2024-10-07 11:28:27.160230] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x18c58f0) 00:17:45.492 [2024-10-07 11:28:27.160238] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:45.492 [2024-10-07 11:28:27.160256] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x18ec480, cid 3, qid 0 00:17:45.492 [2024-10-07 11:28:27.160319] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:45.492 [2024-10-07 11:28:27.160326] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:45.492 [2024-10-07 11:28:27.160330] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:45.492 [2024-10-07 11:28:27.160334] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x18ec480) on tqpair=0x18c58f0 00:17:45.492 [2024-10-07 11:28:27.160345] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:45.492 [2024-10-07 11:28:27.160350] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:45.492 [2024-10-07 11:28:27.160354] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x18c58f0) 00:17:45.492 [2024-10-07 11:28:27.160361] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:45.492 [2024-10-07 11:28:27.160380] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x18ec480, cid 3, qid 0 00:17:45.492 [2024-10-07 11:28:27.160462] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:45.492 [2024-10-07 11:28:27.160471] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:45.492 [2024-10-07 11:28:27.160475] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:45.492 [2024-10-07 11:28:27.160479] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x18ec480) on tqpair=0x18c58f0 00:17:45.492 [2024-10-07 11:28:27.160491] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:45.492 [2024-10-07 11:28:27.160496] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:45.492 [2024-10-07 11:28:27.160500] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x18c58f0) 00:17:45.492 [2024-10-07 11:28:27.160507] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:45.492 [2024-10-07 11:28:27.160529] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x18ec480, cid 3, qid 0 00:17:45.492 [2024-10-07 11:28:27.160581] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:45.492 [2024-10-07 11:28:27.160588] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:45.492 [2024-10-07 11:28:27.160592] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:45.492 [2024-10-07 11:28:27.160596] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x18ec480) on tqpair=0x18c58f0 00:17:45.492 [2024-10-07 11:28:27.160607] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:45.492 [2024-10-07 11:28:27.160612] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:45.492 [2024-10-07 11:28:27.160616] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x18c58f0) 00:17:45.492 [2024-10-07 11:28:27.160623] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:45.492 [2024-10-07 11:28:27.160641] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x18ec480, cid 3, qid 0 00:17:45.492 [2024-10-07 11:28:27.160698] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:45.492 [2024-10-07 11:28:27.160707] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:45.492 [2024-10-07 11:28:27.160711] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:45.492 [2024-10-07 11:28:27.160715] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x18ec480) on tqpair=0x18c58f0 00:17:45.492 [2024-10-07 11:28:27.160726] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:45.493 [2024-10-07 11:28:27.160731] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:45.493 [2024-10-07 11:28:27.160735] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x18c58f0) 00:17:45.493 [2024-10-07 11:28:27.160743] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:45.493 [2024-10-07 11:28:27.160761] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x18ec480, cid 3, qid 0 00:17:45.493 [2024-10-07 11:28:27.160814] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:45.493 [2024-10-07 11:28:27.160821] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:45.493 [2024-10-07 11:28:27.160824] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:45.493 [2024-10-07 11:28:27.160829] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x18ec480) on tqpair=0x18c58f0 00:17:45.493 [2024-10-07 11:28:27.160839] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:45.493 [2024-10-07 11:28:27.160844] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:45.493 [2024-10-07 11:28:27.160848] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x18c58f0) 00:17:45.493 [2024-10-07 11:28:27.160855] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:45.493 [2024-10-07 11:28:27.160874] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x18ec480, cid 3, qid 0 00:17:45.493 [2024-10-07 11:28:27.160926] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:45.493 [2024-10-07 11:28:27.160933] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:45.493 [2024-10-07 11:28:27.160937] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:45.493 [2024-10-07 11:28:27.160941] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x18ec480) on tqpair=0x18c58f0 00:17:45.493 [2024-10-07 11:28:27.160952] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:45.493 [2024-10-07 11:28:27.160957] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:45.493 [2024-10-07 11:28:27.160961] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x18c58f0) 00:17:45.493 [2024-10-07 11:28:27.160968] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:45.493 [2024-10-07 11:28:27.160987] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x18ec480, cid 3, qid 0 00:17:45.493 [2024-10-07 11:28:27.161040] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:45.493 [2024-10-07 11:28:27.161047] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:45.493 [2024-10-07 11:28:27.161051] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:45.493 [2024-10-07 11:28:27.161055] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x18ec480) on tqpair=0x18c58f0 00:17:45.493 [2024-10-07 11:28:27.161065] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:45.493 [2024-10-07 11:28:27.161070] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:45.493 [2024-10-07 11:28:27.161075] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x18c58f0) 00:17:45.493 [2024-10-07 11:28:27.161082] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:45.493 [2024-10-07 11:28:27.161101] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x18ec480, cid 3, qid 0 00:17:45.493 [2024-10-07 11:28:27.161157] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:45.493 [2024-10-07 11:28:27.161164] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:45.493 [2024-10-07 11:28:27.161168] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:45.493 [2024-10-07 11:28:27.161172] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x18ec480) on tqpair=0x18c58f0 00:17:45.493 [2024-10-07 11:28:27.161183] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:45.493 [2024-10-07 11:28:27.161188] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:45.493 [2024-10-07 11:28:27.161192] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x18c58f0) 00:17:45.493 [2024-10-07 11:28:27.161200] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:45.493 [2024-10-07 11:28:27.161218] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x18ec480, cid 3, qid 0 00:17:45.493 [2024-10-07 11:28:27.161279] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:45.493 [2024-10-07 11:28:27.161286] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:45.493 [2024-10-07 11:28:27.161290] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:45.493 [2024-10-07 11:28:27.161294] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x18ec480) on tqpair=0x18c58f0 00:17:45.493 [2024-10-07 11:28:27.161305] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:45.493 [2024-10-07 11:28:27.161310] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:45.493 [2024-10-07 11:28:27.161313] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x18c58f0) 00:17:45.493 [2024-10-07 11:28:27.161321] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:45.493 [2024-10-07 11:28:27.161339] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x18ec480, cid 3, qid 0 00:17:45.493 [2024-10-07 11:28:27.161390] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:45.493 [2024-10-07 11:28:27.161397] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:45.493 [2024-10-07 11:28:27.161401] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:45.493 [2024-10-07 11:28:27.161405] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x18ec480) on tqpair=0x18c58f0 00:17:45.493 [2024-10-07 11:28:27.161432] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:45.493 [2024-10-07 11:28:27.161439] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:45.493 [2024-10-07 11:28:27.161443] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x18c58f0) 00:17:45.493 [2024-10-07 11:28:27.161451] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:45.493 [2024-10-07 11:28:27.161472] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x18ec480, cid 3, qid 0 00:17:45.493 [2024-10-07 11:28:27.161534] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:45.493 [2024-10-07 11:28:27.161540] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:45.493 [2024-10-07 11:28:27.161544] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:45.493 [2024-10-07 11:28:27.161548] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x18ec480) on tqpair=0x18c58f0 00:17:45.493 [2024-10-07 11:28:27.161559] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:45.493 [2024-10-07 11:28:27.161565] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:45.493 [2024-10-07 11:28:27.161568] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x18c58f0) 00:17:45.493 [2024-10-07 11:28:27.161576] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:45.493 [2024-10-07 11:28:27.161594] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x18ec480, cid 3, qid 0 00:17:45.493 [2024-10-07 11:28:27.161668] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:45.493 [2024-10-07 11:28:27.161675] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:45.493 [2024-10-07 11:28:27.161679] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:45.493 [2024-10-07 11:28:27.161683] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x18ec480) on tqpair=0x18c58f0 00:17:45.493 [2024-10-07 11:28:27.161694] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:45.493 [2024-10-07 11:28:27.161699] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:45.493 [2024-10-07 11:28:27.161703] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x18c58f0) 00:17:45.493 [2024-10-07 11:28:27.161711] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:45.493 [2024-10-07 11:28:27.161729] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x18ec480, cid 3, qid 0 00:17:45.493 [2024-10-07 11:28:27.161782] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:45.493 [2024-10-07 11:28:27.161788] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:45.493 [2024-10-07 11:28:27.161792] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:45.493 [2024-10-07 11:28:27.161796] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x18ec480) on tqpair=0x18c58f0 00:17:45.493 [2024-10-07 11:28:27.161807] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:45.493 [2024-10-07 11:28:27.161813] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:45.493 [2024-10-07 11:28:27.161817] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x18c58f0) 00:17:45.493 [2024-10-07 11:28:27.161824] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:45.493 [2024-10-07 11:28:27.161843] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x18ec480, cid 3, qid 0 00:17:45.493 [2024-10-07 11:28:27.161903] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:45.493 [2024-10-07 11:28:27.161912] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:45.493 [2024-10-07 11:28:27.161916] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:45.493 [2024-10-07 11:28:27.161920] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x18ec480) on tqpair=0x18c58f0 00:17:45.493 [2024-10-07 11:28:27.161931] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:45.493 [2024-10-07 11:28:27.161936] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:45.493 [2024-10-07 11:28:27.161940] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x18c58f0) 00:17:45.493 [2024-10-07 11:28:27.161959] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:45.493 [2024-10-07 11:28:27.161981] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x18ec480, cid 3, qid 0 00:17:45.493 [2024-10-07 11:28:27.162040] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:45.493 [2024-10-07 11:28:27.162047] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:45.493 [2024-10-07 11:28:27.162051] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:45.493 [2024-10-07 11:28:27.162055] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x18ec480) on tqpair=0x18c58f0 00:17:45.493 [2024-10-07 11:28:27.162066] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:45.493 [2024-10-07 11:28:27.162071] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:45.493 [2024-10-07 11:28:27.162075] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x18c58f0) 00:17:45.493 [2024-10-07 11:28:27.162082] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:45.493 [2024-10-07 11:28:27.162101] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x18ec480, cid 3, qid 0 00:17:45.493 [2024-10-07 11:28:27.162161] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:45.493 [2024-10-07 11:28:27.162167] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:45.493 [2024-10-07 11:28:27.162171] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:45.493 [2024-10-07 11:28:27.162175] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x18ec480) on tqpair=0x18c58f0 00:17:45.493 [2024-10-07 11:28:27.162186] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:45.493 [2024-10-07 11:28:27.162191] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:45.493 [2024-10-07 11:28:27.162195] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x18c58f0) 00:17:45.493 [2024-10-07 11:28:27.162202] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:45.493 [2024-10-07 11:28:27.162221] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x18ec480, cid 3, qid 0 00:17:45.494 [2024-10-07 11:28:27.162274] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:45.494 [2024-10-07 11:28:27.162281] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:45.494 [2024-10-07 11:28:27.162285] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:45.494 [2024-10-07 11:28:27.162289] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x18ec480) on tqpair=0x18c58f0 00:17:45.494 [2024-10-07 11:28:27.162299] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:45.494 [2024-10-07 11:28:27.162304] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:45.494 [2024-10-07 11:28:27.162308] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x18c58f0) 00:17:45.494 [2024-10-07 11:28:27.162316] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:45.494 [2024-10-07 11:28:27.162334] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x18ec480, cid 3, qid 0 00:17:45.494 [2024-10-07 11:28:27.162390] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:45.494 [2024-10-07 11:28:27.162397] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:45.494 [2024-10-07 11:28:27.162401] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:45.494 [2024-10-07 11:28:27.162405] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x18ec480) on tqpair=0x18c58f0 00:17:45.494 [2024-10-07 11:28:27.166435] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:45.494 [2024-10-07 11:28:27.166457] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:45.494 [2024-10-07 11:28:27.166462] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x18c58f0) 00:17:45.494 [2024-10-07 11:28:27.166472] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:45.494 [2024-10-07 11:28:27.166500] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x18ec480, cid 3, qid 0 00:17:45.494 [2024-10-07 11:28:27.166569] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:45.494 [2024-10-07 11:28:27.166577] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:45.494 [2024-10-07 11:28:27.166581] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:45.494 [2024-10-07 11:28:27.166585] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x18ec480) on tqpair=0x18c58f0 00:17:45.494 [2024-10-07 11:28:27.166594] nvme_ctrlr.c:1269:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] shutdown complete in 7 milliseconds 00:17:45.494 00:17:45.494 11:28:27 nvmf_tcp.nvmf_host.nvmf_identify -- host/identify.sh@45 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.3 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -L all 00:17:45.754 [2024-10-07 11:28:27.208837] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:17:45.754 [2024-10-07 11:28:27.208889] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid87749 ] 00:17:45.754 [2024-10-07 11:28:27.345992] nvme_ctrlr.c:1563:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to connect adminq (no timeout) 00:17:45.754 [2024-10-07 11:28:27.346061] nvme_tcp.c:2349:nvme_tcp_qpair_connect_sock: *DEBUG*: adrfam 1 ai_family 2 00:17:45.754 [2024-10-07 11:28:27.346069] nvme_tcp.c:2353:nvme_tcp_qpair_connect_sock: *DEBUG*: trsvcid is 4420 00:17:45.754 [2024-10-07 11:28:27.346084] nvme_tcp.c:2374:nvme_tcp_qpair_connect_sock: *DEBUG*: sock_impl_name is (null) 00:17:45.754 [2024-10-07 11:28:27.346096] sock.c: 373:spdk_sock_connect_ext: *DEBUG*: Creating a client socket using impl posix 00:17:45.754 [2024-10-07 11:28:27.349583] nvme_ctrlr.c:1563:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for connect adminq (no timeout) 00:17:45.754 [2024-10-07 11:28:27.349677] nvme_tcp.c:1566:nvme_tcp_send_icreq_complete: *DEBUG*: Complete the icreq send for tqpair=0x5888f0 0 00:17:45.754 [2024-10-07 11:28:27.357435] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 1 00:17:45.754 [2024-10-07 11:28:27.357475] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =1 00:17:45.754 [2024-10-07 11:28:27.357482] nvme_tcp.c:1612:nvme_tcp_icresp_handle: *DEBUG*: host_hdgst_enable: 0 00:17:45.754 [2024-10-07 11:28:27.357485] nvme_tcp.c:1613:nvme_tcp_icresp_handle: *DEBUG*: host_ddgst_enable: 0 00:17:45.754 [2024-10-07 11:28:27.357523] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:45.754 [2024-10-07 11:28:27.357531] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:45.754 [2024-10-07 11:28:27.357536] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x5888f0) 00:17:45.754 [2024-10-07 11:28:27.357551] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x400 00:17:45.754 [2024-10-07 11:28:27.357586] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x5af000, cid 0, qid 0 00:17:45.754 [2024-10-07 11:28:27.365478] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:45.754 [2024-10-07 11:28:27.365504] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:45.754 [2024-10-07 11:28:27.365509] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:45.754 [2024-10-07 11:28:27.365515] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x5af000) on tqpair=0x5888f0 00:17:45.754 [2024-10-07 11:28:27.365526] nvme_fabric.c: 621:nvme_fabric_qpair_connect_poll: *DEBUG*: CNTLID 0x0001 00:17:45.754 [2024-10-07 11:28:27.365535] nvme_ctrlr.c:1563:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read vs (no timeout) 00:17:45.754 [2024-10-07 11:28:27.365542] nvme_ctrlr.c:1563:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read vs wait for vs (no timeout) 00:17:45.754 [2024-10-07 11:28:27.365560] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:45.754 [2024-10-07 11:28:27.365566] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:45.754 [2024-10-07 11:28:27.365570] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x5888f0) 00:17:45.754 [2024-10-07 11:28:27.365580] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:45.754 [2024-10-07 11:28:27.365612] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x5af000, cid 0, qid 0 00:17:45.755 [2024-10-07 11:28:27.365692] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:45.755 [2024-10-07 11:28:27.365700] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:45.755 [2024-10-07 11:28:27.365704] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:45.755 [2024-10-07 11:28:27.365708] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x5af000) on tqpair=0x5888f0 00:17:45.755 [2024-10-07 11:28:27.365715] nvme_ctrlr.c:1563:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read cap (no timeout) 00:17:45.755 [2024-10-07 11:28:27.365723] nvme_ctrlr.c:1563:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read cap wait for cap (no timeout) 00:17:45.755 [2024-10-07 11:28:27.365731] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:45.755 [2024-10-07 11:28:27.365735] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:45.755 [2024-10-07 11:28:27.365739] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x5888f0) 00:17:45.755 [2024-10-07 11:28:27.365748] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:45.755 [2024-10-07 11:28:27.365769] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x5af000, cid 0, qid 0 00:17:45.755 [2024-10-07 11:28:27.365830] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:45.755 [2024-10-07 11:28:27.365839] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:45.755 [2024-10-07 11:28:27.365843] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:45.755 [2024-10-07 11:28:27.365847] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x5af000) on tqpair=0x5888f0 00:17:45.755 [2024-10-07 11:28:27.365854] nvme_ctrlr.c:1563:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to check en (no timeout) 00:17:45.755 [2024-10-07 11:28:27.365863] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to check en wait for cc (timeout 15000 ms) 00:17:45.755 [2024-10-07 11:28:27.365871] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:45.755 [2024-10-07 11:28:27.365875] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:45.755 [2024-10-07 11:28:27.365879] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x5888f0) 00:17:45.755 [2024-10-07 11:28:27.365887] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:45.755 [2024-10-07 11:28:27.365907] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x5af000, cid 0, qid 0 00:17:45.755 [2024-10-07 11:28:27.365972] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:45.755 [2024-10-07 11:28:27.365989] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:45.755 [2024-10-07 11:28:27.365993] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:45.755 [2024-10-07 11:28:27.365997] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x5af000) on tqpair=0x5888f0 00:17:45.755 [2024-10-07 11:28:27.366003] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:17:45.755 [2024-10-07 11:28:27.366014] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:45.755 [2024-10-07 11:28:27.366020] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:45.755 [2024-10-07 11:28:27.366023] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x5888f0) 00:17:45.755 [2024-10-07 11:28:27.366031] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:45.755 [2024-10-07 11:28:27.366052] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x5af000, cid 0, qid 0 00:17:45.755 [2024-10-07 11:28:27.366106] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:45.755 [2024-10-07 11:28:27.366114] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:45.755 [2024-10-07 11:28:27.366118] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:45.755 [2024-10-07 11:28:27.366122] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x5af000) on tqpair=0x5888f0 00:17:45.755 [2024-10-07 11:28:27.366127] nvme_ctrlr.c:3893:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CC.EN = 0 && CSTS.RDY = 0 00:17:45.755 [2024-10-07 11:28:27.366133] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to controller is disabled (timeout 15000 ms) 00:17:45.755 [2024-10-07 11:28:27.366141] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:17:45.755 [2024-10-07 11:28:27.366248] nvme_ctrlr.c:4091:nvme_ctrlr_process_init: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Setting CC.EN = 1 00:17:45.755 [2024-10-07 11:28:27.366253] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:17:45.755 [2024-10-07 11:28:27.366263] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:45.755 [2024-10-07 11:28:27.366267] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:45.755 [2024-10-07 11:28:27.366271] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x5888f0) 00:17:45.755 [2024-10-07 11:28:27.366279] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:45.755 [2024-10-07 11:28:27.366299] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x5af000, cid 0, qid 0 00:17:45.755 [2024-10-07 11:28:27.366365] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:45.755 [2024-10-07 11:28:27.366373] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:45.755 [2024-10-07 11:28:27.366377] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:45.755 [2024-10-07 11:28:27.366381] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x5af000) on tqpair=0x5888f0 00:17:45.755 [2024-10-07 11:28:27.366386] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:17:45.755 [2024-10-07 11:28:27.366397] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:45.755 [2024-10-07 11:28:27.366402] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:45.755 [2024-10-07 11:28:27.366406] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x5888f0) 00:17:45.755 [2024-10-07 11:28:27.366427] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:45.755 [2024-10-07 11:28:27.366451] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x5af000, cid 0, qid 0 00:17:45.755 [2024-10-07 11:28:27.366510] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:45.755 [2024-10-07 11:28:27.366517] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:45.755 [2024-10-07 11:28:27.366521] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:45.755 [2024-10-07 11:28:27.366525] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x5af000) on tqpair=0x5888f0 00:17:45.755 [2024-10-07 11:28:27.366530] nvme_ctrlr.c:3928:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:17:45.755 [2024-10-07 11:28:27.366546] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to reset admin queue (timeout 30000 ms) 00:17:45.755 [2024-10-07 11:28:27.366554] nvme_ctrlr.c:1563:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify controller (no timeout) 00:17:45.755 [2024-10-07 11:28:27.366572] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify controller (timeout 30000 ms) 00:17:45.755 [2024-10-07 11:28:27.366583] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:45.755 [2024-10-07 11:28:27.366588] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x5888f0) 00:17:45.755 [2024-10-07 11:28:27.366596] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:45.755 [2024-10-07 11:28:27.366617] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x5af000, cid 0, qid 0 00:17:45.755 [2024-10-07 11:28:27.366733] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:17:45.755 [2024-10-07 11:28:27.366741] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:17:45.755 [2024-10-07 11:28:27.366745] nvme_tcp.c:1730:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:17:45.755 [2024-10-07 11:28:27.366749] nvme_tcp.c:1731:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x5888f0): datao=0, datal=4096, cccid=0 00:17:45.755 [2024-10-07 11:28:27.366754] nvme_tcp.c:1742:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x5af000) on tqpair(0x5888f0): expected_datao=0, payload_size=4096 00:17:45.755 [2024-10-07 11:28:27.366759] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:45.755 [2024-10-07 11:28:27.366768] nvme_tcp.c:1532:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:17:45.755 [2024-10-07 11:28:27.366772] nvme_tcp.c:1323:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:17:45.755 [2024-10-07 11:28:27.366781] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:45.755 [2024-10-07 11:28:27.366788] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:45.755 [2024-10-07 11:28:27.366791] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:45.755 [2024-10-07 11:28:27.366796] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x5af000) on tqpair=0x5888f0 00:17:45.755 [2024-10-07 11:28:27.366805] nvme_ctrlr.c:2077:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] transport max_xfer_size 4294967295 00:17:45.755 [2024-10-07 11:28:27.366811] nvme_ctrlr.c:2081:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] MDTS max_xfer_size 131072 00:17:45.755 [2024-10-07 11:28:27.366816] nvme_ctrlr.c:2084:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CNTLID 0x0001 00:17:45.755 [2024-10-07 11:28:27.366821] nvme_ctrlr.c:2108:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] transport max_sges 16 00:17:45.755 [2024-10-07 11:28:27.366826] nvme_ctrlr.c:2123:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] fuses compare and write: 1 00:17:45.755 [2024-10-07 11:28:27.366832] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to configure AER (timeout 30000 ms) 00:17:45.755 [2024-10-07 11:28:27.366842] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for configure aer (timeout 30000 ms) 00:17:45.755 [2024-10-07 11:28:27.366855] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:45.755 [2024-10-07 11:28:27.366861] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:45.755 [2024-10-07 11:28:27.366865] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x5888f0) 00:17:45.755 [2024-10-07 11:28:27.366873] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:0 cdw10:0000000b SGL DATA BLOCK OFFSET 0x0 len:0x0 00:17:45.755 [2024-10-07 11:28:27.366896] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x5af000, cid 0, qid 0 00:17:45.755 [2024-10-07 11:28:27.366957] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:45.755 [2024-10-07 11:28:27.366964] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:45.755 [2024-10-07 11:28:27.366968] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:45.755 [2024-10-07 11:28:27.366972] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x5af000) on tqpair=0x5888f0 00:17:45.755 [2024-10-07 11:28:27.366981] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:45.755 [2024-10-07 11:28:27.366985] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:45.755 [2024-10-07 11:28:27.366989] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x5888f0) 00:17:45.755 [2024-10-07 11:28:27.366996] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:17:45.755 [2024-10-07 11:28:27.367003] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:45.755 [2024-10-07 11:28:27.367007] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:45.755 [2024-10-07 11:28:27.367011] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=1 on tqpair(0x5888f0) 00:17:45.755 [2024-10-07 11:28:27.367017] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:17:45.755 [2024-10-07 11:28:27.367024] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:45.756 [2024-10-07 11:28:27.367028] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:45.756 [2024-10-07 11:28:27.367032] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=2 on tqpair(0x5888f0) 00:17:45.756 [2024-10-07 11:28:27.367038] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:17:45.756 [2024-10-07 11:28:27.367044] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:45.756 [2024-10-07 11:28:27.367049] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:45.756 [2024-10-07 11:28:27.367052] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x5888f0) 00:17:45.756 [2024-10-07 11:28:27.367059] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:17:45.756 [2024-10-07 11:28:27.367064] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set keep alive timeout (timeout 30000 ms) 00:17:45.756 [2024-10-07 11:28:27.367078] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:17:45.756 [2024-10-07 11:28:27.367087] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:45.756 [2024-10-07 11:28:27.367091] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x5888f0) 00:17:45.756 [2024-10-07 11:28:27.367099] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:4 cdw10:0000000f SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:45.756 [2024-10-07 11:28:27.367121] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x5af000, cid 0, qid 0 00:17:45.756 [2024-10-07 11:28:27.367129] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x5af180, cid 1, qid 0 00:17:45.756 [2024-10-07 11:28:27.367134] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x5af300, cid 2, qid 0 00:17:45.756 [2024-10-07 11:28:27.367139] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x5af480, cid 3, qid 0 00:17:45.756 [2024-10-07 11:28:27.367144] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x5af600, cid 4, qid 0 00:17:45.756 [2024-10-07 11:28:27.367244] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:45.756 [2024-10-07 11:28:27.367251] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:45.756 [2024-10-07 11:28:27.367255] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:45.756 [2024-10-07 11:28:27.367259] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x5af600) on tqpair=0x5888f0 00:17:45.756 [2024-10-07 11:28:27.367266] nvme_ctrlr.c:3046:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Sending keep alive every 5000000 us 00:17:45.756 [2024-10-07 11:28:27.367272] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify controller iocs specific (timeout 30000 ms) 00:17:45.756 [2024-10-07 11:28:27.367285] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set number of queues (timeout 30000 ms) 00:17:45.756 [2024-10-07 11:28:27.367293] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for set number of queues (timeout 30000 ms) 00:17:45.756 [2024-10-07 11:28:27.367301] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:45.756 [2024-10-07 11:28:27.367306] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:45.756 [2024-10-07 11:28:27.367310] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x5888f0) 00:17:45.756 [2024-10-07 11:28:27.367317] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES NUMBER OF QUEUES cid:4 cdw10:00000007 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:17:45.756 [2024-10-07 11:28:27.367338] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x5af600, cid 4, qid 0 00:17:45.756 [2024-10-07 11:28:27.367398] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:45.756 [2024-10-07 11:28:27.367406] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:45.756 [2024-10-07 11:28:27.367423] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:45.756 [2024-10-07 11:28:27.367429] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x5af600) on tqpair=0x5888f0 00:17:45.756 [2024-10-07 11:28:27.367498] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify active ns (timeout 30000 ms) 00:17:45.756 [2024-10-07 11:28:27.367511] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify active ns (timeout 30000 ms) 00:17:45.756 [2024-10-07 11:28:27.367520] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:45.756 [2024-10-07 11:28:27.367524] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x5888f0) 00:17:45.756 [2024-10-07 11:28:27.367532] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:0 cdw10:00000002 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:45.756 [2024-10-07 11:28:27.367555] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x5af600, cid 4, qid 0 00:17:45.756 [2024-10-07 11:28:27.367631] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:17:45.756 [2024-10-07 11:28:27.367639] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:17:45.756 [2024-10-07 11:28:27.367643] nvme_tcp.c:1730:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:17:45.756 [2024-10-07 11:28:27.367647] nvme_tcp.c:1731:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x5888f0): datao=0, datal=4096, cccid=4 00:17:45.756 [2024-10-07 11:28:27.367653] nvme_tcp.c:1742:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x5af600) on tqpair(0x5888f0): expected_datao=0, payload_size=4096 00:17:45.756 [2024-10-07 11:28:27.367657] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:45.756 [2024-10-07 11:28:27.367665] nvme_tcp.c:1532:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:17:45.756 [2024-10-07 11:28:27.367670] nvme_tcp.c:1323:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:17:45.756 [2024-10-07 11:28:27.367678] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:45.756 [2024-10-07 11:28:27.367684] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:45.756 [2024-10-07 11:28:27.367688] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:45.756 [2024-10-07 11:28:27.367692] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x5af600) on tqpair=0x5888f0 00:17:45.756 [2024-10-07 11:28:27.367713] nvme_ctrlr.c:4722:spdk_nvme_ctrlr_get_ns: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Namespace 1 was added 00:17:45.756 [2024-10-07 11:28:27.367726] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify ns (timeout 30000 ms) 00:17:45.756 [2024-10-07 11:28:27.367737] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify ns (timeout 30000 ms) 00:17:45.756 [2024-10-07 11:28:27.367745] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:45.756 [2024-10-07 11:28:27.367750] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x5888f0) 00:17:45.756 [2024-10-07 11:28:27.367757] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:1 cdw10:00000000 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:45.756 [2024-10-07 11:28:27.367779] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x5af600, cid 4, qid 0 00:17:45.756 [2024-10-07 11:28:27.367897] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:17:45.756 [2024-10-07 11:28:27.367905] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:17:45.756 [2024-10-07 11:28:27.367908] nvme_tcp.c:1730:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:17:45.756 [2024-10-07 11:28:27.367912] nvme_tcp.c:1731:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x5888f0): datao=0, datal=4096, cccid=4 00:17:45.756 [2024-10-07 11:28:27.367917] nvme_tcp.c:1742:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x5af600) on tqpair(0x5888f0): expected_datao=0, payload_size=4096 00:17:45.756 [2024-10-07 11:28:27.367922] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:45.756 [2024-10-07 11:28:27.367929] nvme_tcp.c:1532:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:17:45.756 [2024-10-07 11:28:27.367934] nvme_tcp.c:1323:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:17:45.756 [2024-10-07 11:28:27.367942] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:45.756 [2024-10-07 11:28:27.367948] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:45.756 [2024-10-07 11:28:27.367952] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:45.756 [2024-10-07 11:28:27.367956] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x5af600) on tqpair=0x5888f0 00:17:45.756 [2024-10-07 11:28:27.367971] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify namespace id descriptors (timeout 30000 ms) 00:17:45.756 [2024-10-07 11:28:27.367982] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify namespace id descriptors (timeout 30000 ms) 00:17:45.756 [2024-10-07 11:28:27.367991] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:45.756 [2024-10-07 11:28:27.367995] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x5888f0) 00:17:45.756 [2024-10-07 11:28:27.368003] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:1 cdw10:00000003 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:45.756 [2024-10-07 11:28:27.368024] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x5af600, cid 4, qid 0 00:17:45.756 [2024-10-07 11:28:27.368099] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:17:45.756 [2024-10-07 11:28:27.368107] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:17:45.756 [2024-10-07 11:28:27.368110] nvme_tcp.c:1730:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:17:45.756 [2024-10-07 11:28:27.368114] nvme_tcp.c:1731:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x5888f0): datao=0, datal=4096, cccid=4 00:17:45.756 [2024-10-07 11:28:27.368119] nvme_tcp.c:1742:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x5af600) on tqpair(0x5888f0): expected_datao=0, payload_size=4096 00:17:45.756 [2024-10-07 11:28:27.368124] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:45.756 [2024-10-07 11:28:27.368131] nvme_tcp.c:1532:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:17:45.756 [2024-10-07 11:28:27.368135] nvme_tcp.c:1323:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:17:45.756 [2024-10-07 11:28:27.368144] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:45.756 [2024-10-07 11:28:27.368150] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:45.756 [2024-10-07 11:28:27.368154] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:45.756 [2024-10-07 11:28:27.368158] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x5af600) on tqpair=0x5888f0 00:17:45.756 [2024-10-07 11:28:27.368174] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify ns iocs specific (timeout 30000 ms) 00:17:45.756 [2024-10-07 11:28:27.368184] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set supported log pages (timeout 30000 ms) 00:17:45.756 [2024-10-07 11:28:27.368194] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set supported features (timeout 30000 ms) 00:17:45.756 [2024-10-07 11:28:27.368201] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set host behavior support feature (timeout 30000 ms) 00:17:45.756 [2024-10-07 11:28:27.368207] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set doorbell buffer config (timeout 30000 ms) 00:17:45.756 [2024-10-07 11:28:27.368213] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set host ID (timeout 30000 ms) 00:17:45.756 [2024-10-07 11:28:27.368219] nvme_ctrlr.c:3134:nvme_ctrlr_set_host_id: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] NVMe-oF transport - not sending Set Features - Host ID 00:17:45.756 [2024-10-07 11:28:27.368224] nvme_ctrlr.c:1557:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to transport ready (timeout 30000 ms) 00:17:45.756 [2024-10-07 11:28:27.368229] nvme_ctrlr.c:1563:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to ready (no timeout) 00:17:45.756 [2024-10-07 11:28:27.368249] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:45.756 [2024-10-07 11:28:27.368254] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x5888f0) 00:17:45.756 [2024-10-07 11:28:27.368261] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ARBITRATION cid:4 cdw10:00000001 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:45.756 [2024-10-07 11:28:27.368269] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:45.756 [2024-10-07 11:28:27.368273] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:45.757 [2024-10-07 11:28:27.368277] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x5888f0) 00:17:45.757 [2024-10-07 11:28:27.368284] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:5 nsid:0 cdw10:00000000 cdw11:00000000 00:17:45.757 [2024-10-07 11:28:27.368311] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x5af600, cid 4, qid 0 00:17:45.757 [2024-10-07 11:28:27.368324] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x5af780, cid 5, qid 0 00:17:45.757 [2024-10-07 11:28:27.368400] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:45.757 [2024-10-07 11:28:27.368408] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:45.757 [2024-10-07 11:28:27.368427] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:45.757 [2024-10-07 11:28:27.368432] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x5af600) on tqpair=0x5888f0 00:17:45.757 [2024-10-07 11:28:27.368440] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:45.757 [2024-10-07 11:28:27.368446] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:45.757 [2024-10-07 11:28:27.368450] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:45.757 [2024-10-07 11:28:27.368454] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x5af780) on tqpair=0x5888f0 00:17:45.757 [2024-10-07 11:28:27.368466] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:45.757 [2024-10-07 11:28:27.368470] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x5888f0) 00:17:45.757 [2024-10-07 11:28:27.368478] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES POWER MANAGEMENT cid:5 cdw10:00000002 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:45.757 [2024-10-07 11:28:27.368500] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x5af780, cid 5, qid 0 00:17:45.757 [2024-10-07 11:28:27.368565] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:45.757 [2024-10-07 11:28:27.368573] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:45.757 [2024-10-07 11:28:27.368576] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:45.757 [2024-10-07 11:28:27.368581] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x5af780) on tqpair=0x5888f0 00:17:45.757 [2024-10-07 11:28:27.368592] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:45.757 [2024-10-07 11:28:27.368596] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x5888f0) 00:17:45.757 [2024-10-07 11:28:27.368604] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES TEMPERATURE THRESHOLD cid:5 cdw10:00000004 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:45.757 [2024-10-07 11:28:27.368623] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x5af780, cid 5, qid 0 00:17:45.757 [2024-10-07 11:28:27.368688] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:45.757 [2024-10-07 11:28:27.368697] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:45.757 [2024-10-07 11:28:27.368701] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:45.757 [2024-10-07 11:28:27.368705] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x5af780) on tqpair=0x5888f0 00:17:45.757 [2024-10-07 11:28:27.368717] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:45.757 [2024-10-07 11:28:27.368721] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x5888f0) 00:17:45.757 [2024-10-07 11:28:27.368729] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES NUMBER OF QUEUES cid:5 cdw10:00000007 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:45.757 [2024-10-07 11:28:27.368748] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x5af780, cid 5, qid 0 00:17:45.757 [2024-10-07 11:28:27.368804] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:45.757 [2024-10-07 11:28:27.368812] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:45.757 [2024-10-07 11:28:27.368815] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:45.757 [2024-10-07 11:28:27.368820] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x5af780) on tqpair=0x5888f0 00:17:45.757 [2024-10-07 11:28:27.368841] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:45.757 [2024-10-07 11:28:27.368846] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x5888f0) 00:17:45.757 [2024-10-07 11:28:27.368854] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:5 nsid:ffffffff cdw10:07ff0001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:45.757 [2024-10-07 11:28:27.368862] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:45.757 [2024-10-07 11:28:27.368866] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x5888f0) 00:17:45.757 [2024-10-07 11:28:27.368873] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:ffffffff cdw10:007f0002 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:45.757 [2024-10-07 11:28:27.368881] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:45.757 [2024-10-07 11:28:27.368885] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=6 on tqpair(0x5888f0) 00:17:45.757 [2024-10-07 11:28:27.368892] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:6 nsid:ffffffff cdw10:007f0003 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:45.757 [2024-10-07 11:28:27.368901] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:45.757 [2024-10-07 11:28:27.368905] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=7 on tqpair(0x5888f0) 00:17:45.757 [2024-10-07 11:28:27.368911] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:7 nsid:ffffffff cdw10:03ff0005 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:45.757 [2024-10-07 11:28:27.368934] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x5af780, cid 5, qid 0 00:17:45.757 [2024-10-07 11:28:27.368941] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x5af600, cid 4, qid 0 00:17:45.757 [2024-10-07 11:28:27.368946] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x5af900, cid 6, qid 0 00:17:45.757 [2024-10-07 11:28:27.368951] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x5afa80, cid 7, qid 0 00:17:45.757 [2024-10-07 11:28:27.369099] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:17:45.757 [2024-10-07 11:28:27.369107] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:17:45.757 [2024-10-07 11:28:27.369110] nvme_tcp.c:1730:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:17:45.757 [2024-10-07 11:28:27.369114] nvme_tcp.c:1731:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x5888f0): datao=0, datal=8192, cccid=5 00:17:45.757 [2024-10-07 11:28:27.369119] nvme_tcp.c:1742:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x5af780) on tqpair(0x5888f0): expected_datao=0, payload_size=8192 00:17:45.757 [2024-10-07 11:28:27.369124] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:45.757 [2024-10-07 11:28:27.369141] nvme_tcp.c:1532:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:17:45.757 [2024-10-07 11:28:27.369147] nvme_tcp.c:1323:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:17:45.757 [2024-10-07 11:28:27.369153] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:17:45.757 [2024-10-07 11:28:27.369159] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:17:45.757 [2024-10-07 11:28:27.369163] nvme_tcp.c:1730:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:17:45.757 [2024-10-07 11:28:27.369166] nvme_tcp.c:1731:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x5888f0): datao=0, datal=512, cccid=4 00:17:45.757 [2024-10-07 11:28:27.369171] nvme_tcp.c:1742:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x5af600) on tqpair(0x5888f0): expected_datao=0, payload_size=512 00:17:45.757 [2024-10-07 11:28:27.369176] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:45.757 [2024-10-07 11:28:27.369182] nvme_tcp.c:1532:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:17:45.757 [2024-10-07 11:28:27.369186] nvme_tcp.c:1323:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:17:45.757 [2024-10-07 11:28:27.369192] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:17:45.757 [2024-10-07 11:28:27.369198] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:17:45.757 [2024-10-07 11:28:27.369202] nvme_tcp.c:1730:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:17:45.757 [2024-10-07 11:28:27.369206] nvme_tcp.c:1731:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x5888f0): datao=0, datal=512, cccid=6 00:17:45.757 [2024-10-07 11:28:27.369210] nvme_tcp.c:1742:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x5af900) on tqpair(0x5888f0): expected_datao=0, payload_size=512 00:17:45.757 [2024-10-07 11:28:27.369215] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:45.757 [2024-10-07 11:28:27.369221] nvme_tcp.c:1532:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:17:45.757 [2024-10-07 11:28:27.369225] nvme_tcp.c:1323:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:17:45.757 [2024-10-07 11:28:27.369231] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:17:45.757 [2024-10-07 11:28:27.369237] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:17:45.757 [2024-10-07 11:28:27.369240] nvme_tcp.c:1730:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:17:45.757 [2024-10-07 11:28:27.369244] nvme_tcp.c:1731:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x5888f0): datao=0, datal=4096, cccid=7 00:17:45.757 [2024-10-07 11:28:27.369249] nvme_tcp.c:1742:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x5afa80) on tqpair(0x5888f0): expected_datao=0, payload_size=4096 00:17:45.757 [2024-10-07 11:28:27.369253] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:45.757 [2024-10-07 11:28:27.369260] nvme_tcp.c:1532:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:17:45.757 [2024-10-07 11:28:27.369264] nvme_tcp.c:1323:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:17:45.757 [2024-10-07 11:28:27.369272] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:45.757 [2024-10-07 11:28:27.369279] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:45.757 [2024-10-07 11:28:27.369282] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:45.757 [2024-10-07 11:28:27.369286] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x5af780) on tqpair=0x5888f0 00:17:45.757 [2024-10-07 11:28:27.369306] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:45.757 [2024-10-07 11:28:27.369313] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:45.757 [2024-10-07 11:28:27.369317] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:45.757 [2024-10-07 11:28:27.369321] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x5af600) on tqpair=0x5888f0 00:17:45.757 [2024-10-07 11:28:27.369335] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:45.757 [2024-10-07 11:28:27.369350] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:45.757 [2024-10-07 11:28:27.369353] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:45.757 [2024-10-07 11:28:27.369357] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x5af900) on tqpair=0x5888f0 00:17:45.757 [2024-10-07 11:28:27.369365] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:45.757 [2024-10-07 11:28:27.369371] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:45.757 [2024-10-07 11:28:27.369375] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:45.757 [2024-10-07 11:28:27.369379] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x5afa80) on tqpair=0x5888f0 00:17:45.757 ===================================================== 00:17:45.757 NVMe over Fabrics controller at 10.0.0.3:4420: nqn.2016-06.io.spdk:cnode1 00:17:45.757 ===================================================== 00:17:45.757 Controller Capabilities/Features 00:17:45.757 ================================ 00:17:45.757 Vendor ID: 8086 00:17:45.757 Subsystem Vendor ID: 8086 00:17:45.757 Serial Number: SPDK00000000000001 00:17:45.757 Model Number: SPDK bdev Controller 00:17:45.757 Firmware Version: 25.01 00:17:45.757 Recommended Arb Burst: 6 00:17:45.757 IEEE OUI Identifier: e4 d2 5c 00:17:45.757 Multi-path I/O 00:17:45.757 May have multiple subsystem ports: Yes 00:17:45.757 May have multiple controllers: Yes 00:17:45.757 Associated with SR-IOV VF: No 00:17:45.757 Max Data Transfer Size: 131072 00:17:45.757 Max Number of Namespaces: 32 00:17:45.757 Max Number of I/O Queues: 127 00:17:45.757 NVMe Specification Version (VS): 1.3 00:17:45.758 NVMe Specification Version (Identify): 1.3 00:17:45.758 Maximum Queue Entries: 128 00:17:45.758 Contiguous Queues Required: Yes 00:17:45.758 Arbitration Mechanisms Supported 00:17:45.758 Weighted Round Robin: Not Supported 00:17:45.758 Vendor Specific: Not Supported 00:17:45.758 Reset Timeout: 15000 ms 00:17:45.758 Doorbell Stride: 4 bytes 00:17:45.758 NVM Subsystem Reset: Not Supported 00:17:45.758 Command Sets Supported 00:17:45.758 NVM Command Set: Supported 00:17:45.758 Boot Partition: Not Supported 00:17:45.758 Memory Page Size Minimum: 4096 bytes 00:17:45.758 Memory Page Size Maximum: 4096 bytes 00:17:45.758 Persistent Memory Region: Not Supported 00:17:45.758 Optional Asynchronous Events Supported 00:17:45.758 Namespace Attribute Notices: Supported 00:17:45.758 Firmware Activation Notices: Not Supported 00:17:45.758 ANA Change Notices: Not Supported 00:17:45.758 PLE Aggregate Log Change Notices: Not Supported 00:17:45.758 LBA Status Info Alert Notices: Not Supported 00:17:45.758 EGE Aggregate Log Change Notices: Not Supported 00:17:45.758 Normal NVM Subsystem Shutdown event: Not Supported 00:17:45.758 Zone Descriptor Change Notices: Not Supported 00:17:45.758 Discovery Log Change Notices: Not Supported 00:17:45.758 Controller Attributes 00:17:45.758 128-bit Host Identifier: Supported 00:17:45.758 Non-Operational Permissive Mode: Not Supported 00:17:45.758 NVM Sets: Not Supported 00:17:45.758 Read Recovery Levels: Not Supported 00:17:45.758 Endurance Groups: Not Supported 00:17:45.758 Predictable Latency Mode: Not Supported 00:17:45.758 Traffic Based Keep ALive: Not Supported 00:17:45.758 Namespace Granularity: Not Supported 00:17:45.758 SQ Associations: Not Supported 00:17:45.758 UUID List: Not Supported 00:17:45.758 Multi-Domain Subsystem: Not Supported 00:17:45.758 Fixed Capacity Management: Not Supported 00:17:45.758 Variable Capacity Management: Not Supported 00:17:45.758 Delete Endurance Group: Not Supported 00:17:45.758 Delete NVM Set: Not Supported 00:17:45.758 Extended LBA Formats Supported: Not Supported 00:17:45.758 Flexible Data Placement Supported: Not Supported 00:17:45.758 00:17:45.758 Controller Memory Buffer Support 00:17:45.758 ================================ 00:17:45.758 Supported: No 00:17:45.758 00:17:45.758 Persistent Memory Region Support 00:17:45.758 ================================ 00:17:45.758 Supported: No 00:17:45.758 00:17:45.758 Admin Command Set Attributes 00:17:45.758 ============================ 00:17:45.758 Security Send/Receive: Not Supported 00:17:45.758 Format NVM: Not Supported 00:17:45.758 Firmware Activate/Download: Not Supported 00:17:45.758 Namespace Management: Not Supported 00:17:45.758 Device Self-Test: Not Supported 00:17:45.758 Directives: Not Supported 00:17:45.758 NVMe-MI: Not Supported 00:17:45.758 Virtualization Management: Not Supported 00:17:45.758 Doorbell Buffer Config: Not Supported 00:17:45.758 Get LBA Status Capability: Not Supported 00:17:45.758 Command & Feature Lockdown Capability: Not Supported 00:17:45.758 Abort Command Limit: 4 00:17:45.758 Async Event Request Limit: 4 00:17:45.758 Number of Firmware Slots: N/A 00:17:45.758 Firmware Slot 1 Read-Only: N/A 00:17:45.758 Firmware Activation Without Reset: N/A 00:17:45.758 Multiple Update Detection Support: N/A 00:17:45.758 Firmware Update Granularity: No Information Provided 00:17:45.758 Per-Namespace SMART Log: No 00:17:45.758 Asymmetric Namespace Access Log Page: Not Supported 00:17:45.758 Subsystem NQN: nqn.2016-06.io.spdk:cnode1 00:17:45.758 Command Effects Log Page: Supported 00:17:45.758 Get Log Page Extended Data: Supported 00:17:45.758 Telemetry Log Pages: Not Supported 00:17:45.758 Persistent Event Log Pages: Not Supported 00:17:45.758 Supported Log Pages Log Page: May Support 00:17:45.758 Commands Supported & Effects Log Page: Not Supported 00:17:45.758 Feature Identifiers & Effects Log Page:May Support 00:17:45.758 NVMe-MI Commands & Effects Log Page: May Support 00:17:45.758 Data Area 4 for Telemetry Log: Not Supported 00:17:45.758 Error Log Page Entries Supported: 128 00:17:45.758 Keep Alive: Supported 00:17:45.758 Keep Alive Granularity: 10000 ms 00:17:45.758 00:17:45.758 NVM Command Set Attributes 00:17:45.758 ========================== 00:17:45.758 Submission Queue Entry Size 00:17:45.758 Max: 64 00:17:45.758 Min: 64 00:17:45.758 Completion Queue Entry Size 00:17:45.758 Max: 16 00:17:45.758 Min: 16 00:17:45.758 Number of Namespaces: 32 00:17:45.758 Compare Command: Supported 00:17:45.758 Write Uncorrectable Command: Not Supported 00:17:45.758 Dataset Management Command: Supported 00:17:45.758 Write Zeroes Command: Supported 00:17:45.758 Set Features Save Field: Not Supported 00:17:45.758 Reservations: Supported 00:17:45.758 Timestamp: Not Supported 00:17:45.758 Copy: Supported 00:17:45.758 Volatile Write Cache: Present 00:17:45.758 Atomic Write Unit (Normal): 1 00:17:45.758 Atomic Write Unit (PFail): 1 00:17:45.758 Atomic Compare & Write Unit: 1 00:17:45.758 Fused Compare & Write: Supported 00:17:45.758 Scatter-Gather List 00:17:45.758 SGL Command Set: Supported 00:17:45.758 SGL Keyed: Supported 00:17:45.758 SGL Bit Bucket Descriptor: Not Supported 00:17:45.758 SGL Metadata Pointer: Not Supported 00:17:45.758 Oversized SGL: Not Supported 00:17:45.758 SGL Metadata Address: Not Supported 00:17:45.758 SGL Offset: Supported 00:17:45.758 Transport SGL Data Block: Not Supported 00:17:45.758 Replay Protected Memory Block: Not Supported 00:17:45.758 00:17:45.758 Firmware Slot Information 00:17:45.758 ========================= 00:17:45.758 Active slot: 1 00:17:45.758 Slot 1 Firmware Revision: 25.01 00:17:45.758 00:17:45.758 00:17:45.758 Commands Supported and Effects 00:17:45.758 ============================== 00:17:45.758 Admin Commands 00:17:45.758 -------------- 00:17:45.758 Get Log Page (02h): Supported 00:17:45.758 Identify (06h): Supported 00:17:45.758 Abort (08h): Supported 00:17:45.758 Set Features (09h): Supported 00:17:45.758 Get Features (0Ah): Supported 00:17:45.758 Asynchronous Event Request (0Ch): Supported 00:17:45.758 Keep Alive (18h): Supported 00:17:45.758 I/O Commands 00:17:45.758 ------------ 00:17:45.758 Flush (00h): Supported LBA-Change 00:17:45.758 Write (01h): Supported LBA-Change 00:17:45.758 Read (02h): Supported 00:17:45.758 Compare (05h): Supported 00:17:45.758 Write Zeroes (08h): Supported LBA-Change 00:17:45.758 Dataset Management (09h): Supported LBA-Change 00:17:45.758 Copy (19h): Supported LBA-Change 00:17:45.758 00:17:45.758 Error Log 00:17:45.758 ========= 00:17:45.758 00:17:45.758 Arbitration 00:17:45.758 =========== 00:17:45.758 Arbitration Burst: 1 00:17:45.758 00:17:45.758 Power Management 00:17:45.758 ================ 00:17:45.758 Number of Power States: 1 00:17:45.758 Current Power State: Power State #0 00:17:45.758 Power State #0: 00:17:45.758 Max Power: 0.00 W 00:17:45.758 Non-Operational State: Operational 00:17:45.758 Entry Latency: Not Reported 00:17:45.758 Exit Latency: Not Reported 00:17:45.758 Relative Read Throughput: 0 00:17:45.758 Relative Read Latency: 0 00:17:45.758 Relative Write Throughput: 0 00:17:45.758 Relative Write Latency: 0 00:17:45.758 Idle Power: Not Reported 00:17:45.758 Active Power: Not Reported 00:17:45.758 Non-Operational Permissive Mode: Not Supported 00:17:45.758 00:17:45.758 Health Information 00:17:45.758 ================== 00:17:45.758 Critical Warnings: 00:17:45.758 Available Spare Space: OK 00:17:45.758 Temperature: OK 00:17:45.758 Device Reliability: OK 00:17:45.758 Read Only: No 00:17:45.758 Volatile Memory Backup: OK 00:17:45.758 Current Temperature: 0 Kelvin (-273 Celsius) 00:17:45.758 Temperature Threshold: 0 Kelvin (-273 Celsius) 00:17:45.758 Available Spare: 0% 00:17:45.758 Available Spare Threshold: 0% 00:17:45.758 Life Percentage Used:[2024-10-07 11:28:27.373517] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:45.758 [2024-10-07 11:28:27.373528] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=7 on tqpair(0x5888f0) 00:17:45.758 [2024-10-07 11:28:27.373538] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ERROR_RECOVERY cid:7 cdw10:00000005 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:45.758 [2024-10-07 11:28:27.373569] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x5afa80, cid 7, qid 0 00:17:45.758 [2024-10-07 11:28:27.373645] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:45.758 [2024-10-07 11:28:27.373653] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:45.758 [2024-10-07 11:28:27.373657] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:45.758 [2024-10-07 11:28:27.373661] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x5afa80) on tqpair=0x5888f0 00:17:45.758 [2024-10-07 11:28:27.373706] nvme_ctrlr.c:4386:nvme_ctrlr_destruct_async: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Prepare to destruct SSD 00:17:45.758 [2024-10-07 11:28:27.373719] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x5af000) on tqpair=0x5888f0 00:17:45.758 [2024-10-07 11:28:27.373727] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:45.758 [2024-10-07 11:28:27.373733] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x5af180) on tqpair=0x5888f0 00:17:45.758 [2024-10-07 11:28:27.373738] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:45.758 [2024-10-07 11:28:27.373743] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x5af300) on tqpair=0x5888f0 00:17:45.759 [2024-10-07 11:28:27.373748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:45.759 [2024-10-07 11:28:27.373754] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x5af480) on tqpair=0x5888f0 00:17:45.759 [2024-10-07 11:28:27.373759] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:45.759 [2024-10-07 11:28:27.373768] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:45.759 [2024-10-07 11:28:27.373773] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:45.759 [2024-10-07 11:28:27.373777] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x5888f0) 00:17:45.759 [2024-10-07 11:28:27.373786] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:45.759 [2024-10-07 11:28:27.373815] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x5af480, cid 3, qid 0 00:17:45.759 [2024-10-07 11:28:27.373872] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:45.759 [2024-10-07 11:28:27.373879] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:45.759 [2024-10-07 11:28:27.373883] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:45.759 [2024-10-07 11:28:27.373888] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x5af480) on tqpair=0x5888f0 00:17:45.759 [2024-10-07 11:28:27.373896] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:45.759 [2024-10-07 11:28:27.373901] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:45.759 [2024-10-07 11:28:27.373905] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x5888f0) 00:17:45.759 [2024-10-07 11:28:27.373912] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:45.759 [2024-10-07 11:28:27.373937] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x5af480, cid 3, qid 0 00:17:45.759 [2024-10-07 11:28:27.374030] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:45.759 [2024-10-07 11:28:27.374038] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:45.759 [2024-10-07 11:28:27.374042] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:45.759 [2024-10-07 11:28:27.374046] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x5af480) on tqpair=0x5888f0 00:17:45.759 [2024-10-07 11:28:27.374052] nvme_ctrlr.c:1147:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] RTD3E = 0 us 00:17:45.759 [2024-10-07 11:28:27.374057] nvme_ctrlr.c:1150:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] shutdown timeout = 10000 ms 00:17:45.759 [2024-10-07 11:28:27.374067] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:45.759 [2024-10-07 11:28:27.374072] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:45.759 [2024-10-07 11:28:27.374076] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x5888f0) 00:17:45.759 [2024-10-07 11:28:27.374084] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:45.759 [2024-10-07 11:28:27.374105] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x5af480, cid 3, qid 0 00:17:45.759 [2024-10-07 11:28:27.374161] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:45.759 [2024-10-07 11:28:27.374168] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:45.759 [2024-10-07 11:28:27.374172] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:45.759 [2024-10-07 11:28:27.374176] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x5af480) on tqpair=0x5888f0 00:17:45.759 [2024-10-07 11:28:27.374187] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:45.759 [2024-10-07 11:28:27.374192] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:45.759 [2024-10-07 11:28:27.374196] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x5888f0) 00:17:45.759 [2024-10-07 11:28:27.374204] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:45.759 [2024-10-07 11:28:27.374223] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x5af480, cid 3, qid 0 00:17:45.759 [2024-10-07 11:28:27.374275] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:45.759 [2024-10-07 11:28:27.374282] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:45.759 [2024-10-07 11:28:27.374286] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:45.759 [2024-10-07 11:28:27.374290] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x5af480) on tqpair=0x5888f0 00:17:45.759 [2024-10-07 11:28:27.374301] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:45.759 [2024-10-07 11:28:27.374306] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:45.759 [2024-10-07 11:28:27.374310] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x5888f0) 00:17:45.759 [2024-10-07 11:28:27.374317] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:45.759 [2024-10-07 11:28:27.374336] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x5af480, cid 3, qid 0 00:17:45.759 [2024-10-07 11:28:27.374402] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:45.759 [2024-10-07 11:28:27.374409] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:45.759 [2024-10-07 11:28:27.374429] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:45.759 [2024-10-07 11:28:27.374433] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x5af480) on tqpair=0x5888f0 00:17:45.759 [2024-10-07 11:28:27.374445] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:45.759 [2024-10-07 11:28:27.374451] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:45.759 [2024-10-07 11:28:27.374455] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x5888f0) 00:17:45.759 [2024-10-07 11:28:27.374463] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:45.759 [2024-10-07 11:28:27.374484] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x5af480, cid 3, qid 0 00:17:45.759 [2024-10-07 11:28:27.374541] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:45.759 [2024-10-07 11:28:27.374549] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:45.759 [2024-10-07 11:28:27.374553] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:45.759 [2024-10-07 11:28:27.374557] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x5af480) on tqpair=0x5888f0 00:17:45.759 [2024-10-07 11:28:27.374567] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:45.759 [2024-10-07 11:28:27.374572] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:45.759 [2024-10-07 11:28:27.374576] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x5888f0) 00:17:45.759 [2024-10-07 11:28:27.374584] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:45.759 [2024-10-07 11:28:27.374603] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x5af480, cid 3, qid 0 00:17:45.759 [2024-10-07 11:28:27.374655] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:45.759 [2024-10-07 11:28:27.374662] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:45.759 [2024-10-07 11:28:27.374666] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:45.759 [2024-10-07 11:28:27.374670] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x5af480) on tqpair=0x5888f0 00:17:45.759 [2024-10-07 11:28:27.374681] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:45.759 [2024-10-07 11:28:27.374686] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:45.759 [2024-10-07 11:28:27.374690] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x5888f0) 00:17:45.759 [2024-10-07 11:28:27.374697] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:45.759 [2024-10-07 11:28:27.374716] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x5af480, cid 3, qid 0 00:17:45.759 [2024-10-07 11:28:27.374767] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:45.759 [2024-10-07 11:28:27.374774] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:45.759 [2024-10-07 11:28:27.374778] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:45.759 [2024-10-07 11:28:27.374782] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x5af480) on tqpair=0x5888f0 00:17:45.759 [2024-10-07 11:28:27.374793] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:45.759 [2024-10-07 11:28:27.374798] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:45.759 [2024-10-07 11:28:27.374802] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x5888f0) 00:17:45.759 [2024-10-07 11:28:27.374809] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:45.759 [2024-10-07 11:28:27.374828] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x5af480, cid 3, qid 0 00:17:45.759 [2024-10-07 11:28:27.374879] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:45.759 [2024-10-07 11:28:27.374886] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:45.759 [2024-10-07 11:28:27.374890] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:45.759 [2024-10-07 11:28:27.374894] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x5af480) on tqpair=0x5888f0 00:17:45.759 [2024-10-07 11:28:27.374904] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:45.759 [2024-10-07 11:28:27.374909] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:45.759 [2024-10-07 11:28:27.374913] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x5888f0) 00:17:45.759 [2024-10-07 11:28:27.374920] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:45.759 [2024-10-07 11:28:27.374939] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x5af480, cid 3, qid 0 00:17:45.759 [2024-10-07 11:28:27.374997] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:45.759 [2024-10-07 11:28:27.375004] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:45.759 [2024-10-07 11:28:27.375008] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:45.759 [2024-10-07 11:28:27.375012] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x5af480) on tqpair=0x5888f0 00:17:45.759 [2024-10-07 11:28:27.375022] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:45.760 [2024-10-07 11:28:27.375028] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:45.760 [2024-10-07 11:28:27.375032] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x5888f0) 00:17:45.760 [2024-10-07 11:28:27.375039] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:45.760 [2024-10-07 11:28:27.375058] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x5af480, cid 3, qid 0 00:17:45.760 [2024-10-07 11:28:27.375112] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:45.760 [2024-10-07 11:28:27.375120] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:45.760 [2024-10-07 11:28:27.375124] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:45.760 [2024-10-07 11:28:27.375128] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x5af480) on tqpair=0x5888f0 00:17:45.760 [2024-10-07 11:28:27.375138] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:45.760 [2024-10-07 11:28:27.375143] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:45.760 [2024-10-07 11:28:27.375147] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x5888f0) 00:17:45.760 [2024-10-07 11:28:27.375155] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:45.760 [2024-10-07 11:28:27.375173] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x5af480, cid 3, qid 0 00:17:45.760 [2024-10-07 11:28:27.375227] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:45.760 [2024-10-07 11:28:27.375234] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:45.760 [2024-10-07 11:28:27.375238] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:45.760 [2024-10-07 11:28:27.375242] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x5af480) on tqpair=0x5888f0 00:17:45.760 [2024-10-07 11:28:27.375253] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:45.760 [2024-10-07 11:28:27.375258] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:45.760 [2024-10-07 11:28:27.375262] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x5888f0) 00:17:45.760 [2024-10-07 11:28:27.375269] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:45.760 [2024-10-07 11:28:27.375288] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x5af480, cid 3, qid 0 00:17:45.760 [2024-10-07 11:28:27.375341] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:45.760 [2024-10-07 11:28:27.375354] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:45.760 [2024-10-07 11:28:27.375358] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:45.760 [2024-10-07 11:28:27.375362] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x5af480) on tqpair=0x5888f0 00:17:45.760 [2024-10-07 11:28:27.375374] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:45.760 [2024-10-07 11:28:27.375379] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:45.760 [2024-10-07 11:28:27.375383] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x5888f0) 00:17:45.760 [2024-10-07 11:28:27.375390] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:45.760 [2024-10-07 11:28:27.375423] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x5af480, cid 3, qid 0 00:17:45.760 [2024-10-07 11:28:27.375477] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:45.760 [2024-10-07 11:28:27.375484] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:45.760 [2024-10-07 11:28:27.375488] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:45.760 [2024-10-07 11:28:27.375494] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x5af480) on tqpair=0x5888f0 00:17:45.760 [2024-10-07 11:28:27.375506] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:45.760 [2024-10-07 11:28:27.375510] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:45.760 [2024-10-07 11:28:27.375514] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x5888f0) 00:17:45.760 [2024-10-07 11:28:27.375522] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:45.760 [2024-10-07 11:28:27.375543] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x5af480, cid 3, qid 0 00:17:45.760 [2024-10-07 11:28:27.375599] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:45.760 [2024-10-07 11:28:27.375606] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:45.760 [2024-10-07 11:28:27.375610] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:45.760 [2024-10-07 11:28:27.375614] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x5af480) on tqpair=0x5888f0 00:17:45.760 [2024-10-07 11:28:27.375625] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:45.760 [2024-10-07 11:28:27.375629] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:45.760 [2024-10-07 11:28:27.375633] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x5888f0) 00:17:45.760 [2024-10-07 11:28:27.375641] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:45.760 [2024-10-07 11:28:27.375660] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x5af480, cid 3, qid 0 00:17:45.760 [2024-10-07 11:28:27.375719] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:45.760 [2024-10-07 11:28:27.375735] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:45.760 [2024-10-07 11:28:27.375740] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:45.760 [2024-10-07 11:28:27.375745] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x5af480) on tqpair=0x5888f0 00:17:45.760 [2024-10-07 11:28:27.375756] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:45.760 [2024-10-07 11:28:27.375761] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:45.760 [2024-10-07 11:28:27.375765] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x5888f0) 00:17:45.760 [2024-10-07 11:28:27.375773] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:45.760 [2024-10-07 11:28:27.375794] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x5af480, cid 3, qid 0 00:17:45.760 [2024-10-07 11:28:27.375854] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:45.760 [2024-10-07 11:28:27.375862] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:45.760 [2024-10-07 11:28:27.375865] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:45.760 [2024-10-07 11:28:27.375870] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x5af480) on tqpair=0x5888f0 00:17:45.760 [2024-10-07 11:28:27.375881] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:45.760 [2024-10-07 11:28:27.375885] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:45.760 [2024-10-07 11:28:27.375889] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x5888f0) 00:17:45.760 [2024-10-07 11:28:27.375897] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:45.760 [2024-10-07 11:28:27.375916] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x5af480, cid 3, qid 0 00:17:45.760 [2024-10-07 11:28:27.375970] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:45.760 [2024-10-07 11:28:27.375977] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:45.760 [2024-10-07 11:28:27.375981] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:45.760 [2024-10-07 11:28:27.375985] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x5af480) on tqpair=0x5888f0 00:17:45.760 [2024-10-07 11:28:27.375996] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:45.760 [2024-10-07 11:28:27.376001] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:45.760 [2024-10-07 11:28:27.376005] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x5888f0) 00:17:45.760 [2024-10-07 11:28:27.376013] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:45.760 [2024-10-07 11:28:27.376032] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x5af480, cid 3, qid 0 00:17:45.760 [2024-10-07 11:28:27.376084] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:45.760 [2024-10-07 11:28:27.376091] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:45.760 [2024-10-07 11:28:27.376094] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:45.760 [2024-10-07 11:28:27.376099] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x5af480) on tqpair=0x5888f0 00:17:45.760 [2024-10-07 11:28:27.376110] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:45.760 [2024-10-07 11:28:27.376115] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:45.760 [2024-10-07 11:28:27.376119] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x5888f0) 00:17:45.760 [2024-10-07 11:28:27.376126] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:45.760 [2024-10-07 11:28:27.376145] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x5af480, cid 3, qid 0 00:17:45.760 [2024-10-07 11:28:27.376199] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:45.760 [2024-10-07 11:28:27.376206] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:45.760 [2024-10-07 11:28:27.376210] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:45.760 [2024-10-07 11:28:27.376214] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x5af480) on tqpair=0x5888f0 00:17:45.760 [2024-10-07 11:28:27.376225] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:45.760 [2024-10-07 11:28:27.376230] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:45.760 [2024-10-07 11:28:27.376234] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x5888f0) 00:17:45.760 [2024-10-07 11:28:27.376241] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:45.760 [2024-10-07 11:28:27.376260] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x5af480, cid 3, qid 0 00:17:45.760 [2024-10-07 11:28:27.376318] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:45.760 [2024-10-07 11:28:27.376325] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:45.760 [2024-10-07 11:28:27.376329] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:45.760 [2024-10-07 11:28:27.376333] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x5af480) on tqpair=0x5888f0 00:17:45.760 [2024-10-07 11:28:27.376344] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:45.760 [2024-10-07 11:28:27.376349] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:45.760 [2024-10-07 11:28:27.376353] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x5888f0) 00:17:45.760 [2024-10-07 11:28:27.376360] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:45.760 [2024-10-07 11:28:27.376379] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x5af480, cid 3, qid 0 00:17:45.760 [2024-10-07 11:28:27.376443] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:45.760 [2024-10-07 11:28:27.376452] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:45.760 [2024-10-07 11:28:27.376456] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:45.760 [2024-10-07 11:28:27.376460] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x5af480) on tqpair=0x5888f0 00:17:45.760 [2024-10-07 11:28:27.376471] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:45.760 [2024-10-07 11:28:27.376476] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:45.760 [2024-10-07 11:28:27.376480] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x5888f0) 00:17:45.760 [2024-10-07 11:28:27.376488] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:45.760 [2024-10-07 11:28:27.376509] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x5af480, cid 3, qid 0 00:17:45.760 [2024-10-07 11:28:27.376567] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:45.761 [2024-10-07 11:28:27.376574] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:45.761 [2024-10-07 11:28:27.376579] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:45.761 [2024-10-07 11:28:27.376583] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x5af480) on tqpair=0x5888f0 00:17:45.761 [2024-10-07 11:28:27.376594] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:45.761 [2024-10-07 11:28:27.376599] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:45.761 [2024-10-07 11:28:27.376603] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x5888f0) 00:17:45.761 [2024-10-07 11:28:27.376610] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:45.761 [2024-10-07 11:28:27.376629] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x5af480, cid 3, qid 0 00:17:45.761 [2024-10-07 11:28:27.376681] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:45.761 [2024-10-07 11:28:27.376688] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:45.761 [2024-10-07 11:28:27.376692] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:45.761 [2024-10-07 11:28:27.376696] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x5af480) on tqpair=0x5888f0 00:17:45.761 [2024-10-07 11:28:27.376707] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:45.761 [2024-10-07 11:28:27.376711] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:45.761 [2024-10-07 11:28:27.376715] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x5888f0) 00:17:45.761 [2024-10-07 11:28:27.376723] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:45.761 [2024-10-07 11:28:27.376744] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x5af480, cid 3, qid 0 00:17:45.761 [2024-10-07 11:28:27.376798] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:45.761 [2024-10-07 11:28:27.376805] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:45.761 [2024-10-07 11:28:27.376809] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:45.761 [2024-10-07 11:28:27.376813] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x5af480) on tqpair=0x5888f0 00:17:45.761 [2024-10-07 11:28:27.376824] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:45.761 [2024-10-07 11:28:27.376829] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:45.761 [2024-10-07 11:28:27.376833] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x5888f0) 00:17:45.761 [2024-10-07 11:28:27.376841] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:45.761 [2024-10-07 11:28:27.376860] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x5af480, cid 3, qid 0 00:17:45.761 [2024-10-07 11:28:27.376911] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:45.761 [2024-10-07 11:28:27.376918] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:45.761 [2024-10-07 11:28:27.376922] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:45.761 [2024-10-07 11:28:27.376926] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x5af480) on tqpair=0x5888f0 00:17:45.761 [2024-10-07 11:28:27.376937] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:45.761 [2024-10-07 11:28:27.376942] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:45.761 [2024-10-07 11:28:27.376946] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x5888f0) 00:17:45.761 [2024-10-07 11:28:27.376953] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:45.761 [2024-10-07 11:28:27.376972] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x5af480, cid 3, qid 0 00:17:45.761 [2024-10-07 11:28:27.377024] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:45.761 [2024-10-07 11:28:27.377032] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:45.761 [2024-10-07 11:28:27.377035] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:45.761 [2024-10-07 11:28:27.377039] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x5af480) on tqpair=0x5888f0 00:17:45.761 [2024-10-07 11:28:27.377050] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:45.761 [2024-10-07 11:28:27.377055] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:45.761 [2024-10-07 11:28:27.377059] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x5888f0) 00:17:45.761 [2024-10-07 11:28:27.377066] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:45.761 [2024-10-07 11:28:27.377086] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x5af480, cid 3, qid 0 00:17:45.761 [2024-10-07 11:28:27.377143] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:45.761 [2024-10-07 11:28:27.377150] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:45.761 [2024-10-07 11:28:27.377153] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:45.761 [2024-10-07 11:28:27.377158] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x5af480) on tqpair=0x5888f0 00:17:45.761 [2024-10-07 11:28:27.377168] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:45.761 [2024-10-07 11:28:27.377173] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:45.761 [2024-10-07 11:28:27.377177] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x5888f0) 00:17:45.761 [2024-10-07 11:28:27.377185] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:45.761 [2024-10-07 11:28:27.377203] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x5af480, cid 3, qid 0 00:17:45.761 [2024-10-07 11:28:27.377254] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:45.761 [2024-10-07 11:28:27.377262] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:45.761 [2024-10-07 11:28:27.377265] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:45.761 [2024-10-07 11:28:27.377270] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x5af480) on tqpair=0x5888f0 00:17:45.761 [2024-10-07 11:28:27.377281] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:45.761 [2024-10-07 11:28:27.377285] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:45.761 [2024-10-07 11:28:27.377289] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x5888f0) 00:17:45.761 [2024-10-07 11:28:27.377297] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:45.761 [2024-10-07 11:28:27.377316] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x5af480, cid 3, qid 0 00:17:45.761 [2024-10-07 11:28:27.377367] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:45.761 [2024-10-07 11:28:27.377374] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:45.761 [2024-10-07 11:28:27.377378] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:45.761 [2024-10-07 11:28:27.377382] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x5af480) on tqpair=0x5888f0 00:17:45.761 [2024-10-07 11:28:27.377393] nvme_tcp.c: 800:nvme_tcp_build_contig_request: *DEBUG*: enter 00:17:45.761 [2024-10-07 11:28:27.377397] nvme_tcp.c: 977:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:17:45.761 [2024-10-07 11:28:27.377401] nvme_tcp.c: 986:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x5888f0) 00:17:45.761 [2024-10-07 11:28:27.380478] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:45.761 [2024-10-07 11:28:27.380539] nvme_tcp.c: 951:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x5af480, cid 3, qid 0 00:17:45.761 [2024-10-07 11:28:27.380623] nvme_tcp.c:1198:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:17:45.761 [2024-10-07 11:28:27.380631] nvme_tcp.c:1986:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:17:45.761 [2024-10-07 11:28:27.380635] nvme_tcp.c:1659:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:17:45.761 [2024-10-07 11:28:27.380640] nvme_tcp.c:1079:nvme_tcp_req_complete: *DEBUG*: complete tcp_req(0x5af480) on tqpair=0x5888f0 00:17:45.761 [2024-10-07 11:28:27.380649] nvme_ctrlr.c:1269:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] shutdown complete in 6 milliseconds 00:17:45.761 0% 00:17:45.761 Data Units Read: 0 00:17:45.761 Data Units Written: 0 00:17:45.761 Host Read Commands: 0 00:17:45.761 Host Write Commands: 0 00:17:45.761 Controller Busy Time: 0 minutes 00:17:45.761 Power Cycles: 0 00:17:45.761 Power On Hours: 0 hours 00:17:45.761 Unsafe Shutdowns: 0 00:17:45.761 Unrecoverable Media Errors: 0 00:17:45.761 Lifetime Error Log Entries: 0 00:17:45.761 Warning Temperature Time: 0 minutes 00:17:45.761 Critical Temperature Time: 0 minutes 00:17:45.761 00:17:45.761 Number of Queues 00:17:45.761 ================ 00:17:45.761 Number of I/O Submission Queues: 127 00:17:45.761 Number of I/O Completion Queues: 127 00:17:45.761 00:17:45.761 Active Namespaces 00:17:45.761 ================= 00:17:45.761 Namespace ID:1 00:17:45.761 Error Recovery Timeout: Unlimited 00:17:45.761 Command Set Identifier: NVM (00h) 00:17:45.761 Deallocate: Supported 00:17:45.761 Deallocated/Unwritten Error: Not Supported 00:17:45.761 Deallocated Read Value: Unknown 00:17:45.761 Deallocate in Write Zeroes: Not Supported 00:17:45.761 Deallocated Guard Field: 0xFFFF 00:17:45.761 Flush: Supported 00:17:45.761 Reservation: Supported 00:17:45.761 Namespace Sharing Capabilities: Multiple Controllers 00:17:45.761 Size (in LBAs): 131072 (0GiB) 00:17:45.761 Capacity (in LBAs): 131072 (0GiB) 00:17:45.761 Utilization (in LBAs): 131072 (0GiB) 00:17:45.761 NGUID: ABCDEF0123456789ABCDEF0123456789 00:17:45.761 EUI64: ABCDEF0123456789 00:17:45.761 UUID: 3516ef91-10ef-4f5b-bacf-16ec3a955c59 00:17:45.761 Thin Provisioning: Not Supported 00:17:45.761 Per-NS Atomic Units: Yes 00:17:45.761 Atomic Boundary Size (Normal): 0 00:17:45.761 Atomic Boundary Size (PFail): 0 00:17:45.761 Atomic Boundary Offset: 0 00:17:45.761 Maximum Single Source Range Length: 65535 00:17:45.761 Maximum Copy Length: 65535 00:17:45.761 Maximum Source Range Count: 1 00:17:45.761 NGUID/EUI64 Never Reused: No 00:17:45.761 Namespace Write Protected: No 00:17:45.761 Number of LBA Formats: 1 00:17:45.761 Current LBA Format: LBA Format #00 00:17:45.761 LBA Format #00: Data Size: 512 Metadata Size: 0 00:17:45.761 00:17:45.761 11:28:27 nvmf_tcp.nvmf_host.nvmf_identify -- host/identify.sh@51 -- # sync 00:17:45.761 11:28:27 nvmf_tcp.nvmf_host.nvmf_identify -- host/identify.sh@52 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:17:45.761 11:28:27 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:45.761 11:28:27 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@10 -- # set +x 00:17:46.020 11:28:27 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:46.020 11:28:27 nvmf_tcp.nvmf_host.nvmf_identify -- host/identify.sh@54 -- # trap - SIGINT SIGTERM EXIT 00:17:46.020 11:28:27 nvmf_tcp.nvmf_host.nvmf_identify -- host/identify.sh@56 -- # nvmftestfini 00:17:46.020 11:28:27 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@514 -- # nvmfcleanup 00:17:46.020 11:28:27 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@121 -- # sync 00:17:46.020 11:28:27 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:17:46.020 11:28:27 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@124 -- # set +e 00:17:46.020 11:28:27 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@125 -- # for i in {1..20} 00:17:46.020 11:28:27 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:17:46.020 rmmod nvme_tcp 00:17:46.020 rmmod nvme_fabrics 00:17:46.020 rmmod nvme_keyring 00:17:46.020 11:28:27 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:17:46.020 11:28:27 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@128 -- # set -e 00:17:46.020 11:28:27 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@129 -- # return 0 00:17:46.020 11:28:27 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@515 -- # '[' -n 87687 ']' 00:17:46.020 11:28:27 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@516 -- # killprocess 87687 00:17:46.020 11:28:27 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@950 -- # '[' -z 87687 ']' 00:17:46.020 11:28:27 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@954 -- # kill -0 87687 00:17:46.020 11:28:27 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@955 -- # uname 00:17:46.020 11:28:27 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:17:46.020 11:28:27 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 87687 00:17:46.020 killing process with pid 87687 00:17:46.020 11:28:27 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:17:46.020 11:28:27 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:17:46.020 11:28:27 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@968 -- # echo 'killing process with pid 87687' 00:17:46.020 11:28:27 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@969 -- # kill 87687 00:17:46.020 11:28:27 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@974 -- # wait 87687 00:17:46.278 11:28:27 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:17:46.278 11:28:27 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:17:46.278 11:28:27 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:17:46.278 11:28:27 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@297 -- # iptr 00:17:46.278 11:28:27 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@789 -- # iptables-save 00:17:46.278 11:28:27 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:17:46.278 11:28:27 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@789 -- # iptables-restore 00:17:46.278 11:28:27 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@298 -- # [[ nvmf_tgt_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:17:46.278 11:28:27 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@299 -- # nvmf_veth_fini 00:17:46.278 11:28:27 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@233 -- # ip link set nvmf_init_br nomaster 00:17:46.278 11:28:27 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@234 -- # ip link set nvmf_init_br2 nomaster 00:17:46.536 11:28:27 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@235 -- # ip link set nvmf_tgt_br nomaster 00:17:46.536 11:28:28 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@236 -- # ip link set nvmf_tgt_br2 nomaster 00:17:46.536 11:28:28 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@237 -- # ip link set nvmf_init_br down 00:17:46.536 11:28:28 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@238 -- # ip link set nvmf_init_br2 down 00:17:46.536 11:28:28 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@239 -- # ip link set nvmf_tgt_br down 00:17:46.536 11:28:28 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@240 -- # ip link set nvmf_tgt_br2 down 00:17:46.536 11:28:28 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@241 -- # ip link delete nvmf_br type bridge 00:17:46.536 11:28:28 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@242 -- # ip link delete nvmf_init_if 00:17:46.536 11:28:28 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@243 -- # ip link delete nvmf_init_if2 00:17:46.536 11:28:28 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@244 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:17:46.536 11:28:28 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@245 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:17:46.536 11:28:28 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@246 -- # remove_spdk_ns 00:17:46.536 11:28:28 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:46.536 11:28:28 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:17:46.536 11:28:28 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:46.536 11:28:28 nvmf_tcp.nvmf_host.nvmf_identify -- nvmf/common.sh@300 -- # return 0 00:17:46.536 00:17:46.536 real 0m3.327s 00:17:46.536 user 0m8.474s 00:17:46.536 sys 0m0.839s 00:17:46.536 11:28:28 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@1126 -- # xtrace_disable 00:17:46.536 11:28:28 nvmf_tcp.nvmf_host.nvmf_identify -- common/autotest_common.sh@10 -- # set +x 00:17:46.536 ************************************ 00:17:46.536 END TEST nvmf_identify 00:17:46.536 ************************************ 00:17:46.801 11:28:28 nvmf_tcp.nvmf_host -- nvmf/nvmf_host.sh@23 -- # run_test nvmf_perf /home/vagrant/spdk_repo/spdk/test/nvmf/host/perf.sh --transport=tcp 00:17:46.801 11:28:28 nvmf_tcp.nvmf_host -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:17:46.801 11:28:28 nvmf_tcp.nvmf_host -- common/autotest_common.sh@1107 -- # xtrace_disable 00:17:46.801 11:28:28 nvmf_tcp.nvmf_host -- common/autotest_common.sh@10 -- # set +x 00:17:46.801 ************************************ 00:17:46.801 START TEST nvmf_perf 00:17:46.801 ************************************ 00:17:46.801 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/nvmf/host/perf.sh --transport=tcp 00:17:46.801 * Looking for test storage... 00:17:46.801 * Found test storage at /home/vagrant/spdk_repo/spdk/test/nvmf/host 00:17:46.801 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:17:46.801 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:17:46.801 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@1681 -- # lcov --version 00:17:46.802 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:17:46.802 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:17:46.802 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- scripts/common.sh@333 -- # local ver1 ver1_l 00:17:46.802 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- scripts/common.sh@334 -- # local ver2 ver2_l 00:17:46.802 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- scripts/common.sh@336 -- # IFS=.-: 00:17:46.802 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- scripts/common.sh@336 -- # read -ra ver1 00:17:46.802 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- scripts/common.sh@337 -- # IFS=.-: 00:17:46.802 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- scripts/common.sh@337 -- # read -ra ver2 00:17:46.802 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- scripts/common.sh@338 -- # local 'op=<' 00:17:46.802 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- scripts/common.sh@340 -- # ver1_l=2 00:17:46.802 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- scripts/common.sh@341 -- # ver2_l=1 00:17:46.802 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:17:46.802 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- scripts/common.sh@344 -- # case "$op" in 00:17:46.802 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- scripts/common.sh@345 -- # : 1 00:17:46.802 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- scripts/common.sh@364 -- # (( v = 0 )) 00:17:46.802 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:17:46.802 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- scripts/common.sh@365 -- # decimal 1 00:17:46.802 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- scripts/common.sh@353 -- # local d=1 00:17:46.802 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:17:46.802 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- scripts/common.sh@355 -- # echo 1 00:17:46.802 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- scripts/common.sh@365 -- # ver1[v]=1 00:17:46.802 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- scripts/common.sh@366 -- # decimal 2 00:17:46.802 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- scripts/common.sh@353 -- # local d=2 00:17:46.802 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:17:46.802 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- scripts/common.sh@355 -- # echo 2 00:17:46.802 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- scripts/common.sh@366 -- # ver2[v]=2 00:17:46.802 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:17:46.802 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:17:46.802 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- scripts/common.sh@368 -- # return 0 00:17:46.802 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:17:46.802 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:17:46.802 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:46.802 --rc genhtml_branch_coverage=1 00:17:46.802 --rc genhtml_function_coverage=1 00:17:46.802 --rc genhtml_legend=1 00:17:46.802 --rc geninfo_all_blocks=1 00:17:46.802 --rc geninfo_unexecuted_blocks=1 00:17:46.802 00:17:46.802 ' 00:17:46.802 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:17:46.802 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:46.802 --rc genhtml_branch_coverage=1 00:17:46.802 --rc genhtml_function_coverage=1 00:17:46.802 --rc genhtml_legend=1 00:17:46.802 --rc geninfo_all_blocks=1 00:17:46.802 --rc geninfo_unexecuted_blocks=1 00:17:46.802 00:17:46.802 ' 00:17:46.802 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:17:46.802 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:46.802 --rc genhtml_branch_coverage=1 00:17:46.802 --rc genhtml_function_coverage=1 00:17:46.802 --rc genhtml_legend=1 00:17:46.802 --rc geninfo_all_blocks=1 00:17:46.802 --rc geninfo_unexecuted_blocks=1 00:17:46.802 00:17:46.802 ' 00:17:46.802 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:17:46.802 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:46.802 --rc genhtml_branch_coverage=1 00:17:46.802 --rc genhtml_function_coverage=1 00:17:46.802 --rc genhtml_legend=1 00:17:46.802 --rc geninfo_all_blocks=1 00:17:46.802 --rc geninfo_unexecuted_blocks=1 00:17:46.802 00:17:46.802 ' 00:17:46.802 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@10 -- # source /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh 00:17:46.802 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@7 -- # uname -s 00:17:46.802 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:46.802 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:46.802 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:46.802 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:46.802 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:46.802 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:46.802 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:46.802 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:46.802 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:46.803 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:46.803 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:17:46.803 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@18 -- # NVME_HOSTID=3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:17:46.803 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:46.803 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:46.803 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@21 -- # NET_TYPE=virt 00:17:46.803 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:17:46.803 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@49 -- # source /home/vagrant/spdk_repo/spdk/scripts/common.sh 00:17:46.803 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- scripts/common.sh@15 -- # shopt -s extglob 00:17:46.803 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:46.803 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:46.803 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:46.803 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:46.803 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:46.803 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:46.803 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- paths/export.sh@5 -- # export PATH 00:17:46.803 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:46.803 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@51 -- # : 0 00:17:46.803 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:17:46.803 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:17:46.803 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:17:46.803 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:46.803 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:46.803 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:17:46.803 /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:17:46.803 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:17:46.803 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:17:46.803 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@55 -- # have_pci_nics=0 00:17:46.803 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@12 -- # MALLOC_BDEV_SIZE=64 00:17:46.803 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:17:46.803 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@15 -- # rpc_py=/home/vagrant/spdk_repo/spdk/scripts/rpc.py 00:17:46.803 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@17 -- # nvmftestinit 00:17:46.803 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:17:46.803 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:46.803 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@474 -- # prepare_net_devs 00:17:46.803 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@436 -- # local -g is_hw=no 00:17:46.803 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@438 -- # remove_spdk_ns 00:17:46.803 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:46.803 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:17:46.803 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:46.803 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@440 -- # [[ virt != virt ]] 00:17:46.803 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@442 -- # [[ no == yes ]] 00:17:46.803 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@449 -- # [[ virt == phy ]] 00:17:46.803 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@452 -- # [[ virt == phy-fallback ]] 00:17:46.803 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@457 -- # [[ tcp == tcp ]] 00:17:46.803 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@458 -- # nvmf_veth_init 00:17:46.803 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@145 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:17:46.803 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@146 -- # NVMF_SECOND_INITIATOR_IP=10.0.0.2 00:17:46.803 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@147 -- # NVMF_FIRST_TARGET_IP=10.0.0.3 00:17:46.803 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@148 -- # NVMF_SECOND_TARGET_IP=10.0.0.4 00:17:46.803 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@149 -- # NVMF_INITIATOR_IP=10.0.0.1 00:17:46.803 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@150 -- # NVMF_BRIDGE=nvmf_br 00:17:46.803 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@151 -- # NVMF_INITIATOR_INTERFACE=nvmf_init_if 00:17:46.803 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@152 -- # NVMF_INITIATOR_INTERFACE2=nvmf_init_if2 00:17:46.803 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@153 -- # NVMF_INITIATOR_BRIDGE=nvmf_init_br 00:17:46.803 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@154 -- # NVMF_INITIATOR_BRIDGE2=nvmf_init_br2 00:17:46.803 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@155 -- # NVMF_TARGET_NAMESPACE=nvmf_tgt_ns_spdk 00:17:46.803 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@156 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:17:46.803 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@157 -- # NVMF_TARGET_INTERFACE=nvmf_tgt_if 00:17:46.803 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@158 -- # NVMF_TARGET_INTERFACE2=nvmf_tgt_if2 00:17:46.803 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@159 -- # NVMF_TARGET_BRIDGE=nvmf_tgt_br 00:17:46.804 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@160 -- # NVMF_TARGET_BRIDGE2=nvmf_tgt_br2 00:17:46.804 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@162 -- # ip link set nvmf_init_br nomaster 00:17:47.063 Cannot find device "nvmf_init_br" 00:17:47.063 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@162 -- # true 00:17:47.063 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@163 -- # ip link set nvmf_init_br2 nomaster 00:17:47.063 Cannot find device "nvmf_init_br2" 00:17:47.063 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@163 -- # true 00:17:47.063 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@164 -- # ip link set nvmf_tgt_br nomaster 00:17:47.063 Cannot find device "nvmf_tgt_br" 00:17:47.063 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@164 -- # true 00:17:47.063 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@165 -- # ip link set nvmf_tgt_br2 nomaster 00:17:47.063 Cannot find device "nvmf_tgt_br2" 00:17:47.063 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@165 -- # true 00:17:47.063 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@166 -- # ip link set nvmf_init_br down 00:17:47.063 Cannot find device "nvmf_init_br" 00:17:47.063 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@166 -- # true 00:17:47.063 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@167 -- # ip link set nvmf_init_br2 down 00:17:47.063 Cannot find device "nvmf_init_br2" 00:17:47.063 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@167 -- # true 00:17:47.063 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@168 -- # ip link set nvmf_tgt_br down 00:17:47.063 Cannot find device "nvmf_tgt_br" 00:17:47.063 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@168 -- # true 00:17:47.063 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@169 -- # ip link set nvmf_tgt_br2 down 00:17:47.063 Cannot find device "nvmf_tgt_br2" 00:17:47.063 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@169 -- # true 00:17:47.063 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@170 -- # ip link delete nvmf_br type bridge 00:17:47.063 Cannot find device "nvmf_br" 00:17:47.063 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@170 -- # true 00:17:47.063 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@171 -- # ip link delete nvmf_init_if 00:17:47.063 Cannot find device "nvmf_init_if" 00:17:47.063 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@171 -- # true 00:17:47.063 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@172 -- # ip link delete nvmf_init_if2 00:17:47.063 Cannot find device "nvmf_init_if2" 00:17:47.063 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@172 -- # true 00:17:47.063 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@173 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:17:47.063 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:17:47.063 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@173 -- # true 00:17:47.063 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@174 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:17:47.063 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:17:47.063 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@174 -- # true 00:17:47.063 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@177 -- # ip netns add nvmf_tgt_ns_spdk 00:17:47.063 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@180 -- # ip link add nvmf_init_if type veth peer name nvmf_init_br 00:17:47.063 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@181 -- # ip link add nvmf_init_if2 type veth peer name nvmf_init_br2 00:17:47.063 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@182 -- # ip link add nvmf_tgt_if type veth peer name nvmf_tgt_br 00:17:47.063 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@183 -- # ip link add nvmf_tgt_if2 type veth peer name nvmf_tgt_br2 00:17:47.063 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@186 -- # ip link set nvmf_tgt_if netns nvmf_tgt_ns_spdk 00:17:47.063 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@187 -- # ip link set nvmf_tgt_if2 netns nvmf_tgt_ns_spdk 00:17:47.063 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@190 -- # ip addr add 10.0.0.1/24 dev nvmf_init_if 00:17:47.320 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@191 -- # ip addr add 10.0.0.2/24 dev nvmf_init_if2 00:17:47.320 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@192 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.3/24 dev nvmf_tgt_if 00:17:47.320 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@193 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.4/24 dev nvmf_tgt_if2 00:17:47.320 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@196 -- # ip link set nvmf_init_if up 00:17:47.320 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@197 -- # ip link set nvmf_init_if2 up 00:17:47.320 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@198 -- # ip link set nvmf_init_br up 00:17:47.320 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@199 -- # ip link set nvmf_init_br2 up 00:17:47.320 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@200 -- # ip link set nvmf_tgt_br up 00:17:47.320 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@201 -- # ip link set nvmf_tgt_br2 up 00:17:47.320 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@202 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if up 00:17:47.320 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@203 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if2 up 00:17:47.320 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@204 -- # ip netns exec nvmf_tgt_ns_spdk ip link set lo up 00:17:47.320 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@207 -- # ip link add nvmf_br type bridge 00:17:47.320 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@208 -- # ip link set nvmf_br up 00:17:47.320 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@211 -- # ip link set nvmf_init_br master nvmf_br 00:17:47.320 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@212 -- # ip link set nvmf_init_br2 master nvmf_br 00:17:47.320 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@213 -- # ip link set nvmf_tgt_br master nvmf_br 00:17:47.320 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@214 -- # ip link set nvmf_tgt_br2 master nvmf_br 00:17:47.320 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@217 -- # ipts -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT 00:17:47.320 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT' 00:17:47.320 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@218 -- # ipts -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT 00:17:47.320 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT' 00:17:47.320 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@219 -- # ipts -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT 00:17:47.320 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@788 -- # iptables -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT -m comment --comment 'SPDK_NVMF:-A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT' 00:17:47.320 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@222 -- # ping -c 1 10.0.0.3 00:17:47.320 PING 10.0.0.3 (10.0.0.3) 56(84) bytes of data. 00:17:47.320 64 bytes from 10.0.0.3: icmp_seq=1 ttl=64 time=0.091 ms 00:17:47.320 00:17:47.320 --- 10.0.0.3 ping statistics --- 00:17:47.320 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:47.320 rtt min/avg/max/mdev = 0.091/0.091/0.091/0.000 ms 00:17:47.320 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@223 -- # ping -c 1 10.0.0.4 00:17:47.320 PING 10.0.0.4 (10.0.0.4) 56(84) bytes of data. 00:17:47.320 64 bytes from 10.0.0.4: icmp_seq=1 ttl=64 time=0.056 ms 00:17:47.320 00:17:47.320 --- 10.0.0.4 ping statistics --- 00:17:47.320 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:47.320 rtt min/avg/max/mdev = 0.056/0.056/0.056/0.000 ms 00:17:47.320 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@224 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.1 00:17:47.320 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:17:47.320 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.036 ms 00:17:47.320 00:17:47.320 --- 10.0.0.1 ping statistics --- 00:17:47.320 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:47.320 rtt min/avg/max/mdev = 0.036/0.036/0.036/0.000 ms 00:17:47.320 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@225 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.2 00:17:47.320 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:17:47.320 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.054 ms 00:17:47.320 00:17:47.320 --- 10.0.0.2 ping statistics --- 00:17:47.320 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:47.320 rtt min/avg/max/mdev = 0.054/0.054/0.054/0.000 ms 00:17:47.320 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@227 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:17:47.320 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@459 -- # return 0 00:17:47.320 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:17:47.320 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:17:47.320 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:17:47.320 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:17:47.320 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:17:47.320 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:17:47.320 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:17:47.320 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@18 -- # nvmfappstart -m 0xF 00:17:47.320 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:17:47.320 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@724 -- # xtrace_disable 00:17:47.320 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@10 -- # set +x 00:17:47.320 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@507 -- # nvmfpid=87970 00:17:47.320 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@506 -- # ip netns exec nvmf_tgt_ns_spdk /home/vagrant/spdk_repo/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:17:47.320 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@508 -- # waitforlisten 87970 00:17:47.320 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@831 -- # '[' -z 87970 ']' 00:17:47.320 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:47.320 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@836 -- # local max_retries=100 00:17:47.320 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:47.320 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:47.320 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@840 -- # xtrace_disable 00:17:47.321 11:28:28 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@10 -- # set +x 00:17:47.321 [2024-10-07 11:28:29.026214] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:17:47.321 [2024-10-07 11:28:29.026345] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:47.578 [2024-10-07 11:28:29.168510] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 4 00:17:47.835 [2024-10-07 11:28:29.349210] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:47.835 [2024-10-07 11:28:29.349279] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:47.835 [2024-10-07 11:28:29.349304] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:17:47.835 [2024-10-07 11:28:29.349315] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:17:47.835 [2024-10-07 11:28:29.349324] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:47.835 [2024-10-07 11:28:29.350946] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:17:47.836 [2024-10-07 11:28:29.351058] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:17:47.836 [2024-10-07 11:28:29.351135] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:17:47.836 [2024-10-07 11:28:29.351135] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 3 00:17:48.400 11:28:30 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:17:48.400 11:28:30 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@864 -- # return 0 00:17:48.400 11:28:30 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:17:48.400 11:28:30 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@730 -- # xtrace_disable 00:17:48.400 11:28:30 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@10 -- # set +x 00:17:48.400 11:28:30 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:48.400 11:28:30 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@28 -- # /home/vagrant/spdk_repo/spdk/scripts/gen_nvme.sh 00:17:48.400 11:28:30 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@28 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py load_subsystem_config 00:17:48.966 11:28:30 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@30 -- # jq -r '.[].params | select(.name=="Nvme0").traddr' 00:17:48.966 11:28:30 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@30 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py framework_get_config bdev 00:17:49.224 11:28:30 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@30 -- # local_nvme_trid=0000:00:10.0 00:17:49.224 11:28:30 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@31 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:17:49.483 11:28:31 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@31 -- # bdevs=' Malloc0' 00:17:49.483 11:28:31 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@33 -- # '[' -n 0000:00:10.0 ']' 00:17:49.483 11:28:31 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@34 -- # bdevs=' Malloc0 Nvme0n1' 00:17:49.483 11:28:31 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@37 -- # '[' tcp == rdma ']' 00:17:49.483 11:28:31 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@42 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:17:49.741 [2024-10-07 11:28:31.426194] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:49.999 11:28:31 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@44 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:17:50.257 11:28:31 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@45 -- # for bdev in $bdevs 00:17:50.257 11:28:31 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@46 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:17:50.514 11:28:32 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@45 -- # for bdev in $bdevs 00:17:50.514 11:28:32 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@46 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Nvme0n1 00:17:50.772 11:28:32 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@48 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4420 00:17:51.030 [2024-10-07 11:28:32.575658] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:17:51.030 11:28:32 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@49 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.3 -s 4420 00:17:51.288 11:28:32 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@52 -- # '[' -n 0000:00:10.0 ']' 00:17:51.288 11:28:32 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@53 -- # perf_app -i 0 -q 32 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:PCIe traddr:0000:00:10.0' 00:17:51.288 11:28:32 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@21 -- # '[' 0 -eq 1 ']' 00:17:51.288 11:28:32 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@24 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_nvme_perf -i 0 -q 32 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:PCIe traddr:0000:00:10.0' 00:17:52.661 Initializing NVMe Controllers 00:17:52.662 Attached to NVMe Controller at 0000:00:10.0 [1b36:0010] 00:17:52.662 Associating PCIE (0000:00:10.0) NSID 1 with lcore 0 00:17:52.662 Initialization complete. Launching workers. 00:17:52.662 ======================================================== 00:17:52.662 Latency(us) 00:17:52.662 Device Information : IOPS MiB/s Average min max 00:17:52.662 PCIE (0000:00:10.0) NSID 1 from core 0: 23552.00 92.00 1358.71 321.10 8109.41 00:17:52.662 ======================================================== 00:17:52.662 Total : 23552.00 92.00 1358.71 321.10 8109.41 00:17:52.662 00:17:52.662 11:28:33 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@56 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_nvme_perf -q 1 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.3 trsvcid:4420' 00:17:53.595 Initializing NVMe Controllers 00:17:53.595 Attached to NVMe over Fabrics controller at 10.0.0.3:4420: nqn.2016-06.io.spdk:cnode1 00:17:53.595 Associating TCP (addr:10.0.0.3 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:17:53.595 Associating TCP (addr:10.0.0.3 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:17:53.595 Initialization complete. Launching workers. 00:17:53.595 ======================================================== 00:17:53.595 Latency(us) 00:17:53.595 Device Information : IOPS MiB/s Average min max 00:17:53.595 TCP (addr:10.0.0.3 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 3076.76 12.02 324.58 124.26 7270.09 00:17:53.595 TCP (addr:10.0.0.3 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 124.87 0.49 8071.35 6255.72 12009.11 00:17:53.595 ======================================================== 00:17:53.595 Total : 3201.63 12.51 626.71 124.26 12009.11 00:17:53.595 00:17:53.853 11:28:35 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@57 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_nvme_perf -q 32 -o 4096 -w randrw -M 50 -t 1 -HI -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.3 trsvcid:4420' 00:17:55.243 Initializing NVMe Controllers 00:17:55.243 Attached to NVMe over Fabrics controller at 10.0.0.3:4420: nqn.2016-06.io.spdk:cnode1 00:17:55.243 Associating TCP (addr:10.0.0.3 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:17:55.243 Associating TCP (addr:10.0.0.3 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:17:55.243 Initialization complete. Launching workers. 00:17:55.243 ======================================================== 00:17:55.243 Latency(us) 00:17:55.243 Device Information : IOPS MiB/s Average min max 00:17:55.243 TCP (addr:10.0.0.3 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 7859.45 30.70 4073.21 463.58 8171.02 00:17:55.243 TCP (addr:10.0.0.3 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 2691.41 10.51 11912.12 5986.56 20148.83 00:17:55.243 ======================================================== 00:17:55.243 Total : 10550.86 41.21 6072.84 463.58 20148.83 00:17:55.243 00:17:55.243 11:28:36 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@59 -- # [[ '' == \e\8\1\0 ]] 00:17:55.243 11:28:36 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@60 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_nvme_perf -q 128 -o 262144 -O 16384 -w randrw -M 50 -t 2 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.3 trsvcid:4420' 00:17:57.771 Initializing NVMe Controllers 00:17:57.771 Attached to NVMe over Fabrics controller at 10.0.0.3:4420: nqn.2016-06.io.spdk:cnode1 00:17:57.771 Controller IO queue size 128, less than required. 00:17:57.771 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:17:57.771 Controller IO queue size 128, less than required. 00:17:57.771 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:17:57.771 Associating TCP (addr:10.0.0.3 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:17:57.771 Associating TCP (addr:10.0.0.3 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:17:57.771 Initialization complete. Launching workers. 00:17:57.771 ======================================================== 00:17:57.771 Latency(us) 00:17:57.771 Device Information : IOPS MiB/s Average min max 00:17:57.771 TCP (addr:10.0.0.3 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1005.26 251.31 130888.96 83615.46 243895.69 00:17:57.771 TCP (addr:10.0.0.3 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 594.56 148.64 228002.09 76673.06 364692.71 00:17:57.771 ======================================================== 00:17:57.771 Total : 1599.82 399.95 166980.35 76673.06 364692.71 00:17:57.771 00:17:57.771 11:28:39 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@64 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_nvme_perf -q 128 -o 36964 -O 4096 -w randrw -M 50 -t 5 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.3 trsvcid:4420' -c 0xf -P 4 00:17:57.771 Initializing NVMe Controllers 00:17:57.771 Attached to NVMe over Fabrics controller at 10.0.0.3:4420: nqn.2016-06.io.spdk:cnode1 00:17:57.771 Controller IO queue size 128, less than required. 00:17:57.771 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:17:57.771 WARNING: IO size 36964 (-o) is not a multiple of nsid 1 sector size 512. Removing this ns from test 00:17:57.771 Controller IO queue size 128, less than required. 00:17:57.771 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:17:57.771 WARNING: IO size 36964 (-o) is not a multiple of nsid 2 sector size 4096. Removing this ns from test 00:17:57.771 WARNING: Some requested NVMe devices were skipped 00:17:57.771 No valid NVMe controllers or AIO or URING devices found 00:17:58.029 11:28:39 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@65 -- # /home/vagrant/spdk_repo/spdk/build/bin/spdk_nvme_perf -q 128 -o 262144 -w randrw -M 50 -t 2 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.3 trsvcid:4420' --transport-stat 00:18:00.556 Initializing NVMe Controllers 00:18:00.556 Attached to NVMe over Fabrics controller at 10.0.0.3:4420: nqn.2016-06.io.spdk:cnode1 00:18:00.556 Controller IO queue size 128, less than required. 00:18:00.556 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:18:00.556 Controller IO queue size 128, less than required. 00:18:00.556 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:18:00.556 Associating TCP (addr:10.0.0.3 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:18:00.556 Associating TCP (addr:10.0.0.3 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:18:00.556 Initialization complete. Launching workers. 00:18:00.556 00:18:00.556 ==================== 00:18:00.556 lcore 0, ns TCP (addr:10.0.0.3 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 statistics: 00:18:00.556 TCP transport: 00:18:00.556 polls: 8268 00:18:00.556 idle_polls: 4110 00:18:00.556 sock_completions: 4158 00:18:00.556 nvme_completions: 3511 00:18:00.556 submitted_requests: 5324 00:18:00.556 queued_requests: 1 00:18:00.556 00:18:00.556 ==================== 00:18:00.556 lcore 0, ns TCP (addr:10.0.0.3 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 statistics: 00:18:00.556 TCP transport: 00:18:00.556 polls: 8367 00:18:00.556 idle_polls: 4935 00:18:00.556 sock_completions: 3432 00:18:00.556 nvme_completions: 6277 00:18:00.556 submitted_requests: 9368 00:18:00.556 queued_requests: 1 00:18:00.556 ======================================================== 00:18:00.556 Latency(us) 00:18:00.556 Device Information : IOPS MiB/s Average min max 00:18:00.556 TCP (addr:10.0.0.3 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 875.92 218.98 151966.18 62260.19 284967.04 00:18:00.556 TCP (addr:10.0.0.3 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 1566.17 391.54 82648.93 48093.94 144601.54 00:18:00.556 ======================================================== 00:18:00.556 Total : 2442.09 610.52 107511.34 48093.94 284967.04 00:18:00.556 00:18:00.556 11:28:42 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@66 -- # sync 00:18:00.556 11:28:42 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@67 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:18:00.814 11:28:42 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@69 -- # '[' 0 -eq 1 ']' 00:18:00.814 11:28:42 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@112 -- # trap - SIGINT SIGTERM EXIT 00:18:00.814 11:28:42 nvmf_tcp.nvmf_host.nvmf_perf -- host/perf.sh@114 -- # nvmftestfini 00:18:00.814 11:28:42 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@514 -- # nvmfcleanup 00:18:00.814 11:28:42 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@121 -- # sync 00:18:00.814 11:28:42 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:18:00.814 11:28:42 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@124 -- # set +e 00:18:00.814 11:28:42 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@125 -- # for i in {1..20} 00:18:00.814 11:28:42 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:18:00.814 rmmod nvme_tcp 00:18:00.814 rmmod nvme_fabrics 00:18:00.814 rmmod nvme_keyring 00:18:00.814 11:28:42 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:18:00.814 11:28:42 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@128 -- # set -e 00:18:00.814 11:28:42 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@129 -- # return 0 00:18:00.814 11:28:42 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@515 -- # '[' -n 87970 ']' 00:18:00.814 11:28:42 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@516 -- # killprocess 87970 00:18:00.814 11:28:42 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@950 -- # '[' -z 87970 ']' 00:18:00.814 11:28:42 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@954 -- # kill -0 87970 00:18:00.814 11:28:42 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@955 -- # uname 00:18:00.814 11:28:42 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:18:00.814 11:28:42 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 87970 00:18:00.814 killing process with pid 87970 00:18:00.814 11:28:42 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:18:00.814 11:28:42 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:18:00.814 11:28:42 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@968 -- # echo 'killing process with pid 87970' 00:18:00.814 11:28:42 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@969 -- # kill 87970 00:18:00.814 11:28:42 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@974 -- # wait 87970 00:18:01.747 11:28:43 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:18:01.747 11:28:43 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:18:01.747 11:28:43 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:18:01.747 11:28:43 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@297 -- # iptr 00:18:01.747 11:28:43 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@789 -- # iptables-save 00:18:01.747 11:28:43 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:18:01.747 11:28:43 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@789 -- # iptables-restore 00:18:01.747 11:28:43 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@298 -- # [[ nvmf_tgt_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:18:01.747 11:28:43 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@299 -- # nvmf_veth_fini 00:18:01.747 11:28:43 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@233 -- # ip link set nvmf_init_br nomaster 00:18:01.747 11:28:43 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@234 -- # ip link set nvmf_init_br2 nomaster 00:18:01.747 11:28:43 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@235 -- # ip link set nvmf_tgt_br nomaster 00:18:01.747 11:28:43 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@236 -- # ip link set nvmf_tgt_br2 nomaster 00:18:01.747 11:28:43 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@237 -- # ip link set nvmf_init_br down 00:18:01.747 11:28:43 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@238 -- # ip link set nvmf_init_br2 down 00:18:01.747 11:28:43 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@239 -- # ip link set nvmf_tgt_br down 00:18:01.747 11:28:43 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@240 -- # ip link set nvmf_tgt_br2 down 00:18:01.747 11:28:43 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@241 -- # ip link delete nvmf_br type bridge 00:18:01.747 11:28:43 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@242 -- # ip link delete nvmf_init_if 00:18:02.005 11:28:43 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@243 -- # ip link delete nvmf_init_if2 00:18:02.005 11:28:43 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@244 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:18:02.005 11:28:43 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@245 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:18:02.005 11:28:43 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@246 -- # remove_spdk_ns 00:18:02.005 11:28:43 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:02.005 11:28:43 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:18:02.005 11:28:43 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:02.005 11:28:43 nvmf_tcp.nvmf_host.nvmf_perf -- nvmf/common.sh@300 -- # return 0 00:18:02.005 00:18:02.005 real 0m15.287s 00:18:02.005 user 0m54.757s 00:18:02.005 sys 0m3.909s 00:18:02.005 11:28:43 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@1126 -- # xtrace_disable 00:18:02.005 11:28:43 nvmf_tcp.nvmf_host.nvmf_perf -- common/autotest_common.sh@10 -- # set +x 00:18:02.005 ************************************ 00:18:02.005 END TEST nvmf_perf 00:18:02.005 ************************************ 00:18:02.005 11:28:43 nvmf_tcp.nvmf_host -- nvmf/nvmf_host.sh@24 -- # run_test nvmf_fio_host /home/vagrant/spdk_repo/spdk/test/nvmf/host/fio.sh --transport=tcp 00:18:02.005 11:28:43 nvmf_tcp.nvmf_host -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:18:02.005 11:28:43 nvmf_tcp.nvmf_host -- common/autotest_common.sh@1107 -- # xtrace_disable 00:18:02.005 11:28:43 nvmf_tcp.nvmf_host -- common/autotest_common.sh@10 -- # set +x 00:18:02.005 ************************************ 00:18:02.005 START TEST nvmf_fio_host 00:18:02.005 ************************************ 00:18:02.005 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/nvmf/host/fio.sh --transport=tcp 00:18:02.005 * Looking for test storage... 00:18:02.005 * Found test storage at /home/vagrant/spdk_repo/spdk/test/nvmf/host 00:18:02.005 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:18:02.005 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:18:02.005 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1681 -- # lcov --version 00:18:02.264 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:18:02.264 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:18:02.264 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@333 -- # local ver1 ver1_l 00:18:02.264 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@334 -- # local ver2 ver2_l 00:18:02.264 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@336 -- # IFS=.-: 00:18:02.264 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@336 -- # read -ra ver1 00:18:02.265 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@337 -- # IFS=.-: 00:18:02.265 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@337 -- # read -ra ver2 00:18:02.265 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@338 -- # local 'op=<' 00:18:02.265 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@340 -- # ver1_l=2 00:18:02.265 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@341 -- # ver2_l=1 00:18:02.265 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:18:02.265 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@344 -- # case "$op" in 00:18:02.265 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@345 -- # : 1 00:18:02.265 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@364 -- # (( v = 0 )) 00:18:02.265 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:02.265 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@365 -- # decimal 1 00:18:02.265 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@353 -- # local d=1 00:18:02.265 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:18:02.265 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@355 -- # echo 1 00:18:02.265 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@365 -- # ver1[v]=1 00:18:02.265 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@366 -- # decimal 2 00:18:02.265 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@353 -- # local d=2 00:18:02.265 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:18:02.265 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@355 -- # echo 2 00:18:02.265 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@366 -- # ver2[v]=2 00:18:02.265 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:18:02.265 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:18:02.265 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@368 -- # return 0 00:18:02.265 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:18:02.265 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:18:02.265 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:02.265 --rc genhtml_branch_coverage=1 00:18:02.265 --rc genhtml_function_coverage=1 00:18:02.265 --rc genhtml_legend=1 00:18:02.265 --rc geninfo_all_blocks=1 00:18:02.265 --rc geninfo_unexecuted_blocks=1 00:18:02.265 00:18:02.265 ' 00:18:02.265 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:18:02.265 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:02.265 --rc genhtml_branch_coverage=1 00:18:02.265 --rc genhtml_function_coverage=1 00:18:02.265 --rc genhtml_legend=1 00:18:02.265 --rc geninfo_all_blocks=1 00:18:02.265 --rc geninfo_unexecuted_blocks=1 00:18:02.265 00:18:02.265 ' 00:18:02.265 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:18:02.265 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:02.265 --rc genhtml_branch_coverage=1 00:18:02.265 --rc genhtml_function_coverage=1 00:18:02.265 --rc genhtml_legend=1 00:18:02.265 --rc geninfo_all_blocks=1 00:18:02.265 --rc geninfo_unexecuted_blocks=1 00:18:02.265 00:18:02.265 ' 00:18:02.265 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:18:02.265 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:02.265 --rc genhtml_branch_coverage=1 00:18:02.265 --rc genhtml_function_coverage=1 00:18:02.265 --rc genhtml_legend=1 00:18:02.265 --rc geninfo_all_blocks=1 00:18:02.265 --rc geninfo_unexecuted_blocks=1 00:18:02.265 00:18:02.265 ' 00:18:02.265 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- host/fio.sh@9 -- # source /home/vagrant/spdk_repo/spdk/scripts/common.sh 00:18:02.265 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@15 -- # shopt -s extglob 00:18:02.265 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:02.265 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:02.265 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:02.265 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:02.265 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:02.265 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:02.265 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- paths/export.sh@5 -- # export PATH 00:18:02.265 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:02.265 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- host/fio.sh@10 -- # source /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh 00:18:02.265 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@7 -- # uname -s 00:18:02.265 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:02.265 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:02.265 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:02.265 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:02.265 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:02.265 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:02.265 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:02.265 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:02.265 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:02.265 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:02.265 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:18:02.265 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@18 -- # NVME_HOSTID=3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:18:02.265 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:02.265 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:02.265 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@21 -- # NET_TYPE=virt 00:18:02.265 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:18:02.265 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@49 -- # source /home/vagrant/spdk_repo/spdk/scripts/common.sh 00:18:02.265 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@15 -- # shopt -s extglob 00:18:02.265 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:02.265 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:02.265 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:02.265 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:02.265 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:02.265 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:02.265 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- paths/export.sh@5 -- # export PATH 00:18:02.265 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:02.265 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@51 -- # : 0 00:18:02.265 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:18:02.265 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:18:02.266 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:18:02.266 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:02.266 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:02.266 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:18:02.266 /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:18:02.266 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:18:02.266 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:18:02.266 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@55 -- # have_pci_nics=0 00:18:02.266 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- host/fio.sh@12 -- # rpc_py=/home/vagrant/spdk_repo/spdk/scripts/rpc.py 00:18:02.266 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- host/fio.sh@14 -- # nvmftestinit 00:18:02.266 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:18:02.266 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:02.266 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@474 -- # prepare_net_devs 00:18:02.266 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@436 -- # local -g is_hw=no 00:18:02.266 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@438 -- # remove_spdk_ns 00:18:02.266 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:02.266 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:18:02.266 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:02.266 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@440 -- # [[ virt != virt ]] 00:18:02.266 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@442 -- # [[ no == yes ]] 00:18:02.266 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@449 -- # [[ virt == phy ]] 00:18:02.266 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@452 -- # [[ virt == phy-fallback ]] 00:18:02.266 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@457 -- # [[ tcp == tcp ]] 00:18:02.266 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@458 -- # nvmf_veth_init 00:18:02.266 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@145 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:18:02.266 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@146 -- # NVMF_SECOND_INITIATOR_IP=10.0.0.2 00:18:02.266 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@147 -- # NVMF_FIRST_TARGET_IP=10.0.0.3 00:18:02.266 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@148 -- # NVMF_SECOND_TARGET_IP=10.0.0.4 00:18:02.266 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@149 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:02.266 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@150 -- # NVMF_BRIDGE=nvmf_br 00:18:02.266 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@151 -- # NVMF_INITIATOR_INTERFACE=nvmf_init_if 00:18:02.266 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@152 -- # NVMF_INITIATOR_INTERFACE2=nvmf_init_if2 00:18:02.266 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@153 -- # NVMF_INITIATOR_BRIDGE=nvmf_init_br 00:18:02.266 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@154 -- # NVMF_INITIATOR_BRIDGE2=nvmf_init_br2 00:18:02.266 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@155 -- # NVMF_TARGET_NAMESPACE=nvmf_tgt_ns_spdk 00:18:02.266 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@156 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:02.266 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@157 -- # NVMF_TARGET_INTERFACE=nvmf_tgt_if 00:18:02.266 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@158 -- # NVMF_TARGET_INTERFACE2=nvmf_tgt_if2 00:18:02.266 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@159 -- # NVMF_TARGET_BRIDGE=nvmf_tgt_br 00:18:02.266 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@160 -- # NVMF_TARGET_BRIDGE2=nvmf_tgt_br2 00:18:02.266 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@162 -- # ip link set nvmf_init_br nomaster 00:18:02.266 Cannot find device "nvmf_init_br" 00:18:02.266 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@162 -- # true 00:18:02.266 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@163 -- # ip link set nvmf_init_br2 nomaster 00:18:02.266 Cannot find device "nvmf_init_br2" 00:18:02.266 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@163 -- # true 00:18:02.266 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@164 -- # ip link set nvmf_tgt_br nomaster 00:18:02.266 Cannot find device "nvmf_tgt_br" 00:18:02.266 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@164 -- # true 00:18:02.266 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@165 -- # ip link set nvmf_tgt_br2 nomaster 00:18:02.266 Cannot find device "nvmf_tgt_br2" 00:18:02.266 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@165 -- # true 00:18:02.266 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@166 -- # ip link set nvmf_init_br down 00:18:02.266 Cannot find device "nvmf_init_br" 00:18:02.266 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@166 -- # true 00:18:02.266 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@167 -- # ip link set nvmf_init_br2 down 00:18:02.266 Cannot find device "nvmf_init_br2" 00:18:02.266 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@167 -- # true 00:18:02.266 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@168 -- # ip link set nvmf_tgt_br down 00:18:02.266 Cannot find device "nvmf_tgt_br" 00:18:02.266 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@168 -- # true 00:18:02.266 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@169 -- # ip link set nvmf_tgt_br2 down 00:18:02.266 Cannot find device "nvmf_tgt_br2" 00:18:02.266 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@169 -- # true 00:18:02.266 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@170 -- # ip link delete nvmf_br type bridge 00:18:02.266 Cannot find device "nvmf_br" 00:18:02.266 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@170 -- # true 00:18:02.266 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@171 -- # ip link delete nvmf_init_if 00:18:02.266 Cannot find device "nvmf_init_if" 00:18:02.266 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@171 -- # true 00:18:02.266 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@172 -- # ip link delete nvmf_init_if2 00:18:02.266 Cannot find device "nvmf_init_if2" 00:18:02.266 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@172 -- # true 00:18:02.266 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@173 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:18:02.266 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:18:02.266 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@173 -- # true 00:18:02.266 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@174 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:18:02.266 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:18:02.266 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@174 -- # true 00:18:02.266 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@177 -- # ip netns add nvmf_tgt_ns_spdk 00:18:02.266 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@180 -- # ip link add nvmf_init_if type veth peer name nvmf_init_br 00:18:02.524 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@181 -- # ip link add nvmf_init_if2 type veth peer name nvmf_init_br2 00:18:02.524 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@182 -- # ip link add nvmf_tgt_if type veth peer name nvmf_tgt_br 00:18:02.524 11:28:43 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@183 -- # ip link add nvmf_tgt_if2 type veth peer name nvmf_tgt_br2 00:18:02.524 11:28:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@186 -- # ip link set nvmf_tgt_if netns nvmf_tgt_ns_spdk 00:18:02.524 11:28:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@187 -- # ip link set nvmf_tgt_if2 netns nvmf_tgt_ns_spdk 00:18:02.524 11:28:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@190 -- # ip addr add 10.0.0.1/24 dev nvmf_init_if 00:18:02.524 11:28:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@191 -- # ip addr add 10.0.0.2/24 dev nvmf_init_if2 00:18:02.524 11:28:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@192 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.3/24 dev nvmf_tgt_if 00:18:02.524 11:28:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@193 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.4/24 dev nvmf_tgt_if2 00:18:02.524 11:28:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@196 -- # ip link set nvmf_init_if up 00:18:02.524 11:28:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@197 -- # ip link set nvmf_init_if2 up 00:18:02.524 11:28:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@198 -- # ip link set nvmf_init_br up 00:18:02.524 11:28:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@199 -- # ip link set nvmf_init_br2 up 00:18:02.524 11:28:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@200 -- # ip link set nvmf_tgt_br up 00:18:02.524 11:28:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@201 -- # ip link set nvmf_tgt_br2 up 00:18:02.524 11:28:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@202 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if up 00:18:02.524 11:28:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@203 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if2 up 00:18:02.524 11:28:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@204 -- # ip netns exec nvmf_tgt_ns_spdk ip link set lo up 00:18:02.524 11:28:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@207 -- # ip link add nvmf_br type bridge 00:18:02.524 11:28:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@208 -- # ip link set nvmf_br up 00:18:02.524 11:28:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@211 -- # ip link set nvmf_init_br master nvmf_br 00:18:02.524 11:28:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@212 -- # ip link set nvmf_init_br2 master nvmf_br 00:18:02.524 11:28:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@213 -- # ip link set nvmf_tgt_br master nvmf_br 00:18:02.524 11:28:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@214 -- # ip link set nvmf_tgt_br2 master nvmf_br 00:18:02.524 11:28:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@217 -- # ipts -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT 00:18:02.524 11:28:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT' 00:18:02.524 11:28:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@218 -- # ipts -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT 00:18:02.524 11:28:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT' 00:18:02.524 11:28:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@219 -- # ipts -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT 00:18:02.524 11:28:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@788 -- # iptables -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT -m comment --comment 'SPDK_NVMF:-A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT' 00:18:02.524 11:28:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@222 -- # ping -c 1 10.0.0.3 00:18:02.524 PING 10.0.0.3 (10.0.0.3) 56(84) bytes of data. 00:18:02.524 64 bytes from 10.0.0.3: icmp_seq=1 ttl=64 time=0.065 ms 00:18:02.524 00:18:02.524 --- 10.0.0.3 ping statistics --- 00:18:02.524 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:02.524 rtt min/avg/max/mdev = 0.065/0.065/0.065/0.000 ms 00:18:02.524 11:28:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@223 -- # ping -c 1 10.0.0.4 00:18:02.524 PING 10.0.0.4 (10.0.0.4) 56(84) bytes of data. 00:18:02.524 64 bytes from 10.0.0.4: icmp_seq=1 ttl=64 time=0.053 ms 00:18:02.524 00:18:02.524 --- 10.0.0.4 ping statistics --- 00:18:02.524 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:02.524 rtt min/avg/max/mdev = 0.053/0.053/0.053/0.000 ms 00:18:02.524 11:28:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@224 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.1 00:18:02.524 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:02.524 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.019 ms 00:18:02.524 00:18:02.524 --- 10.0.0.1 ping statistics --- 00:18:02.524 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:02.524 rtt min/avg/max/mdev = 0.019/0.019/0.019/0.000 ms 00:18:02.524 11:28:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@225 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.2 00:18:02.782 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:02.782 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.085 ms 00:18:02.782 00:18:02.782 --- 10.0.0.2 ping statistics --- 00:18:02.782 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:02.782 rtt min/avg/max/mdev = 0.085/0.085/0.085/0.000 ms 00:18:02.782 11:28:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@227 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:02.782 11:28:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@459 -- # return 0 00:18:02.782 11:28:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:18:02.782 11:28:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:02.782 11:28:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:18:02.782 11:28:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:18:02.782 11:28:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:02.782 11:28:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:18:02.782 11:28:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:18:02.782 11:28:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- host/fio.sh@16 -- # [[ y != y ]] 00:18:02.782 11:28:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- host/fio.sh@21 -- # timing_enter start_nvmf_tgt 00:18:02.782 11:28:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@724 -- # xtrace_disable 00:18:02.782 11:28:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@10 -- # set +x 00:18:02.782 11:28:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- host/fio.sh@24 -- # nvmfpid=88508 00:18:02.782 11:28:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- host/fio.sh@23 -- # ip netns exec nvmf_tgt_ns_spdk /home/vagrant/spdk_repo/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:18:02.782 11:28:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- host/fio.sh@26 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:18:02.782 11:28:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- host/fio.sh@28 -- # waitforlisten 88508 00:18:02.782 11:28:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@831 -- # '[' -z 88508 ']' 00:18:02.782 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:02.782 11:28:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:02.782 11:28:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@836 -- # local max_retries=100 00:18:02.782 11:28:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:02.782 11:28:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@840 -- # xtrace_disable 00:18:02.782 11:28:44 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@10 -- # set +x 00:18:02.782 [2024-10-07 11:28:44.338804] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:18:02.782 [2024-10-07 11:28:44.338921] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:02.782 [2024-10-07 11:28:44.480923] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 4 00:18:03.039 [2024-10-07 11:28:44.637036] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:03.039 [2024-10-07 11:28:44.637142] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:03.039 [2024-10-07 11:28:44.637158] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:18:03.039 [2024-10-07 11:28:44.637169] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:18:03.039 [2024-10-07 11:28:44.637179] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:03.039 [2024-10-07 11:28:44.638728] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:18:03.039 [2024-10-07 11:28:44.638790] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:18:03.039 [2024-10-07 11:28:44.638935] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 3 00:18:03.039 [2024-10-07 11:28:44.638944] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:18:03.998 11:28:45 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:18:03.998 11:28:45 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@864 -- # return 0 00:18:03.998 11:28:45 nvmf_tcp.nvmf_host.nvmf_fio_host -- host/fio.sh@29 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:18:04.255 [2024-10-07 11:28:45.759711] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:04.255 11:28:45 nvmf_tcp.nvmf_host.nvmf_fio_host -- host/fio.sh@30 -- # timing_exit start_nvmf_tgt 00:18:04.256 11:28:45 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@730 -- # xtrace_disable 00:18:04.256 11:28:45 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@10 -- # set +x 00:18:04.256 11:28:45 nvmf_tcp.nvmf_host.nvmf_fio_host -- host/fio.sh@32 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc1 00:18:04.513 Malloc1 00:18:04.513 11:28:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- host/fio.sh@33 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:18:04.771 11:28:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- host/fio.sh@34 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:18:05.029 11:28:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- host/fio.sh@35 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4420 00:18:05.287 [2024-10-07 11:28:46.910155] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:18:05.287 11:28:46 nvmf_tcp.nvmf_host.nvmf_fio_host -- host/fio.sh@36 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.3 -s 4420 00:18:05.545 11:28:47 nvmf_tcp.nvmf_host.nvmf_fio_host -- host/fio.sh@38 -- # PLUGIN_DIR=/home/vagrant/spdk_repo/spdk/app/fio/nvme 00:18:05.545 11:28:47 nvmf_tcp.nvmf_host.nvmf_fio_host -- host/fio.sh@41 -- # fio_nvme /home/vagrant/spdk_repo/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.3 trsvcid=4420 ns=1' --bs=4096 00:18:05.545 11:28:47 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1360 -- # fio_plugin /home/vagrant/spdk_repo/spdk/build/fio/spdk_nvme /home/vagrant/spdk_repo/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.3 trsvcid=4420 ns=1' --bs=4096 00:18:05.545 11:28:47 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1337 -- # local fio_dir=/usr/src/fio 00:18:05.545 11:28:47 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1339 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:18:05.545 11:28:47 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1339 -- # local sanitizers 00:18:05.545 11:28:47 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1340 -- # local plugin=/home/vagrant/spdk_repo/spdk/build/fio/spdk_nvme 00:18:05.545 11:28:47 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1341 -- # shift 00:18:05.545 11:28:47 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1343 -- # local asan_lib= 00:18:05.545 11:28:47 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1344 -- # for sanitizer in "${sanitizers[@]}" 00:18:05.545 11:28:47 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1345 -- # awk '{print $3}' 00:18:05.545 11:28:47 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1345 -- # ldd /home/vagrant/spdk_repo/spdk/build/fio/spdk_nvme 00:18:05.545 11:28:47 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1345 -- # grep libasan 00:18:05.545 11:28:47 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1345 -- # asan_lib= 00:18:05.545 11:28:47 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1346 -- # [[ -n '' ]] 00:18:05.545 11:28:47 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1344 -- # for sanitizer in "${sanitizers[@]}" 00:18:05.545 11:28:47 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1345 -- # ldd /home/vagrant/spdk_repo/spdk/build/fio/spdk_nvme 00:18:05.545 11:28:47 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1345 -- # grep libclang_rt.asan 00:18:05.545 11:28:47 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1345 -- # awk '{print $3}' 00:18:05.545 11:28:47 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1345 -- # asan_lib= 00:18:05.545 11:28:47 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1346 -- # [[ -n '' ]] 00:18:05.545 11:28:47 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1352 -- # LD_PRELOAD=' /home/vagrant/spdk_repo/spdk/build/fio/spdk_nvme' 00:18:05.545 11:28:47 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1352 -- # /usr/src/fio/fio /home/vagrant/spdk_repo/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.3 trsvcid=4420 ns=1' --bs=4096 00:18:05.803 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:18:05.803 fio-3.35 00:18:05.803 Starting 1 thread 00:18:08.337 00:18:08.337 test: (groupid=0, jobs=1): err= 0: pid=88635: Mon Oct 7 11:28:49 2024 00:18:08.337 read: IOPS=8932, BW=34.9MiB/s (36.6MB/s)(70.0MiB/2007msec) 00:18:08.337 slat (usec): min=2, max=385, avg= 2.62, stdev= 3.66 00:18:08.337 clat (usec): min=3408, max=13535, avg=7499.11, stdev=531.40 00:18:08.337 lat (usec): min=3473, max=13537, avg=7501.73, stdev=531.20 00:18:08.337 clat percentiles (usec): 00:18:08.337 | 1.00th=[ 6325], 5.00th=[ 6718], 10.00th=[ 6915], 20.00th=[ 7111], 00:18:08.337 | 30.00th=[ 7242], 40.00th=[ 7373], 50.00th=[ 7504], 60.00th=[ 7570], 00:18:08.337 | 70.00th=[ 7701], 80.00th=[ 7898], 90.00th=[ 8094], 95.00th=[ 8356], 00:18:08.337 | 99.00th=[ 8717], 99.50th=[ 8979], 99.90th=[11600], 99.95th=[12387], 00:18:08.337 | 99.99th=[13435] 00:18:08.337 bw ( KiB/s): min=35064, max=36176, per=99.97%, avg=35720.00, stdev=490.94, samples=4 00:18:08.337 iops : min= 8766, max= 9044, avg=8930.00, stdev=122.74, samples=4 00:18:08.337 write: IOPS=8947, BW=34.9MiB/s (36.6MB/s)(70.1MiB/2007msec); 0 zone resets 00:18:08.337 slat (usec): min=2, max=258, avg= 2.76, stdev= 2.35 00:18:08.337 clat (usec): min=2606, max=12558, avg=6769.02, stdev=462.37 00:18:08.337 lat (usec): min=2621, max=12561, avg=6771.78, stdev=462.22 00:18:08.337 clat percentiles (usec): 00:18:08.337 | 1.00th=[ 5800], 5.00th=[ 6063], 10.00th=[ 6259], 20.00th=[ 6456], 00:18:08.337 | 30.00th=[ 6587], 40.00th=[ 6652], 50.00th=[ 6783], 60.00th=[ 6849], 00:18:08.337 | 70.00th=[ 6980], 80.00th=[ 7111], 90.00th=[ 7308], 95.00th=[ 7439], 00:18:08.337 | 99.00th=[ 7767], 99.50th=[ 7898], 99.90th=[10945], 99.95th=[11731], 00:18:08.337 | 99.99th=[12518] 00:18:08.337 bw ( KiB/s): min=35560, max=36160, per=100.00%, avg=35794.00, stdev=264.72, samples=4 00:18:08.337 iops : min= 8890, max= 9040, avg=8948.50, stdev=66.18, samples=4 00:18:08.337 lat (msec) : 4=0.06%, 10=99.79%, 20=0.14% 00:18:08.337 cpu : usr=68.89%, sys=23.08%, ctx=19, majf=0, minf=6 00:18:08.337 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.8% 00:18:08.337 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:08.337 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:18:08.337 issued rwts: total=17927,17957,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:08.337 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:08.337 00:18:08.337 Run status group 0 (all jobs): 00:18:08.337 READ: bw=34.9MiB/s (36.6MB/s), 34.9MiB/s-34.9MiB/s (36.6MB/s-36.6MB/s), io=70.0MiB (73.4MB), run=2007-2007msec 00:18:08.337 WRITE: bw=34.9MiB/s (36.6MB/s), 34.9MiB/s-34.9MiB/s (36.6MB/s-36.6MB/s), io=70.1MiB (73.6MB), run=2007-2007msec 00:18:08.337 11:28:49 nvmf_tcp.nvmf_host.nvmf_fio_host -- host/fio.sh@45 -- # fio_nvme /home/vagrant/spdk_repo/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.3 trsvcid=4420 ns=1' 00:18:08.337 11:28:49 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1360 -- # fio_plugin /home/vagrant/spdk_repo/spdk/build/fio/spdk_nvme /home/vagrant/spdk_repo/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.3 trsvcid=4420 ns=1' 00:18:08.337 11:28:49 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1337 -- # local fio_dir=/usr/src/fio 00:18:08.337 11:28:49 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1339 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:18:08.337 11:28:49 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1339 -- # local sanitizers 00:18:08.337 11:28:49 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1340 -- # local plugin=/home/vagrant/spdk_repo/spdk/build/fio/spdk_nvme 00:18:08.337 11:28:49 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1341 -- # shift 00:18:08.337 11:28:49 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1343 -- # local asan_lib= 00:18:08.337 11:28:49 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1344 -- # for sanitizer in "${sanitizers[@]}" 00:18:08.337 11:28:49 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1345 -- # grep libasan 00:18:08.337 11:28:49 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1345 -- # ldd /home/vagrant/spdk_repo/spdk/build/fio/spdk_nvme 00:18:08.337 11:28:49 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1345 -- # awk '{print $3}' 00:18:08.337 11:28:49 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1345 -- # asan_lib= 00:18:08.337 11:28:49 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1346 -- # [[ -n '' ]] 00:18:08.337 11:28:49 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1344 -- # for sanitizer in "${sanitizers[@]}" 00:18:08.337 11:28:49 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1345 -- # ldd /home/vagrant/spdk_repo/spdk/build/fio/spdk_nvme 00:18:08.337 11:28:49 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1345 -- # grep libclang_rt.asan 00:18:08.337 11:28:49 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1345 -- # awk '{print $3}' 00:18:08.337 11:28:49 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1345 -- # asan_lib= 00:18:08.337 11:28:49 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1346 -- # [[ -n '' ]] 00:18:08.337 11:28:49 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1352 -- # LD_PRELOAD=' /home/vagrant/spdk_repo/spdk/build/fio/spdk_nvme' 00:18:08.337 11:28:49 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1352 -- # /usr/src/fio/fio /home/vagrant/spdk_repo/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.3 trsvcid=4420 ns=1' 00:18:08.337 test: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=spdk, iodepth=128 00:18:08.337 fio-3.35 00:18:08.337 Starting 1 thread 00:18:10.867 00:18:10.867 test: (groupid=0, jobs=1): err= 0: pid=88678: Mon Oct 7 11:28:52 2024 00:18:10.867 read: IOPS=7817, BW=122MiB/s (128MB/s)(245MiB/2006msec) 00:18:10.867 slat (usec): min=3, max=149, avg= 4.14, stdev= 2.03 00:18:10.867 clat (usec): min=2651, max=18602, avg=9699.24, stdev=2341.73 00:18:10.867 lat (usec): min=2655, max=18606, avg=9703.38, stdev=2341.90 00:18:10.867 clat percentiles (usec): 00:18:10.867 | 1.00th=[ 5211], 5.00th=[ 6128], 10.00th=[ 6915], 20.00th=[ 7635], 00:18:10.867 | 30.00th=[ 8225], 40.00th=[ 8848], 50.00th=[ 9503], 60.00th=[10290], 00:18:10.867 | 70.00th=[11076], 80.00th=[11469], 90.00th=[12780], 95.00th=[13698], 00:18:10.867 | 99.00th=[16319], 99.50th=[16909], 99.90th=[17695], 99.95th=[17957], 00:18:10.867 | 99.99th=[18482] 00:18:10.867 bw ( KiB/s): min=56864, max=70816, per=50.62%, avg=63312.00, stdev=7091.62, samples=4 00:18:10.867 iops : min= 3554, max= 4426, avg=3957.00, stdev=443.23, samples=4 00:18:10.867 write: IOPS=4737, BW=74.0MiB/s (77.6MB/s)(129MiB/1748msec); 0 zone resets 00:18:10.867 slat (usec): min=36, max=323, avg=39.48, stdev= 7.34 00:18:10.867 clat (usec): min=3369, max=19270, avg=11820.70, stdev=2054.59 00:18:10.867 lat (usec): min=3406, max=19307, avg=11860.18, stdev=2055.68 00:18:10.867 clat percentiles (usec): 00:18:10.867 | 1.00th=[ 7963], 5.00th=[ 8848], 10.00th=[ 9372], 20.00th=[10028], 00:18:10.867 | 30.00th=[10683], 40.00th=[11076], 50.00th=[11600], 60.00th=[11994], 00:18:10.867 | 70.00th=[12649], 80.00th=[13435], 90.00th=[14746], 95.00th=[15795], 00:18:10.867 | 99.00th=[16909], 99.50th=[17433], 99.90th=[19006], 99.95th=[19006], 00:18:10.867 | 99.99th=[19268] 00:18:10.867 bw ( KiB/s): min=58368, max=74208, per=86.87%, avg=65848.00, stdev=8184.14, samples=4 00:18:10.867 iops : min= 3648, max= 4638, avg=4115.50, stdev=511.51, samples=4 00:18:10.867 lat (msec) : 4=0.21%, 10=43.02%, 20=56.77% 00:18:10.867 cpu : usr=73.12%, sys=17.51%, ctx=23, majf=0, minf=23 00:18:10.867 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.7%, >=64=98.7% 00:18:10.867 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:10.867 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:18:10.867 issued rwts: total=15682,8281,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:10.867 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:10.867 00:18:10.867 Run status group 0 (all jobs): 00:18:10.867 READ: bw=122MiB/s (128MB/s), 122MiB/s-122MiB/s (128MB/s-128MB/s), io=245MiB (257MB), run=2006-2006msec 00:18:10.867 WRITE: bw=74.0MiB/s (77.6MB/s), 74.0MiB/s-74.0MiB/s (77.6MB/s-77.6MB/s), io=129MiB (136MB), run=1748-1748msec 00:18:10.867 11:28:52 nvmf_tcp.nvmf_host.nvmf_fio_host -- host/fio.sh@47 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:18:10.867 11:28:52 nvmf_tcp.nvmf_host.nvmf_fio_host -- host/fio.sh@49 -- # '[' 0 -eq 1 ']' 00:18:10.867 11:28:52 nvmf_tcp.nvmf_host.nvmf_fio_host -- host/fio.sh@83 -- # trap - SIGINT SIGTERM EXIT 00:18:10.867 11:28:52 nvmf_tcp.nvmf_host.nvmf_fio_host -- host/fio.sh@85 -- # rm -f ./local-test-0-verify.state 00:18:10.867 11:28:52 nvmf_tcp.nvmf_host.nvmf_fio_host -- host/fio.sh@86 -- # nvmftestfini 00:18:10.867 11:28:52 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@514 -- # nvmfcleanup 00:18:10.867 11:28:52 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@121 -- # sync 00:18:10.867 11:28:52 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:18:10.867 11:28:52 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@124 -- # set +e 00:18:10.867 11:28:52 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@125 -- # for i in {1..20} 00:18:10.867 11:28:52 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:18:11.126 rmmod nvme_tcp 00:18:11.126 rmmod nvme_fabrics 00:18:11.126 rmmod nvme_keyring 00:18:11.126 11:28:52 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:18:11.126 11:28:52 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@128 -- # set -e 00:18:11.126 11:28:52 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@129 -- # return 0 00:18:11.126 11:28:52 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@515 -- # '[' -n 88508 ']' 00:18:11.126 11:28:52 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@516 -- # killprocess 88508 00:18:11.126 11:28:52 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@950 -- # '[' -z 88508 ']' 00:18:11.126 11:28:52 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@954 -- # kill -0 88508 00:18:11.126 11:28:52 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@955 -- # uname 00:18:11.126 11:28:52 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:18:11.126 11:28:52 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 88508 00:18:11.126 11:28:52 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:18:11.126 killing process with pid 88508 00:18:11.126 11:28:52 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:18:11.126 11:28:52 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@968 -- # echo 'killing process with pid 88508' 00:18:11.126 11:28:52 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@969 -- # kill 88508 00:18:11.126 11:28:52 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@974 -- # wait 88508 00:18:11.383 11:28:52 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:18:11.383 11:28:52 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:18:11.383 11:28:52 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:18:11.383 11:28:52 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@297 -- # iptr 00:18:11.384 11:28:52 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@789 -- # iptables-save 00:18:11.384 11:28:52 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:18:11.384 11:28:52 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@789 -- # iptables-restore 00:18:11.384 11:28:53 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@298 -- # [[ nvmf_tgt_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:18:11.384 11:28:53 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@299 -- # nvmf_veth_fini 00:18:11.384 11:28:53 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@233 -- # ip link set nvmf_init_br nomaster 00:18:11.384 11:28:53 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@234 -- # ip link set nvmf_init_br2 nomaster 00:18:11.384 11:28:53 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@235 -- # ip link set nvmf_tgt_br nomaster 00:18:11.384 11:28:53 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@236 -- # ip link set nvmf_tgt_br2 nomaster 00:18:11.384 11:28:53 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@237 -- # ip link set nvmf_init_br down 00:18:11.384 11:28:53 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@238 -- # ip link set nvmf_init_br2 down 00:18:11.384 11:28:53 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@239 -- # ip link set nvmf_tgt_br down 00:18:11.384 11:28:53 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@240 -- # ip link set nvmf_tgt_br2 down 00:18:11.384 11:28:53 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@241 -- # ip link delete nvmf_br type bridge 00:18:11.642 11:28:53 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@242 -- # ip link delete nvmf_init_if 00:18:11.642 11:28:53 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@243 -- # ip link delete nvmf_init_if2 00:18:11.642 11:28:53 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@244 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:18:11.642 11:28:53 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@245 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:18:11.642 11:28:53 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@246 -- # remove_spdk_ns 00:18:11.642 11:28:53 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:11.642 11:28:53 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:18:11.642 11:28:53 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:11.642 11:28:53 nvmf_tcp.nvmf_host.nvmf_fio_host -- nvmf/common.sh@300 -- # return 0 00:18:11.642 00:18:11.642 real 0m9.628s 00:18:11.642 user 0m37.872s 00:18:11.642 sys 0m2.461s 00:18:11.642 11:28:53 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@1126 -- # xtrace_disable 00:18:11.642 11:28:53 nvmf_tcp.nvmf_host.nvmf_fio_host -- common/autotest_common.sh@10 -- # set +x 00:18:11.642 ************************************ 00:18:11.642 END TEST nvmf_fio_host 00:18:11.642 ************************************ 00:18:11.642 11:28:53 nvmf_tcp.nvmf_host -- nvmf/nvmf_host.sh@25 -- # run_test nvmf_failover /home/vagrant/spdk_repo/spdk/test/nvmf/host/failover.sh --transport=tcp 00:18:11.642 11:28:53 nvmf_tcp.nvmf_host -- common/autotest_common.sh@1101 -- # '[' 3 -le 1 ']' 00:18:11.642 11:28:53 nvmf_tcp.nvmf_host -- common/autotest_common.sh@1107 -- # xtrace_disable 00:18:11.642 11:28:53 nvmf_tcp.nvmf_host -- common/autotest_common.sh@10 -- # set +x 00:18:11.642 ************************************ 00:18:11.642 START TEST nvmf_failover 00:18:11.642 ************************************ 00:18:11.642 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@1125 -- # /home/vagrant/spdk_repo/spdk/test/nvmf/host/failover.sh --transport=tcp 00:18:11.901 * Looking for test storage... 00:18:11.901 * Found test storage at /home/vagrant/spdk_repo/spdk/test/nvmf/host 00:18:11.901 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@1680 -- # [[ y == y ]] 00:18:11.901 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@1681 -- # lcov --version 00:18:11.901 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@1681 -- # awk '{print $NF}' 00:18:11.901 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@1681 -- # lt 1.15 2 00:18:11.901 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- scripts/common.sh@373 -- # cmp_versions 1.15 '<' 2 00:18:11.901 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- scripts/common.sh@333 -- # local ver1 ver1_l 00:18:11.901 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- scripts/common.sh@334 -- # local ver2 ver2_l 00:18:11.901 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- scripts/common.sh@336 -- # IFS=.-: 00:18:11.901 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- scripts/common.sh@336 -- # read -ra ver1 00:18:11.901 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- scripts/common.sh@337 -- # IFS=.-: 00:18:11.901 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- scripts/common.sh@337 -- # read -ra ver2 00:18:11.901 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- scripts/common.sh@338 -- # local 'op=<' 00:18:11.901 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- scripts/common.sh@340 -- # ver1_l=2 00:18:11.901 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- scripts/common.sh@341 -- # ver2_l=1 00:18:11.901 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- scripts/common.sh@343 -- # local lt=0 gt=0 eq=0 v 00:18:11.901 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- scripts/common.sh@344 -- # case "$op" in 00:18:11.901 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- scripts/common.sh@345 -- # : 1 00:18:11.901 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- scripts/common.sh@364 -- # (( v = 0 )) 00:18:11.901 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- scripts/common.sh@364 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:11.901 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- scripts/common.sh@365 -- # decimal 1 00:18:11.901 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- scripts/common.sh@353 -- # local d=1 00:18:11.901 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- scripts/common.sh@354 -- # [[ 1 =~ ^[0-9]+$ ]] 00:18:11.901 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- scripts/common.sh@355 -- # echo 1 00:18:11.901 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- scripts/common.sh@365 -- # ver1[v]=1 00:18:11.901 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- scripts/common.sh@366 -- # decimal 2 00:18:11.901 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- scripts/common.sh@353 -- # local d=2 00:18:11.901 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- scripts/common.sh@354 -- # [[ 2 =~ ^[0-9]+$ ]] 00:18:11.901 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- scripts/common.sh@355 -- # echo 2 00:18:11.901 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- scripts/common.sh@366 -- # ver2[v]=2 00:18:11.901 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- scripts/common.sh@367 -- # (( ver1[v] > ver2[v] )) 00:18:11.901 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- scripts/common.sh@368 -- # (( ver1[v] < ver2[v] )) 00:18:11.901 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- scripts/common.sh@368 -- # return 0 00:18:11.901 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@1682 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:18:11.901 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@1694 -- # export 'LCOV_OPTS= 00:18:11.901 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:11.901 --rc genhtml_branch_coverage=1 00:18:11.901 --rc genhtml_function_coverage=1 00:18:11.901 --rc genhtml_legend=1 00:18:11.901 --rc geninfo_all_blocks=1 00:18:11.901 --rc geninfo_unexecuted_blocks=1 00:18:11.901 00:18:11.901 ' 00:18:11.901 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@1694 -- # LCOV_OPTS=' 00:18:11.901 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:11.901 --rc genhtml_branch_coverage=1 00:18:11.901 --rc genhtml_function_coverage=1 00:18:11.901 --rc genhtml_legend=1 00:18:11.901 --rc geninfo_all_blocks=1 00:18:11.901 --rc geninfo_unexecuted_blocks=1 00:18:11.901 00:18:11.901 ' 00:18:11.901 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@1695 -- # export 'LCOV=lcov 00:18:11.901 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:11.901 --rc genhtml_branch_coverage=1 00:18:11.901 --rc genhtml_function_coverage=1 00:18:11.901 --rc genhtml_legend=1 00:18:11.901 --rc geninfo_all_blocks=1 00:18:11.901 --rc geninfo_unexecuted_blocks=1 00:18:11.901 00:18:11.901 ' 00:18:11.901 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@1695 -- # LCOV='lcov 00:18:11.901 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:11.901 --rc genhtml_branch_coverage=1 00:18:11.901 --rc genhtml_function_coverage=1 00:18:11.901 --rc genhtml_legend=1 00:18:11.901 --rc geninfo_all_blocks=1 00:18:11.901 --rc geninfo_unexecuted_blocks=1 00:18:11.901 00:18:11.901 ' 00:18:11.901 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@9 -- # source /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh 00:18:11.901 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@7 -- # uname -s 00:18:11.901 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:11.901 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:11.901 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:11.901 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:11.901 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:11.901 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:11.901 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:11.901 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:11.901 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:11.901 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:11.901 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:18:11.901 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@18 -- # NVME_HOSTID=3fd2c4d8-8500-487b-9d52-f46258bd1bb3 00:18:11.901 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:11.901 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:11.901 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@21 -- # NET_TYPE=virt 00:18:11.901 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:18:11.901 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@49 -- # source /home/vagrant/spdk_repo/spdk/scripts/common.sh 00:18:11.901 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- scripts/common.sh@15 -- # shopt -s extglob 00:18:11.901 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- scripts/common.sh@544 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:11.901 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- scripts/common.sh@552 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:11.901 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- scripts/common.sh@553 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:11.901 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:11.901 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:11.901 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:11.901 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- paths/export.sh@5 -- # export PATH 00:18:11.901 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:11.901 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@51 -- # : 0 00:18:11.901 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@52 -- # export NVMF_APP_SHM_ID 00:18:11.901 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@53 -- # build_nvmf_app_args 00:18:11.901 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:18:11.901 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:11.901 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:11.901 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@33 -- # '[' '' -eq 1 ']' 00:18:11.901 /home/vagrant/spdk_repo/spdk/test/nvmf/common.sh: line 33: [: : integer expression expected 00:18:11.901 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@37 -- # '[' -n '' ']' 00:18:11.901 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@39 -- # '[' 0 -eq 1 ']' 00:18:11.901 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@55 -- # have_pci_nics=0 00:18:11.901 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@11 -- # MALLOC_BDEV_SIZE=64 00:18:11.901 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:18:11.901 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@14 -- # rpc_py=/home/vagrant/spdk_repo/spdk/scripts/rpc.py 00:18:11.902 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@16 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:18:11.902 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@18 -- # nvmftestinit 00:18:11.902 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@467 -- # '[' -z tcp ']' 00:18:11.902 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@472 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:11.902 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@474 -- # prepare_net_devs 00:18:11.902 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@436 -- # local -g is_hw=no 00:18:11.902 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@438 -- # remove_spdk_ns 00:18:11.902 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:11.902 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:18:11.902 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:11.902 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@440 -- # [[ virt != virt ]] 00:18:11.902 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@442 -- # [[ no == yes ]] 00:18:11.902 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@449 -- # [[ virt == phy ]] 00:18:11.902 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@452 -- # [[ virt == phy-fallback ]] 00:18:11.902 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@457 -- # [[ tcp == tcp ]] 00:18:11.902 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@458 -- # nvmf_veth_init 00:18:11.902 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@145 -- # NVMF_FIRST_INITIATOR_IP=10.0.0.1 00:18:11.902 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@146 -- # NVMF_SECOND_INITIATOR_IP=10.0.0.2 00:18:11.902 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@147 -- # NVMF_FIRST_TARGET_IP=10.0.0.3 00:18:11.902 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@148 -- # NVMF_SECOND_TARGET_IP=10.0.0.4 00:18:11.902 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@149 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:11.902 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@150 -- # NVMF_BRIDGE=nvmf_br 00:18:11.902 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@151 -- # NVMF_INITIATOR_INTERFACE=nvmf_init_if 00:18:11.902 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@152 -- # NVMF_INITIATOR_INTERFACE2=nvmf_init_if2 00:18:11.902 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@153 -- # NVMF_INITIATOR_BRIDGE=nvmf_init_br 00:18:11.902 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@154 -- # NVMF_INITIATOR_BRIDGE2=nvmf_init_br2 00:18:11.902 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@155 -- # NVMF_TARGET_NAMESPACE=nvmf_tgt_ns_spdk 00:18:11.902 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@156 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:11.902 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@157 -- # NVMF_TARGET_INTERFACE=nvmf_tgt_if 00:18:11.902 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@158 -- # NVMF_TARGET_INTERFACE2=nvmf_tgt_if2 00:18:11.902 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@159 -- # NVMF_TARGET_BRIDGE=nvmf_tgt_br 00:18:11.902 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@160 -- # NVMF_TARGET_BRIDGE2=nvmf_tgt_br2 00:18:11.902 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@162 -- # ip link set nvmf_init_br nomaster 00:18:11.902 Cannot find device "nvmf_init_br" 00:18:11.902 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@162 -- # true 00:18:11.902 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@163 -- # ip link set nvmf_init_br2 nomaster 00:18:11.902 Cannot find device "nvmf_init_br2" 00:18:11.902 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@163 -- # true 00:18:11.902 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@164 -- # ip link set nvmf_tgt_br nomaster 00:18:11.902 Cannot find device "nvmf_tgt_br" 00:18:11.902 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@164 -- # true 00:18:11.902 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@165 -- # ip link set nvmf_tgt_br2 nomaster 00:18:11.902 Cannot find device "nvmf_tgt_br2" 00:18:11.902 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@165 -- # true 00:18:11.902 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@166 -- # ip link set nvmf_init_br down 00:18:11.902 Cannot find device "nvmf_init_br" 00:18:11.902 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@166 -- # true 00:18:11.902 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@167 -- # ip link set nvmf_init_br2 down 00:18:11.902 Cannot find device "nvmf_init_br2" 00:18:11.902 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@167 -- # true 00:18:11.902 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@168 -- # ip link set nvmf_tgt_br down 00:18:11.902 Cannot find device "nvmf_tgt_br" 00:18:11.902 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@168 -- # true 00:18:11.902 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@169 -- # ip link set nvmf_tgt_br2 down 00:18:11.902 Cannot find device "nvmf_tgt_br2" 00:18:11.902 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@169 -- # true 00:18:11.902 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@170 -- # ip link delete nvmf_br type bridge 00:18:11.902 Cannot find device "nvmf_br" 00:18:11.902 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@170 -- # true 00:18:11.902 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@171 -- # ip link delete nvmf_init_if 00:18:11.902 Cannot find device "nvmf_init_if" 00:18:11.902 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@171 -- # true 00:18:11.902 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@172 -- # ip link delete nvmf_init_if2 00:18:12.160 Cannot find device "nvmf_init_if2" 00:18:12.160 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@172 -- # true 00:18:12.160 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@173 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:18:12.160 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:18:12.160 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@173 -- # true 00:18:12.160 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@174 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:18:12.160 Cannot open network namespace "nvmf_tgt_ns_spdk": No such file or directory 00:18:12.160 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@174 -- # true 00:18:12.160 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@177 -- # ip netns add nvmf_tgt_ns_spdk 00:18:12.160 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@180 -- # ip link add nvmf_init_if type veth peer name nvmf_init_br 00:18:12.160 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@181 -- # ip link add nvmf_init_if2 type veth peer name nvmf_init_br2 00:18:12.160 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@182 -- # ip link add nvmf_tgt_if type veth peer name nvmf_tgt_br 00:18:12.160 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@183 -- # ip link add nvmf_tgt_if2 type veth peer name nvmf_tgt_br2 00:18:12.160 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@186 -- # ip link set nvmf_tgt_if netns nvmf_tgt_ns_spdk 00:18:12.160 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@187 -- # ip link set nvmf_tgt_if2 netns nvmf_tgt_ns_spdk 00:18:12.160 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@190 -- # ip addr add 10.0.0.1/24 dev nvmf_init_if 00:18:12.160 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@191 -- # ip addr add 10.0.0.2/24 dev nvmf_init_if2 00:18:12.160 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@192 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.3/24 dev nvmf_tgt_if 00:18:12.160 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@193 -- # ip netns exec nvmf_tgt_ns_spdk ip addr add 10.0.0.4/24 dev nvmf_tgt_if2 00:18:12.160 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@196 -- # ip link set nvmf_init_if up 00:18:12.160 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@197 -- # ip link set nvmf_init_if2 up 00:18:12.160 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@198 -- # ip link set nvmf_init_br up 00:18:12.160 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@199 -- # ip link set nvmf_init_br2 up 00:18:12.160 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@200 -- # ip link set nvmf_tgt_br up 00:18:12.160 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@201 -- # ip link set nvmf_tgt_br2 up 00:18:12.160 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@202 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if up 00:18:12.160 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@203 -- # ip netns exec nvmf_tgt_ns_spdk ip link set nvmf_tgt_if2 up 00:18:12.160 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@204 -- # ip netns exec nvmf_tgt_ns_spdk ip link set lo up 00:18:12.160 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@207 -- # ip link add nvmf_br type bridge 00:18:12.160 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@208 -- # ip link set nvmf_br up 00:18:12.160 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@211 -- # ip link set nvmf_init_br master nvmf_br 00:18:12.160 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@212 -- # ip link set nvmf_init_br2 master nvmf_br 00:18:12.160 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@213 -- # ip link set nvmf_tgt_br master nvmf_br 00:18:12.160 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@214 -- # ip link set nvmf_tgt_br2 master nvmf_br 00:18:12.160 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@217 -- # ipts -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT 00:18:12.160 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if -p tcp --dport 4420 -j ACCEPT' 00:18:12.160 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@218 -- # ipts -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT 00:18:12.160 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@788 -- # iptables -I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT -m comment --comment 'SPDK_NVMF:-I INPUT 1 -i nvmf_init_if2 -p tcp --dport 4420 -j ACCEPT' 00:18:12.160 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@219 -- # ipts -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT 00:18:12.160 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@788 -- # iptables -A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT -m comment --comment 'SPDK_NVMF:-A FORWARD -i nvmf_br -o nvmf_br -j ACCEPT' 00:18:12.160 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@222 -- # ping -c 1 10.0.0.3 00:18:12.160 PING 10.0.0.3 (10.0.0.3) 56(84) bytes of data. 00:18:12.160 64 bytes from 10.0.0.3: icmp_seq=1 ttl=64 time=0.094 ms 00:18:12.160 00:18:12.160 --- 10.0.0.3 ping statistics --- 00:18:12.160 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:12.160 rtt min/avg/max/mdev = 0.094/0.094/0.094/0.000 ms 00:18:12.160 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@223 -- # ping -c 1 10.0.0.4 00:18:12.160 PING 10.0.0.4 (10.0.0.4) 56(84) bytes of data. 00:18:12.161 64 bytes from 10.0.0.4: icmp_seq=1 ttl=64 time=0.059 ms 00:18:12.161 00:18:12.161 --- 10.0.0.4 ping statistics --- 00:18:12.161 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:12.161 rtt min/avg/max/mdev = 0.059/0.059/0.059/0.000 ms 00:18:12.161 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@224 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.1 00:18:12.161 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:12.161 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.042 ms 00:18:12.161 00:18:12.161 --- 10.0.0.1 ping statistics --- 00:18:12.161 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:12.161 rtt min/avg/max/mdev = 0.042/0.042/0.042/0.000 ms 00:18:12.161 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@225 -- # ip netns exec nvmf_tgt_ns_spdk ping -c 1 10.0.0.2 00:18:12.161 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:12.161 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.062 ms 00:18:12.161 00:18:12.161 --- 10.0.0.2 ping statistics --- 00:18:12.161 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:12.161 rtt min/avg/max/mdev = 0.062/0.062/0.062/0.000 ms 00:18:12.161 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@227 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:12.161 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@459 -- # return 0 00:18:12.161 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@476 -- # '[' '' == iso ']' 00:18:12.161 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@480 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:12.161 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@481 -- # [[ tcp == \r\d\m\a ]] 00:18:12.161 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@490 -- # [[ tcp == \t\c\p ]] 00:18:12.161 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@491 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:12.161 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@494 -- # '[' tcp == tcp ']' 00:18:12.161 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@500 -- # modprobe nvme-tcp 00:18:12.418 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@20 -- # nvmfappstart -m 0xE 00:18:12.418 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@505 -- # timing_enter start_nvmf_tgt 00:18:12.418 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@724 -- # xtrace_disable 00:18:12.418 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@10 -- # set +x 00:18:12.418 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@507 -- # nvmfpid=88957 00:18:12.418 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@506 -- # ip netns exec nvmf_tgt_ns_spdk /home/vagrant/spdk_repo/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:18:12.419 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@508 -- # waitforlisten 88957 00:18:12.419 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@831 -- # '[' -z 88957 ']' 00:18:12.419 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:12.419 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@836 -- # local max_retries=100 00:18:12.419 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:12.419 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:12.419 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@840 -- # xtrace_disable 00:18:12.419 11:28:53 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@10 -- # set +x 00:18:12.419 [2024-10-07 11:28:53.967544] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:18:12.419 [2024-10-07 11:28:53.967661] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:12.419 [2024-10-07 11:28:54.111340] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 3 00:18:12.677 [2024-10-07 11:28:54.267380] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:12.677 [2024-10-07 11:28:54.267481] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:12.677 [2024-10-07 11:28:54.267503] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:18:12.677 [2024-10-07 11:28:54.267520] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. 00:18:12.677 [2024-10-07 11:28:54.267535] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:12.677 [2024-10-07 11:28:54.268380] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 2 00:18:12.677 [2024-10-07 11:28:54.268485] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 3 00:18:12.677 [2024-10-07 11:28:54.268488] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 1 00:18:13.611 11:28:55 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:18:13.611 11:28:55 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@864 -- # return 0 00:18:13.611 11:28:55 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@509 -- # timing_exit start_nvmf_tgt 00:18:13.611 11:28:55 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@730 -- # xtrace_disable 00:18:13.611 11:28:55 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@10 -- # set +x 00:18:13.611 11:28:55 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@510 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:13.611 11:28:55 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@22 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:18:13.870 [2024-10-07 11:28:55.457974] tcp.c: 738:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:13.870 11:28:55 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@23 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc0 00:18:14.133 Malloc0 00:18:14.133 11:28:55 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@24 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:18:14.403 11:28:56 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@25 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:18:14.970 11:28:56 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@26 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4420 00:18:15.228 [2024-10-07 11:28:56.790807] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:18:15.228 11:28:56 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@27 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4421 00:18:15.487 [2024-10-07 11:28:57.099028] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4421 *** 00:18:15.487 11:28:57 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@28 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4422 00:18:15.745 [2024-10-07 11:28:57.371255] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4422 *** 00:18:15.745 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:18:15.745 11:28:57 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@31 -- # bdevperf_pid=89076 00:18:15.745 11:28:57 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@30 -- # /home/vagrant/spdk_repo/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 15 -f 00:18:15.745 11:28:57 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@33 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; cat $testdir/try.txt; rm -f $testdir/try.txt; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:18:15.745 11:28:57 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@34 -- # waitforlisten 89076 /var/tmp/bdevperf.sock 00:18:15.746 11:28:57 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@831 -- # '[' -z 89076 ']' 00:18:15.746 11:28:57 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@835 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:18:15.746 11:28:57 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@836 -- # local max_retries=100 00:18:15.746 11:28:57 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@838 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:18:15.746 11:28:57 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@840 -- # xtrace_disable 00:18:15.746 11:28:57 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@10 -- # set +x 00:18:17.118 11:28:58 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@860 -- # (( i == 0 )) 00:18:17.118 11:28:58 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@864 -- # return 0 00:18:17.118 11:28:58 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@35 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.3 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -x failover 00:18:17.376 NVMe0n1 00:18:17.376 11:28:58 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@36 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.3 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -x failover 00:18:17.634 NVMe0n1 00:18:17.634 11:28:59 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@39 -- # run_test_pid=89123 00:18:17.634 11:28:59 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@38 -- # /home/vagrant/spdk_repo/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:18:17.634 11:28:59 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@41 -- # sleep 1 00:18:18.568 11:29:00 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@43 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4420 00:18:19.136 [2024-10-07 11:29:00.574350] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16aade0 is same with the state(6) to be set 00:18:19.136 [2024-10-07 11:29:00.574485] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16aade0 is same with the state(6) to be set 00:18:19.136 [2024-10-07 11:29:00.574498] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16aade0 is same with the state(6) to be set 00:18:19.136 [2024-10-07 11:29:00.574508] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16aade0 is same with the state(6) to be set 00:18:19.136 [2024-10-07 11:29:00.574516] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16aade0 is same with the state(6) to be set 00:18:19.136 [2024-10-07 11:29:00.574526] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16aade0 is same with the state(6) to be set 00:18:19.136 [2024-10-07 11:29:00.574535] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16aade0 is same with the state(6) to be set 00:18:19.136 [2024-10-07 11:29:00.574543] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16aade0 is same with the state(6) to be set 00:18:19.136 [2024-10-07 11:29:00.574551] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16aade0 is same with the state(6) to be set 00:18:19.136 [2024-10-07 11:29:00.574560] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16aade0 is same with the state(6) to be set 00:18:19.136 [2024-10-07 11:29:00.574568] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16aade0 is same with the state(6) to be set 00:18:19.136 [2024-10-07 11:29:00.574577] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16aade0 is same with the state(6) to be set 00:18:19.136 [2024-10-07 11:29:00.574586] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16aade0 is same with the state(6) to be set 00:18:19.136 [2024-10-07 11:29:00.574594] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16aade0 is same with the state(6) to be set 00:18:19.136 [2024-10-07 11:29:00.574602] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16aade0 is same with the state(6) to be set 00:18:19.136 [2024-10-07 11:29:00.574609] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16aade0 is same with the state(6) to be set 00:18:19.136 [2024-10-07 11:29:00.574617] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16aade0 is same with the state(6) to be set 00:18:19.136 [2024-10-07 11:29:00.574626] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16aade0 is same with the state(6) to be set 00:18:19.136 [2024-10-07 11:29:00.574633] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16aade0 is same with the state(6) to be set 00:18:19.136 [2024-10-07 11:29:00.574641] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16aade0 is same with the state(6) to be set 00:18:19.136 [2024-10-07 11:29:00.574650] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16aade0 is same with the state(6) to be set 00:18:19.136 [2024-10-07 11:29:00.574669] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16aade0 is same with the state(6) to be set 00:18:19.136 [2024-10-07 11:29:00.574678] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16aade0 is same with the state(6) to be set 00:18:19.136 [2024-10-07 11:29:00.574687] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16aade0 is same with the state(6) to be set 00:18:19.136 [2024-10-07 11:29:00.574695] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16aade0 is same with the state(6) to be set 00:18:19.136 [2024-10-07 11:29:00.574703] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16aade0 is same with the state(6) to be set 00:18:19.136 [2024-10-07 11:29:00.574711] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16aade0 is same with the state(6) to be set 00:18:19.136 [2024-10-07 11:29:00.574719] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16aade0 is same with the state(6) to be set 00:18:19.136 [2024-10-07 11:29:00.574729] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16aade0 is same with the state(6) to be set 00:18:19.136 [2024-10-07 11:29:00.574738] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16aade0 is same with the state(6) to be set 00:18:19.136 [2024-10-07 11:29:00.574746] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16aade0 is same with the state(6) to be set 00:18:19.136 [2024-10-07 11:29:00.574754] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16aade0 is same with the state(6) to be set 00:18:19.136 [2024-10-07 11:29:00.574762] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16aade0 is same with the state(6) to be set 00:18:19.136 [2024-10-07 11:29:00.574771] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16aade0 is same with the state(6) to be set 00:18:19.136 [2024-10-07 11:29:00.574794] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16aade0 is same with the state(6) to be set 00:18:19.136 [2024-10-07 11:29:00.574802] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16aade0 is same with the state(6) to be set 00:18:19.136 [2024-10-07 11:29:00.574824] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16aade0 is same with the state(6) to be set 00:18:19.136 [2024-10-07 11:29:00.574832] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16aade0 is same with the state(6) to be set 00:18:19.136 [2024-10-07 11:29:00.574839] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16aade0 is same with the state(6) to be set 00:18:19.136 [2024-10-07 11:29:00.574847] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16aade0 is same with the state(6) to be set 00:18:19.136 [2024-10-07 11:29:00.574854] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16aade0 is same with the state(6) to be set 00:18:19.136 [2024-10-07 11:29:00.574861] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16aade0 is same with the state(6) to be set 00:18:19.136 [2024-10-07 11:29:00.574869] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16aade0 is same with the state(6) to be set 00:18:19.136 [2024-10-07 11:29:00.574876] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16aade0 is same with the state(6) to be set 00:18:19.136 [2024-10-07 11:29:00.574884] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16aade0 is same with the state(6) to be set 00:18:19.136 [2024-10-07 11:29:00.574891] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16aade0 is same with the state(6) to be set 00:18:19.136 [2024-10-07 11:29:00.574899] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16aade0 is same with the state(6) to be set 00:18:19.136 [2024-10-07 11:29:00.574906] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16aade0 is same with the state(6) to be set 00:18:19.136 [2024-10-07 11:29:00.574913] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16aade0 is same with the state(6) to be set 00:18:19.136 [2024-10-07 11:29:00.574921] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16aade0 is same with the state(6) to be set 00:18:19.137 [2024-10-07 11:29:00.574928] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16aade0 is same with the state(6) to be set 00:18:19.137 [2024-10-07 11:29:00.574935] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16aade0 is same with the state(6) to be set 00:18:19.137 [2024-10-07 11:29:00.574944] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16aade0 is same with the state(6) to be set 00:18:19.137 [2024-10-07 11:29:00.574958] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16aade0 is same with the state(6) to be set 00:18:19.137 [2024-10-07 11:29:00.574966] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16aade0 is same with the state(6) to be set 00:18:19.137 [2024-10-07 11:29:00.574974] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16aade0 is same with the state(6) to be set 00:18:19.137 [2024-10-07 11:29:00.574982] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16aade0 is same with the state(6) to be set 00:18:19.137 [2024-10-07 11:29:00.574990] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16aade0 is same with the state(6) to be set 00:18:19.137 [2024-10-07 11:29:00.574998] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16aade0 is same with the state(6) to be set 00:18:19.137 [2024-10-07 11:29:00.575006] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16aade0 is same with the state(6) to be set 00:18:19.137 [2024-10-07 11:29:00.575013] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16aade0 is same with the state(6) to be set 00:18:19.137 [2024-10-07 11:29:00.575021] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16aade0 is same with the state(6) to be set 00:18:19.137 [2024-10-07 11:29:00.575029] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16aade0 is same with the state(6) to be set 00:18:19.137 [2024-10-07 11:29:00.575036] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16aade0 is same with the state(6) to be set 00:18:19.137 [2024-10-07 11:29:00.575044] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16aade0 is same with the state(6) to be set 00:18:19.137 [2024-10-07 11:29:00.575067] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16aade0 is same with the state(6) to be set 00:18:19.137 [2024-10-07 11:29:00.575092] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16aade0 is same with the state(6) to be set 00:18:19.137 [2024-10-07 11:29:00.575100] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16aade0 is same with the state(6) to be set 00:18:19.137 [2024-10-07 11:29:00.575108] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16aade0 is same with the state(6) to be set 00:18:19.137 [2024-10-07 11:29:00.575116] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16aade0 is same with the state(6) to be set 00:18:19.137 [2024-10-07 11:29:00.575124] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16aade0 is same with the state(6) to be set 00:18:19.137 [2024-10-07 11:29:00.575131] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16aade0 is same with the state(6) to be set 00:18:19.137 [2024-10-07 11:29:00.575139] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16aade0 is same with the state(6) to be set 00:18:19.137 [2024-10-07 11:29:00.575147] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16aade0 is same with the state(6) to be set 00:18:19.137 [2024-10-07 11:29:00.575155] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16aade0 is same with the state(6) to be set 00:18:19.137 [2024-10-07 11:29:00.575162] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16aade0 is same with the state(6) to be set 00:18:19.137 [2024-10-07 11:29:00.575170] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16aade0 is same with the state(6) to be set 00:18:19.137 [2024-10-07 11:29:00.575178] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16aade0 is same with the state(6) to be set 00:18:19.137 [2024-10-07 11:29:00.575186] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16aade0 is same with the state(6) to be set 00:18:19.137 [2024-10-07 11:29:00.575193] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16aade0 is same with the state(6) to be set 00:18:19.137 [2024-10-07 11:29:00.575201] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16aade0 is same with the state(6) to be set 00:18:19.137 [2024-10-07 11:29:00.575209] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16aade0 is same with the state(6) to be set 00:18:19.137 [2024-10-07 11:29:00.575217] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16aade0 is same with the state(6) to be set 00:18:19.137 [2024-10-07 11:29:00.575225] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16aade0 is same with the state(6) to be set 00:18:19.137 [2024-10-07 11:29:00.575234] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16aade0 is same with the state(6) to be set 00:18:19.137 [2024-10-07 11:29:00.575248] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16aade0 is same with the state(6) to be set 00:18:19.137 [2024-10-07 11:29:00.575256] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16aade0 is same with the state(6) to be set 00:18:19.137 [2024-10-07 11:29:00.575270] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16aade0 is same with the state(6) to be set 00:18:19.137 [2024-10-07 11:29:00.575278] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16aade0 is same with the state(6) to be set 00:18:19.137 [2024-10-07 11:29:00.575287] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16aade0 is same with the state(6) to be set 00:18:19.137 [2024-10-07 11:29:00.575295] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16aade0 is same with the state(6) to be set 00:18:19.137 [2024-10-07 11:29:00.575303] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16aade0 is same with the state(6) to be set 00:18:19.137 [2024-10-07 11:29:00.575311] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16aade0 is same with the state(6) to be set 00:18:19.137 [2024-10-07 11:29:00.575319] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16aade0 is same with the state(6) to be set 00:18:19.137 [2024-10-07 11:29:00.575327] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16aade0 is same with the state(6) to be set 00:18:19.137 [2024-10-07 11:29:00.575335] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16aade0 is same with the state(6) to be set 00:18:19.137 [2024-10-07 11:29:00.575343] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16aade0 is same with the state(6) to be set 00:18:19.137 [2024-10-07 11:29:00.575350] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16aade0 is same with the state(6) to be set 00:18:19.137 [2024-10-07 11:29:00.575358] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16aade0 is same with the state(6) to be set 00:18:19.137 [2024-10-07 11:29:00.575366] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16aade0 is same with the state(6) to be set 00:18:19.137 [2024-10-07 11:29:00.575374] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16aade0 is same with the state(6) to be set 00:18:19.137 [2024-10-07 11:29:00.575382] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16aade0 is same with the state(6) to be set 00:18:19.137 [2024-10-07 11:29:00.575390] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16aade0 is same with the state(6) to be set 00:18:19.137 [2024-10-07 11:29:00.575398] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16aade0 is same with the state(6) to be set 00:18:19.137 [2024-10-07 11:29:00.575406] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16aade0 is same with the state(6) to be set 00:18:19.137 [2024-10-07 11:29:00.575414] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16aade0 is same with the state(6) to be set 00:18:19.137 [2024-10-07 11:29:00.575422] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16aade0 is same with the state(6) to be set 00:18:19.137 [2024-10-07 11:29:00.575430] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16aade0 is same with the state(6) to be set 00:18:19.137 [2024-10-07 11:29:00.575437] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16aade0 is same with the state(6) to be set 00:18:19.137 [2024-10-07 11:29:00.575446] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16aade0 is same with the state(6) to be set 00:18:19.137 [2024-10-07 11:29:00.575454] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16aade0 is same with the state(6) to be set 00:18:19.137 [2024-10-07 11:29:00.575462] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16aade0 is same with the state(6) to be set 00:18:19.137 [2024-10-07 11:29:00.575478] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16aade0 is same with the state(6) to be set 00:18:19.137 [2024-10-07 11:29:00.575487] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16aade0 is same with the state(6) to be set 00:18:19.137 [2024-10-07 11:29:00.575496] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16aade0 is same with the state(6) to be set 00:18:19.137 [2024-10-07 11:29:00.575504] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16aade0 is same with the state(6) to be set 00:18:19.137 [2024-10-07 11:29:00.575513] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16aade0 is same with the state(6) to be set 00:18:19.137 [2024-10-07 11:29:00.575536] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16aade0 is same with the state(6) to be set 00:18:19.137 [2024-10-07 11:29:00.575547] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16aade0 is same with the state(6) to be set 00:18:19.137 [2024-10-07 11:29:00.575557] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16aade0 is same with the state(6) to be set 00:18:19.137 [2024-10-07 11:29:00.575565] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16aade0 is same with the state(6) to be set 00:18:19.137 [2024-10-07 11:29:00.575574] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16aade0 is same with the state(6) to be set 00:18:19.137 [2024-10-07 11:29:00.575583] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16aade0 is same with the state(6) to be set 00:18:19.137 [2024-10-07 11:29:00.575591] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16aade0 is same with the state(6) to be set 00:18:19.137 [2024-10-07 11:29:00.575599] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16aade0 is same with the state(6) to be set 00:18:19.137 [2024-10-07 11:29:00.575608] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16aade0 is same with the state(6) to be set 00:18:19.137 [2024-10-07 11:29:00.575616] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16aade0 is same with the state(6) to be set 00:18:19.137 [2024-10-07 11:29:00.575624] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16aade0 is same with the state(6) to be set 00:18:19.137 11:29:00 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@45 -- # sleep 3 00:18:22.418 11:29:03 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@47 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.3 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -x failover 00:18:22.418 NVMe0n1 00:18:22.418 11:29:04 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@48 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4421 00:18:22.676 [2024-10-07 11:29:04.318908] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16ab2b0 is same with the state(6) to be set 00:18:22.676 [2024-10-07 11:29:04.318968] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16ab2b0 is same with the state(6) to be set 00:18:22.676 [2024-10-07 11:29:04.318981] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16ab2b0 is same with the state(6) to be set 00:18:22.676 [2024-10-07 11:29:04.318990] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16ab2b0 is same with the state(6) to be set 00:18:22.676 [2024-10-07 11:29:04.318999] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16ab2b0 is same with the state(6) to be set 00:18:22.676 [2024-10-07 11:29:04.319008] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16ab2b0 is same with the state(6) to be set 00:18:22.676 [2024-10-07 11:29:04.319017] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16ab2b0 is same with the state(6) to be set 00:18:22.676 [2024-10-07 11:29:04.319025] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16ab2b0 is same with the state(6) to be set 00:18:22.676 [2024-10-07 11:29:04.319033] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16ab2b0 is same with the state(6) to be set 00:18:22.676 [2024-10-07 11:29:04.319041] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16ab2b0 is same with the state(6) to be set 00:18:22.676 [2024-10-07 11:29:04.319050] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16ab2b0 is same with the state(6) to be set 00:18:22.676 [2024-10-07 11:29:04.319058] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16ab2b0 is same with the state(6) to be set 00:18:22.676 [2024-10-07 11:29:04.319066] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16ab2b0 is same with the state(6) to be set 00:18:22.676 [2024-10-07 11:29:04.319074] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16ab2b0 is same with the state(6) to be set 00:18:22.676 [2024-10-07 11:29:04.319082] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16ab2b0 is same with the state(6) to be set 00:18:22.676 [2024-10-07 11:29:04.319091] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16ab2b0 is same with the state(6) to be set 00:18:22.676 [2024-10-07 11:29:04.319099] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16ab2b0 is same with the state(6) to be set 00:18:22.676 [2024-10-07 11:29:04.319107] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16ab2b0 is same with the state(6) to be set 00:18:22.676 [2024-10-07 11:29:04.319116] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16ab2b0 is same with the state(6) to be set 00:18:22.676 [2024-10-07 11:29:04.319124] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16ab2b0 is same with the state(6) to be set 00:18:22.676 [2024-10-07 11:29:04.319133] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16ab2b0 is same with the state(6) to be set 00:18:22.676 [2024-10-07 11:29:04.319141] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16ab2b0 is same with the state(6) to be set 00:18:22.676 [2024-10-07 11:29:04.319149] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16ab2b0 is same with the state(6) to be set 00:18:22.676 [2024-10-07 11:29:04.319157] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16ab2b0 is same with the state(6) to be set 00:18:22.676 [2024-10-07 11:29:04.319165] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16ab2b0 is same with the state(6) to be set 00:18:22.676 [2024-10-07 11:29:04.319173] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16ab2b0 is same with the state(6) to be set 00:18:22.676 [2024-10-07 11:29:04.319181] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16ab2b0 is same with the state(6) to be set 00:18:22.676 [2024-10-07 11:29:04.319188] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16ab2b0 is same with the state(6) to be set 00:18:22.676 [2024-10-07 11:29:04.319196] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16ab2b0 is same with the state(6) to be set 00:18:22.676 [2024-10-07 11:29:04.319206] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16ab2b0 is same with the state(6) to be set 00:18:22.677 [2024-10-07 11:29:04.319214] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16ab2b0 is same with the state(6) to be set 00:18:22.677 [2024-10-07 11:29:04.319223] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16ab2b0 is same with the state(6) to be set 00:18:22.677 [2024-10-07 11:29:04.319231] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16ab2b0 is same with the state(6) to be set 00:18:22.677 [2024-10-07 11:29:04.319239] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16ab2b0 is same with the state(6) to be set 00:18:22.677 [2024-10-07 11:29:04.319247] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16ab2b0 is same with the state(6) to be set 00:18:22.677 [2024-10-07 11:29:04.319255] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16ab2b0 is same with the state(6) to be set 00:18:22.677 [2024-10-07 11:29:04.319263] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16ab2b0 is same with the state(6) to be set 00:18:22.677 [2024-10-07 11:29:04.319629] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16ab2b0 is same with the state(6) to be set 00:18:22.677 [2024-10-07 11:29:04.319657] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16ab2b0 is same with the state(6) to be set 00:18:22.677 [2024-10-07 11:29:04.319666] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16ab2b0 is same with the state(6) to be set 00:18:22.677 [2024-10-07 11:29:04.319675] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16ab2b0 is same with the state(6) to be set 00:18:22.677 [2024-10-07 11:29:04.319684] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16ab2b0 is same with the state(6) to be set 00:18:22.677 [2024-10-07 11:29:04.319694] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16ab2b0 is same with the state(6) to be set 00:18:22.677 [2024-10-07 11:29:04.319704] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16ab2b0 is same with the state(6) to be set 00:18:22.677 [2024-10-07 11:29:04.319713] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16ab2b0 is same with the state(6) to be set 00:18:22.677 [2024-10-07 11:29:04.319721] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16ab2b0 is same with the state(6) to be set 00:18:22.677 [2024-10-07 11:29:04.319730] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16ab2b0 is same with the state(6) to be set 00:18:22.677 [2024-10-07 11:29:04.319738] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16ab2b0 is same with the state(6) to be set 00:18:22.677 [2024-10-07 11:29:04.319747] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16ab2b0 is same with the state(6) to be set 00:18:22.677 [2024-10-07 11:29:04.319754] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16ab2b0 is same with the state(6) to be set 00:18:22.677 [2024-10-07 11:29:04.319762] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16ab2b0 is same with the state(6) to be set 00:18:22.677 [2024-10-07 11:29:04.319770] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16ab2b0 is same with the state(6) to be set 00:18:22.677 [2024-10-07 11:29:04.319778] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16ab2b0 is same with the state(6) to be set 00:18:22.677 [2024-10-07 11:29:04.319786] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16ab2b0 is same with the state(6) to be set 00:18:22.677 [2024-10-07 11:29:04.319794] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16ab2b0 is same with the state(6) to be set 00:18:22.677 [2024-10-07 11:29:04.319905] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16ab2b0 is same with the state(6) to be set 00:18:22.677 [2024-10-07 11:29:04.319919] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16ab2b0 is same with the state(6) to be set 00:18:22.677 [2024-10-07 11:29:04.319927] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16ab2b0 is same with the state(6) to be set 00:18:22.677 [2024-10-07 11:29:04.319935] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16ab2b0 is same with the state(6) to be set 00:18:22.677 [2024-10-07 11:29:04.319944] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16ab2b0 is same with the state(6) to be set 00:18:22.677 [2024-10-07 11:29:04.319952] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16ab2b0 is same with the state(6) to be set 00:18:22.677 [2024-10-07 11:29:04.319961] tcp.c:1773:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x16ab2b0 is same with the state(6) to be set 00:18:22.677 11:29:04 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@50 -- # sleep 3 00:18:25.984 11:29:07 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@53 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4420 00:18:25.984 [2024-10-07 11:29:07.629380] tcp.c:1081:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.3 port 4420 *** 00:18:25.984 11:29:07 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@55 -- # sleep 1 00:18:27.356 11:29:08 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@57 -- # /home/vagrant/spdk_repo/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.3 -s 4422 00:18:27.356 11:29:08 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@59 -- # wait 89123 00:18:33.949 { 00:18:33.949 "results": [ 00:18:33.949 { 00:18:33.949 "job": "NVMe0n1", 00:18:33.949 "core_mask": "0x1", 00:18:33.949 "workload": "verify", 00:18:33.949 "status": "finished", 00:18:33.949 "verify_range": { 00:18:33.949 "start": 0, 00:18:33.949 "length": 16384 00:18:33.949 }, 00:18:33.949 "queue_depth": 128, 00:18:33.949 "io_size": 4096, 00:18:33.949 "runtime": 15.008216, 00:18:33.949 "iops": 9096.08443801715, 00:18:33.949 "mibps": 35.53157983600449, 00:18:33.949 "io_failed": 0, 00:18:33.949 "io_timeout": 0, 00:18:33.949 "avg_latency_us": 14038.905146516292, 00:18:33.949 "min_latency_us": 711.2145454545455, 00:18:33.949 "max_latency_us": 33363.781818181815 00:18:33.949 } 00:18:33.949 ], 00:18:33.949 "core_count": 1 00:18:33.949 } 00:18:33.949 11:29:14 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@61 -- # killprocess 89076 00:18:33.949 11:29:14 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@950 -- # '[' -z 89076 ']' 00:18:33.949 11:29:14 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@954 -- # kill -0 89076 00:18:33.949 11:29:14 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@955 -- # uname 00:18:33.949 11:29:14 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:18:33.949 11:29:14 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 89076 00:18:33.949 killing process with pid 89076 00:18:33.949 11:29:14 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@956 -- # process_name=reactor_0 00:18:33.949 11:29:14 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@960 -- # '[' reactor_0 = sudo ']' 00:18:33.949 11:29:14 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@968 -- # echo 'killing process with pid 89076' 00:18:33.949 11:29:14 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@969 -- # kill 89076 00:18:33.949 11:29:14 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@974 -- # wait 89076 00:18:33.949 11:29:14 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@63 -- # cat /home/vagrant/spdk_repo/spdk/test/nvmf/host/try.txt 00:18:33.949 [2024-10-07 11:28:57.472507] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:18:33.949 [2024-10-07 11:28:57.472692] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid89076 ] 00:18:33.949 [2024-10-07 11:28:57.623953] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:33.949 [2024-10-07 11:28:57.770062] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:18:33.949 Running I/O for 15 seconds... 00:18:33.949 8171.00 IOPS, 31.92 MiB/s [2024-10-07T11:29:15.660Z] [2024-10-07 11:29:00.576219] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:77392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.949 [2024-10-07 11:29:00.576270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.949 [2024-10-07 11:29:00.576302] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:77400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.949 [2024-10-07 11:29:00.576321] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.949 [2024-10-07 11:29:00.576338] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:77408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.949 [2024-10-07 11:29:00.576354] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.949 [2024-10-07 11:29:00.576370] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:77416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.949 [2024-10-07 11:29:00.576385] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.949 [2024-10-07 11:29:00.576401] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:77424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.949 [2024-10-07 11:29:00.576451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.949 [2024-10-07 11:29:00.576482] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:77432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.949 [2024-10-07 11:29:00.576527] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.949 [2024-10-07 11:29:00.576559] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:77440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.949 [2024-10-07 11:29:00.576589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.949 [2024-10-07 11:29:00.576619] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:77448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.949 [2024-10-07 11:29:00.576647] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.949 [2024-10-07 11:29:00.576674] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:77456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.949 [2024-10-07 11:29:00.576697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.949 [2024-10-07 11:29:00.576726] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:77464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.949 [2024-10-07 11:29:00.576752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.949 [2024-10-07 11:29:00.576780] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:77472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.949 [2024-10-07 11:29:00.576821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.949 [2024-10-07 11:29:00.576929] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:77480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.949 [2024-10-07 11:29:00.576960] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.949 [2024-10-07 11:29:00.576991] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:77488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.949 [2024-10-07 11:29:00.577017] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.949 [2024-10-07 11:29:00.577035] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:77496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.949 [2024-10-07 11:29:00.577055] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.949 [2024-10-07 11:29:00.577078] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:77504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.949 [2024-10-07 11:29:00.577106] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.949 [2024-10-07 11:29:00.577136] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:77512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.949 [2024-10-07 11:29:00.577172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.949 [2024-10-07 11:29:00.577205] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:77520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.949 [2024-10-07 11:29:00.577241] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.949 [2024-10-07 11:29:00.577263] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:77528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.949 [2024-10-07 11:29:00.577277] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.949 [2024-10-07 11:29:00.577294] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:77536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.950 [2024-10-07 11:29:00.577308] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.950 [2024-10-07 11:29:00.577324] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:77544 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.950 [2024-10-07 11:29:00.577339] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.950 [2024-10-07 11:29:00.577354] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:77552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.950 [2024-10-07 11:29:00.577369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.950 [2024-10-07 11:29:00.577384] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:77560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.950 [2024-10-07 11:29:00.577399] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.950 [2024-10-07 11:29:00.577416] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:77568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.950 [2024-10-07 11:29:00.577443] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.950 [2024-10-07 11:29:00.577484] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:77576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.950 [2024-10-07 11:29:00.577515] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.950 [2024-10-07 11:29:00.577532] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:77584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.950 [2024-10-07 11:29:00.577547] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.950 [2024-10-07 11:29:00.577563] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:77592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.950 [2024-10-07 11:29:00.577577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.950 [2024-10-07 11:29:00.577593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:77600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.950 [2024-10-07 11:29:00.577608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.950 [2024-10-07 11:29:00.577624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:77608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.950 [2024-10-07 11:29:00.577638] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.950 [2024-10-07 11:29:00.577654] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:77616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.950 [2024-10-07 11:29:00.577668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.950 [2024-10-07 11:29:00.577684] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:77624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.950 [2024-10-07 11:29:00.577699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.950 [2024-10-07 11:29:00.577716] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:77632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.950 [2024-10-07 11:29:00.577730] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.950 [2024-10-07 11:29:00.577746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:77640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.950 [2024-10-07 11:29:00.577760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.950 [2024-10-07 11:29:00.577776] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:77648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.950 [2024-10-07 11:29:00.577797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.950 [2024-10-07 11:29:00.577814] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:78016 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:33.950 [2024-10-07 11:29:00.577829] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.950 [2024-10-07 11:29:00.577845] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:78024 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:33.950 [2024-10-07 11:29:00.577860] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.950 [2024-10-07 11:29:00.577876] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:78032 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:33.950 [2024-10-07 11:29:00.577890] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.950 [2024-10-07 11:29:00.577915] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:78040 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:33.950 [2024-10-07 11:29:00.577931] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.950 [2024-10-07 11:29:00.577947] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:78048 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:33.950 [2024-10-07 11:29:00.577976] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.950 [2024-10-07 11:29:00.577993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:78056 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:33.950 [2024-10-07 11:29:00.578008] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.950 [2024-10-07 11:29:00.578025] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:78064 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:33.950 [2024-10-07 11:29:00.578039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.950 [2024-10-07 11:29:00.578055] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:78072 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:33.950 [2024-10-07 11:29:00.578069] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.950 [2024-10-07 11:29:00.578086] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:78080 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:33.950 [2024-10-07 11:29:00.578101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.950 [2024-10-07 11:29:00.578116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:78088 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:33.950 [2024-10-07 11:29:00.578131] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.950 [2024-10-07 11:29:00.578146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:78096 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:33.950 [2024-10-07 11:29:00.578161] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.950 [2024-10-07 11:29:00.578177] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:78104 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:33.950 [2024-10-07 11:29:00.578192] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.950 [2024-10-07 11:29:00.578207] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:78112 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:33.950 [2024-10-07 11:29:00.578222] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.950 [2024-10-07 11:29:00.578238] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:72 nsid:1 lba:78120 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:33.950 [2024-10-07 11:29:00.578252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.950 [2024-10-07 11:29:00.578268] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:78128 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:33.950 [2024-10-07 11:29:00.578282] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.950 [2024-10-07 11:29:00.578298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:109 nsid:1 lba:78136 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:33.950 [2024-10-07 11:29:00.578330] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.950 [2024-10-07 11:29:00.578348] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:78144 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:33.950 [2024-10-07 11:29:00.578363] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.950 [2024-10-07 11:29:00.578378] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:78152 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:33.950 [2024-10-07 11:29:00.578393] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.950 [2024-10-07 11:29:00.578408] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:78160 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:33.950 [2024-10-07 11:29:00.578437] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.950 [2024-10-07 11:29:00.578454] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:78168 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:33.950 [2024-10-07 11:29:00.578469] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.950 [2024-10-07 11:29:00.578485] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:78176 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:33.950 [2024-10-07 11:29:00.578499] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.950 [2024-10-07 11:29:00.578515] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:78184 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:33.950 [2024-10-07 11:29:00.578530] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.950 [2024-10-07 11:29:00.578550] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:78192 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:33.950 [2024-10-07 11:29:00.578565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.950 [2024-10-07 11:29:00.578580] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:78200 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:33.950 [2024-10-07 11:29:00.578595] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.950 [2024-10-07 11:29:00.578611] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:78208 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:33.950 [2024-10-07 11:29:00.578626] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.950 [2024-10-07 11:29:00.578641] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:78216 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:33.950 [2024-10-07 11:29:00.578655] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.950 [2024-10-07 11:29:00.578671] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:78224 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:33.950 [2024-10-07 11:29:00.578685] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.950 [2024-10-07 11:29:00.578701] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:78232 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:33.951 [2024-10-07 11:29:00.578716] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.951 [2024-10-07 11:29:00.578731] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:78240 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:33.951 [2024-10-07 11:29:00.578754] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.951 [2024-10-07 11:29:00.578771] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:78248 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:33.951 [2024-10-07 11:29:00.578800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.951 [2024-10-07 11:29:00.578815] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:78256 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:33.951 [2024-10-07 11:29:00.578829] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.951 [2024-10-07 11:29:00.578845] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:78264 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:33.951 [2024-10-07 11:29:00.578865] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.951 [2024-10-07 11:29:00.578881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:78272 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:33.951 [2024-10-07 11:29:00.578895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.951 [2024-10-07 11:29:00.578910] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:78280 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:33.951 [2024-10-07 11:29:00.578924] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.951 [2024-10-07 11:29:00.578939] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:78288 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:33.951 [2024-10-07 11:29:00.578953] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.951 [2024-10-07 11:29:00.578968] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:78296 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:33.951 [2024-10-07 11:29:00.578982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.951 [2024-10-07 11:29:00.578997] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:78304 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:33.951 [2024-10-07 11:29:00.579011] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.951 [2024-10-07 11:29:00.579026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:78312 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:33.951 [2024-10-07 11:29:00.579041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.951 [2024-10-07 11:29:00.579073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:78320 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:33.951 [2024-10-07 11:29:00.579087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.951 [2024-10-07 11:29:00.579103] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:78328 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:33.951 [2024-10-07 11:29:00.579117] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.951 [2024-10-07 11:29:00.579133] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:78336 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:33.951 [2024-10-07 11:29:00.579147] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.951 [2024-10-07 11:29:00.579170] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:78344 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:33.951 [2024-10-07 11:29:00.579185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.951 [2024-10-07 11:29:00.579201] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:78352 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:33.951 [2024-10-07 11:29:00.579215] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.951 [2024-10-07 11:29:00.579231] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:78360 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:33.951 [2024-10-07 11:29:00.579245] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.951 [2024-10-07 11:29:00.579261] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:78368 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:33.951 [2024-10-07 11:29:00.579275] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.951 [2024-10-07 11:29:00.579290] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:78376 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:33.951 [2024-10-07 11:29:00.579305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.951 [2024-10-07 11:29:00.579320] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:78384 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:33.951 [2024-10-07 11:29:00.579334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.951 [2024-10-07 11:29:00.579350] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:78392 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:33.951 [2024-10-07 11:29:00.579370] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.951 [2024-10-07 11:29:00.579386] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:78400 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:33.951 [2024-10-07 11:29:00.579401] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.951 [2024-10-07 11:29:00.579434] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:78408 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:33.951 [2024-10-07 11:29:00.579496] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.951 [2024-10-07 11:29:00.579526] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:77656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.951 [2024-10-07 11:29:00.579542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.951 [2024-10-07 11:29:00.579558] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:77664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.951 [2024-10-07 11:29:00.579573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.951 [2024-10-07 11:29:00.579588] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:77672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.951 [2024-10-07 11:29:00.579602] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.951 [2024-10-07 11:29:00.579618] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:77680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.951 [2024-10-07 11:29:00.579648] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.951 [2024-10-07 11:29:00.579666] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:77688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.951 [2024-10-07 11:29:00.579680] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.951 [2024-10-07 11:29:00.579696] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:77696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.951 [2024-10-07 11:29:00.579710] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.951 [2024-10-07 11:29:00.579727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:77704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.951 [2024-10-07 11:29:00.579741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.951 [2024-10-07 11:29:00.579756] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:77712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.951 [2024-10-07 11:29:00.579771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.951 [2024-10-07 11:29:00.579786] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:77720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.951 [2024-10-07 11:29:00.579801] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.951 [2024-10-07 11:29:00.579816] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:77728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.951 [2024-10-07 11:29:00.579846] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.951 [2024-10-07 11:29:00.579861] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:77736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.951 [2024-10-07 11:29:00.579875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.951 [2024-10-07 11:29:00.579890] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:77744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.951 [2024-10-07 11:29:00.579904] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.951 [2024-10-07 11:29:00.579919] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:77752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.951 [2024-10-07 11:29:00.579933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.951 [2024-10-07 11:29:00.579949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:77760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.951 [2024-10-07 11:29:00.579969] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.951 [2024-10-07 11:29:00.579985] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:77768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.951 [2024-10-07 11:29:00.579999] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.951 [2024-10-07 11:29:00.580015] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:77776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.951 [2024-10-07 11:29:00.580030] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.951 [2024-10-07 11:29:00.580069] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:77784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.951 [2024-10-07 11:29:00.580085] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.951 [2024-10-07 11:29:00.580101] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:77792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.951 [2024-10-07 11:29:00.580115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.951 [2024-10-07 11:29:00.580131] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:77800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.951 [2024-10-07 11:29:00.580145] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.951 [2024-10-07 11:29:00.580161] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:77808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.952 [2024-10-07 11:29:00.580175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.952 [2024-10-07 11:29:00.580191] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:77816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.952 [2024-10-07 11:29:00.580205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.952 [2024-10-07 11:29:00.580221] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:77824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.952 [2024-10-07 11:29:00.580235] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.952 [2024-10-07 11:29:00.580251] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:77832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.952 [2024-10-07 11:29:00.580265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.952 [2024-10-07 11:29:00.580281] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:77840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.952 [2024-10-07 11:29:00.580295] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.952 [2024-10-07 11:29:00.580312] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:77848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.952 [2024-10-07 11:29:00.580326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.952 [2024-10-07 11:29:00.580342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:77856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.952 [2024-10-07 11:29:00.580356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.952 [2024-10-07 11:29:00.580373] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:77864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.952 [2024-10-07 11:29:00.580387] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.952 [2024-10-07 11:29:00.580404] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:77872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.952 [2024-10-07 11:29:00.580418] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.952 [2024-10-07 11:29:00.580433] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:77880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.952 [2024-10-07 11:29:00.580463] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.952 [2024-10-07 11:29:00.580489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:77888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.952 [2024-10-07 11:29:00.580511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.952 [2024-10-07 11:29:00.580529] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:77896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.952 [2024-10-07 11:29:00.580543] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.952 [2024-10-07 11:29:00.580559] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:77904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.952 [2024-10-07 11:29:00.580573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.952 [2024-10-07 11:29:00.580589] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:77912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.952 [2024-10-07 11:29:00.580604] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.952 [2024-10-07 11:29:00.580619] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:77920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.952 [2024-10-07 11:29:00.580633] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.952 [2024-10-07 11:29:00.580649] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:77928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.952 [2024-10-07 11:29:00.580663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.952 [2024-10-07 11:29:00.580678] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:77936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.952 [2024-10-07 11:29:00.580692] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.952 [2024-10-07 11:29:00.580708] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:77944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.952 [2024-10-07 11:29:00.580722] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.952 [2024-10-07 11:29:00.580738] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:77952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.952 [2024-10-07 11:29:00.580752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.952 [2024-10-07 11:29:00.580768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:77960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.952 [2024-10-07 11:29:00.580796] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.952 [2024-10-07 11:29:00.580812] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:77968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.952 [2024-10-07 11:29:00.580825] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.952 [2024-10-07 11:29:00.580840] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:77976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.952 [2024-10-07 11:29:00.580854] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.952 [2024-10-07 11:29:00.580869] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:77984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.952 [2024-10-07 11:29:00.580890] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.952 [2024-10-07 11:29:00.580906] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:77992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.952 [2024-10-07 11:29:00.580920] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.952 [2024-10-07 11:29:00.580935] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:78000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.952 [2024-10-07 11:29:00.580949] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.952 [2024-10-07 11:29:00.580966] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x69abc0 is same with the state(6) to be set 00:18:33.952 [2024-10-07 11:29:00.580984] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:33.952 [2024-10-07 11:29:00.580995] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:33.952 [2024-10-07 11:29:00.581012] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:78008 len:8 PRP1 0x0 PRP2 0x0 00:18:33.952 [2024-10-07 11:29:00.581026] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.952 [2024-10-07 11:29:00.581121] bdev_nvme.c:1730:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x69abc0 was disconnected and freed. reset controller. 00:18:33.952 [2024-10-07 11:29:00.581253] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:18:33.952 [2024-10-07 11:29:00.581280] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.952 [2024-10-07 11:29:00.581297] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:18:33.952 [2024-10-07 11:29:00.581311] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.952 [2024-10-07 11:29:00.581326] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:18:33.952 [2024-10-07 11:29:00.581340] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.952 [2024-10-07 11:29:00.581355] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:18:33.952 [2024-10-07 11:29:00.581369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.952 [2024-10-07 11:29:00.581382] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.952 [2024-10-07 11:29:00.582701] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.952 [2024-10-07 11:29:00.582743] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.952 [2024-10-07 11:29:00.582867] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.952 [2024-10-07 11:29:00.582899] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.952 [2024-10-07 11:29:00.582916] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.952 [2024-10-07 11:29:00.582940] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.952 [2024-10-07 11:29:00.582964] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.952 [2024-10-07 11:29:00.582992] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.952 [2024-10-07 11:29:00.583010] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.952 [2024-10-07 11:29:00.583036] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.952 [2024-10-07 11:29:00.604707] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.952 [2024-10-07 11:29:00.605941] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.952 [2024-10-07 11:29:00.606026] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.952 [2024-10-07 11:29:00.606055] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.952 [2024-10-07 11:29:00.608121] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.952 [2024-10-07 11:29:00.608808] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.952 [2024-10-07 11:29:00.608862] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.952 [2024-10-07 11:29:00.608898] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.952 [2024-10-07 11:29:00.609081] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.952 [2024-10-07 11:29:00.614815] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.952 [2024-10-07 11:29:00.614939] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.952 [2024-10-07 11:29:00.614971] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.952 [2024-10-07 11:29:00.614988] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.952 [2024-10-07 11:29:00.615011] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.953 [2024-10-07 11:29:00.615033] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.953 [2024-10-07 11:29:00.615047] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.953 [2024-10-07 11:29:00.615061] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.953 [2024-10-07 11:29:00.615083] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.953 [2024-10-07 11:29:00.624891] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.953 [2024-10-07 11:29:00.625018] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.953 [2024-10-07 11:29:00.625050] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.953 [2024-10-07 11:29:00.625066] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.953 [2024-10-07 11:29:00.625090] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.953 [2024-10-07 11:29:00.625112] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.953 [2024-10-07 11:29:00.625126] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.953 [2024-10-07 11:29:00.625139] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.953 [2024-10-07 11:29:00.625161] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.953 [2024-10-07 11:29:00.635912] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.953 [2024-10-07 11:29:00.636188] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.953 [2024-10-07 11:29:00.636232] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.953 [2024-10-07 11:29:00.636252] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.953 [2024-10-07 11:29:00.636304] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.953 [2024-10-07 11:29:00.636332] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.953 [2024-10-07 11:29:00.636347] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.953 [2024-10-07 11:29:00.636360] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.953 [2024-10-07 11:29:00.636384] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.953 [2024-10-07 11:29:00.649031] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.953 [2024-10-07 11:29:00.649404] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.953 [2024-10-07 11:29:00.649459] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.953 [2024-10-07 11:29:00.649481] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.953 [2024-10-07 11:29:00.649616] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.953 [2024-10-07 11:29:00.649760] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.953 [2024-10-07 11:29:00.649793] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.953 [2024-10-07 11:29:00.649809] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.953 [2024-10-07 11:29:00.649862] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.953 [2024-10-07 11:29:00.662216] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.953 [2024-10-07 11:29:00.662661] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.953 [2024-10-07 11:29:00.662707] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.953 [2024-10-07 11:29:00.662727] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.953 [2024-10-07 11:29:00.662861] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.953 [2024-10-07 11:29:00.662934] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.953 [2024-10-07 11:29:00.662958] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.953 [2024-10-07 11:29:00.662972] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.953 [2024-10-07 11:29:00.663019] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.953 [2024-10-07 11:29:00.672304] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.953 [2024-10-07 11:29:00.674972] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.953 [2024-10-07 11:29:00.675038] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.953 [2024-10-07 11:29:00.675059] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.953 [2024-10-07 11:29:00.675980] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.953 [2024-10-07 11:29:00.676368] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.953 [2024-10-07 11:29:00.676407] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.953 [2024-10-07 11:29:00.676453] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.953 [2024-10-07 11:29:00.676605] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.953 [2024-10-07 11:29:00.682390] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.953 [2024-10-07 11:29:00.682531] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.953 [2024-10-07 11:29:00.682563] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.953 [2024-10-07 11:29:00.682581] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.953 [2024-10-07 11:29:00.682606] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.953 [2024-10-07 11:29:00.682629] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.953 [2024-10-07 11:29:00.682645] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.953 [2024-10-07 11:29:00.682659] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.953 [2024-10-07 11:29:00.682682] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.953 [2024-10-07 11:29:00.692504] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.953 [2024-10-07 11:29:00.692631] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.953 [2024-10-07 11:29:00.692662] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.953 [2024-10-07 11:29:00.692679] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.953 [2024-10-07 11:29:00.692704] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.953 [2024-10-07 11:29:00.692726] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.953 [2024-10-07 11:29:00.692740] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.953 [2024-10-07 11:29:00.692753] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.953 [2024-10-07 11:29:00.692776] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.953 [2024-10-07 11:29:00.704005] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.953 [2024-10-07 11:29:00.704132] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.953 [2024-10-07 11:29:00.704163] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.953 [2024-10-07 11:29:00.704181] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.953 [2024-10-07 11:29:00.704205] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.953 [2024-10-07 11:29:00.704227] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.953 [2024-10-07 11:29:00.704241] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.953 [2024-10-07 11:29:00.704272] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.953 [2024-10-07 11:29:00.704298] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.953 [2024-10-07 11:29:00.718734] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.953 [2024-10-07 11:29:00.718850] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.953 [2024-10-07 11:29:00.718882] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.953 [2024-10-07 11:29:00.718899] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.953 [2024-10-07 11:29:00.718924] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.953 [2024-10-07 11:29:00.718946] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.953 [2024-10-07 11:29:00.718961] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.953 [2024-10-07 11:29:00.718975] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.954 [2024-10-07 11:29:00.719014] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.954 [2024-10-07 11:29:00.733484] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.954 [2024-10-07 11:29:00.733634] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.954 [2024-10-07 11:29:00.733666] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.954 [2024-10-07 11:29:00.733684] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.954 [2024-10-07 11:29:00.733709] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.954 [2024-10-07 11:29:00.733732] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.954 [2024-10-07 11:29:00.733747] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.954 [2024-10-07 11:29:00.733761] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.954 [2024-10-07 11:29:00.733785] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.954 [2024-10-07 11:29:00.748152] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.954 [2024-10-07 11:29:00.748282] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.954 [2024-10-07 11:29:00.748313] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.954 [2024-10-07 11:29:00.748330] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.954 [2024-10-07 11:29:00.748354] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.954 [2024-10-07 11:29:00.748376] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.954 [2024-10-07 11:29:00.748392] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.954 [2024-10-07 11:29:00.748405] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.954 [2024-10-07 11:29:00.748442] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.954 [2024-10-07 11:29:00.763393] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.954 [2024-10-07 11:29:00.763637] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.954 [2024-10-07 11:29:00.763671] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.954 [2024-10-07 11:29:00.763689] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.954 [2024-10-07 11:29:00.763714] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.954 [2024-10-07 11:29:00.763736] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.954 [2024-10-07 11:29:00.763750] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.954 [2024-10-07 11:29:00.763764] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.954 [2024-10-07 11:29:00.763788] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.954 [2024-10-07 11:29:00.776261] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.954 [2024-10-07 11:29:00.776390] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.954 [2024-10-07 11:29:00.776422] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.954 [2024-10-07 11:29:00.776454] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.954 [2024-10-07 11:29:00.777005] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.954 [2024-10-07 11:29:00.777148] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.954 [2024-10-07 11:29:00.777171] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.954 [2024-10-07 11:29:00.777185] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.954 [2024-10-07 11:29:00.777209] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.954 [2024-10-07 11:29:00.786573] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.954 [2024-10-07 11:29:00.787540] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.954 [2024-10-07 11:29:00.787598] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.954 [2024-10-07 11:29:00.787618] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.954 [2024-10-07 11:29:00.789313] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.954 [2024-10-07 11:29:00.789683] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.954 [2024-10-07 11:29:00.789722] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.954 [2024-10-07 11:29:00.789739] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.954 [2024-10-07 11:29:00.790240] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.954 [2024-10-07 11:29:00.797166] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.954 [2024-10-07 11:29:00.797291] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.954 [2024-10-07 11:29:00.797322] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.954 [2024-10-07 11:29:00.797339] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.954 [2024-10-07 11:29:00.797363] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.954 [2024-10-07 11:29:00.797416] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.954 [2024-10-07 11:29:00.797462] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.954 [2024-10-07 11:29:00.797483] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.954 [2024-10-07 11:29:00.797509] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.954 [2024-10-07 11:29:00.807261] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.954 [2024-10-07 11:29:00.807386] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.954 [2024-10-07 11:29:00.807417] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.954 [2024-10-07 11:29:00.807451] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.954 [2024-10-07 11:29:00.807476] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.954 [2024-10-07 11:29:00.807498] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.954 [2024-10-07 11:29:00.807512] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.954 [2024-10-07 11:29:00.807525] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.954 [2024-10-07 11:29:00.807548] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.954 [2024-10-07 11:29:00.817358] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.954 [2024-10-07 11:29:00.817509] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.954 [2024-10-07 11:29:00.817543] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.954 [2024-10-07 11:29:00.817560] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.954 [2024-10-07 11:29:00.817585] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.954 [2024-10-07 11:29:00.817607] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.954 [2024-10-07 11:29:00.817621] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.954 [2024-10-07 11:29:00.817634] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.954 [2024-10-07 11:29:00.817657] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.954 [2024-10-07 11:29:00.829238] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.954 [2024-10-07 11:29:00.829379] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.954 [2024-10-07 11:29:00.829432] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.954 [2024-10-07 11:29:00.829475] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.954 [2024-10-07 11:29:00.829503] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.954 [2024-10-07 11:29:00.829540] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.954 [2024-10-07 11:29:00.829558] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.954 [2024-10-07 11:29:00.829571] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.954 [2024-10-07 11:29:00.829610] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.954 [2024-10-07 11:29:00.842081] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.954 [2024-10-07 11:29:00.842207] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.954 [2024-10-07 11:29:00.842238] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.954 [2024-10-07 11:29:00.842255] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.954 [2024-10-07 11:29:00.842279] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.954 [2024-10-07 11:29:00.842300] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.954 [2024-10-07 11:29:00.842314] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.954 [2024-10-07 11:29:00.842329] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.954 [2024-10-07 11:29:00.842352] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.954 [2024-10-07 11:29:00.853215] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.954 [2024-10-07 11:29:00.853480] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.954 [2024-10-07 11:29:00.853517] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.954 [2024-10-07 11:29:00.853535] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.954 [2024-10-07 11:29:00.853668] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.954 [2024-10-07 11:29:00.853781] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.954 [2024-10-07 11:29:00.853802] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.955 [2024-10-07 11:29:00.853816] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.955 [2024-10-07 11:29:00.853921] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.955 [2024-10-07 11:29:00.863318] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.955 [2024-10-07 11:29:00.863458] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.955 [2024-10-07 11:29:00.863490] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.955 [2024-10-07 11:29:00.863506] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.955 [2024-10-07 11:29:00.863531] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.955 [2024-10-07 11:29:00.863552] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.955 [2024-10-07 11:29:00.863566] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.955 [2024-10-07 11:29:00.863580] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.955 [2024-10-07 11:29:00.863602] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.955 [2024-10-07 11:29:00.873559] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.955 [2024-10-07 11:29:00.873682] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.955 [2024-10-07 11:29:00.873713] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.955 [2024-10-07 11:29:00.873747] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.955 [2024-10-07 11:29:00.873773] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.955 [2024-10-07 11:29:00.873797] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.955 [2024-10-07 11:29:00.873811] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.955 [2024-10-07 11:29:00.873824] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.955 [2024-10-07 11:29:00.873846] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.955 [2024-10-07 11:29:00.885890] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.955 [2024-10-07 11:29:00.886303] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.955 [2024-10-07 11:29:00.886350] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.955 [2024-10-07 11:29:00.886370] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.955 [2024-10-07 11:29:00.886443] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.955 [2024-10-07 11:29:00.886476] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.955 [2024-10-07 11:29:00.886497] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.955 [2024-10-07 11:29:00.886511] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.955 [2024-10-07 11:29:00.886536] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.955 [2024-10-07 11:29:00.897692] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.955 [2024-10-07 11:29:00.897947] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.955 [2024-10-07 11:29:00.897997] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.955 [2024-10-07 11:29:00.898016] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.955 [2024-10-07 11:29:00.898153] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.955 [2024-10-07 11:29:00.898272] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.955 [2024-10-07 11:29:00.898313] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.955 [2024-10-07 11:29:00.898330] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.955 [2024-10-07 11:29:00.898462] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.955 [2024-10-07 11:29:00.907826] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.955 [2024-10-07 11:29:00.907939] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.955 [2024-10-07 11:29:00.907971] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.955 [2024-10-07 11:29:00.907990] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.955 [2024-10-07 11:29:00.908424] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.955 [2024-10-07 11:29:00.908611] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.955 [2024-10-07 11:29:00.908666] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.955 [2024-10-07 11:29:00.908684] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.955 [2024-10-07 11:29:00.908830] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.955 [2024-10-07 11:29:00.918177] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.955 [2024-10-07 11:29:00.918293] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.955 [2024-10-07 11:29:00.918326] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.955 [2024-10-07 11:29:00.918344] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.955 [2024-10-07 11:29:00.918368] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.955 [2024-10-07 11:29:00.918391] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.955 [2024-10-07 11:29:00.918406] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.955 [2024-10-07 11:29:00.918437] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.955 [2024-10-07 11:29:00.918463] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.955 [2024-10-07 11:29:00.928261] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.955 [2024-10-07 11:29:00.928390] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.955 [2024-10-07 11:29:00.928448] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.955 [2024-10-07 11:29:00.928469] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.955 [2024-10-07 11:29:00.928493] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.955 [2024-10-07 11:29:00.928515] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.955 [2024-10-07 11:29:00.928529] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.955 [2024-10-07 11:29:00.928558] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.955 [2024-10-07 11:29:00.928580] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.955 [2024-10-07 11:29:00.939407] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.955 [2024-10-07 11:29:00.939718] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.955 [2024-10-07 11:29:00.939762] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.955 [2024-10-07 11:29:00.939781] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.955 [2024-10-07 11:29:00.939823] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.955 [2024-10-07 11:29:00.939848] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.955 [2024-10-07 11:29:00.939863] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.955 [2024-10-07 11:29:00.939876] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.955 [2024-10-07 11:29:00.939898] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.955 [2024-10-07 11:29:00.952450] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.955 [2024-10-07 11:29:00.952690] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.955 [2024-10-07 11:29:00.952735] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.955 [2024-10-07 11:29:00.952770] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.955 [2024-10-07 11:29:00.952894] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.955 [2024-10-07 11:29:00.953640] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.955 [2024-10-07 11:29:00.953679] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.955 [2024-10-07 11:29:00.953712] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.955 [2024-10-07 11:29:00.955706] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.955 [2024-10-07 11:29:00.967318] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.955 [2024-10-07 11:29:00.967457] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.955 [2024-10-07 11:29:00.967490] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.955 [2024-10-07 11:29:00.967507] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.955 [2024-10-07 11:29:00.967531] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.955 [2024-10-07 11:29:00.967553] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.955 [2024-10-07 11:29:00.967568] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.955 [2024-10-07 11:29:00.967581] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.955 [2024-10-07 11:29:00.967603] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.955 [2024-10-07 11:29:00.979170] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.955 [2024-10-07 11:29:00.979295] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.955 [2024-10-07 11:29:00.979326] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.955 [2024-10-07 11:29:00.979343] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.955 [2024-10-07 11:29:00.979366] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.955 [2024-10-07 11:29:00.979387] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.956 [2024-10-07 11:29:00.979401] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.956 [2024-10-07 11:29:00.979414] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.956 [2024-10-07 11:29:00.979451] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.956 [2024-10-07 11:29:00.990768] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.956 [2024-10-07 11:29:00.990896] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.956 [2024-10-07 11:29:00.990927] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.956 [2024-10-07 11:29:00.990944] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.956 [2024-10-07 11:29:00.991522] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.956 [2024-10-07 11:29:00.991665] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.956 [2024-10-07 11:29:00.991689] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.956 [2024-10-07 11:29:00.991703] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.956 [2024-10-07 11:29:00.991727] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.956 [2024-10-07 11:29:01.001253] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.956 [2024-10-07 11:29:01.001394] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.956 [2024-10-07 11:29:01.001443] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.956 [2024-10-07 11:29:01.001477] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.956 [2024-10-07 11:29:01.003567] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.956 [2024-10-07 11:29:01.003891] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.956 [2024-10-07 11:29:01.003928] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.956 [2024-10-07 11:29:01.003944] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.956 [2024-10-07 11:29:01.004401] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.956 [2024-10-07 11:29:01.012631] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.956 [2024-10-07 11:29:01.012857] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.956 [2024-10-07 11:29:01.012897] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.956 [2024-10-07 11:29:01.012915] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.956 [2024-10-07 11:29:01.013042] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.956 [2024-10-07 11:29:01.013146] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.956 [2024-10-07 11:29:01.013175] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.956 [2024-10-07 11:29:01.013191] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.956 [2024-10-07 11:29:01.014392] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.956 [2024-10-07 11:29:01.025053] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.956 [2024-10-07 11:29:01.026202] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.956 [2024-10-07 11:29:01.026265] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.956 [2024-10-07 11:29:01.026285] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.956 [2024-10-07 11:29:01.026488] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.956 [2024-10-07 11:29:01.026607] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.956 [2024-10-07 11:29:01.026629] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.956 [2024-10-07 11:29:01.026662] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.956 [2024-10-07 11:29:01.026783] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.956 [2024-10-07 11:29:01.037593] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.956 [2024-10-07 11:29:01.039802] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.956 [2024-10-07 11:29:01.039863] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.956 [2024-10-07 11:29:01.039883] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.956 [2024-10-07 11:29:01.039984] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.956 [2024-10-07 11:29:01.040014] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.956 [2024-10-07 11:29:01.040028] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.956 [2024-10-07 11:29:01.040042] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.956 [2024-10-07 11:29:01.040065] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.956 [2024-10-07 11:29:01.048044] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.956 [2024-10-07 11:29:01.048170] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.956 [2024-10-07 11:29:01.048202] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.956 [2024-10-07 11:29:01.048219] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.956 [2024-10-07 11:29:01.048242] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.956 [2024-10-07 11:29:01.048264] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.956 [2024-10-07 11:29:01.048278] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.956 [2024-10-07 11:29:01.048290] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.956 [2024-10-07 11:29:01.048312] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.956 [2024-10-07 11:29:01.060820] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.956 [2024-10-07 11:29:01.061015] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.956 [2024-10-07 11:29:01.061048] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.956 [2024-10-07 11:29:01.061066] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.956 [2024-10-07 11:29:01.061090] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.956 [2024-10-07 11:29:01.061112] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.956 [2024-10-07 11:29:01.061127] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.956 [2024-10-07 11:29:01.061141] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.956 [2024-10-07 11:29:01.061164] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.956 [2024-10-07 11:29:01.071040] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.956 [2024-10-07 11:29:01.071195] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.956 [2024-10-07 11:29:01.071229] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.956 [2024-10-07 11:29:01.071248] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.956 [2024-10-07 11:29:01.071273] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.956 [2024-10-07 11:29:01.071296] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.956 [2024-10-07 11:29:01.071310] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.956 [2024-10-07 11:29:01.071324] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.956 [2024-10-07 11:29:01.071348] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.956 [2024-10-07 11:29:01.081161] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.956 [2024-10-07 11:29:01.081307] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.956 [2024-10-07 11:29:01.081341] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.956 [2024-10-07 11:29:01.081359] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.956 [2024-10-07 11:29:01.081383] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.956 [2024-10-07 11:29:01.081406] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.956 [2024-10-07 11:29:01.081461] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.956 [2024-10-07 11:29:01.081489] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.956 [2024-10-07 11:29:01.081517] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.956 [2024-10-07 11:29:01.092338] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.956 [2024-10-07 11:29:01.092567] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.956 [2024-10-07 11:29:01.092602] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.956 [2024-10-07 11:29:01.092620] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.956 [2024-10-07 11:29:01.092645] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.956 [2024-10-07 11:29:01.092668] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.956 [2024-10-07 11:29:01.092683] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.956 [2024-10-07 11:29:01.092697] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.956 [2024-10-07 11:29:01.092736] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.956 [2024-10-07 11:29:01.104243] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.956 [2024-10-07 11:29:01.105053] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.956 [2024-10-07 11:29:01.105099] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.956 [2024-10-07 11:29:01.105120] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.957 [2024-10-07 11:29:01.105526] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.957 [2024-10-07 11:29:01.105641] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.957 [2024-10-07 11:29:01.105667] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.957 [2024-10-07 11:29:01.105682] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.957 [2024-10-07 11:29:01.105709] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.957 [2024-10-07 11:29:01.116538] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.957 [2024-10-07 11:29:01.116896] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.957 [2024-10-07 11:29:01.116942] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.957 [2024-10-07 11:29:01.116962] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.957 [2024-10-07 11:29:01.117021] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.957 [2024-10-07 11:29:01.117051] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.957 [2024-10-07 11:29:01.117066] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.957 [2024-10-07 11:29:01.117080] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.957 [2024-10-07 11:29:01.117105] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.957 [2024-10-07 11:29:01.126894] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.957 [2024-10-07 11:29:01.127108] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.957 [2024-10-07 11:29:01.127141] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.957 [2024-10-07 11:29:01.127159] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.957 [2024-10-07 11:29:01.127284] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.957 [2024-10-07 11:29:01.128578] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.957 [2024-10-07 11:29:01.128616] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.957 [2024-10-07 11:29:01.128634] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.957 [2024-10-07 11:29:01.131107] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.957 [2024-10-07 11:29:01.136993] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.957 [2024-10-07 11:29:01.137126] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.957 [2024-10-07 11:29:01.137158] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.957 [2024-10-07 11:29:01.137175] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.957 [2024-10-07 11:29:01.137199] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.957 [2024-10-07 11:29:01.137222] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.957 [2024-10-07 11:29:01.137236] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.957 [2024-10-07 11:29:01.137250] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.957 [2024-10-07 11:29:01.137289] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.957 [2024-10-07 11:29:01.148209] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.957 [2024-10-07 11:29:01.148371] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.957 [2024-10-07 11:29:01.148404] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.957 [2024-10-07 11:29:01.148421] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.957 [2024-10-07 11:29:01.148463] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.957 [2024-10-07 11:29:01.148487] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.957 [2024-10-07 11:29:01.148501] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.957 [2024-10-07 11:29:01.148514] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.957 [2024-10-07 11:29:01.148538] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.957 [2024-10-07 11:29:01.158346] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.957 [2024-10-07 11:29:01.158489] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.957 [2024-10-07 11:29:01.158521] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.957 [2024-10-07 11:29:01.158538] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.957 [2024-10-07 11:29:01.158562] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.957 [2024-10-07 11:29:01.158585] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.957 [2024-10-07 11:29:01.158599] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.957 [2024-10-07 11:29:01.158612] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.957 [2024-10-07 11:29:01.158635] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.957 [2024-10-07 11:29:01.170595] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.957 [2024-10-07 11:29:01.170845] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.957 [2024-10-07 11:29:01.170890] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.957 [2024-10-07 11:29:01.170910] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.957 [2024-10-07 11:29:01.171026] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.957 [2024-10-07 11:29:01.171134] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.957 [2024-10-07 11:29:01.171159] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.957 [2024-10-07 11:29:01.171175] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.957 [2024-10-07 11:29:01.171277] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.957 [2024-10-07 11:29:01.186790] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.957 [2024-10-07 11:29:01.187503] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.957 [2024-10-07 11:29:01.187564] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.957 [2024-10-07 11:29:01.187619] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.957 [2024-10-07 11:29:01.187993] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.957 [2024-10-07 11:29:01.188083] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.957 [2024-10-07 11:29:01.188106] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.957 [2024-10-07 11:29:01.188120] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.957 [2024-10-07 11:29:01.188145] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.957 [2024-10-07 11:29:01.197142] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.957 [2024-10-07 11:29:01.197274] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.957 [2024-10-07 11:29:01.197306] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.957 [2024-10-07 11:29:01.197324] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.957 [2024-10-07 11:29:01.197349] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.957 [2024-10-07 11:29:01.197384] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.957 [2024-10-07 11:29:01.197402] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.957 [2024-10-07 11:29:01.197420] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.957 [2024-10-07 11:29:01.197474] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.957 [2024-10-07 11:29:01.207352] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.957 [2024-10-07 11:29:01.207495] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.957 [2024-10-07 11:29:01.207529] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.957 [2024-10-07 11:29:01.207547] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.957 [2024-10-07 11:29:01.207572] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.957 [2024-10-07 11:29:01.207594] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.957 [2024-10-07 11:29:01.207608] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.957 [2024-10-07 11:29:01.207621] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.957 [2024-10-07 11:29:01.207644] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.958 [2024-10-07 11:29:01.219809] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.958 [2024-10-07 11:29:01.220106] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.958 [2024-10-07 11:29:01.220152] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.958 [2024-10-07 11:29:01.220173] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.958 [2024-10-07 11:29:01.220235] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.958 [2024-10-07 11:29:01.220279] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.958 [2024-10-07 11:29:01.220328] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.958 [2024-10-07 11:29:01.220344] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.958 [2024-10-07 11:29:01.220370] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.958 [2024-10-07 11:29:01.232022] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.958 [2024-10-07 11:29:01.232290] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.958 [2024-10-07 11:29:01.232336] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.958 [2024-10-07 11:29:01.232357] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.958 [2024-10-07 11:29:01.232521] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.958 [2024-10-07 11:29:01.232643] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.958 [2024-10-07 11:29:01.232666] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.958 [2024-10-07 11:29:01.232681] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.958 [2024-10-07 11:29:01.232787] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.958 [2024-10-07 11:29:01.244649] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.958 [2024-10-07 11:29:01.247062] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.958 [2024-10-07 11:29:01.247127] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.958 [2024-10-07 11:29:01.247148] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.958 [2024-10-07 11:29:01.247252] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.958 [2024-10-07 11:29:01.247566] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.958 [2024-10-07 11:29:01.247604] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.958 [2024-10-07 11:29:01.247622] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.958 [2024-10-07 11:29:01.247791] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.958 [2024-10-07 11:29:01.256067] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.958 [2024-10-07 11:29:01.256384] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.958 [2024-10-07 11:29:01.256459] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.958 [2024-10-07 11:29:01.256492] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.958 [2024-10-07 11:29:01.256553] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.958 [2024-10-07 11:29:01.256587] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.958 [2024-10-07 11:29:01.256602] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.958 [2024-10-07 11:29:01.256615] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.958 [2024-10-07 11:29:01.256639] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.958 [2024-10-07 11:29:01.268128] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.958 [2024-10-07 11:29:01.268639] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.958 [2024-10-07 11:29:01.268717] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.958 [2024-10-07 11:29:01.268738] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.958 [2024-10-07 11:29:01.268808] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.958 [2024-10-07 11:29:01.268838] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.958 [2024-10-07 11:29:01.268854] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.958 [2024-10-07 11:29:01.268883] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.958 [2024-10-07 11:29:01.268907] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.958 [2024-10-07 11:29:01.281319] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.958 [2024-10-07 11:29:01.281544] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.958 [2024-10-07 11:29:01.281585] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.958 [2024-10-07 11:29:01.281605] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.958 [2024-10-07 11:29:01.281631] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.958 [2024-10-07 11:29:01.281654] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.958 [2024-10-07 11:29:01.281668] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.958 [2024-10-07 11:29:01.281682] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.958 [2024-10-07 11:29:01.281724] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.958 [2024-10-07 11:29:01.293032] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.958 [2024-10-07 11:29:01.293184] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.958 [2024-10-07 11:29:01.293219] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.958 [2024-10-07 11:29:01.293237] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.958 [2024-10-07 11:29:01.293432] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.958 [2024-10-07 11:29:01.293500] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.958 [2024-10-07 11:29:01.293530] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.958 [2024-10-07 11:29:01.293545] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.958 [2024-10-07 11:29:01.293571] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.958 [2024-10-07 11:29:01.305897] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.958 [2024-10-07 11:29:01.306200] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.958 [2024-10-07 11:29:01.306246] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.958 [2024-10-07 11:29:01.306267] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.958 [2024-10-07 11:29:01.306492] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.958 [2024-10-07 11:29:01.306617] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.958 [2024-10-07 11:29:01.306649] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.958 [2024-10-07 11:29:01.306665] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.958 [2024-10-07 11:29:01.306797] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.958 [2024-10-07 11:29:01.322160] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.958 [2024-10-07 11:29:01.323012] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.958 [2024-10-07 11:29:01.323071] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.958 [2024-10-07 11:29:01.323091] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.958 [2024-10-07 11:29:01.323196] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.958 [2024-10-07 11:29:01.323226] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.958 [2024-10-07 11:29:01.323240] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.958 [2024-10-07 11:29:01.323253] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.958 [2024-10-07 11:29:01.323277] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.958 [2024-10-07 11:29:01.333571] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.958 [2024-10-07 11:29:01.333816] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.958 [2024-10-07 11:29:01.333849] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.958 [2024-10-07 11:29:01.333866] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.958 [2024-10-07 11:29:01.334026] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.958 [2024-10-07 11:29:01.334146] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.958 [2024-10-07 11:29:01.334185] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.958 [2024-10-07 11:29:01.334202] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.958 [2024-10-07 11:29:01.334331] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.958 [2024-10-07 11:29:01.344097] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.958 [2024-10-07 11:29:01.344213] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.958 [2024-10-07 11:29:01.344246] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.958 [2024-10-07 11:29:01.344264] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.958 [2024-10-07 11:29:01.344289] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.958 [2024-10-07 11:29:01.344312] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.958 [2024-10-07 11:29:01.344326] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.959 [2024-10-07 11:29:01.344361] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.959 [2024-10-07 11:29:01.346963] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.959 [2024-10-07 11:29:01.355810] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.959 [2024-10-07 11:29:01.356006] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.959 [2024-10-07 11:29:01.356039] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.959 [2024-10-07 11:29:01.356057] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.959 [2024-10-07 11:29:01.356082] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.959 [2024-10-07 11:29:01.356105] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.959 [2024-10-07 11:29:01.356119] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.959 [2024-10-07 11:29:01.356132] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.959 [2024-10-07 11:29:01.356155] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.959 [2024-10-07 11:29:01.366593] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.959 [2024-10-07 11:29:01.366856] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.959 [2024-10-07 11:29:01.366901] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.959 [2024-10-07 11:29:01.366920] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.959 [2024-10-07 11:29:01.366973] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.959 [2024-10-07 11:29:01.367015] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.959 [2024-10-07 11:29:01.367034] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.959 [2024-10-07 11:29:01.367049] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.959 [2024-10-07 11:29:01.367072] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.959 [2024-10-07 11:29:01.379774] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.959 [2024-10-07 11:29:01.379969] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.959 [2024-10-07 11:29:01.380012] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.959 [2024-10-07 11:29:01.380031] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.959 [2024-10-07 11:29:01.380189] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.959 [2024-10-07 11:29:01.380262] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.959 [2024-10-07 11:29:01.380285] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.959 [2024-10-07 11:29:01.380299] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.959 [2024-10-07 11:29:01.380323] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.959 [2024-10-07 11:29:01.393613] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.959 [2024-10-07 11:29:01.394478] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.959 [2024-10-07 11:29:01.394528] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.959 [2024-10-07 11:29:01.394549] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.959 [2024-10-07 11:29:01.394938] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.959 [2024-10-07 11:29:01.395032] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.959 [2024-10-07 11:29:01.395060] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.959 [2024-10-07 11:29:01.395076] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.959 [2024-10-07 11:29:01.395254] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.959 8641.50 IOPS, 33.76 MiB/s [2024-10-07T11:29:15.670Z] [2024-10-07 11:29:01.404008] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.959 [2024-10-07 11:29:01.404228] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.959 [2024-10-07 11:29:01.404274] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.959 [2024-10-07 11:29:01.404294] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.959 [2024-10-07 11:29:01.404440] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.959 [2024-10-07 11:29:01.404584] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.959 [2024-10-07 11:29:01.404616] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.959 [2024-10-07 11:29:01.404632] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.959 [2024-10-07 11:29:01.406567] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.959 [2024-10-07 11:29:01.414112] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.959 [2024-10-07 11:29:01.414230] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.959 [2024-10-07 11:29:01.414263] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.959 [2024-10-07 11:29:01.414282] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.959 [2024-10-07 11:29:01.414321] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.959 [2024-10-07 11:29:01.414344] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.959 [2024-10-07 11:29:01.414358] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.959 [2024-10-07 11:29:01.414371] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.959 [2024-10-07 11:29:01.414410] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.959 [2024-10-07 11:29:01.424576] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.959 [2024-10-07 11:29:01.425363] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.959 [2024-10-07 11:29:01.425422] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.959 [2024-10-07 11:29:01.425471] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.959 [2024-10-07 11:29:01.425590] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.959 [2024-10-07 11:29:01.425622] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.959 [2024-10-07 11:29:01.425637] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.959 [2024-10-07 11:29:01.425652] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.959 [2024-10-07 11:29:01.425676] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.959 [2024-10-07 11:29:01.438232] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.959 [2024-10-07 11:29:01.438362] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.959 [2024-10-07 11:29:01.438394] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.959 [2024-10-07 11:29:01.438412] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.959 [2024-10-07 11:29:01.438479] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.959 [2024-10-07 11:29:01.438510] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.959 [2024-10-07 11:29:01.438529] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.959 [2024-10-07 11:29:01.438544] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.959 [2024-10-07 11:29:01.438568] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.959 [2024-10-07 11:29:01.452741] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.959 [2024-10-07 11:29:01.452869] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.959 [2024-10-07 11:29:01.452900] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.959 [2024-10-07 11:29:01.452917] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.959 [2024-10-07 11:29:01.452941] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.959 [2024-10-07 11:29:01.452968] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.959 [2024-10-07 11:29:01.452982] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.959 [2024-10-07 11:29:01.452994] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.959 [2024-10-07 11:29:01.453017] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.959 [2024-10-07 11:29:01.464255] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.959 [2024-10-07 11:29:01.464506] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.959 [2024-10-07 11:29:01.464541] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.959 [2024-10-07 11:29:01.464558] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.959 [2024-10-07 11:29:01.464664] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.959 [2024-10-07 11:29:01.464766] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.959 [2024-10-07 11:29:01.464785] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.959 [2024-10-07 11:29:01.464798] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.959 [2024-10-07 11:29:01.467095] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.959 [2024-10-07 11:29:01.474924] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.959 [2024-10-07 11:29:01.475050] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.959 [2024-10-07 11:29:01.475081] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.959 [2024-10-07 11:29:01.475098] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.959 [2024-10-07 11:29:01.475322] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.959 [2024-10-07 11:29:01.475399] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.960 [2024-10-07 11:29:01.475439] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.960 [2024-10-07 11:29:01.475454] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.960 [2024-10-07 11:29:01.475479] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.960 [2024-10-07 11:29:01.485019] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.960 [2024-10-07 11:29:01.485146] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.960 [2024-10-07 11:29:01.485177] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.960 [2024-10-07 11:29:01.485194] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.960 [2024-10-07 11:29:01.485217] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.960 [2024-10-07 11:29:01.485238] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.960 [2024-10-07 11:29:01.485252] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.960 [2024-10-07 11:29:01.485265] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.960 [2024-10-07 11:29:01.485456] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.960 [2024-10-07 11:29:01.496087] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.960 [2024-10-07 11:29:01.496214] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.960 [2024-10-07 11:29:01.496245] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.960 [2024-10-07 11:29:01.496262] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.960 [2024-10-07 11:29:01.496286] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.960 [2024-10-07 11:29:01.496307] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.960 [2024-10-07 11:29:01.496321] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.960 [2024-10-07 11:29:01.496334] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.960 [2024-10-07 11:29:01.496357] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.960 [2024-10-07 11:29:01.506807] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.960 [2024-10-07 11:29:01.506982] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.960 [2024-10-07 11:29:01.507030] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.960 [2024-10-07 11:29:01.507050] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.960 [2024-10-07 11:29:01.507075] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.960 [2024-10-07 11:29:01.507098] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.960 [2024-10-07 11:29:01.507113] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.960 [2024-10-07 11:29:01.507126] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.960 [2024-10-07 11:29:01.507150] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.960 [2024-10-07 11:29:01.518933] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.960 [2024-10-07 11:29:01.519171] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.960 [2024-10-07 11:29:01.519214] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.960 [2024-10-07 11:29:01.519233] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.960 [2024-10-07 11:29:01.519349] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.960 [2024-10-07 11:29:01.519467] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.960 [2024-10-07 11:29:01.519489] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.960 [2024-10-07 11:29:01.519503] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.960 [2024-10-07 11:29:01.521187] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.960 [2024-10-07 11:29:01.529570] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.960 [2024-10-07 11:29:01.529811] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.960 [2024-10-07 11:29:01.529857] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.960 [2024-10-07 11:29:01.529876] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.960 [2024-10-07 11:29:01.530044] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.960 [2024-10-07 11:29:01.530183] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.960 [2024-10-07 11:29:01.530214] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.960 [2024-10-07 11:29:01.530229] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.960 [2024-10-07 11:29:01.530359] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.960 [2024-10-07 11:29:01.539669] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.960 [2024-10-07 11:29:01.539794] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.960 [2024-10-07 11:29:01.539825] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.960 [2024-10-07 11:29:01.539842] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.960 [2024-10-07 11:29:01.539865] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.960 [2024-10-07 11:29:01.539904] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.960 [2024-10-07 11:29:01.539920] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.960 [2024-10-07 11:29:01.539934] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.960 [2024-10-07 11:29:01.539957] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.960 [2024-10-07 11:29:01.549766] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.960 [2024-10-07 11:29:01.549896] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.960 [2024-10-07 11:29:01.549927] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.960 [2024-10-07 11:29:01.549944] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.960 [2024-10-07 11:29:01.549982] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.960 [2024-10-07 11:29:01.550006] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.960 [2024-10-07 11:29:01.550020] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.960 [2024-10-07 11:29:01.550033] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.960 [2024-10-07 11:29:01.550055] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.960 [2024-10-07 11:29:01.561063] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.960 [2024-10-07 11:29:01.561189] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.960 [2024-10-07 11:29:01.561220] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.960 [2024-10-07 11:29:01.561237] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.960 [2024-10-07 11:29:01.561260] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.960 [2024-10-07 11:29:01.561281] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.960 [2024-10-07 11:29:01.561296] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.960 [2024-10-07 11:29:01.561309] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.960 [2024-10-07 11:29:01.561331] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.960 [2024-10-07 11:29:01.574718] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.960 [2024-10-07 11:29:01.574849] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.960 [2024-10-07 11:29:01.574881] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.960 [2024-10-07 11:29:01.574898] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.960 [2024-10-07 11:29:01.574923] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.960 [2024-10-07 11:29:01.574945] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.960 [2024-10-07 11:29:01.574960] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.960 [2024-10-07 11:29:01.574973] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.960 [2024-10-07 11:29:01.574996] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.960 [2024-10-07 11:29:01.586074] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.960 [2024-10-07 11:29:01.586299] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.960 [2024-10-07 11:29:01.586334] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.960 [2024-10-07 11:29:01.586352] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.960 [2024-10-07 11:29:01.586525] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.960 [2024-10-07 11:29:01.586671] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.960 [2024-10-07 11:29:01.586695] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.960 [2024-10-07 11:29:01.586709] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.960 [2024-10-07 11:29:01.586839] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.960 [2024-10-07 11:29:01.596293] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.960 [2024-10-07 11:29:01.596406] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.960 [2024-10-07 11:29:01.596481] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.960 [2024-10-07 11:29:01.596498] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.960 [2024-10-07 11:29:01.596522] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.961 [2024-10-07 11:29:01.596544] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.961 [2024-10-07 11:29:01.596558] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.961 [2024-10-07 11:29:01.596571] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.961 [2024-10-07 11:29:01.596594] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.961 [2024-10-07 11:29:01.606394] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.961 [2024-10-07 11:29:01.606552] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.961 [2024-10-07 11:29:01.606585] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.961 [2024-10-07 11:29:01.606602] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.961 [2024-10-07 11:29:01.606626] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.961 [2024-10-07 11:29:01.606648] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.961 [2024-10-07 11:29:01.606661] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.961 [2024-10-07 11:29:01.606674] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.961 [2024-10-07 11:29:01.606697] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.961 [2024-10-07 11:29:01.616995] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.961 [2024-10-07 11:29:01.617179] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.961 [2024-10-07 11:29:01.617213] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.961 [2024-10-07 11:29:01.617251] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.961 [2024-10-07 11:29:01.617312] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.961 [2024-10-07 11:29:01.617341] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.961 [2024-10-07 11:29:01.617356] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.961 [2024-10-07 11:29:01.617370] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.961 [2024-10-07 11:29:01.617393] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.961 [2024-10-07 11:29:01.630401] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.961 [2024-10-07 11:29:01.630624] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.961 [2024-10-07 11:29:01.630659] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.961 [2024-10-07 11:29:01.630676] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.961 [2024-10-07 11:29:01.630701] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.961 [2024-10-07 11:29:01.630723] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.961 [2024-10-07 11:29:01.630737] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.961 [2024-10-07 11:29:01.630750] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.961 [2024-10-07 11:29:01.630773] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.961 [2024-10-07 11:29:01.642666] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.961 [2024-10-07 11:29:01.642821] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.961 [2024-10-07 11:29:01.642853] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.961 [2024-10-07 11:29:01.642871] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.961 [2024-10-07 11:29:01.642895] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.961 [2024-10-07 11:29:01.642916] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.961 [2024-10-07 11:29:01.642931] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.961 [2024-10-07 11:29:01.642944] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.961 [2024-10-07 11:29:01.642967] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.961 [2024-10-07 11:29:01.653141] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.961 [2024-10-07 11:29:01.653366] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.961 [2024-10-07 11:29:01.653399] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.961 [2024-10-07 11:29:01.653417] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.961 [2024-10-07 11:29:01.653554] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.961 [2024-10-07 11:29:01.653668] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.961 [2024-10-07 11:29:01.653708] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.961 [2024-10-07 11:29:01.653742] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.961 [2024-10-07 11:29:01.653855] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.961 [2024-10-07 11:29:01.663370] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.961 [2024-10-07 11:29:01.663508] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.961 [2024-10-07 11:29:01.663539] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.961 [2024-10-07 11:29:01.663560] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.961 [2024-10-07 11:29:01.663584] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.961 [2024-10-07 11:29:01.663606] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.961 [2024-10-07 11:29:01.663620] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.961 [2024-10-07 11:29:01.663633] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.961 [2024-10-07 11:29:01.663655] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.961 [2024-10-07 11:29:01.673482] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.961 [2024-10-07 11:29:01.673596] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.961 [2024-10-07 11:29:01.673629] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.961 [2024-10-07 11:29:01.673647] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.961 [2024-10-07 11:29:01.673676] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.961 [2024-10-07 11:29:01.673698] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.961 [2024-10-07 11:29:01.673713] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.961 [2024-10-07 11:29:01.673726] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.961 [2024-10-07 11:29:01.673749] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.961 [2024-10-07 11:29:01.684726] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.961 [2024-10-07 11:29:01.685025] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.961 [2024-10-07 11:29:01.685070] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.961 [2024-10-07 11:29:01.685090] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.961 [2024-10-07 11:29:01.685293] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.961 [2024-10-07 11:29:01.685366] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.961 [2024-10-07 11:29:01.685389] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.961 [2024-10-07 11:29:01.685403] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.961 [2024-10-07 11:29:01.685445] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.961 [2024-10-07 11:29:01.695088] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.961 [2024-10-07 11:29:01.695310] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.961 [2024-10-07 11:29:01.695345] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.961 [2024-10-07 11:29:01.695363] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.961 [2024-10-07 11:29:01.695498] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.961 [2024-10-07 11:29:01.698006] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.961 [2024-10-07 11:29:01.698047] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.961 [2024-10-07 11:29:01.698064] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.961 [2024-10-07 11:29:01.699897] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.961 [2024-10-07 11:29:01.705188] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.961 [2024-10-07 11:29:01.705301] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.961 [2024-10-07 11:29:01.705333] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.961 [2024-10-07 11:29:01.705351] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.961 [2024-10-07 11:29:01.705375] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.961 [2024-10-07 11:29:01.705398] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.961 [2024-10-07 11:29:01.705427] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.961 [2024-10-07 11:29:01.705443] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.961 [2024-10-07 11:29:01.705468] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.961 [2024-10-07 11:29:01.715611] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.961 [2024-10-07 11:29:01.715737] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.961 [2024-10-07 11:29:01.715768] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.962 [2024-10-07 11:29:01.715785] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.962 [2024-10-07 11:29:01.715808] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.962 [2024-10-07 11:29:01.715829] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.962 [2024-10-07 11:29:01.715843] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.962 [2024-10-07 11:29:01.715856] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.962 [2024-10-07 11:29:01.715878] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.962 [2024-10-07 11:29:01.725858] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.962 [2024-10-07 11:29:01.726012] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.962 [2024-10-07 11:29:01.726045] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.962 [2024-10-07 11:29:01.726063] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.962 [2024-10-07 11:29:01.726104] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.962 [2024-10-07 11:29:01.726129] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.962 [2024-10-07 11:29:01.726144] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.962 [2024-10-07 11:29:01.726158] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.962 [2024-10-07 11:29:01.726182] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.962 [2024-10-07 11:29:01.736297] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.962 [2024-10-07 11:29:01.736507] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.962 [2024-10-07 11:29:01.736539] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.962 [2024-10-07 11:29:01.736555] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.962 [2024-10-07 11:29:01.736629] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.962 [2024-10-07 11:29:01.736655] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.962 [2024-10-07 11:29:01.736669] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.962 [2024-10-07 11:29:01.736682] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.962 [2024-10-07 11:29:01.736705] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.962 [2024-10-07 11:29:01.746417] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.962 [2024-10-07 11:29:01.746569] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.962 [2024-10-07 11:29:01.746603] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.962 [2024-10-07 11:29:01.746620] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.962 [2024-10-07 11:29:01.748695] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.962 [2024-10-07 11:29:01.748985] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.962 [2024-10-07 11:29:01.749021] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.962 [2024-10-07 11:29:01.749038] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.962 [2024-10-07 11:29:01.749093] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.962 [2024-10-07 11:29:01.756536] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.962 [2024-10-07 11:29:01.756659] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.962 [2024-10-07 11:29:01.756689] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.962 [2024-10-07 11:29:01.756706] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.962 [2024-10-07 11:29:01.756874] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.962 [2024-10-07 11:29:01.756936] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.962 [2024-10-07 11:29:01.756957] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.962 [2024-10-07 11:29:01.756986] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.962 [2024-10-07 11:29:01.757012] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.962 [2024-10-07 11:29:01.766994] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.962 [2024-10-07 11:29:01.767122] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.962 [2024-10-07 11:29:01.767153] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.962 [2024-10-07 11:29:01.767171] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.962 [2024-10-07 11:29:01.767195] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.962 [2024-10-07 11:29:01.767216] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.962 [2024-10-07 11:29:01.767230] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.962 [2024-10-07 11:29:01.767243] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.962 [2024-10-07 11:29:01.767266] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.962 [2024-10-07 11:29:01.779589] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.962 [2024-10-07 11:29:01.779788] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.962 [2024-10-07 11:29:01.779819] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.962 [2024-10-07 11:29:01.779836] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.962 [2024-10-07 11:29:01.780669] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.962 [2024-10-07 11:29:01.782381] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.962 [2024-10-07 11:29:01.782448] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.962 [2024-10-07 11:29:01.782480] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.962 [2024-10-07 11:29:01.783088] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.962 [2024-10-07 11:29:01.793189] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.962 [2024-10-07 11:29:01.793420] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.962 [2024-10-07 11:29:01.793468] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.962 [2024-10-07 11:29:01.793486] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.962 [2024-10-07 11:29:01.793511] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.962 [2024-10-07 11:29:01.793549] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.962 [2024-10-07 11:29:01.793564] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.962 [2024-10-07 11:29:01.793576] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.962 [2024-10-07 11:29:01.793844] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.962 [2024-10-07 11:29:01.803287] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.962 [2024-10-07 11:29:01.803404] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.962 [2024-10-07 11:29:01.803469] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.962 [2024-10-07 11:29:01.803489] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.962 [2024-10-07 11:29:01.803515] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.962 [2024-10-07 11:29:01.803539] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.962 [2024-10-07 11:29:01.803553] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.962 [2024-10-07 11:29:01.803567] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.962 [2024-10-07 11:29:01.803606] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.962 [2024-10-07 11:29:01.814601] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.962 [2024-10-07 11:29:01.814750] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.962 [2024-10-07 11:29:01.814782] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.962 [2024-10-07 11:29:01.814799] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.962 [2024-10-07 11:29:01.814824] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.962 [2024-10-07 11:29:01.814859] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.962 [2024-10-07 11:29:01.814879] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.962 [2024-10-07 11:29:01.814893] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.962 [2024-10-07 11:29:01.814916] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.962 [2024-10-07 11:29:01.825610] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.962 [2024-10-07 11:29:01.826015] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.963 [2024-10-07 11:29:01.826061] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.963 [2024-10-07 11:29:01.826081] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.963 [2024-10-07 11:29:01.826239] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.963 [2024-10-07 11:29:01.826394] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.963 [2024-10-07 11:29:01.826450] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.963 [2024-10-07 11:29:01.826478] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.963 [2024-10-07 11:29:01.826608] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.963 [2024-10-07 11:29:01.837473] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.963 [2024-10-07 11:29:01.837602] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.963 [2024-10-07 11:29:01.837633] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.963 [2024-10-07 11:29:01.837650] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.963 [2024-10-07 11:29:01.837675] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.963 [2024-10-07 11:29:01.837716] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.963 [2024-10-07 11:29:01.837732] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.963 [2024-10-07 11:29:01.837745] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.963 [2024-10-07 11:29:01.837769] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.963 [2024-10-07 11:29:01.847572] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.963 [2024-10-07 11:29:01.847708] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.963 [2024-10-07 11:29:01.847739] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.963 [2024-10-07 11:29:01.847757] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.963 [2024-10-07 11:29:01.847781] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.963 [2024-10-07 11:29:01.847803] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.963 [2024-10-07 11:29:01.847823] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.963 [2024-10-07 11:29:01.847837] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.963 [2024-10-07 11:29:01.848737] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.963 [2024-10-07 11:29:01.857954] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.963 [2024-10-07 11:29:01.858093] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.963 [2024-10-07 11:29:01.858124] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.963 [2024-10-07 11:29:01.858141] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.963 [2024-10-07 11:29:01.858165] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.963 [2024-10-07 11:29:01.858187] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.963 [2024-10-07 11:29:01.858202] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.963 [2024-10-07 11:29:01.858215] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.963 [2024-10-07 11:29:01.858239] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.963 [2024-10-07 11:29:01.871687] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.963 [2024-10-07 11:29:01.871814] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.963 [2024-10-07 11:29:01.871846] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.963 [2024-10-07 11:29:01.871863] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.963 [2024-10-07 11:29:01.871888] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.963 [2024-10-07 11:29:01.871910] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.963 [2024-10-07 11:29:01.871924] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.963 [2024-10-07 11:29:01.871938] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.963 [2024-10-07 11:29:01.871961] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.963 [2024-10-07 11:29:01.886312] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.963 [2024-10-07 11:29:01.886452] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.963 [2024-10-07 11:29:01.886491] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.963 [2024-10-07 11:29:01.886510] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.963 [2024-10-07 11:29:01.886537] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.963 [2024-10-07 11:29:01.886560] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.963 [2024-10-07 11:29:01.886575] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.963 [2024-10-07 11:29:01.886590] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.963 [2024-10-07 11:29:01.886614] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.963 [2024-10-07 11:29:01.901144] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.963 [2024-10-07 11:29:01.902235] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.963 [2024-10-07 11:29:01.902284] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.963 [2024-10-07 11:29:01.902304] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.963 [2024-10-07 11:29:01.902880] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.963 [2024-10-07 11:29:01.902993] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.963 [2024-10-07 11:29:01.903022] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.963 [2024-10-07 11:29:01.903037] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.963 [2024-10-07 11:29:01.903062] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.963 [2024-10-07 11:29:01.914977] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.963 [2024-10-07 11:29:01.915107] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.963 [2024-10-07 11:29:01.915138] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.963 [2024-10-07 11:29:01.915155] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.963 [2024-10-07 11:29:01.915723] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.963 [2024-10-07 11:29:01.915837] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.963 [2024-10-07 11:29:01.915860] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.963 [2024-10-07 11:29:01.915874] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.963 [2024-10-07 11:29:01.915899] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.963 [2024-10-07 11:29:01.925558] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.963 [2024-10-07 11:29:01.925801] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.963 [2024-10-07 11:29:01.925841] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.963 [2024-10-07 11:29:01.925881] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.963 [2024-10-07 11:29:01.926005] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.963 [2024-10-07 11:29:01.926545] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.963 [2024-10-07 11:29:01.926585] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.963 [2024-10-07 11:29:01.926617] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.963 [2024-10-07 11:29:01.928426] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.963 [2024-10-07 11:29:01.937785] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.963 [2024-10-07 11:29:01.938011] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.963 [2024-10-07 11:29:01.938052] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.963 [2024-10-07 11:29:01.938083] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.963 [2024-10-07 11:29:01.938213] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.963 [2024-10-07 11:29:01.940539] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.963 [2024-10-07 11:29:01.940584] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.963 [2024-10-07 11:29:01.940602] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.963 [2024-10-07 11:29:01.942391] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.963 [2024-10-07 11:29:01.948601] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.963 [2024-10-07 11:29:01.948834] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.963 [2024-10-07 11:29:01.948869] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.963 [2024-10-07 11:29:01.948887] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.963 [2024-10-07 11:29:01.949004] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.963 [2024-10-07 11:29:01.949110] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.963 [2024-10-07 11:29:01.949130] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.963 [2024-10-07 11:29:01.949143] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.963 [2024-10-07 11:29:01.949276] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.963 [2024-10-07 11:29:01.958796] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.964 [2024-10-07 11:29:01.958922] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.964 [2024-10-07 11:29:01.958953] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.964 [2024-10-07 11:29:01.958971] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.964 [2024-10-07 11:29:01.958995] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.964 [2024-10-07 11:29:01.959017] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.964 [2024-10-07 11:29:01.959064] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.964 [2024-10-07 11:29:01.959097] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.964 [2024-10-07 11:29:01.959122] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.964 [2024-10-07 11:29:01.968891] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.964 [2024-10-07 11:29:01.969016] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.964 [2024-10-07 11:29:01.969046] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.964 [2024-10-07 11:29:01.969063] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.964 [2024-10-07 11:29:01.969087] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.964 [2024-10-07 11:29:01.969108] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.964 [2024-10-07 11:29:01.969122] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.964 [2024-10-07 11:29:01.969135] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.964 [2024-10-07 11:29:01.969158] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.964 [2024-10-07 11:29:01.979937] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.964 [2024-10-07 11:29:01.980110] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.964 [2024-10-07 11:29:01.980143] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.964 [2024-10-07 11:29:01.980160] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.964 [2024-10-07 11:29:01.980185] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.964 [2024-10-07 11:29:01.980206] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.964 [2024-10-07 11:29:01.980220] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.964 [2024-10-07 11:29:01.980233] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.964 [2024-10-07 11:29:01.980256] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.964 [2024-10-07 11:29:01.992972] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.964 [2024-10-07 11:29:01.993241] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.964 [2024-10-07 11:29:01.993277] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.964 [2024-10-07 11:29:01.993295] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.964 [2024-10-07 11:29:01.993409] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.964 [2024-10-07 11:29:01.993585] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.964 [2024-10-07 11:29:01.993618] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.964 [2024-10-07 11:29:01.993634] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.964 [2024-10-07 11:29:01.993692] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.964 [2024-10-07 11:29:02.006851] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.964 [2024-10-07 11:29:02.007403] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.964 [2024-10-07 11:29:02.007476] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.964 [2024-10-07 11:29:02.007513] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.964 [2024-10-07 11:29:02.007728] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.964 [2024-10-07 11:29:02.007928] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.964 [2024-10-07 11:29:02.007964] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.964 [2024-10-07 11:29:02.007980] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.964 [2024-10-07 11:29:02.008039] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.964 [2024-10-07 11:29:02.020358] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.964 [2024-10-07 11:29:02.020689] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.964 [2024-10-07 11:29:02.020736] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.964 [2024-10-07 11:29:02.020756] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.964 [2024-10-07 11:29:02.020881] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.964 [2024-10-07 11:29:02.021016] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.964 [2024-10-07 11:29:02.021043] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.964 [2024-10-07 11:29:02.021058] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.964 [2024-10-07 11:29:02.021178] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.964 [2024-10-07 11:29:02.030586] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.964 [2024-10-07 11:29:02.030711] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.964 [2024-10-07 11:29:02.030742] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.964 [2024-10-07 11:29:02.030759] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.964 [2024-10-07 11:29:02.030783] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.964 [2024-10-07 11:29:02.030804] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.964 [2024-10-07 11:29:02.030818] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.964 [2024-10-07 11:29:02.030831] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.964 [2024-10-07 11:29:02.030854] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.964 [2024-10-07 11:29:02.043694] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.964 [2024-10-07 11:29:02.043940] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.964 [2024-10-07 11:29:02.043993] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.964 [2024-10-07 11:29:02.044013] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.964 [2024-10-07 11:29:02.044076] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.964 [2024-10-07 11:29:02.044104] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.964 [2024-10-07 11:29:02.044118] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.964 [2024-10-07 11:29:02.044131] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.964 [2024-10-07 11:29:02.044155] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.964 [2024-10-07 11:29:02.056761] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.964 [2024-10-07 11:29:02.056888] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.964 [2024-10-07 11:29:02.056919] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.964 [2024-10-07 11:29:02.056937] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.964 [2024-10-07 11:29:02.056961] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.964 [2024-10-07 11:29:02.056983] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.964 [2024-10-07 11:29:02.057013] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.964 [2024-10-07 11:29:02.057027] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.964 [2024-10-07 11:29:02.057906] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.964 [2024-10-07 11:29:02.069623] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.964 [2024-10-07 11:29:02.069920] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.964 [2024-10-07 11:29:02.069976] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.964 [2024-10-07 11:29:02.069998] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.964 [2024-10-07 11:29:02.070192] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.964 [2024-10-07 11:29:02.070353] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.964 [2024-10-07 11:29:02.070387] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.964 [2024-10-07 11:29:02.070404] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.964 [2024-10-07 11:29:02.070491] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.964 [2024-10-07 11:29:02.080360] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.964 [2024-10-07 11:29:02.080522] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.964 [2024-10-07 11:29:02.080554] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.964 [2024-10-07 11:29:02.080571] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.964 [2024-10-07 11:29:02.080595] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.964 [2024-10-07 11:29:02.080617] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.964 [2024-10-07 11:29:02.080631] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.964 [2024-10-07 11:29:02.080662] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.964 [2024-10-07 11:29:02.080688] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.965 [2024-10-07 11:29:02.093419] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.965 [2024-10-07 11:29:02.093599] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.965 [2024-10-07 11:29:02.093632] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.965 [2024-10-07 11:29:02.093649] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.965 [2024-10-07 11:29:02.093673] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.965 [2024-10-07 11:29:02.093694] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.965 [2024-10-07 11:29:02.093708] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.965 [2024-10-07 11:29:02.093721] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.965 [2024-10-07 11:29:02.093744] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.965 [2024-10-07 11:29:02.106138] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.965 [2024-10-07 11:29:02.106375] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.965 [2024-10-07 11:29:02.106411] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.965 [2024-10-07 11:29:02.106456] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.965 [2024-10-07 11:29:02.106597] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.965 [2024-10-07 11:29:02.106701] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.965 [2024-10-07 11:29:02.106733] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.965 [2024-10-07 11:29:02.106749] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.965 [2024-10-07 11:29:02.107857] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.965 [2024-10-07 11:29:02.116687] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.965 [2024-10-07 11:29:02.118837] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.965 [2024-10-07 11:29:02.118900] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.965 [2024-10-07 11:29:02.118920] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.965 [2024-10-07 11:29:02.119298] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.965 [2024-10-07 11:29:02.119632] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.965 [2024-10-07 11:29:02.119669] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.965 [2024-10-07 11:29:02.119686] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.965 [2024-10-07 11:29:02.119828] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.965 [2024-10-07 11:29:02.126782] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.965 [2024-10-07 11:29:02.126910] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.965 [2024-10-07 11:29:02.126957] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.965 [2024-10-07 11:29:02.126976] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.965 [2024-10-07 11:29:02.127000] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.965 [2024-10-07 11:29:02.127036] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.965 [2024-10-07 11:29:02.127054] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.965 [2024-10-07 11:29:02.127068] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.965 [2024-10-07 11:29:02.127092] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.965 [2024-10-07 11:29:02.137913] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.965 [2024-10-07 11:29:02.138142] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.965 [2024-10-07 11:29:02.138182] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.965 [2024-10-07 11:29:02.138201] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.965 [2024-10-07 11:29:02.138365] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.965 [2024-10-07 11:29:02.138446] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.965 [2024-10-07 11:29:02.138481] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.965 [2024-10-07 11:29:02.138496] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.965 [2024-10-07 11:29:02.138521] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.965 [2024-10-07 11:29:02.152627] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.965 [2024-10-07 11:29:02.152753] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.965 [2024-10-07 11:29:02.152783] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.965 [2024-10-07 11:29:02.152800] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.965 [2024-10-07 11:29:02.152823] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.965 [2024-10-07 11:29:02.152845] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.965 [2024-10-07 11:29:02.152858] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.965 [2024-10-07 11:29:02.152871] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.965 [2024-10-07 11:29:02.152894] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.965 [2024-10-07 11:29:02.166793] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.965 [2024-10-07 11:29:02.166919] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.965 [2024-10-07 11:29:02.166951] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.965 [2024-10-07 11:29:02.166968] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.965 [2024-10-07 11:29:02.166992] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.965 [2024-10-07 11:29:02.167032] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.965 [2024-10-07 11:29:02.167047] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.965 [2024-10-07 11:29:02.167060] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.965 [2024-10-07 11:29:02.167083] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.965 [2024-10-07 11:29:02.179182] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.965 [2024-10-07 11:29:02.179308] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.965 [2024-10-07 11:29:02.179339] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.965 [2024-10-07 11:29:02.179357] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.965 [2024-10-07 11:29:02.179380] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.965 [2024-10-07 11:29:02.179402] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.965 [2024-10-07 11:29:02.179416] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.965 [2024-10-07 11:29:02.179445] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.965 [2024-10-07 11:29:02.179472] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.965 [2024-10-07 11:29:02.191766] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.965 [2024-10-07 11:29:02.191891] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.965 [2024-10-07 11:29:02.191922] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.965 [2024-10-07 11:29:02.191939] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.965 [2024-10-07 11:29:02.191962] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.965 [2024-10-07 11:29:02.191983] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.965 [2024-10-07 11:29:02.191996] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.965 [2024-10-07 11:29:02.192009] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.965 [2024-10-07 11:29:02.192032] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.965 [2024-10-07 11:29:02.206716] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.965 [2024-10-07 11:29:02.206832] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.965 [2024-10-07 11:29:02.206864] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.965 [2024-10-07 11:29:02.206882] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.965 [2024-10-07 11:29:02.207478] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.965 [2024-10-07 11:29:02.207616] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.965 [2024-10-07 11:29:02.207642] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.965 [2024-10-07 11:29:02.207657] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.965 [2024-10-07 11:29:02.207683] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.965 [2024-10-07 11:29:02.218989] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.965 [2024-10-07 11:29:02.220008] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.965 [2024-10-07 11:29:02.220068] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.965 [2024-10-07 11:29:02.220104] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.965 [2024-10-07 11:29:02.220327] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.965 [2024-10-07 11:29:02.220866] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.965 [2024-10-07 11:29:02.220916] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.965 [2024-10-07 11:29:02.220949] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.966 [2024-10-07 11:29:02.221067] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.966 [2024-10-07 11:29:02.232783] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.966 [2024-10-07 11:29:02.233039] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.966 [2024-10-07 11:29:02.233083] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.966 [2024-10-07 11:29:02.233102] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.966 [2024-10-07 11:29:02.233128] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.966 [2024-10-07 11:29:02.233150] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.966 [2024-10-07 11:29:02.233164] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.966 [2024-10-07 11:29:02.233177] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.966 [2024-10-07 11:29:02.233200] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.966 [2024-10-07 11:29:02.245518] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.966 [2024-10-07 11:29:02.245950] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.966 [2024-10-07 11:29:02.246026] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.966 [2024-10-07 11:29:02.246047] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.966 [2024-10-07 11:29:02.246122] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.966 [2024-10-07 11:29:02.246153] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.966 [2024-10-07 11:29:02.246168] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.966 [2024-10-07 11:29:02.246182] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.966 [2024-10-07 11:29:02.246206] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.966 [2024-10-07 11:29:02.256528] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.966 [2024-10-07 11:29:02.256677] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.966 [2024-10-07 11:29:02.256723] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.966 [2024-10-07 11:29:02.256759] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.966 [2024-10-07 11:29:02.256786] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.966 [2024-10-07 11:29:02.256810] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.966 [2024-10-07 11:29:02.256839] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.966 [2024-10-07 11:29:02.256853] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.966 [2024-10-07 11:29:02.256877] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.966 [2024-10-07 11:29:02.269989] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.966 [2024-10-07 11:29:02.270193] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.966 [2024-10-07 11:29:02.270227] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.966 [2024-10-07 11:29:02.270245] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.966 [2024-10-07 11:29:02.270913] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.966 [2024-10-07 11:29:02.271046] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.966 [2024-10-07 11:29:02.271071] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.966 [2024-10-07 11:29:02.271086] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.966 [2024-10-07 11:29:02.271112] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.966 [2024-10-07 11:29:02.282188] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.966 [2024-10-07 11:29:02.282463] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.966 [2024-10-07 11:29:02.282511] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.966 [2024-10-07 11:29:02.282533] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.966 [2024-10-07 11:29:02.282655] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.966 [2024-10-07 11:29:02.282771] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.966 [2024-10-07 11:29:02.282792] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.966 [2024-10-07 11:29:02.282808] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.966 [2024-10-07 11:29:02.282911] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.966 [2024-10-07 11:29:02.294756] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.966 [2024-10-07 11:29:02.297118] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.966 [2024-10-07 11:29:02.297168] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.966 [2024-10-07 11:29:02.297188] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.966 [2024-10-07 11:29:02.297459] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.966 [2024-10-07 11:29:02.297533] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.966 [2024-10-07 11:29:02.297579] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.966 [2024-10-07 11:29:02.297596] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.966 [2024-10-07 11:29:02.297623] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.966 [2024-10-07 11:29:02.304847] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.966 [2024-10-07 11:29:02.304980] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.966 [2024-10-07 11:29:02.305012] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.966 [2024-10-07 11:29:02.305030] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.966 [2024-10-07 11:29:02.305055] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.966 [2024-10-07 11:29:02.305078] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.966 [2024-10-07 11:29:02.305093] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.966 [2024-10-07 11:29:02.305107] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.966 [2024-10-07 11:29:02.305131] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.966 [2024-10-07 11:29:02.317351] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.966 [2024-10-07 11:29:02.317493] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.966 [2024-10-07 11:29:02.317526] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.966 [2024-10-07 11:29:02.317543] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.966 [2024-10-07 11:29:02.317568] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.966 [2024-10-07 11:29:02.317591] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.966 [2024-10-07 11:29:02.317605] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.966 [2024-10-07 11:29:02.317619] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.966 [2024-10-07 11:29:02.317642] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.966 [2024-10-07 11:29:02.330664] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.966 [2024-10-07 11:29:02.330813] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.966 [2024-10-07 11:29:02.330845] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.966 [2024-10-07 11:29:02.330863] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.966 [2024-10-07 11:29:02.331472] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.966 [2024-10-07 11:29:02.331623] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.966 [2024-10-07 11:29:02.331649] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.966 [2024-10-07 11:29:02.331664] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.966 [2024-10-07 11:29:02.331689] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.966 [2024-10-07 11:29:02.341320] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.966 [2024-10-07 11:29:02.341580] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.966 [2024-10-07 11:29:02.341617] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.966 [2024-10-07 11:29:02.341636] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.966 [2024-10-07 11:29:02.341767] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.966 [2024-10-07 11:29:02.341889] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.967 [2024-10-07 11:29:02.341921] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.967 [2024-10-07 11:29:02.341937] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.967 [2024-10-07 11:29:02.342072] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.967 [2024-10-07 11:29:02.353889] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.967 [2024-10-07 11:29:02.356245] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.967 [2024-10-07 11:29:02.356295] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.967 [2024-10-07 11:29:02.356316] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.967 [2024-10-07 11:29:02.356452] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.967 [2024-10-07 11:29:02.356487] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.967 [2024-10-07 11:29:02.356504] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.967 [2024-10-07 11:29:02.356518] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.967 [2024-10-07 11:29:02.356798] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.967 [2024-10-07 11:29:02.365232] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.967 [2024-10-07 11:29:02.365394] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.967 [2024-10-07 11:29:02.365443] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.967 [2024-10-07 11:29:02.365464] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.967 [2024-10-07 11:29:02.365490] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.967 [2024-10-07 11:29:02.365513] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.967 [2024-10-07 11:29:02.365528] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.967 [2024-10-07 11:29:02.365542] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.967 [2024-10-07 11:29:02.365566] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.967 [2024-10-07 11:29:02.377066] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.967 [2024-10-07 11:29:02.378426] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.967 [2024-10-07 11:29:02.378503] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.967 [2024-10-07 11:29:02.378525] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.967 [2024-10-07 11:29:02.378699] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.967 [2024-10-07 11:29:02.378732] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.967 [2024-10-07 11:29:02.378748] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.967 [2024-10-07 11:29:02.378762] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.967 [2024-10-07 11:29:02.378787] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.967 [2024-10-07 11:29:02.392563] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.967 [2024-10-07 11:29:02.392787] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.967 [2024-10-07 11:29:02.392828] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.967 [2024-10-07 11:29:02.392848] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.967 [2024-10-07 11:29:02.392874] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.967 [2024-10-07 11:29:02.392896] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.967 [2024-10-07 11:29:02.392911] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.967 [2024-10-07 11:29:02.392925] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.967 [2024-10-07 11:29:02.392949] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.967 8878.33 IOPS, 34.68 MiB/s [2024-10-07T11:29:15.678Z] [2024-10-07 11:29:02.408690] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.967 [2024-10-07 11:29:02.409006] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.967 [2024-10-07 11:29:02.409053] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.967 [2024-10-07 11:29:02.409074] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.967 [2024-10-07 11:29:02.409131] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.967 [2024-10-07 11:29:02.409161] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.967 [2024-10-07 11:29:02.409177] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.967 [2024-10-07 11:29:02.409191] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.967 [2024-10-07 11:29:02.409216] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.967 [2024-10-07 11:29:02.421834] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.967 [2024-10-07 11:29:02.423747] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.967 [2024-10-07 11:29:02.423797] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.967 [2024-10-07 11:29:02.423818] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.967 [2024-10-07 11:29:02.424459] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.967 [2024-10-07 11:29:02.424680] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.967 [2024-10-07 11:29:02.424708] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.967 [2024-10-07 11:29:02.424743] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.967 [2024-10-07 11:29:02.424790] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.967 [2024-10-07 11:29:02.433580] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.967 [2024-10-07 11:29:02.434070] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.967 [2024-10-07 11:29:02.434120] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.967 [2024-10-07 11:29:02.434141] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.967 [2024-10-07 11:29:02.434222] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.967 [2024-10-07 11:29:02.434254] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.967 [2024-10-07 11:29:02.434271] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.967 [2024-10-07 11:29:02.434285] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.967 [2024-10-07 11:29:02.434310] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.967 [2024-10-07 11:29:02.443668] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.967 [2024-10-07 11:29:02.443786] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.967 [2024-10-07 11:29:02.443818] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.967 [2024-10-07 11:29:02.443836] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.967 [2024-10-07 11:29:02.445503] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.967 [2024-10-07 11:29:02.445649] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.967 [2024-10-07 11:29:02.445675] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.967 [2024-10-07 11:29:02.445690] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.967 [2024-10-07 11:29:02.445717] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.967 [2024-10-07 11:29:02.453756] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.967 [2024-10-07 11:29:02.454205] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.967 [2024-10-07 11:29:02.454253] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.967 [2024-10-07 11:29:02.454274] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.967 [2024-10-07 11:29:02.454457] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.967 [2024-10-07 11:29:02.455587] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.967 [2024-10-07 11:29:02.455626] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.967 [2024-10-07 11:29:02.455659] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.967 [2024-10-07 11:29:02.456081] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.967 [2024-10-07 11:29:02.466191] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.967 [2024-10-07 11:29:02.466323] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.967 [2024-10-07 11:29:02.466371] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.967 [2024-10-07 11:29:02.466390] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.967 [2024-10-07 11:29:02.466979] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.967 [2024-10-07 11:29:02.467100] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.967 [2024-10-07 11:29:02.467124] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.967 [2024-10-07 11:29:02.467139] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.967 [2024-10-07 11:29:02.467165] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.967 [2024-10-07 11:29:02.476279] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.967 [2024-10-07 11:29:02.476408] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.967 [2024-10-07 11:29:02.476454] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.967 [2024-10-07 11:29:02.476474] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.967 [2024-10-07 11:29:02.476499] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.968 [2024-10-07 11:29:02.476521] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.968 [2024-10-07 11:29:02.476535] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.968 [2024-10-07 11:29:02.476548] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.968 [2024-10-07 11:29:02.476571] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.968 [2024-10-07 11:29:02.488833] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.968 [2024-10-07 11:29:02.489371] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.968 [2024-10-07 11:29:02.489461] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.968 [2024-10-07 11:29:02.489493] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.968 [2024-10-07 11:29:02.489674] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.968 [2024-10-07 11:29:02.489736] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.968 [2024-10-07 11:29:02.489757] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.968 [2024-10-07 11:29:02.489771] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.968 [2024-10-07 11:29:02.489796] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.968 [2024-10-07 11:29:02.499834] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.968 [2024-10-07 11:29:02.500044] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.968 [2024-10-07 11:29:02.500078] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.968 [2024-10-07 11:29:02.500096] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.968 [2024-10-07 11:29:02.500345] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.968 [2024-10-07 11:29:02.501043] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.968 [2024-10-07 11:29:02.501081] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.968 [2024-10-07 11:29:02.501098] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.968 [2024-10-07 11:29:02.503799] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.968 [2024-10-07 11:29:02.509919] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.968 [2024-10-07 11:29:02.510058] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.968 [2024-10-07 11:29:02.510090] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.968 [2024-10-07 11:29:02.510108] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.968 [2024-10-07 11:29:02.510133] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.968 [2024-10-07 11:29:02.510156] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.968 [2024-10-07 11:29:02.510170] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.968 [2024-10-07 11:29:02.510185] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.968 [2024-10-07 11:29:02.512331] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.968 [2024-10-07 11:29:02.520023] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.968 [2024-10-07 11:29:02.520169] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.968 [2024-10-07 11:29:02.520201] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.968 [2024-10-07 11:29:02.520219] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.968 [2024-10-07 11:29:02.520244] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.968 [2024-10-07 11:29:02.520267] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.968 [2024-10-07 11:29:02.520281] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.968 [2024-10-07 11:29:02.520295] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.968 [2024-10-07 11:29:02.520319] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.968 [2024-10-07 11:29:02.530123] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.968 [2024-10-07 11:29:02.530241] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.968 [2024-10-07 11:29:02.530274] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.968 [2024-10-07 11:29:02.530292] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.968 [2024-10-07 11:29:02.530332] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.968 [2024-10-07 11:29:02.530354] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.968 [2024-10-07 11:29:02.530379] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.968 [2024-10-07 11:29:02.530393] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.968 [2024-10-07 11:29:02.530451] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.968 [2024-10-07 11:29:02.541062] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.968 [2024-10-07 11:29:02.542591] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.968 [2024-10-07 11:29:02.542653] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.968 [2024-10-07 11:29:02.542674] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.968 [2024-10-07 11:29:02.544795] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.968 [2024-10-07 11:29:02.545471] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.968 [2024-10-07 11:29:02.545529] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.968 [2024-10-07 11:29:02.545564] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.968 [2024-10-07 11:29:02.545766] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.968 [2024-10-07 11:29:02.551401] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.968 [2024-10-07 11:29:02.551637] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.968 [2024-10-07 11:29:02.551677] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.968 [2024-10-07 11:29:02.551696] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.968 [2024-10-07 11:29:02.552726] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.968 [2024-10-07 11:29:02.553200] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.968 [2024-10-07 11:29:02.553236] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.968 [2024-10-07 11:29:02.553252] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.968 [2024-10-07 11:29:02.553717] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.968 [2024-10-07 11:29:02.561532] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.968 [2024-10-07 11:29:02.561666] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.968 [2024-10-07 11:29:02.561699] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.968 [2024-10-07 11:29:02.561717] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.968 [2024-10-07 11:29:02.561741] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.968 [2024-10-07 11:29:02.561764] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.968 [2024-10-07 11:29:02.561779] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.968 [2024-10-07 11:29:02.561793] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.968 [2024-10-07 11:29:02.561817] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.968 [2024-10-07 11:29:02.572410] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.968 [2024-10-07 11:29:02.572559] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.968 [2024-10-07 11:29:02.572591] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.968 [2024-10-07 11:29:02.572625] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.968 [2024-10-07 11:29:02.573215] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.968 [2024-10-07 11:29:02.573342] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.968 [2024-10-07 11:29:02.573365] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.968 [2024-10-07 11:29:02.573379] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.968 [2024-10-07 11:29:02.573402] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.968 [2024-10-07 11:29:02.582959] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.968 [2024-10-07 11:29:02.583120] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.968 [2024-10-07 11:29:02.583152] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.968 [2024-10-07 11:29:02.583170] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.968 [2024-10-07 11:29:02.584839] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.968 [2024-10-07 11:29:02.585487] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.968 [2024-10-07 11:29:02.585531] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.968 [2024-10-07 11:29:02.585565] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.968 [2024-10-07 11:29:02.585804] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.968 [2024-10-07 11:29:02.593380] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.968 [2024-10-07 11:29:02.593639] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.968 [2024-10-07 11:29:02.593676] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.968 [2024-10-07 11:29:02.593695] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.969 [2024-10-07 11:29:02.593831] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.969 [2024-10-07 11:29:02.593951] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.969 [2024-10-07 11:29:02.593988] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.969 [2024-10-07 11:29:02.594003] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.969 [2024-10-07 11:29:02.594124] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.969 [2024-10-07 11:29:02.603836] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.969 [2024-10-07 11:29:02.603983] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.969 [2024-10-07 11:29:02.604017] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.969 [2024-10-07 11:29:02.604035] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.969 [2024-10-07 11:29:02.604060] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.969 [2024-10-07 11:29:02.604083] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.969 [2024-10-07 11:29:02.604117] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.969 [2024-10-07 11:29:02.604132] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.969 [2024-10-07 11:29:02.604158] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.969 [2024-10-07 11:29:02.616744] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.969 [2024-10-07 11:29:02.616986] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.969 [2024-10-07 11:29:02.617040] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.969 [2024-10-07 11:29:02.617077] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.969 [2024-10-07 11:29:02.617277] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.969 [2024-10-07 11:29:02.617933] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.969 [2024-10-07 11:29:02.618000] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.969 [2024-10-07 11:29:02.618020] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.969 [2024-10-07 11:29:02.618274] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.969 [2024-10-07 11:29:02.633259] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.969 [2024-10-07 11:29:02.633529] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.969 [2024-10-07 11:29:02.633566] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.969 [2024-10-07 11:29:02.633584] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.969 [2024-10-07 11:29:02.633608] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.969 [2024-10-07 11:29:02.633629] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.969 [2024-10-07 11:29:02.633644] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.969 [2024-10-07 11:29:02.633657] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.969 [2024-10-07 11:29:02.633680] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.969 [2024-10-07 11:29:02.646807] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.969 [2024-10-07 11:29:02.646961] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.969 [2024-10-07 11:29:02.646994] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.969 [2024-10-07 11:29:02.647011] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.969 [2024-10-07 11:29:02.647036] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.969 [2024-10-07 11:29:02.647057] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.969 [2024-10-07 11:29:02.647072] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.969 [2024-10-07 11:29:02.647085] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.969 [2024-10-07 11:29:02.647107] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.969 [2024-10-07 11:29:02.660060] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.969 [2024-10-07 11:29:02.660270] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.969 [2024-10-07 11:29:02.660305] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.969 [2024-10-07 11:29:02.660323] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.969 [2024-10-07 11:29:02.660348] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.969 [2024-10-07 11:29:02.660370] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.969 [2024-10-07 11:29:02.660385] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.969 [2024-10-07 11:29:02.660399] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.969 [2024-10-07 11:29:02.660437] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.969 [2024-10-07 11:29:02.672542] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.969 [2024-10-07 11:29:02.672996] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.969 [2024-10-07 11:29:02.673042] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.969 [2024-10-07 11:29:02.673063] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.969 [2024-10-07 11:29:02.673133] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.969 [2024-10-07 11:29:02.673163] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.969 [2024-10-07 11:29:02.673181] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.969 [2024-10-07 11:29:02.673194] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.969 [2024-10-07 11:29:02.673219] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.969 [2024-10-07 11:29:02.687004] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.969 [2024-10-07 11:29:02.687135] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.969 [2024-10-07 11:29:02.687168] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.969 [2024-10-07 11:29:02.687201] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.969 [2024-10-07 11:29:02.687857] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.969 [2024-10-07 11:29:02.687975] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.969 [2024-10-07 11:29:02.687999] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.969 [2024-10-07 11:29:02.688014] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.969 [2024-10-07 11:29:02.688039] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.969 [2024-10-07 11:29:02.698162] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.969 [2024-10-07 11:29:02.698410] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.969 [2024-10-07 11:29:02.698443] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.969 [2024-10-07 11:29:02.698477] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.969 [2024-10-07 11:29:02.698618] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.969 [2024-10-07 11:29:02.698726] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.969 [2024-10-07 11:29:02.698769] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.969 [2024-10-07 11:29:02.698785] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.969 [2024-10-07 11:29:02.699113] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.969 [2024-10-07 11:29:02.709743] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.969 [2024-10-07 11:29:02.710028] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.969 [2024-10-07 11:29:02.710081] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.969 [2024-10-07 11:29:02.710101] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.969 [2024-10-07 11:29:02.710261] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.969 [2024-10-07 11:29:02.710443] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.969 [2024-10-07 11:29:02.710497] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.969 [2024-10-07 11:29:02.710514] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.969 [2024-10-07 11:29:02.710628] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.969 [2024-10-07 11:29:02.720833] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.969 [2024-10-07 11:29:02.720978] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.969 [2024-10-07 11:29:02.721012] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.969 [2024-10-07 11:29:02.721030] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.969 [2024-10-07 11:29:02.721355] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.969 [2024-10-07 11:29:02.721570] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.969 [2024-10-07 11:29:02.721610] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.969 [2024-10-07 11:29:02.721627] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.969 [2024-10-07 11:29:02.721732] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.969 [2024-10-07 11:29:02.731490] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.969 [2024-10-07 11:29:02.731632] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.969 [2024-10-07 11:29:02.731664] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.970 [2024-10-07 11:29:02.731682] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.970 [2024-10-07 11:29:02.731706] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.970 [2024-10-07 11:29:02.731744] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.970 [2024-10-07 11:29:02.731758] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.970 [2024-10-07 11:29:02.731792] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.970 [2024-10-07 11:29:02.731835] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.970 [2024-10-07 11:29:02.741655] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.970 [2024-10-07 11:29:02.741799] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.970 [2024-10-07 11:29:02.741831] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.970 [2024-10-07 11:29:02.741849] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.970 [2024-10-07 11:29:02.741873] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.970 [2024-10-07 11:29:02.741895] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.970 [2024-10-07 11:29:02.741926] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.970 [2024-10-07 11:29:02.741939] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.970 [2024-10-07 11:29:02.741978] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.970 [2024-10-07 11:29:02.752862] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.970 [2024-10-07 11:29:02.753116] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.970 [2024-10-07 11:29:02.753166] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.970 [2024-10-07 11:29:02.753186] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.970 [2024-10-07 11:29:02.754080] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.970 [2024-10-07 11:29:02.754344] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.970 [2024-10-07 11:29:02.754380] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.970 [2024-10-07 11:29:02.754397] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.970 [2024-10-07 11:29:02.754437] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.970 [2024-10-07 11:29:02.762961] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.970 [2024-10-07 11:29:02.763085] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.970 [2024-10-07 11:29:02.763115] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.970 [2024-10-07 11:29:02.763133] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.970 [2024-10-07 11:29:02.763156] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.970 [2024-10-07 11:29:02.763177] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.970 [2024-10-07 11:29:02.763191] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.970 [2024-10-07 11:29:02.763204] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.970 [2024-10-07 11:29:02.763226] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.970 [2024-10-07 11:29:02.775562] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.970 [2024-10-07 11:29:02.775687] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.970 [2024-10-07 11:29:02.775743] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.970 [2024-10-07 11:29:02.775763] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.970 [2024-10-07 11:29:02.776350] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.970 [2024-10-07 11:29:02.776472] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.970 [2024-10-07 11:29:02.776497] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.970 [2024-10-07 11:29:02.776512] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.970 [2024-10-07 11:29:02.776538] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.970 [2024-10-07 11:29:02.786127] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.970 [2024-10-07 11:29:02.786316] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.970 [2024-10-07 11:29:02.786359] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.970 [2024-10-07 11:29:02.786377] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.970 [2024-10-07 11:29:02.786509] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.970 [2024-10-07 11:29:02.786837] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.970 [2024-10-07 11:29:02.786863] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.970 [2024-10-07 11:29:02.786889] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.970 [2024-10-07 11:29:02.788906] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.970 [2024-10-07 11:29:02.797726] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.970 [2024-10-07 11:29:02.797996] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.970 [2024-10-07 11:29:02.798033] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.970 [2024-10-07 11:29:02.798052] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.970 [2024-10-07 11:29:02.798201] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.970 [2024-10-07 11:29:02.798336] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.970 [2024-10-07 11:29:02.798360] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.970 [2024-10-07 11:29:02.798375] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.970 [2024-10-07 11:29:02.798506] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.970 [2024-10-07 11:29:02.807839] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.970 [2024-10-07 11:29:02.807956] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.970 [2024-10-07 11:29:02.807989] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.970 [2024-10-07 11:29:02.808007] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.970 [2024-10-07 11:29:02.808152] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.970 [2024-10-07 11:29:02.808309] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.970 [2024-10-07 11:29:02.808335] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.970 [2024-10-07 11:29:02.808350] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.970 [2024-10-07 11:29:02.808571] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.970 [2024-10-07 11:29:02.819499] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.970 [2024-10-07 11:29:02.819729] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.970 [2024-10-07 11:29:02.819764] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.970 [2024-10-07 11:29:02.819782] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.970 [2024-10-07 11:29:02.819921] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.970 [2024-10-07 11:29:02.820056] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.970 [2024-10-07 11:29:02.820080] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.970 [2024-10-07 11:29:02.820094] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.970 [2024-10-07 11:29:02.820223] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.970 [2024-10-07 11:29:02.829585] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.970 [2024-10-07 11:29:02.829711] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.970 [2024-10-07 11:29:02.829757] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.970 [2024-10-07 11:29:02.829773] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.970 [2024-10-07 11:29:02.829796] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.970 [2024-10-07 11:29:02.829852] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.970 [2024-10-07 11:29:02.829866] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.970 [2024-10-07 11:29:02.829880] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.971 [2024-10-07 11:29:02.829903] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.971 [2024-10-07 11:29:02.841012] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.971 [2024-10-07 11:29:02.841140] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.971 [2024-10-07 11:29:02.841172] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.971 [2024-10-07 11:29:02.841204] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.971 [2024-10-07 11:29:02.841227] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.971 [2024-10-07 11:29:02.841263] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.971 [2024-10-07 11:29:02.841281] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.971 [2024-10-07 11:29:02.841294] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.971 [2024-10-07 11:29:02.841591] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.971 [2024-10-07 11:29:02.851864] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.971 [2024-10-07 11:29:02.852114] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.971 [2024-10-07 11:29:02.852148] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.971 [2024-10-07 11:29:02.852166] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.971 [2024-10-07 11:29:02.852285] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.971 [2024-10-07 11:29:02.852396] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.971 [2024-10-07 11:29:02.852415] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.971 [2024-10-07 11:29:02.852428] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.971 [2024-10-07 11:29:02.852467] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.971 [2024-10-07 11:29:02.862669] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.971 [2024-10-07 11:29:02.862812] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.971 [2024-10-07 11:29:02.862847] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.971 [2024-10-07 11:29:02.862865] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.971 [2024-10-07 11:29:02.862890] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.971 [2024-10-07 11:29:02.862913] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.971 [2024-10-07 11:29:02.862928] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.971 [2024-10-07 11:29:02.862941] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.971 [2024-10-07 11:29:02.862966] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.971 [2024-10-07 11:29:02.875358] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.971 [2024-10-07 11:29:02.875593] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.971 [2024-10-07 11:29:02.875629] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.971 [2024-10-07 11:29:02.875647] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.971 [2024-10-07 11:29:02.876017] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.971 [2024-10-07 11:29:02.877686] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.971 [2024-10-07 11:29:02.877725] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.971 [2024-10-07 11:29:02.877759] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.971 [2024-10-07 11:29:02.878381] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.971 [2024-10-07 11:29:02.886506] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.971 [2024-10-07 11:29:02.886745] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.971 [2024-10-07 11:29:02.886779] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.971 [2024-10-07 11:29:02.886831] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.971 [2024-10-07 11:29:02.886988] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.971 [2024-10-07 11:29:02.887111] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.971 [2024-10-07 11:29:02.887133] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.971 [2024-10-07 11:29:02.887148] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.971 [2024-10-07 11:29:02.887250] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.971 [2024-10-07 11:29:02.898143] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.971 [2024-10-07 11:29:02.898259] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.971 [2024-10-07 11:29:02.898307] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.971 [2024-10-07 11:29:02.898324] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.971 [2024-10-07 11:29:02.898348] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.971 [2024-10-07 11:29:02.898548] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.971 [2024-10-07 11:29:02.898577] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.971 [2024-10-07 11:29:02.898592] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.971 [2024-10-07 11:29:02.898737] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.971 [2024-10-07 11:29:02.909365] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.971 [2024-10-07 11:29:02.909532] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.971 [2024-10-07 11:29:02.909566] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.971 [2024-10-07 11:29:02.909584] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.971 [2024-10-07 11:29:02.909756] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.971 [2024-10-07 11:29:02.909894] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.971 [2024-10-07 11:29:02.909925] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.971 [2024-10-07 11:29:02.909940] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.971 [2024-10-07 11:29:02.910101] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.971 [2024-10-07 11:29:02.920875] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.971 [2024-10-07 11:29:02.921108] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.971 [2024-10-07 11:29:02.921144] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.971 [2024-10-07 11:29:02.921163] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.971 [2024-10-07 11:29:02.921323] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.971 [2024-10-07 11:29:02.922448] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.971 [2024-10-07 11:29:02.922534] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.971 [2024-10-07 11:29:02.922553] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.971 [2024-10-07 11:29:02.925743] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.971 [2024-10-07 11:29:02.931214] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.971 [2024-10-07 11:29:02.931476] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.971 [2024-10-07 11:29:02.931519] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.971 [2024-10-07 11:29:02.931538] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.971 [2024-10-07 11:29:02.931645] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.971 [2024-10-07 11:29:02.931742] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.971 [2024-10-07 11:29:02.931761] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.971 [2024-10-07 11:29:02.931775] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.971 [2024-10-07 11:29:02.931801] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.971 [2024-10-07 11:29:02.942799] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.971 [2024-10-07 11:29:02.943059] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.971 [2024-10-07 11:29:02.943107] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.971 [2024-10-07 11:29:02.943128] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.971 [2024-10-07 11:29:02.943257] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.971 [2024-10-07 11:29:02.943370] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.971 [2024-10-07 11:29:02.943398] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.971 [2024-10-07 11:29:02.943443] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.971 [2024-10-07 11:29:02.943569] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.971 [2024-10-07 11:29:02.953350] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.971 [2024-10-07 11:29:02.953551] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.971 [2024-10-07 11:29:02.953625] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.971 [2024-10-07 11:29:02.953663] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.971 [2024-10-07 11:29:02.953708] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.971 [2024-10-07 11:29:02.953745] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.971 [2024-10-07 11:29:02.953772] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.972 [2024-10-07 11:29:02.953799] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.972 [2024-10-07 11:29:02.953843] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.972 [2024-10-07 11:29:02.965612] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.972 [2024-10-07 11:29:02.965735] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.972 [2024-10-07 11:29:02.965769] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.972 [2024-10-07 11:29:02.965787] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.972 [2024-10-07 11:29:02.965813] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.972 [2024-10-07 11:29:02.965837] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.972 [2024-10-07 11:29:02.965851] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.972 [2024-10-07 11:29:02.965866] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.972 [2024-10-07 11:29:02.965890] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.972 [2024-10-07 11:29:02.976245] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.972 [2024-10-07 11:29:02.976494] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.972 [2024-10-07 11:29:02.976540] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.972 [2024-10-07 11:29:02.976561] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.972 [2024-10-07 11:29:02.976669] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.972 [2024-10-07 11:29:02.976811] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.972 [2024-10-07 11:29:02.976864] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.972 [2024-10-07 11:29:02.976890] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.972 [2024-10-07 11:29:02.980935] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.972 [2024-10-07 11:29:02.987341] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.972 [2024-10-07 11:29:02.987569] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.972 [2024-10-07 11:29:02.987615] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.972 [2024-10-07 11:29:02.987635] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.972 [2024-10-07 11:29:02.987732] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.972 [2024-10-07 11:29:02.987759] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.972 [2024-10-07 11:29:02.987774] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.972 [2024-10-07 11:29:02.987787] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.972 [2024-10-07 11:29:02.987812] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.972 [2024-10-07 11:29:02.997428] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.972 [2024-10-07 11:29:02.997551] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.972 [2024-10-07 11:29:02.997584] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.972 [2024-10-07 11:29:02.997601] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.972 [2024-10-07 11:29:02.997666] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.972 [2024-10-07 11:29:02.997694] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.972 [2024-10-07 11:29:02.997708] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.972 [2024-10-07 11:29:02.997722] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.972 [2024-10-07 11:29:02.997745] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.972 [2024-10-07 11:29:03.007524] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.972 [2024-10-07 11:29:03.007641] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.972 [2024-10-07 11:29:03.007673] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.972 [2024-10-07 11:29:03.007692] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.972 [2024-10-07 11:29:03.007838] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.972 [2024-10-07 11:29:03.008056] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.972 [2024-10-07 11:29:03.008093] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.972 [2024-10-07 11:29:03.008111] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.972 [2024-10-07 11:29:03.008212] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.972 [2024-10-07 11:29:03.020271] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.972 [2024-10-07 11:29:03.020505] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.972 [2024-10-07 11:29:03.020550] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.972 [2024-10-07 11:29:03.020569] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.972 [2024-10-07 11:29:03.022046] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.972 [2024-10-07 11:29:03.024663] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.972 [2024-10-07 11:29:03.024711] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.972 [2024-10-07 11:29:03.024747] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.972 [2024-10-07 11:29:03.025417] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.972 [2024-10-07 11:29:03.030363] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.972 [2024-10-07 11:29:03.030510] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.972 [2024-10-07 11:29:03.030543] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.972 [2024-10-07 11:29:03.030562] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.972 [2024-10-07 11:29:03.030588] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.972 [2024-10-07 11:29:03.030611] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.972 [2024-10-07 11:29:03.030626] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.972 [2024-10-07 11:29:03.030666] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.972 [2024-10-07 11:29:03.030693] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.972 [2024-10-07 11:29:03.042233] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.972 [2024-10-07 11:29:03.042591] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.972 [2024-10-07 11:29:03.042671] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.972 [2024-10-07 11:29:03.042713] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.972 [2024-10-07 11:29:03.042850] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.972 [2024-10-07 11:29:03.042968] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.972 [2024-10-07 11:29:03.042997] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.972 [2024-10-07 11:29:03.043013] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.972 [2024-10-07 11:29:03.044755] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.972 [2024-10-07 11:29:03.054393] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.972 [2024-10-07 11:29:03.054711] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.972 [2024-10-07 11:29:03.054778] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.972 [2024-10-07 11:29:03.054800] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.972 [2024-10-07 11:29:03.054971] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.972 [2024-10-07 11:29:03.055106] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.972 [2024-10-07 11:29:03.055137] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.972 [2024-10-07 11:29:03.055153] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.972 [2024-10-07 11:29:03.055786] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.972 [2024-10-07 11:29:03.064623] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.972 [2024-10-07 11:29:03.064752] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.972 [2024-10-07 11:29:03.064785] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.972 [2024-10-07 11:29:03.064807] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.972 [2024-10-07 11:29:03.065087] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.972 [2024-10-07 11:29:03.065261] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.972 [2024-10-07 11:29:03.065296] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.972 [2024-10-07 11:29:03.065313] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.972 [2024-10-07 11:29:03.065460] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.972 [2024-10-07 11:29:03.074722] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.972 [2024-10-07 11:29:03.074854] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.972 [2024-10-07 11:29:03.074904] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.972 [2024-10-07 11:29:03.074923] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.972 [2024-10-07 11:29:03.074948] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.972 [2024-10-07 11:29:03.074973] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.973 [2024-10-07 11:29:03.074988] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.973 [2024-10-07 11:29:03.075001] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.973 [2024-10-07 11:29:03.075025] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.973 [2024-10-07 11:29:03.084838] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.973 [2024-10-07 11:29:03.085046] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.973 [2024-10-07 11:29:03.085101] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.973 [2024-10-07 11:29:03.085133] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.973 [2024-10-07 11:29:03.087088] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.973 [2024-10-07 11:29:03.089060] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.973 [2024-10-07 11:29:03.089124] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.973 [2024-10-07 11:29:03.089174] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.973 [2024-10-07 11:29:03.089588] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.973 [2024-10-07 11:29:03.099951] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.973 [2024-10-07 11:29:03.100387] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.973 [2024-10-07 11:29:03.100467] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.973 [2024-10-07 11:29:03.100502] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.973 [2024-10-07 11:29:03.100590] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.973 [2024-10-07 11:29:03.100633] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.973 [2024-10-07 11:29:03.100662] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.973 [2024-10-07 11:29:03.100686] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.973 [2024-10-07 11:29:03.100723] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.973 [2024-10-07 11:29:03.115919] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.973 [2024-10-07 11:29:03.116520] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.973 [2024-10-07 11:29:03.116578] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.973 [2024-10-07 11:29:03.116607] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.973 [2024-10-07 11:29:03.116880] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.973 [2024-10-07 11:29:03.117201] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.973 [2024-10-07 11:29:03.117252] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.973 [2024-10-07 11:29:03.117279] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.973 [2024-10-07 11:29:03.117361] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.973 [2024-10-07 11:29:03.126707] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.973 [2024-10-07 11:29:03.127136] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.973 [2024-10-07 11:29:03.127222] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.973 [2024-10-07 11:29:03.127265] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.973 [2024-10-07 11:29:03.132470] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.973 [2024-10-07 11:29:03.137179] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.973 [2024-10-07 11:29:03.137238] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.973 [2024-10-07 11:29:03.137272] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.973 [2024-10-07 11:29:03.137324] bdev_nvme.c:3031:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:33.973 [2024-10-07 11:29:03.138283] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.973 [2024-10-07 11:29:03.147683] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.973 [2024-10-07 11:29:03.147938] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.973 [2024-10-07 11:29:03.147976] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.973 [2024-10-07 11:29:03.147999] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.973 [2024-10-07 11:29:03.148132] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.973 [2024-10-07 11:29:03.148263] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.973 [2024-10-07 11:29:03.148296] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.973 [2024-10-07 11:29:03.148318] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.973 [2024-10-07 11:29:03.148768] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.973 [2024-10-07 11:29:03.157997] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.973 [2024-10-07 11:29:03.158129] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.973 [2024-10-07 11:29:03.158166] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.973 [2024-10-07 11:29:03.158187] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.973 [2024-10-07 11:29:03.158218] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.973 [2024-10-07 11:29:03.158245] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.973 [2024-10-07 11:29:03.158273] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.973 [2024-10-07 11:29:03.158314] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.973 [2024-10-07 11:29:03.158345] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.973 [2024-10-07 11:29:03.168291] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.973 [2024-10-07 11:29:03.168440] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.973 [2024-10-07 11:29:03.168478] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.973 [2024-10-07 11:29:03.168500] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.973 [2024-10-07 11:29:03.170676] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.973 [2024-10-07 11:29:03.171696] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.973 [2024-10-07 11:29:03.171741] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.973 [2024-10-07 11:29:03.171762] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.973 [2024-10-07 11:29:03.171907] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.973 [2024-10-07 11:29:03.178391] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.973 [2024-10-07 11:29:03.178536] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.973 [2024-10-07 11:29:03.178574] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.973 [2024-10-07 11:29:03.178595] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.973 [2024-10-07 11:29:03.178624] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.973 [2024-10-07 11:29:03.178651] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.973 [2024-10-07 11:29:03.178670] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.973 [2024-10-07 11:29:03.178687] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.973 [2024-10-07 11:29:03.178715] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.973 [2024-10-07 11:29:03.191950] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.973 [2024-10-07 11:29:03.192805] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.973 [2024-10-07 11:29:03.192858] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.973 [2024-10-07 11:29:03.192882] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.973 [2024-10-07 11:29:03.193130] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.973 [2024-10-07 11:29:03.193279] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.973 [2024-10-07 11:29:03.193325] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.973 [2024-10-07 11:29:03.193345] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.973 [2024-10-07 11:29:03.193742] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.973 [2024-10-07 11:29:03.203670] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.973 [2024-10-07 11:29:03.205819] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.973 [2024-10-07 11:29:03.205892] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.973 [2024-10-07 11:29:03.205918] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.973 [2024-10-07 11:29:03.206560] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.973 [2024-10-07 11:29:03.206686] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.973 [2024-10-07 11:29:03.206714] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.973 [2024-10-07 11:29:03.206732] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.973 [2024-10-07 11:29:03.206772] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.973 [2024-10-07 11:29:03.217609] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.973 [2024-10-07 11:29:03.217744] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.973 [2024-10-07 11:29:03.217781] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.974 [2024-10-07 11:29:03.217802] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.974 [2024-10-07 11:29:03.217843] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.974 [2024-10-07 11:29:03.217871] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.974 [2024-10-07 11:29:03.217888] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.974 [2024-10-07 11:29:03.217905] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.974 [2024-10-07 11:29:03.217934] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.974 [2024-10-07 11:29:03.228953] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.974 [2024-10-07 11:29:03.229185] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.974 [2024-10-07 11:29:03.229225] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.974 [2024-10-07 11:29:03.229247] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.974 [2024-10-07 11:29:03.229376] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.974 [2024-10-07 11:29:03.230173] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.974 [2024-10-07 11:29:03.230219] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.974 [2024-10-07 11:29:03.230239] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.974 [2024-10-07 11:29:03.232560] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.974 [2024-10-07 11:29:03.241574] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.974 [2024-10-07 11:29:03.241857] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.974 [2024-10-07 11:29:03.241907] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.974 [2024-10-07 11:29:03.241930] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.974 [2024-10-07 11:29:03.242102] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.974 [2024-10-07 11:29:03.242264] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.974 [2024-10-07 11:29:03.242294] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.974 [2024-10-07 11:29:03.242313] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.974 [2024-10-07 11:29:03.242480] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.974 [2024-10-07 11:29:03.253141] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.974 [2024-10-07 11:29:03.253426] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.974 [2024-10-07 11:29:03.253472] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.974 [2024-10-07 11:29:03.253496] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.974 [2024-10-07 11:29:03.253697] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.974 [2024-10-07 11:29:03.253875] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.974 [2024-10-07 11:29:03.253911] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.974 [2024-10-07 11:29:03.253930] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.974 [2024-10-07 11:29:03.254083] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.974 [2024-10-07 11:29:03.263482] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.974 [2024-10-07 11:29:03.263623] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.974 [2024-10-07 11:29:03.263660] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.974 [2024-10-07 11:29:03.263682] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.974 [2024-10-07 11:29:03.263711] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.974 [2024-10-07 11:29:03.263738] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.974 [2024-10-07 11:29:03.263756] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.974 [2024-10-07 11:29:03.263773] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.974 [2024-10-07 11:29:03.263802] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.974 [2024-10-07 11:29:03.274247] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.974 [2024-10-07 11:29:03.274528] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.974 [2024-10-07 11:29:03.274574] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.974 [2024-10-07 11:29:03.274596] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.974 [2024-10-07 11:29:03.274750] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.974 [2024-10-07 11:29:03.275246] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.974 [2024-10-07 11:29:03.275286] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.974 [2024-10-07 11:29:03.275318] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.974 [2024-10-07 11:29:03.277941] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.974 [2024-10-07 11:29:03.284589] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.974 [2024-10-07 11:29:03.287105] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.974 [2024-10-07 11:29:03.287162] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.974 [2024-10-07 11:29:03.287187] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.974 [2024-10-07 11:29:03.288024] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.974 [2024-10-07 11:29:03.288164] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.974 [2024-10-07 11:29:03.288192] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.974 [2024-10-07 11:29:03.288219] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.974 [2024-10-07 11:29:03.288250] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.974 [2024-10-07 11:29:03.294698] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.974 [2024-10-07 11:29:03.294829] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.974 [2024-10-07 11:29:03.294866] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.974 [2024-10-07 11:29:03.294887] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.974 [2024-10-07 11:29:03.294917] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.974 [2024-10-07 11:29:03.294945] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.974 [2024-10-07 11:29:03.294963] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.974 [2024-10-07 11:29:03.294980] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.974 [2024-10-07 11:29:03.295008] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.974 [2024-10-07 11:29:03.304801] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.974 [2024-10-07 11:29:03.304933] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.974 [2024-10-07 11:29:03.304970] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.974 [2024-10-07 11:29:03.304991] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.974 [2024-10-07 11:29:03.305021] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.974 [2024-10-07 11:29:03.305048] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.974 [2024-10-07 11:29:03.305065] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.974 [2024-10-07 11:29:03.305082] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.974 [2024-10-07 11:29:03.305111] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.974 [2024-10-07 11:29:03.315045] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.974 [2024-10-07 11:29:03.315177] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.974 [2024-10-07 11:29:03.315224] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.974 [2024-10-07 11:29:03.315266] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.974 [2024-10-07 11:29:03.315297] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.974 [2024-10-07 11:29:03.315324] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.974 [2024-10-07 11:29:03.315342] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.974 [2024-10-07 11:29:03.315359] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.974 [2024-10-07 11:29:03.315388] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.974 [2024-10-07 11:29:03.325143] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.974 [2024-10-07 11:29:03.325282] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.975 [2024-10-07 11:29:03.325317] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.975 [2024-10-07 11:29:03.325338] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.975 [2024-10-07 11:29:03.325368] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.975 [2024-10-07 11:29:03.325394] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.975 [2024-10-07 11:29:03.325432] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.975 [2024-10-07 11:29:03.325452] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.975 [2024-10-07 11:29:03.325482] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.975 [2024-10-07 11:29:03.335926] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.975 [2024-10-07 11:29:03.336345] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.975 [2024-10-07 11:29:03.336396] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.975 [2024-10-07 11:29:03.336443] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.975 [2024-10-07 11:29:03.336633] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.975 [2024-10-07 11:29:03.336767] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.975 [2024-10-07 11:29:03.336801] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.975 [2024-10-07 11:29:03.336829] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.975 [2024-10-07 11:29:03.336925] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.975 [2024-10-07 11:29:03.348946] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.975 [2024-10-07 11:29:03.349203] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.975 [2024-10-07 11:29:03.349254] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.975 [2024-10-07 11:29:03.349278] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.975 [2024-10-07 11:29:03.349472] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.975 [2024-10-07 11:29:03.349652] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.975 [2024-10-07 11:29:03.349708] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.975 [2024-10-07 11:29:03.349729] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.975 [2024-10-07 11:29:03.349930] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.975 [2024-10-07 11:29:03.359517] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.975 [2024-10-07 11:29:03.359652] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.975 [2024-10-07 11:29:03.359689] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.975 [2024-10-07 11:29:03.359711] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.975 [2024-10-07 11:29:03.359740] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.975 [2024-10-07 11:29:03.359767] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.975 [2024-10-07 11:29:03.359786] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.975 [2024-10-07 11:29:03.359803] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.975 [2024-10-07 11:29:03.359842] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.975 [2024-10-07 11:29:03.370295] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.975 [2024-10-07 11:29:03.370540] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.975 [2024-10-07 11:29:03.370578] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.975 [2024-10-07 11:29:03.370600] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.975 [2024-10-07 11:29:03.371046] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.975 [2024-10-07 11:29:03.371147] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.975 [2024-10-07 11:29:03.371173] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.975 [2024-10-07 11:29:03.371190] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.975 [2024-10-07 11:29:03.371220] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.975 [2024-10-07 11:29:03.383508] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.975 [2024-10-07 11:29:03.384482] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.975 [2024-10-07 11:29:03.384534] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.975 [2024-10-07 11:29:03.384558] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.975 [2024-10-07 11:29:03.384724] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.975 [2024-10-07 11:29:03.384965] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.975 [2024-10-07 11:29:03.385010] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.975 [2024-10-07 11:29:03.385030] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.975 [2024-10-07 11:29:03.385884] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.975 [2024-10-07 11:29:03.394664] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.975 [2024-10-07 11:29:03.394957] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.975 [2024-10-07 11:29:03.395009] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.975 [2024-10-07 11:29:03.395033] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.975 [2024-10-07 11:29:03.395173] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.975 [2024-10-07 11:29:03.395305] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.975 [2024-10-07 11:29:03.395328] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.975 [2024-10-07 11:29:03.395346] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.975 [2024-10-07 11:29:03.395461] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.975 8877.00 IOPS, 34.68 MiB/s [2024-10-07T11:29:15.686Z] [2024-10-07 11:29:03.412590] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.975 [2024-10-07 11:29:03.413737] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.975 [2024-10-07 11:29:03.413802] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.975 [2024-10-07 11:29:03.413827] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.975 [2024-10-07 11:29:03.414461] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.975 [2024-10-07 11:29:03.414569] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.975 [2024-10-07 11:29:03.414596] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.975 [2024-10-07 11:29:03.414614] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.975 [2024-10-07 11:29:03.414645] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.975 [2024-10-07 11:29:03.428361] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.975 [2024-10-07 11:29:03.428727] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.975 [2024-10-07 11:29:03.428771] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.975 [2024-10-07 11:29:03.428791] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.975 [2024-10-07 11:29:03.428847] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.975 [2024-10-07 11:29:03.428876] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.975 [2024-10-07 11:29:03.428892] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.975 [2024-10-07 11:29:03.428907] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.975 [2024-10-07 11:29:03.428931] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.975 [2024-10-07 11:29:03.442721] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.975 [2024-10-07 11:29:03.443305] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.975 [2024-10-07 11:29:03.443366] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.975 [2024-10-07 11:29:03.443386] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.975 [2024-10-07 11:29:03.443675] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.975 [2024-10-07 11:29:03.443904] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.975 [2024-10-07 11:29:03.443941] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.975 [2024-10-07 11:29:03.443958] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.975 [2024-10-07 11:29:03.444019] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.975 [2024-10-07 11:29:03.455928] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.975 [2024-10-07 11:29:03.456148] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.975 [2024-10-07 11:29:03.456181] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.975 [2024-10-07 11:29:03.456199] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.975 [2024-10-07 11:29:03.457672] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.975 [2024-10-07 11:29:03.458192] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.975 [2024-10-07 11:29:03.458230] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.975 [2024-10-07 11:29:03.458247] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.975 [2024-10-07 11:29:03.458498] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.976 [2024-10-07 11:29:03.467516] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.976 [2024-10-07 11:29:03.467742] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.976 [2024-10-07 11:29:03.467781] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.976 [2024-10-07 11:29:03.467800] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.976 [2024-10-07 11:29:03.467945] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.976 [2024-10-07 11:29:03.468076] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.976 [2024-10-07 11:29:03.468099] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.976 [2024-10-07 11:29:03.468114] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.976 [2024-10-07 11:29:03.468226] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.976 [2024-10-07 11:29:03.477599] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.976 [2024-10-07 11:29:03.477707] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.976 [2024-10-07 11:29:03.477738] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.976 [2024-10-07 11:29:03.477755] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.976 [2024-10-07 11:29:03.477927] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.976 [2024-10-07 11:29:03.478098] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.976 [2024-10-07 11:29:03.478124] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.976 [2024-10-07 11:29:03.478156] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.976 [2024-10-07 11:29:03.478259] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.976 [2024-10-07 11:29:03.489852] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.976 [2024-10-07 11:29:03.490370] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.976 [2024-10-07 11:29:03.490436] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.976 [2024-10-07 11:29:03.490458] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.976 [2024-10-07 11:29:03.490675] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.976 [2024-10-07 11:29:03.490914] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.976 [2024-10-07 11:29:03.490949] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.976 [2024-10-07 11:29:03.490966] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.976 [2024-10-07 11:29:03.491027] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.976 [2024-10-07 11:29:03.502691] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.976 [2024-10-07 11:29:03.503080] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.976 [2024-10-07 11:29:03.503123] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.976 [2024-10-07 11:29:03.503143] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.976 [2024-10-07 11:29:03.503215] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.976 [2024-10-07 11:29:03.503243] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.976 [2024-10-07 11:29:03.503259] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.976 [2024-10-07 11:29:03.503273] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.976 [2024-10-07 11:29:03.503297] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.976 [2024-10-07 11:29:03.513007] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.976 [2024-10-07 11:29:03.513193] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.976 [2024-10-07 11:29:03.513224] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.976 [2024-10-07 11:29:03.513241] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.976 [2024-10-07 11:29:03.513332] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.976 [2024-10-07 11:29:03.513359] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.976 [2024-10-07 11:29:03.513374] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.976 [2024-10-07 11:29:03.513388] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.976 [2024-10-07 11:29:03.513426] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.976 [2024-10-07 11:29:03.523086] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.976 [2024-10-07 11:29:03.523215] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.976 [2024-10-07 11:29:03.523246] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.976 [2024-10-07 11:29:03.523264] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.976 [2024-10-07 11:29:03.523525] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.976 [2024-10-07 11:29:03.523684] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.976 [2024-10-07 11:29:03.523755] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.976 [2024-10-07 11:29:03.523771] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.976 [2024-10-07 11:29:03.523901] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.976 [2024-10-07 11:29:03.534784] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.976 [2024-10-07 11:29:03.535107] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.976 [2024-10-07 11:29:03.535149] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.976 [2024-10-07 11:29:03.535169] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.976 [2024-10-07 11:29:03.535385] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.976 [2024-10-07 11:29:03.535609] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.976 [2024-10-07 11:29:03.535644] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.976 [2024-10-07 11:29:03.535660] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.976 [2024-10-07 11:29:03.535720] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.976 [2024-10-07 11:29:03.545869] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.976 [2024-10-07 11:29:03.546079] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.976 [2024-10-07 11:29:03.546112] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.976 [2024-10-07 11:29:03.546129] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.976 [2024-10-07 11:29:03.546237] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.976 [2024-10-07 11:29:03.546344] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.976 [2024-10-07 11:29:03.546362] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.976 [2024-10-07 11:29:03.546377] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.976 [2024-10-07 11:29:03.547092] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.976 [2024-10-07 11:29:03.556202] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.976 [2024-10-07 11:29:03.556451] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.976 [2024-10-07 11:29:03.556485] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.976 [2024-10-07 11:29:03.556502] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.976 [2024-10-07 11:29:03.556604] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.976 [2024-10-07 11:29:03.556833] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.976 [2024-10-07 11:29:03.556863] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.976 [2024-10-07 11:29:03.556879] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.976 [2024-10-07 11:29:03.556939] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.976 [2024-10-07 11:29:03.566340] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.976 [2024-10-07 11:29:03.566464] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.976 [2024-10-07 11:29:03.566502] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.976 [2024-10-07 11:29:03.566520] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.976 [2024-10-07 11:29:03.566760] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.976 [2024-10-07 11:29:03.566914] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.976 [2024-10-07 11:29:03.566949] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.976 [2024-10-07 11:29:03.566966] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.976 [2024-10-07 11:29:03.567027] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.976 [2024-10-07 11:29:03.576421] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.976 [2024-10-07 11:29:03.576544] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.976 [2024-10-07 11:29:03.576575] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.976 [2024-10-07 11:29:03.576593] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.976 [2024-10-07 11:29:03.576617] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.976 [2024-10-07 11:29:03.576639] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.976 [2024-10-07 11:29:03.576655] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.976 [2024-10-07 11:29:03.576669] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.977 [2024-10-07 11:29:03.576692] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.977 [2024-10-07 11:29:03.586514] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.977 [2024-10-07 11:29:03.586627] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.977 [2024-10-07 11:29:03.586657] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.977 [2024-10-07 11:29:03.586675] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.977 [2024-10-07 11:29:03.586699] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.977 [2024-10-07 11:29:03.586721] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.977 [2024-10-07 11:29:03.586737] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.977 [2024-10-07 11:29:03.586750] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.977 [2024-10-07 11:29:03.586792] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.977 [2024-10-07 11:29:03.600086] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.977 [2024-10-07 11:29:03.600304] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.977 [2024-10-07 11:29:03.600337] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.977 [2024-10-07 11:29:03.600356] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.977 [2024-10-07 11:29:03.600477] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.977 [2024-10-07 11:29:03.600714] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.977 [2024-10-07 11:29:03.600737] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.977 [2024-10-07 11:29:03.600751] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.977 [2024-10-07 11:29:03.600839] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.977 [2024-10-07 11:29:03.611758] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.977 [2024-10-07 11:29:03.612002] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.977 [2024-10-07 11:29:03.612034] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.977 [2024-10-07 11:29:03.612051] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.977 [2024-10-07 11:29:03.612189] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.977 [2024-10-07 11:29:03.612317] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.977 [2024-10-07 11:29:03.612349] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.977 [2024-10-07 11:29:03.612366] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.977 [2024-10-07 11:29:03.612493] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.977 [2024-10-07 11:29:03.623866] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.977 [2024-10-07 11:29:03.624184] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.977 [2024-10-07 11:29:03.624218] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.977 [2024-10-07 11:29:03.624247] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.977 [2024-10-07 11:29:03.624305] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.977 [2024-10-07 11:29:03.624334] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.977 [2024-10-07 11:29:03.624349] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.977 [2024-10-07 11:29:03.624363] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.977 [2024-10-07 11:29:03.624387] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.977 [2024-10-07 11:29:03.634812] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.977 [2024-10-07 11:29:03.634978] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.977 [2024-10-07 11:29:03.635028] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.977 [2024-10-07 11:29:03.635098] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.977 [2024-10-07 11:29:03.635146] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.977 [2024-10-07 11:29:03.635189] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.977 [2024-10-07 11:29:03.635217] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.977 [2024-10-07 11:29:03.635241] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.977 [2024-10-07 11:29:03.635274] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.977 [2024-10-07 11:29:03.649648] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.977 [2024-10-07 11:29:03.649974] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.977 [2024-10-07 11:29:03.650026] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.977 [2024-10-07 11:29:03.650045] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.977 [2024-10-07 11:29:03.650536] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.977 [2024-10-07 11:29:03.650778] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.977 [2024-10-07 11:29:03.650813] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.977 [2024-10-07 11:29:03.650830] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.977 [2024-10-07 11:29:03.650886] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.977 [2024-10-07 11:29:03.663400] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.977 [2024-10-07 11:29:03.664593] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.977 [2024-10-07 11:29:03.664637] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.977 [2024-10-07 11:29:03.664656] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.977 [2024-10-07 11:29:03.665202] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.977 [2024-10-07 11:29:03.665463] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.977 [2024-10-07 11:29:03.665531] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.977 [2024-10-07 11:29:03.665549] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.977 [2024-10-07 11:29:03.665758] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.977 [2024-10-07 11:29:03.674585] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.977 [2024-10-07 11:29:03.674813] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.977 [2024-10-07 11:29:03.674852] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.977 [2024-10-07 11:29:03.674872] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.977 [2024-10-07 11:29:03.675015] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.977 [2024-10-07 11:29:03.675152] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.977 [2024-10-07 11:29:03.675214] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.977 [2024-10-07 11:29:03.675232] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.977 [2024-10-07 11:29:03.675340] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.977 [2024-10-07 11:29:03.685116] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.977 [2024-10-07 11:29:03.685270] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.977 [2024-10-07 11:29:03.685300] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.977 [2024-10-07 11:29:03.685318] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.977 [2024-10-07 11:29:03.685341] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.977 [2024-10-07 11:29:03.685362] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.977 [2024-10-07 11:29:03.685395] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.977 [2024-10-07 11:29:03.685409] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.977 [2024-10-07 11:29:03.685432] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.977 [2024-10-07 11:29:03.695244] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.977 [2024-10-07 11:29:03.696226] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.977 [2024-10-07 11:29:03.696270] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.977 [2024-10-07 11:29:03.696289] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.977 [2024-10-07 11:29:03.697793] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.977 [2024-10-07 11:29:03.697986] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.977 [2024-10-07 11:29:03.698012] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.977 [2024-10-07 11:29:03.698029] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.977 [2024-10-07 11:29:03.698054] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.977 [2024-10-07 11:29:03.706802] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.977 [2024-10-07 11:29:03.706923] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.977 [2024-10-07 11:29:03.706953] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.977 [2024-10-07 11:29:03.706971] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.977 [2024-10-07 11:29:03.706996] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.977 [2024-10-07 11:29:03.707018] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.977 [2024-10-07 11:29:03.707033] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.978 [2024-10-07 11:29:03.707047] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.978 [2024-10-07 11:29:03.707070] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.978 [2024-10-07 11:29:03.719677] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.978 [2024-10-07 11:29:03.719830] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.978 [2024-10-07 11:29:03.719862] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.978 [2024-10-07 11:29:03.719879] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.978 [2024-10-07 11:29:03.719903] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.978 [2024-10-07 11:29:03.719926] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.978 [2024-10-07 11:29:03.719940] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.978 [2024-10-07 11:29:03.719954] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.978 [2024-10-07 11:29:03.719977] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.978 [2024-10-07 11:29:03.730234] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.978 [2024-10-07 11:29:03.730434] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.978 [2024-10-07 11:29:03.730467] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.978 [2024-10-07 11:29:03.730484] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.978 [2024-10-07 11:29:03.730599] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.978 [2024-10-07 11:29:03.730666] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.978 [2024-10-07 11:29:03.730689] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.978 [2024-10-07 11:29:03.730704] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.978 [2024-10-07 11:29:03.730728] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.978 [2024-10-07 11:29:03.744463] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.978 [2024-10-07 11:29:03.745191] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.978 [2024-10-07 11:29:03.745234] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.978 [2024-10-07 11:29:03.745253] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.978 [2024-10-07 11:29:03.745343] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.978 [2024-10-07 11:29:03.745373] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.978 [2024-10-07 11:29:03.745388] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.978 [2024-10-07 11:29:03.745403] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.978 [2024-10-07 11:29:03.745444] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.978 [2024-10-07 11:29:03.756660] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.978 [2024-10-07 11:29:03.756797] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.978 [2024-10-07 11:29:03.756844] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.978 [2024-10-07 11:29:03.756861] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.978 [2024-10-07 11:29:03.757463] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.978 [2024-10-07 11:29:03.757622] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.978 [2024-10-07 11:29:03.757646] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.978 [2024-10-07 11:29:03.757660] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.978 [2024-10-07 11:29:03.757685] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.978 [2024-10-07 11:29:03.767295] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.978 [2024-10-07 11:29:03.767506] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.978 [2024-10-07 11:29:03.767539] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.978 [2024-10-07 11:29:03.767556] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.978 [2024-10-07 11:29:03.767923] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.978 [2024-10-07 11:29:03.769839] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.978 [2024-10-07 11:29:03.769877] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.978 [2024-10-07 11:29:03.769893] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.978 [2024-10-07 11:29:03.770530] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.978 [2024-10-07 11:29:03.778280] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.978 [2024-10-07 11:29:03.778527] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.978 [2024-10-07 11:29:03.778559] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.978 [2024-10-07 11:29:03.778577] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.978 [2024-10-07 11:29:03.778690] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.978 [2024-10-07 11:29:03.778811] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.978 [2024-10-07 11:29:03.778832] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.978 [2024-10-07 11:29:03.778846] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.978 [2024-10-07 11:29:03.779308] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.978 [2024-10-07 11:29:03.788377] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.978 [2024-10-07 11:29:03.788492] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.978 [2024-10-07 11:29:03.788522] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.978 [2024-10-07 11:29:03.788540] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.978 [2024-10-07 11:29:03.788719] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.978 [2024-10-07 11:29:03.788871] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.978 [2024-10-07 11:29:03.788895] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.978 [2024-10-07 11:29:03.788928] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.978 [2024-10-07 11:29:03.789068] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.978 [2024-10-07 11:29:03.798495] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.978 [2024-10-07 11:29:03.798614] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.978 [2024-10-07 11:29:03.798643] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.978 [2024-10-07 11:29:03.798660] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.978 [2024-10-07 11:29:03.798684] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.978 [2024-10-07 11:29:03.798706] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.978 [2024-10-07 11:29:03.798720] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.978 [2024-10-07 11:29:03.798732] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.978 [2024-10-07 11:29:03.798755] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.978 [2024-10-07 11:29:03.808637] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.978 [2024-10-07 11:29:03.808746] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.978 [2024-10-07 11:29:03.808778] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.978 [2024-10-07 11:29:03.808795] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.978 [2024-10-07 11:29:03.808819] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.978 [2024-10-07 11:29:03.808841] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.978 [2024-10-07 11:29:03.808856] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.978 [2024-10-07 11:29:03.808870] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.978 [2024-10-07 11:29:03.808893] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.978 [2024-10-07 11:29:03.818855] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.978 [2024-10-07 11:29:03.818965] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.978 [2024-10-07 11:29:03.818995] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.978 [2024-10-07 11:29:03.819012] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.978 [2024-10-07 11:29:03.819036] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.978 [2024-10-07 11:29:03.819059] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.978 [2024-10-07 11:29:03.819073] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.979 [2024-10-07 11:29:03.819087] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.979 [2024-10-07 11:29:03.819111] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.979 [2024-10-07 11:29:03.831479] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.979 [2024-10-07 11:29:03.831808] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.979 [2024-10-07 11:29:03.831852] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.979 [2024-10-07 11:29:03.831872] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.979 [2024-10-07 11:29:03.832350] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.979 [2024-10-07 11:29:03.832606] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.979 [2024-10-07 11:29:03.832642] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.979 [2024-10-07 11:29:03.832658] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.979 [2024-10-07 11:29:03.832860] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.979 [2024-10-07 11:29:03.843021] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.979 [2024-10-07 11:29:03.843221] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.979 [2024-10-07 11:29:03.843273] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.979 [2024-10-07 11:29:03.843293] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.979 [2024-10-07 11:29:03.843396] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.979 [2024-10-07 11:29:03.844183] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.979 [2024-10-07 11:29:03.844217] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.979 [2024-10-07 11:29:03.844249] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.979 [2024-10-07 11:29:03.846923] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.979 [2024-10-07 11:29:03.853103] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.979 [2024-10-07 11:29:03.853208] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.979 [2024-10-07 11:29:03.853237] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.979 [2024-10-07 11:29:03.853254] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.979 [2024-10-07 11:29:03.853278] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.979 [2024-10-07 11:29:03.853301] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.979 [2024-10-07 11:29:03.853315] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.979 [2024-10-07 11:29:03.853329] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.979 [2024-10-07 11:29:03.853352] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.979 [2024-10-07 11:29:03.864662] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.979 [2024-10-07 11:29:03.866942] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.979 [2024-10-07 11:29:03.866988] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.979 [2024-10-07 11:29:03.867008] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.979 [2024-10-07 11:29:03.867255] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.979 [2024-10-07 11:29:03.867350] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.979 [2024-10-07 11:29:03.867374] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.979 [2024-10-07 11:29:03.867388] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.979 [2024-10-07 11:29:03.867430] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.979 [2024-10-07 11:29:03.874742] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.979 [2024-10-07 11:29:03.874898] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.979 [2024-10-07 11:29:03.874929] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.979 [2024-10-07 11:29:03.874946] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.979 [2024-10-07 11:29:03.874970] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.979 [2024-10-07 11:29:03.874992] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.979 [2024-10-07 11:29:03.875007] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.979 [2024-10-07 11:29:03.875020] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.979 [2024-10-07 11:29:03.875044] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.979 [2024-10-07 11:29:03.887176] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.979 [2024-10-07 11:29:03.887315] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.979 [2024-10-07 11:29:03.887346] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.979 [2024-10-07 11:29:03.887364] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.979 [2024-10-07 11:29:03.887387] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.979 [2024-10-07 11:29:03.887409] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.979 [2024-10-07 11:29:03.887423] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.979 [2024-10-07 11:29:03.887451] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.979 [2024-10-07 11:29:03.887476] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.979 [2024-10-07 11:29:03.897862] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.979 [2024-10-07 11:29:03.898606] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.979 [2024-10-07 11:29:03.898665] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.979 [2024-10-07 11:29:03.898684] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.979 [2024-10-07 11:29:03.901220] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.979 [2024-10-07 11:29:03.901856] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.979 [2024-10-07 11:29:03.901891] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.979 [2024-10-07 11:29:03.901908] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.979 [2024-10-07 11:29:03.902160] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.979 [2024-10-07 11:29:03.907944] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.979 [2024-10-07 11:29:03.908052] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.979 [2024-10-07 11:29:03.908083] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.979 [2024-10-07 11:29:03.908100] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.979 [2024-10-07 11:29:03.908124] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.979 [2024-10-07 11:29:03.908146] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.979 [2024-10-07 11:29:03.908162] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.979 [2024-10-07 11:29:03.908176] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.979 [2024-10-07 11:29:03.908199] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.979 [2024-10-07 11:29:03.918021] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.979 [2024-10-07 11:29:03.918127] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.979 [2024-10-07 11:29:03.918165] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.979 [2024-10-07 11:29:03.918183] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.979 [2024-10-07 11:29:03.918206] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.979 [2024-10-07 11:29:03.918228] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.979 [2024-10-07 11:29:03.918242] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.979 [2024-10-07 11:29:03.918256] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.979 [2024-10-07 11:29:03.918278] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.979 [2024-10-07 11:29:03.928678] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.979 [2024-10-07 11:29:03.928941] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.979 [2024-10-07 11:29:03.928976] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.979 [2024-10-07 11:29:03.928994] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.979 [2024-10-07 11:29:03.929133] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.979 [2024-10-07 11:29:03.929242] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.979 [2024-10-07 11:29:03.929261] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.979 [2024-10-07 11:29:03.929275] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.979 [2024-10-07 11:29:03.929644] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.979 [2024-10-07 11:29:03.938777] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.979 [2024-10-07 11:29:03.938883] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.979 [2024-10-07 11:29:03.938914] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.980 [2024-10-07 11:29:03.938949] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.980 [2024-10-07 11:29:03.938974] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.980 [2024-10-07 11:29:03.938996] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.980 [2024-10-07 11:29:03.939010] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.980 [2024-10-07 11:29:03.939024] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.980 [2024-10-07 11:29:03.939048] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.980 [2024-10-07 11:29:03.949288] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.980 [2024-10-07 11:29:03.949524] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.980 [2024-10-07 11:29:03.949557] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.980 [2024-10-07 11:29:03.949576] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.980 [2024-10-07 11:29:03.949600] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.980 [2024-10-07 11:29:03.949622] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.980 [2024-10-07 11:29:03.949636] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.980 [2024-10-07 11:29:03.949650] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.980 [2024-10-07 11:29:03.949674] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.980 [2024-10-07 11:29:03.959471] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.980 [2024-10-07 11:29:03.959588] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.980 [2024-10-07 11:29:03.959619] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.980 [2024-10-07 11:29:03.959637] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.980 [2024-10-07 11:29:03.959691] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.980 [2024-10-07 11:29:03.959721] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.980 [2024-10-07 11:29:03.959736] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.980 [2024-10-07 11:29:03.959750] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.980 [2024-10-07 11:29:03.959774] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.980 [2024-10-07 11:29:03.970215] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.980 [2024-10-07 11:29:03.970320] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.980 [2024-10-07 11:29:03.970350] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.980 [2024-10-07 11:29:03.970367] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.980 [2024-10-07 11:29:03.970429] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.980 [2024-10-07 11:29:03.971263] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.980 [2024-10-07 11:29:03.971317] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.980 [2024-10-07 11:29:03.971351] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.980 [2024-10-07 11:29:03.971631] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.980 [2024-10-07 11:29:03.983171] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.980 [2024-10-07 11:29:03.983491] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.980 [2024-10-07 11:29:03.983534] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.980 [2024-10-07 11:29:03.983554] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.980 [2024-10-07 11:29:03.983681] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.980 [2024-10-07 11:29:03.983787] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.980 [2024-10-07 11:29:03.983813] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.980 [2024-10-07 11:29:03.983827] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.980 [2024-10-07 11:29:03.983915] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.980 [2024-10-07 11:29:03.994625] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.980 [2024-10-07 11:29:03.994865] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.980 [2024-10-07 11:29:03.994916] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.980 [2024-10-07 11:29:03.994935] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.980 [2024-10-07 11:29:03.995091] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.980 [2024-10-07 11:29:03.995270] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.980 [2024-10-07 11:29:03.995307] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.980 [2024-10-07 11:29:03.995324] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.980 [2024-10-07 11:29:03.995463] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.980 [2024-10-07 11:29:04.005517] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.980 [2024-10-07 11:29:04.005632] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.980 [2024-10-07 11:29:04.005662] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.980 [2024-10-07 11:29:04.005679] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.980 [2024-10-07 11:29:04.005703] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.980 [2024-10-07 11:29:04.005725] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.980 [2024-10-07 11:29:04.005739] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.980 [2024-10-07 11:29:04.005753] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.980 [2024-10-07 11:29:04.005776] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.980 [2024-10-07 11:29:04.015598] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.980 [2024-10-07 11:29:04.018123] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.980 [2024-10-07 11:29:04.018179] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.980 [2024-10-07 11:29:04.018199] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.980 [2024-10-07 11:29:04.018980] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.980 [2024-10-07 11:29:04.019193] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.980 [2024-10-07 11:29:04.019232] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.980 [2024-10-07 11:29:04.019246] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.980 [2024-10-07 11:29:04.019277] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.980 [2024-10-07 11:29:04.026273] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.980 [2024-10-07 11:29:04.026413] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.980 [2024-10-07 11:29:04.026458] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.980 [2024-10-07 11:29:04.026476] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.980 [2024-10-07 11:29:04.026501] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.980 [2024-10-07 11:29:04.026523] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.980 [2024-10-07 11:29:04.026537] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.980 [2024-10-07 11:29:04.026551] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.980 [2024-10-07 11:29:04.026574] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.980 [2024-10-07 11:29:04.037077] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.980 [2024-10-07 11:29:04.037201] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.980 [2024-10-07 11:29:04.037232] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.980 [2024-10-07 11:29:04.037249] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.980 [2024-10-07 11:29:04.037274] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.980 [2024-10-07 11:29:04.037296] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.980 [2024-10-07 11:29:04.037311] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.980 [2024-10-07 11:29:04.037325] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.980 [2024-10-07 11:29:04.037348] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.980 [2024-10-07 11:29:04.049767] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.980 [2024-10-07 11:29:04.050022] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.980 [2024-10-07 11:29:04.050065] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.980 [2024-10-07 11:29:04.050082] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.980 [2024-10-07 11:29:04.050613] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.980 [2024-10-07 11:29:04.052584] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.980 [2024-10-07 11:29:04.052622] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.980 [2024-10-07 11:29:04.052639] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.980 [2024-10-07 11:29:04.052876] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.980 [2024-10-07 11:29:04.059879] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.980 [2024-10-07 11:29:04.059984] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.981 [2024-10-07 11:29:04.060015] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.981 [2024-10-07 11:29:04.060032] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.981 [2024-10-07 11:29:04.060056] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.981 [2024-10-07 11:29:04.060079] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.981 [2024-10-07 11:29:04.060093] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.981 [2024-10-07 11:29:04.060107] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.981 [2024-10-07 11:29:04.060130] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.981 [2024-10-07 11:29:04.070922] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.981 [2024-10-07 11:29:04.071961] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.981 [2024-10-07 11:29:04.072004] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.981 [2024-10-07 11:29:04.072024] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.981 [2024-10-07 11:29:04.074220] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.981 [2024-10-07 11:29:04.074756] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.981 [2024-10-07 11:29:04.074792] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.981 [2024-10-07 11:29:04.074809] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.981 [2024-10-07 11:29:04.074899] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.981 [2024-10-07 11:29:04.081005] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.981 [2024-10-07 11:29:04.081116] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.981 [2024-10-07 11:29:04.081146] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.981 [2024-10-07 11:29:04.081164] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.981 [2024-10-07 11:29:04.081187] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.981 [2024-10-07 11:29:04.081209] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.981 [2024-10-07 11:29:04.081223] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.981 [2024-10-07 11:29:04.081264] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.981 [2024-10-07 11:29:04.081290] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.981 [2024-10-07 11:29:04.092588] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.981 [2024-10-07 11:29:04.092721] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.981 [2024-10-07 11:29:04.092753] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.981 [2024-10-07 11:29:04.092771] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.981 [2024-10-07 11:29:04.092795] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.981 [2024-10-07 11:29:04.093689] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.981 [2024-10-07 11:29:04.093727] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.981 [2024-10-07 11:29:04.093744] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.981 [2024-10-07 11:29:04.094429] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.981 [2024-10-07 11:29:04.106262] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.981 [2024-10-07 11:29:04.106747] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.981 [2024-10-07 11:29:04.106788] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.981 [2024-10-07 11:29:04.106807] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.981 [2024-10-07 11:29:04.107156] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.981 [2024-10-07 11:29:04.107247] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.981 [2024-10-07 11:29:04.107270] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.981 [2024-10-07 11:29:04.107284] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.981 [2024-10-07 11:29:04.107308] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.981 [2024-10-07 11:29:04.116341] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.981 [2024-10-07 11:29:04.119263] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.981 [2024-10-07 11:29:04.119324] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.981 [2024-10-07 11:29:04.119344] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.981 [2024-10-07 11:29:04.122301] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.981 [2024-10-07 11:29:04.122847] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.981 [2024-10-07 11:29:04.122882] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.981 [2024-10-07 11:29:04.122898] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.981 [2024-10-07 11:29:04.123129] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.981 [2024-10-07 11:29:04.126446] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.981 [2024-10-07 11:29:04.126566] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.981 [2024-10-07 11:29:04.126596] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.981 [2024-10-07 11:29:04.126614] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.981 [2024-10-07 11:29:04.126637] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.981 [2024-10-07 11:29:04.126659] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.981 [2024-10-07 11:29:04.126674] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.981 [2024-10-07 11:29:04.126687] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.981 [2024-10-07 11:29:04.126714] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.981 [2024-10-07 11:29:04.137144] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.981 [2024-10-07 11:29:04.137272] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.981 [2024-10-07 11:29:04.137303] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.981 [2024-10-07 11:29:04.137320] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.981 [2024-10-07 11:29:04.137344] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.981 [2024-10-07 11:29:04.137367] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.981 [2024-10-07 11:29:04.137381] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.981 [2024-10-07 11:29:04.137395] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.981 [2024-10-07 11:29:04.137432] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.981 [2024-10-07 11:29:04.149471] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.981 [2024-10-07 11:29:04.149792] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.981 [2024-10-07 11:29:04.149835] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.981 [2024-10-07 11:29:04.149855] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.981 [2024-10-07 11:29:04.150073] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.981 [2024-10-07 11:29:04.150137] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.981 [2024-10-07 11:29:04.150158] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.981 [2024-10-07 11:29:04.150173] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.981 [2024-10-07 11:29:04.150199] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.981 [2024-10-07 11:29:04.163056] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.981 [2024-10-07 11:29:04.163223] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.981 [2024-10-07 11:29:04.163255] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.981 [2024-10-07 11:29:04.163273] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.981 [2024-10-07 11:29:04.163322] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.981 [2024-10-07 11:29:04.163346] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.981 [2024-10-07 11:29:04.163361] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.981 [2024-10-07 11:29:04.163375] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.981 [2024-10-07 11:29:04.163399] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.981 [2024-10-07 11:29:04.176220] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.981 [2024-10-07 11:29:04.176579] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.981 [2024-10-07 11:29:04.176621] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.981 [2024-10-07 11:29:04.176641] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.981 [2024-10-07 11:29:04.176923] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.981 [2024-10-07 11:29:04.177591] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.981 [2024-10-07 11:29:04.177642] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.981 [2024-10-07 11:29:04.177659] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.981 [2024-10-07 11:29:04.177902] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.981 [2024-10-07 11:29:04.188723] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.982 [2024-10-07 11:29:04.188835] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.982 [2024-10-07 11:29:04.188866] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.982 [2024-10-07 11:29:04.188884] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.982 [2024-10-07 11:29:04.188908] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.982 [2024-10-07 11:29:04.188931] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.982 [2024-10-07 11:29:04.188945] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.982 [2024-10-07 11:29:04.188960] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.982 [2024-10-07 11:29:04.188983] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.982 [2024-10-07 11:29:04.199292] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.982 [2024-10-07 11:29:04.199506] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.982 [2024-10-07 11:29:04.199538] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.982 [2024-10-07 11:29:04.199556] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.982 [2024-10-07 11:29:04.199672] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.982 [2024-10-07 11:29:04.199777] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.982 [2024-10-07 11:29:04.199796] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.982 [2024-10-07 11:29:04.199810] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.982 [2024-10-07 11:29:04.200049] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.982 [2024-10-07 11:29:04.209600] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.982 [2024-10-07 11:29:04.209722] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.982 [2024-10-07 11:29:04.209764] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.982 [2024-10-07 11:29:04.209781] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.982 [2024-10-07 11:29:04.209805] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.982 [2024-10-07 11:29:04.209840] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.982 [2024-10-07 11:29:04.209855] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.982 [2024-10-07 11:29:04.209869] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.982 [2024-10-07 11:29:04.209893] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.982 [2024-10-07 11:29:04.219698] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.982 [2024-10-07 11:29:04.219805] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.982 [2024-10-07 11:29:04.219866] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.982 [2024-10-07 11:29:04.219883] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.982 [2024-10-07 11:29:04.219907] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.982 [2024-10-07 11:29:04.220357] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.982 [2024-10-07 11:29:04.220391] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.982 [2024-10-07 11:29:04.220407] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.982 [2024-10-07 11:29:04.220656] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.982 [2024-10-07 11:29:04.232462] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.982 [2024-10-07 11:29:04.232582] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.982 [2024-10-07 11:29:04.232612] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.982 [2024-10-07 11:29:04.232629] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.982 [2024-10-07 11:29:04.233193] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.982 [2024-10-07 11:29:04.233332] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.982 [2024-10-07 11:29:04.233354] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.982 [2024-10-07 11:29:04.233368] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.982 [2024-10-07 11:29:04.233392] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.982 [2024-10-07 11:29:04.243833] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.982 [2024-10-07 11:29:04.244043] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.982 [2024-10-07 11:29:04.244097] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.982 [2024-10-07 11:29:04.244118] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.982 [2024-10-07 11:29:04.244236] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.982 [2024-10-07 11:29:04.244341] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.982 [2024-10-07 11:29:04.244360] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.982 [2024-10-07 11:29:04.244374] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.982 [2024-10-07 11:29:04.244881] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.982 [2024-10-07 11:29:04.257416] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.982 [2024-10-07 11:29:04.257622] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.982 [2024-10-07 11:29:04.257659] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.982 [2024-10-07 11:29:04.257677] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.982 [2024-10-07 11:29:04.257798] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.982 [2024-10-07 11:29:04.257905] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.982 [2024-10-07 11:29:04.257930] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.982 [2024-10-07 11:29:04.257945] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.982 [2024-10-07 11:29:04.258405] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.982 [2024-10-07 11:29:04.268950] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.982 [2024-10-07 11:29:04.269059] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.982 [2024-10-07 11:29:04.269088] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.982 [2024-10-07 11:29:04.269106] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.982 [2024-10-07 11:29:04.269130] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.982 [2024-10-07 11:29:04.270810] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.982 [2024-10-07 11:29:04.270850] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.982 [2024-10-07 11:29:04.270868] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.982 [2024-10-07 11:29:04.271062] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.982 [2024-10-07 11:29:04.279033] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.982 [2024-10-07 11:29:04.279137] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.982 [2024-10-07 11:29:04.279167] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.982 [2024-10-07 11:29:04.279184] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.982 [2024-10-07 11:29:04.279209] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.982 [2024-10-07 11:29:04.279249] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.982 [2024-10-07 11:29:04.279265] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.982 [2024-10-07 11:29:04.279281] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.982 [2024-10-07 11:29:04.279304] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.982 [2024-10-07 11:29:04.291708] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.982 [2024-10-07 11:29:04.291814] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.982 [2024-10-07 11:29:04.291844] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.982 [2024-10-07 11:29:04.291862] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.982 [2024-10-07 11:29:04.291886] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.982 [2024-10-07 11:29:04.291908] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.982 [2024-10-07 11:29:04.291922] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.982 [2024-10-07 11:29:04.291936] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.982 [2024-10-07 11:29:04.291959] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.982 [2024-10-07 11:29:04.302195] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.982 [2024-10-07 11:29:04.302387] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.982 [2024-10-07 11:29:04.302432] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.982 [2024-10-07 11:29:04.302452] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.982 [2024-10-07 11:29:04.302584] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.982 [2024-10-07 11:29:04.302705] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.982 [2024-10-07 11:29:04.302728] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.982 [2024-10-07 11:29:04.302742] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.982 [2024-10-07 11:29:04.302767] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.983 [2024-10-07 11:29:04.312273] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.983 [2024-10-07 11:29:04.312373] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.983 [2024-10-07 11:29:04.312403] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.983 [2024-10-07 11:29:04.312437] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.983 [2024-10-07 11:29:04.312462] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.983 [2024-10-07 11:29:04.312484] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.983 [2024-10-07 11:29:04.312499] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.983 [2024-10-07 11:29:04.312513] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.983 [2024-10-07 11:29:04.312536] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.983 [2024-10-07 11:29:04.321369] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:86992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.983 [2024-10-07 11:29:04.321403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.983 [2024-10-07 11:29:04.321444] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:87000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.983 [2024-10-07 11:29:04.321461] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.983 [2024-10-07 11:29:04.321478] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:87008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.983 [2024-10-07 11:29:04.321492] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.983 [2024-10-07 11:29:04.321508] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:87016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.983 [2024-10-07 11:29:04.321522] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.983 [2024-10-07 11:29:04.321538] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:87024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.983 [2024-10-07 11:29:04.321553] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.983 [2024-10-07 11:29:04.321568] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:87032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.983 [2024-10-07 11:29:04.321582] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.983 [2024-10-07 11:29:04.321598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:87040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.983 [2024-10-07 11:29:04.321612] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.983 [2024-10-07 11:29:04.321627] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:87048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.983 [2024-10-07 11:29:04.321641] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.983 [2024-10-07 11:29:04.321657] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:87056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.983 [2024-10-07 11:29:04.321671] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.983 [2024-10-07 11:29:04.321687] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:87064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.983 [2024-10-07 11:29:04.321701] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.983 [2024-10-07 11:29:04.321716] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:87072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.983 [2024-10-07 11:29:04.321730] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.983 [2024-10-07 11:29:04.321746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:87080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.983 [2024-10-07 11:29:04.321760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.983 [2024-10-07 11:29:04.321775] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:87088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.983 [2024-10-07 11:29:04.321803] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.983 [2024-10-07 11:29:04.321820] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:87096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.983 [2024-10-07 11:29:04.321834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.983 [2024-10-07 11:29:04.321850] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:87104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.983 [2024-10-07 11:29:04.321865] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.983 [2024-10-07 11:29:04.321881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:87112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.983 [2024-10-07 11:29:04.321895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.983 [2024-10-07 11:29:04.321911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:87120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.983 [2024-10-07 11:29:04.321926] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.983 [2024-10-07 11:29:04.321943] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:87128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.983 [2024-10-07 11:29:04.321969] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.983 [2024-10-07 11:29:04.321988] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:87136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.983 [2024-10-07 11:29:04.322002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.983 [2024-10-07 11:29:04.322018] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:87144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.983 [2024-10-07 11:29:04.322033] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.983 [2024-10-07 11:29:04.322049] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:87152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.983 [2024-10-07 11:29:04.322063] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.983 [2024-10-07 11:29:04.322079] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:87160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.983 [2024-10-07 11:29:04.322093] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.983 [2024-10-07 11:29:04.322109] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:87168 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.983 [2024-10-07 11:29:04.322123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.983 [2024-10-07 11:29:04.322139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:87176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.983 [2024-10-07 11:29:04.322154] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.983 [2024-10-07 11:29:04.322170] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:87184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.983 [2024-10-07 11:29:04.322184] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.983 [2024-10-07 11:29:04.322209] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:87192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.983 [2024-10-07 11:29:04.322225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.983 [2024-10-07 11:29:04.322242] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:87200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.983 [2024-10-07 11:29:04.322257] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.983 [2024-10-07 11:29:04.322273] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:87208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.983 [2024-10-07 11:29:04.322287] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.983 [2024-10-07 11:29:04.322303] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:87216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.983 [2024-10-07 11:29:04.322317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.983 [2024-10-07 11:29:04.322333] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:87224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.983 [2024-10-07 11:29:04.322348] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.983 [2024-10-07 11:29:04.322364] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:87232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.983 [2024-10-07 11:29:04.322378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.983 [2024-10-07 11:29:04.322394] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:87240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.983 [2024-10-07 11:29:04.322420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.983 [2024-10-07 11:29:04.322440] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:87248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.983 [2024-10-07 11:29:04.322455] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.983 [2024-10-07 11:29:04.322472] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:87256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.984 [2024-10-07 11:29:04.322487] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.984 [2024-10-07 11:29:04.322503] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:87264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.984 [2024-10-07 11:29:04.322517] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.984 [2024-10-07 11:29:04.322533] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:87272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.984 [2024-10-07 11:29:04.322547] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.984 [2024-10-07 11:29:04.322564] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:87280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.984 [2024-10-07 11:29:04.322578] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.984 [2024-10-07 11:29:04.322594] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:87288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.984 [2024-10-07 11:29:04.322608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.984 [2024-10-07 11:29:04.322633] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:87296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.984 [2024-10-07 11:29:04.322648] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.984 [2024-10-07 11:29:04.322665] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:87304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.984 [2024-10-07 11:29:04.322679] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.984 [2024-10-07 11:29:04.322695] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:87312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.984 [2024-10-07 11:29:04.322709] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.984 [2024-10-07 11:29:04.322725] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:87320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.984 [2024-10-07 11:29:04.322739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.984 [2024-10-07 11:29:04.322755] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:87328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.984 [2024-10-07 11:29:04.322769] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.984 [2024-10-07 11:29:04.322785] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:87336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.984 [2024-10-07 11:29:04.322799] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.984 [2024-10-07 11:29:04.322815] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:87344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.984 [2024-10-07 11:29:04.322829] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.984 [2024-10-07 11:29:04.322845] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:87352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.984 [2024-10-07 11:29:04.322859] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.984 [2024-10-07 11:29:04.322879] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:87360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.984 [2024-10-07 11:29:04.322893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.984 [2024-10-07 11:29:04.322909] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:87368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.984 [2024-10-07 11:29:04.322923] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.984 [2024-10-07 11:29:04.322939] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:87376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.984 [2024-10-07 11:29:04.322954] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.984 [2024-10-07 11:29:04.322970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:87384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.984 [2024-10-07 11:29:04.322985] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.984 [2024-10-07 11:29:04.323001] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:87392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.984 [2024-10-07 11:29:04.323023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.984 [2024-10-07 11:29:04.323040] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:87400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.984 [2024-10-07 11:29:04.323054] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.984 [2024-10-07 11:29:04.323070] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:87408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.984 [2024-10-07 11:29:04.323084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.984 [2024-10-07 11:29:04.323100] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:87416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.984 [2024-10-07 11:29:04.323114] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.984 [2024-10-07 11:29:04.323130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:87424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.984 [2024-10-07 11:29:04.323156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.984 [2024-10-07 11:29:04.323173] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:87432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.984 [2024-10-07 11:29:04.323188] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.984 [2024-10-07 11:29:04.323203] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:87440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.984 [2024-10-07 11:29:04.323218] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.984 [2024-10-07 11:29:04.323234] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:87448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.984 [2024-10-07 11:29:04.323248] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.984 [2024-10-07 11:29:04.323263] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:87456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.984 [2024-10-07 11:29:04.323278] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.984 [2024-10-07 11:29:04.323294] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:87464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.984 [2024-10-07 11:29:04.323308] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.984 [2024-10-07 11:29:04.323324] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:87472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.984 [2024-10-07 11:29:04.323339] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.984 [2024-10-07 11:29:04.323355] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:87480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.984 [2024-10-07 11:29:04.323369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.984 [2024-10-07 11:29:04.323385] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:87488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.984 [2024-10-07 11:29:04.323399] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.984 [2024-10-07 11:29:04.323436] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:87496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.984 [2024-10-07 11:29:04.323452] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.984 [2024-10-07 11:29:04.323468] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:87504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:33.984 [2024-10-07 11:29:04.323483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.984 [2024-10-07 11:29:04.323500] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:87512 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:33.984 [2024-10-07 11:29:04.323515] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.984 [2024-10-07 11:29:04.323531] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:87520 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:33.984 [2024-10-07 11:29:04.323545] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.984 [2024-10-07 11:29:04.323561] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:87528 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:33.984 [2024-10-07 11:29:04.323576] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.984 [2024-10-07 11:29:04.323592] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:87536 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:33.984 [2024-10-07 11:29:04.323606] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.984 [2024-10-07 11:29:04.323622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:87544 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:33.984 [2024-10-07 11:29:04.323636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.984 [2024-10-07 11:29:04.323652] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:87552 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:33.984 [2024-10-07 11:29:04.323673] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.984 [2024-10-07 11:29:04.323689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:87560 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:33.984 [2024-10-07 11:29:04.323704] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.984 [2024-10-07 11:29:04.323720] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:87568 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:33.984 [2024-10-07 11:29:04.323734] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.984 [2024-10-07 11:29:04.323751] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:87576 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:33.984 [2024-10-07 11:29:04.323765] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.984 [2024-10-07 11:29:04.323781] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:87584 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:33.984 [2024-10-07 11:29:04.323795] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.984 [2024-10-07 11:29:04.323811] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:95 nsid:1 lba:87592 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:33.985 [2024-10-07 11:29:04.323833] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.985 [2024-10-07 11:29:04.323850] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:87600 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:33.985 [2024-10-07 11:29:04.323864] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.985 [2024-10-07 11:29:04.323880] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:87608 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:33.985 [2024-10-07 11:29:04.323895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.985 [2024-10-07 11:29:04.323911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:87616 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:33.985 [2024-10-07 11:29:04.323925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.985 [2024-10-07 11:29:04.323941] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:87624 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:33.985 [2024-10-07 11:29:04.323955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.985 [2024-10-07 11:29:04.323971] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:87632 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:33.985 [2024-10-07 11:29:04.323991] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.985 [2024-10-07 11:29:04.324008] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:87640 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:33.985 [2024-10-07 11:29:04.324023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.985 [2024-10-07 11:29:04.324039] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:87648 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:33.985 [2024-10-07 11:29:04.324053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.985 [2024-10-07 11:29:04.324069] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:87656 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:33.985 [2024-10-07 11:29:04.324084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.985 [2024-10-07 11:29:04.324099] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:87664 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:33.985 [2024-10-07 11:29:04.324113] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.985 [2024-10-07 11:29:04.324129] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:87672 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:33.985 [2024-10-07 11:29:04.324143] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.985 [2024-10-07 11:29:04.324159] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:87680 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:33.985 [2024-10-07 11:29:04.324180] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.985 [2024-10-07 11:29:04.324196] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:87688 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:33.985 [2024-10-07 11:29:04.324211] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.985 [2024-10-07 11:29:04.324227] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:87696 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:33.985 [2024-10-07 11:29:04.324249] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.985 [2024-10-07 11:29:04.324265] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:87704 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:33.985 [2024-10-07 11:29:04.324280] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.985 [2024-10-07 11:29:04.324296] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:87712 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:33.985 [2024-10-07 11:29:04.324310] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.985 [2024-10-07 11:29:04.324326] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:87720 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:33.985 [2024-10-07 11:29:04.324341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.985 [2024-10-07 11:29:04.324356] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:87728 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:33.985 [2024-10-07 11:29:04.324371] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.985 [2024-10-07 11:29:04.324386] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:87736 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:33.985 [2024-10-07 11:29:04.324400] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.985 [2024-10-07 11:29:04.324427] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:87744 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:33.985 [2024-10-07 11:29:04.324443] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.985 [2024-10-07 11:29:04.324459] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:87752 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:33.985 [2024-10-07 11:29:04.324474] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.985 [2024-10-07 11:29:04.324490] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:87760 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:33.985 [2024-10-07 11:29:04.324511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.985 [2024-10-07 11:29:04.324528] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:87768 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:33.985 [2024-10-07 11:29:04.324542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.985 [2024-10-07 11:29:04.324558] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:87776 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:33.985 [2024-10-07 11:29:04.324572] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.985 [2024-10-07 11:29:04.324588] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:87784 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:33.985 [2024-10-07 11:29:04.324602] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.985 [2024-10-07 11:29:04.324617] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:87792 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:33.985 [2024-10-07 11:29:04.324631] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.985 [2024-10-07 11:29:04.324656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:87800 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:33.985 [2024-10-07 11:29:04.324671] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.985 [2024-10-07 11:29:04.324687] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:87808 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:33.985 [2024-10-07 11:29:04.324706] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.985 [2024-10-07 11:29:04.324723] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:87816 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:33.985 [2024-10-07 11:29:04.324737] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.985 [2024-10-07 11:29:04.324753] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:87824 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:33.985 [2024-10-07 11:29:04.324768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.985 [2024-10-07 11:29:04.324783] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:87832 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:33.985 [2024-10-07 11:29:04.324798] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.985 [2024-10-07 11:29:04.324813] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:87840 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:33.985 [2024-10-07 11:29:04.324827] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.985 [2024-10-07 11:29:04.324843] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:87848 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:33.985 [2024-10-07 11:29:04.324858] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.985 [2024-10-07 11:29:04.324874] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:89 nsid:1 lba:87856 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:33.985 [2024-10-07 11:29:04.324888] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.985 [2024-10-07 11:29:04.324904] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:87864 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:33.985 [2024-10-07 11:29:04.324918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.985 [2024-10-07 11:29:04.324934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:87872 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:33.985 [2024-10-07 11:29:04.324948] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.985 [2024-10-07 11:29:04.324964] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:87880 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:33.985 [2024-10-07 11:29:04.324979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.985 [2024-10-07 11:29:04.324994] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:87888 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:33.985 [2024-10-07 11:29:04.325014] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.985 [2024-10-07 11:29:04.325047] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:33.985 [2024-10-07 11:29:04.325074] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:87896 len:8 PRP1 0x0 PRP2 0x0 00:18:33.985 [2024-10-07 11:29:04.325090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.985 [2024-10-07 11:29:04.325108] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:33.985 [2024-10-07 11:29:04.325119] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:33.985 [2024-10-07 11:29:04.325130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:87904 len:8 PRP1 0x0 PRP2 0x0 00:18:33.985 [2024-10-07 11:29:04.325144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.985 [2024-10-07 11:29:04.325158] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:33.985 [2024-10-07 11:29:04.325168] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:33.985 [2024-10-07 11:29:04.325179] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:87912 len:8 PRP1 0x0 PRP2 0x0 00:18:33.985 [2024-10-07 11:29:04.325203] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.985 [2024-10-07 11:29:04.325223] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:33.986 [2024-10-07 11:29:04.325234] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:33.986 [2024-10-07 11:29:04.325245] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:87920 len:8 PRP1 0x0 PRP2 0x0 00:18:33.986 [2024-10-07 11:29:04.325258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.986 [2024-10-07 11:29:04.325273] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:33.986 [2024-10-07 11:29:04.325283] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:33.986 [2024-10-07 11:29:04.325293] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:87928 len:8 PRP1 0x0 PRP2 0x0 00:18:33.986 [2024-10-07 11:29:04.325307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.986 [2024-10-07 11:29:04.325321] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:33.986 [2024-10-07 11:29:04.325332] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:33.986 [2024-10-07 11:29:04.325343] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:87936 len:8 PRP1 0x0 PRP2 0x0 00:18:33.986 [2024-10-07 11:29:04.325356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.986 [2024-10-07 11:29:04.325370] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:33.986 [2024-10-07 11:29:04.325381] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:33.986 [2024-10-07 11:29:04.325391] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:87944 len:8 PRP1 0x0 PRP2 0x0 00:18:33.986 [2024-10-07 11:29:04.325405] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.986 [2024-10-07 11:29:04.325434] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:33.986 [2024-10-07 11:29:04.325445] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:33.986 [2024-10-07 11:29:04.325456] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:87952 len:8 PRP1 0x0 PRP2 0x0 00:18:33.986 [2024-10-07 11:29:04.325470] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.986 [2024-10-07 11:29:04.325490] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:33.986 [2024-10-07 11:29:04.325508] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:33.986 [2024-10-07 11:29:04.325521] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:87960 len:8 PRP1 0x0 PRP2 0x0 00:18:33.986 [2024-10-07 11:29:04.325534] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.986 [2024-10-07 11:29:04.325548] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:33.986 [2024-10-07 11:29:04.325559] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:33.986 [2024-10-07 11:29:04.325570] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:87968 len:8 PRP1 0x0 PRP2 0x0 00:18:33.986 [2024-10-07 11:29:04.325583] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.986 [2024-10-07 11:29:04.325597] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:33.986 [2024-10-07 11:29:04.325607] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:33.986 [2024-10-07 11:29:04.325618] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:87976 len:8 PRP1 0x0 PRP2 0x0 00:18:33.986 [2024-10-07 11:29:04.325631] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.986 [2024-10-07 11:29:04.325650] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:33.986 [2024-10-07 11:29:04.325662] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:33.986 [2024-10-07 11:29:04.325673] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:87984 len:8 PRP1 0x0 PRP2 0x0 00:18:33.986 [2024-10-07 11:29:04.325686] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.986 [2024-10-07 11:29:04.325700] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:33.986 [2024-10-07 11:29:04.325710] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:33.986 [2024-10-07 11:29:04.325721] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:87992 len:8 PRP1 0x0 PRP2 0x0 00:18:33.986 [2024-10-07 11:29:04.325735] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.986 [2024-10-07 11:29:04.325749] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:33.986 [2024-10-07 11:29:04.325759] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:33.986 [2024-10-07 11:29:04.325770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:88000 len:8 PRP1 0x0 PRP2 0x0 00:18:33.986 [2024-10-07 11:29:04.325783] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.986 [2024-10-07 11:29:04.325797] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:33.986 [2024-10-07 11:29:04.325808] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:33.986 [2024-10-07 11:29:04.325818] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:88008 len:8 PRP1 0x0 PRP2 0x0 00:18:33.986 [2024-10-07 11:29:04.325832] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:33.986 [2024-10-07 11:29:04.325897] bdev_nvme.c:1730:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x69b060 was disconnected and freed. reset controller. 00:18:33.986 [2024-10-07 11:29:04.327184] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.986 [2024-10-07 11:29:04.327268] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:33.986 [2024-10-07 11:29:04.327305] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.986 [2024-10-07 11:29:04.327425] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.986 [2024-10-07 11:29:04.327456] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:33.986 [2024-10-07 11:29:04.327473] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:33.986 [2024-10-07 11:29:04.327526] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.986 [2024-10-07 11:29:04.327549] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.986 [2024-10-07 11:29:04.327564] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.986 [2024-10-07 11:29:04.327586] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:33.986 [2024-10-07 11:29:04.327606] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.986 [2024-10-07 11:29:04.327629] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.986 [2024-10-07 11:29:04.327645] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.986 [2024-10-07 11:29:04.327659] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.986 [2024-10-07 11:29:04.327674] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.986 [2024-10-07 11:29:04.327689] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.986 [2024-10-07 11:29:04.327702] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.986 [2024-10-07 11:29:04.327725] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.986 [2024-10-07 11:29:04.327739] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.986 [2024-10-07 11:29:04.337403] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.986 [2024-10-07 11:29:04.337477] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.986 [2024-10-07 11:29:04.337552] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.986 [2024-10-07 11:29:04.337592] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.986 [2024-10-07 11:29:04.337611] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.986 [2024-10-07 11:29:04.337668] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.986 [2024-10-07 11:29:04.337692] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:33.986 [2024-10-07 11:29:04.337708] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:33.986 [2024-10-07 11:29:04.337726] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.986 [2024-10-07 11:29:04.337750] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:33.986 [2024-10-07 11:29:04.337766] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.986 [2024-10-07 11:29:04.337780] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.986 [2024-10-07 11:29:04.337793] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.986 [2024-10-07 11:29:04.337816] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.986 [2024-10-07 11:29:04.337851] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.986 [2024-10-07 11:29:04.337867] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.986 [2024-10-07 11:29:04.337880] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.986 [2024-10-07 11:29:04.337902] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.986 [2024-10-07 11:29:04.350492] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.986 [2024-10-07 11:29:04.350540] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.986 [2024-10-07 11:29:04.350625] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.986 [2024-10-07 11:29:04.350653] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.986 [2024-10-07 11:29:04.350670] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.986 [2024-10-07 11:29:04.350717] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.986 [2024-10-07 11:29:04.350740] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:33.986 [2024-10-07 11:29:04.350755] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:33.986 [2024-10-07 11:29:04.350779] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.986 [2024-10-07 11:29:04.350799] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:33.986 [2024-10-07 11:29:04.350818] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.986 [2024-10-07 11:29:04.350833] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.986 [2024-10-07 11:29:04.350853] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.987 [2024-10-07 11:29:04.350868] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.987 [2024-10-07 11:29:04.350882] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.987 [2024-10-07 11:29:04.350896] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.987 [2024-10-07 11:29:04.350918] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.987 [2024-10-07 11:29:04.350931] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.987 [2024-10-07 11:29:04.366207] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.987 [2024-10-07 11:29:04.366264] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.987 [2024-10-07 11:29:04.367071] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.987 [2024-10-07 11:29:04.367125] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:33.987 [2024-10-07 11:29:04.367151] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:33.987 [2024-10-07 11:29:04.367213] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.987 [2024-10-07 11:29:04.367241] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.987 [2024-10-07 11:29:04.367262] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.987 [2024-10-07 11:29:04.367747] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:33.987 [2024-10-07 11:29:04.367780] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.987 [2024-10-07 11:29:04.367996] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.987 [2024-10-07 11:29:04.368028] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.987 [2024-10-07 11:29:04.368049] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.987 [2024-10-07 11:29:04.368071] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.987 [2024-10-07 11:29:04.368090] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.987 [2024-10-07 11:29:04.368108] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.987 [2024-10-07 11:29:04.368340] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.987 [2024-10-07 11:29:04.368370] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.987 [2024-10-07 11:29:04.377989] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.987 [2024-10-07 11:29:04.378069] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.987 [2024-10-07 11:29:04.378395] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.987 [2024-10-07 11:29:04.378459] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.987 [2024-10-07 11:29:04.378480] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.987 [2024-10-07 11:29:04.378534] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.987 [2024-10-07 11:29:04.378558] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:33.987 [2024-10-07 11:29:04.378574] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:33.987 [2024-10-07 11:29:04.378724] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.987 [2024-10-07 11:29:04.378762] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:33.987 [2024-10-07 11:29:04.378887] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.987 [2024-10-07 11:29:04.378913] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.987 [2024-10-07 11:29:04.378931] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.987 [2024-10-07 11:29:04.378948] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.987 [2024-10-07 11:29:04.378963] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.987 [2024-10-07 11:29:04.378977] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.987 [2024-10-07 11:29:04.379079] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.987 [2024-10-07 11:29:04.379098] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.987 [2024-10-07 11:29:04.390201] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.987 [2024-10-07 11:29:04.390381] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.987 [2024-10-07 11:29:04.390489] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.987 [2024-10-07 11:29:04.390542] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:33.987 [2024-10-07 11:29:04.390561] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:33.987 [2024-10-07 11:29:04.391510] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.987 [2024-10-07 11:29:04.391551] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.987 [2024-10-07 11:29:04.391570] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.987 [2024-10-07 11:29:04.391589] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:33.987 [2024-10-07 11:29:04.391814] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.987 [2024-10-07 11:29:04.391858] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.987 [2024-10-07 11:29:04.391873] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.987 [2024-10-07 11:29:04.391887] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.987 [2024-10-07 11:29:04.392013] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.987 [2024-10-07 11:29:04.392033] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.987 [2024-10-07 11:29:04.392047] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.987 [2024-10-07 11:29:04.392060] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.987 [2024-10-07 11:29:04.392167] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.987 [2024-10-07 11:29:04.400285] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.987 [2024-10-07 11:29:04.400400] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.987 [2024-10-07 11:29:04.400441] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:33.987 [2024-10-07 11:29:04.400460] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:33.987 8844.00 IOPS, 34.55 MiB/s [2024-10-07T11:29:15.698Z] [2024-10-07 11:29:04.403104] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:33.987 [2024-10-07 11:29:04.403415] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.987 [2024-10-07 11:29:04.403462] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.987 [2024-10-07 11:29:04.403480] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.987 [2024-10-07 11:29:04.403630] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.987 [2024-10-07 11:29:04.403658] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.987 [2024-10-07 11:29:04.403837] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.987 [2024-10-07 11:29:04.403896] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.987 [2024-10-07 11:29:04.403915] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.987 [2024-10-07 11:29:04.406023] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.987 [2024-10-07 11:29:04.406357] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.987 [2024-10-07 11:29:04.406421] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.987 [2024-10-07 11:29:04.406442] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.987 [2024-10-07 11:29:04.406615] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.987 [2024-10-07 11:29:04.411692] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.987 [2024-10-07 11:29:04.411842] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.987 [2024-10-07 11:29:04.411871] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:33.987 [2024-10-07 11:29:04.411888] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:33.987 [2024-10-07 11:29:04.411912] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:33.987 [2024-10-07 11:29:04.411933] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.987 [2024-10-07 11:29:04.411947] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.987 [2024-10-07 11:29:04.411961] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.987 [2024-10-07 11:29:04.411984] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.987 [2024-10-07 11:29:04.413702] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.987 [2024-10-07 11:29:04.413816] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.988 [2024-10-07 11:29:04.413846] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.988 [2024-10-07 11:29:04.413863] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.988 [2024-10-07 11:29:04.413887] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.988 [2024-10-07 11:29:04.413909] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.988 [2024-10-07 11:29:04.413923] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.988 [2024-10-07 11:29:04.413937] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.988 [2024-10-07 11:29:04.413969] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.988 [2024-10-07 11:29:04.424703] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.988 [2024-10-07 11:29:04.425690] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.988 [2024-10-07 11:29:04.425827] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.988 [2024-10-07 11:29:04.425856] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:33.988 [2024-10-07 11:29:04.425873] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:33.988 [2024-10-07 11:29:04.426957] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.988 [2024-10-07 11:29:04.426998] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.988 [2024-10-07 11:29:04.427017] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.988 [2024-10-07 11:29:04.427036] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:33.988 [2024-10-07 11:29:04.427924] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.988 [2024-10-07 11:29:04.427963] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.988 [2024-10-07 11:29:04.427980] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.988 [2024-10-07 11:29:04.427993] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.988 [2024-10-07 11:29:04.428385] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.988 [2024-10-07 11:29:04.428427] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.988 [2024-10-07 11:29:04.428444] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.988 [2024-10-07 11:29:04.428457] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.988 [2024-10-07 11:29:04.428526] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.988 [2024-10-07 11:29:04.435960] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.988 [2024-10-07 11:29:04.436204] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.988 [2024-10-07 11:29:04.436234] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:33.988 [2024-10-07 11:29:04.436250] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:33.988 [2024-10-07 11:29:04.436358] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.988 [2024-10-07 11:29:04.436407] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:33.988 [2024-10-07 11:29:04.436556] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.988 [2024-10-07 11:29:04.436589] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.988 [2024-10-07 11:29:04.436605] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.988 [2024-10-07 11:29:04.436620] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.988 [2024-10-07 11:29:04.436632] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.988 [2024-10-07 11:29:04.436645] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.988 [2024-10-07 11:29:04.437448] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.988 [2024-10-07 11:29:04.437535] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.988 [2024-10-07 11:29:04.438060] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.988 [2024-10-07 11:29:04.438098] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.988 [2024-10-07 11:29:04.438115] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.988 [2024-10-07 11:29:04.440483] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.988 [2024-10-07 11:29:04.446180] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.988 [2024-10-07 11:29:04.446293] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.988 [2024-10-07 11:29:04.446349] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:33.988 [2024-10-07 11:29:04.446365] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:33.988 [2024-10-07 11:29:04.446432] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:33.988 [2024-10-07 11:29:04.446484] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.988 [2024-10-07 11:29:04.446505] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.988 [2024-10-07 11:29:04.446526] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.988 [2024-10-07 11:29:04.446550] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.988 [2024-10-07 11:29:04.446570] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.988 [2024-10-07 11:29:04.446635] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.988 [2024-10-07 11:29:04.446661] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.988 [2024-10-07 11:29:04.446677] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.988 [2024-10-07 11:29:04.446700] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.988 [2024-10-07 11:29:04.446736] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.988 [2024-10-07 11:29:04.446750] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.988 [2024-10-07 11:29:04.446778] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.988 [2024-10-07 11:29:04.446800] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.988 [2024-10-07 11:29:04.457587] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.988 [2024-10-07 11:29:04.457638] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.988 [2024-10-07 11:29:04.458342] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.988 [2024-10-07 11:29:04.458386] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:33.988 [2024-10-07 11:29:04.458405] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:33.988 [2024-10-07 11:29:04.458471] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.988 [2024-10-07 11:29:04.458505] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.988 [2024-10-07 11:29:04.458521] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.988 [2024-10-07 11:29:04.458772] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:33.988 [2024-10-07 11:29:04.458803] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.988 [2024-10-07 11:29:04.458853] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.988 [2024-10-07 11:29:04.458874] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.988 [2024-10-07 11:29:04.458888] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.988 [2024-10-07 11:29:04.458905] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.988 [2024-10-07 11:29:04.458919] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.988 [2024-10-07 11:29:04.458948] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.988 [2024-10-07 11:29:04.458975] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.988 [2024-10-07 11:29:04.458990] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.988 [2024-10-07 11:29:04.471510] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.988 [2024-10-07 11:29:04.471558] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.988 [2024-10-07 11:29:04.472460] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.988 [2024-10-07 11:29:04.472513] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.988 [2024-10-07 11:29:04.472533] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.988 [2024-10-07 11:29:04.472585] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.988 [2024-10-07 11:29:04.472609] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:33.988 [2024-10-07 11:29:04.472625] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:33.988 [2024-10-07 11:29:04.473002] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.988 [2024-10-07 11:29:04.473033] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:33.988 [2024-10-07 11:29:04.473240] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.988 [2024-10-07 11:29:04.473275] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.988 [2024-10-07 11:29:04.473292] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.988 [2024-10-07 11:29:04.473309] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.988 [2024-10-07 11:29:04.473323] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.988 [2024-10-07 11:29:04.473336] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.988 [2024-10-07 11:29:04.473561] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.988 [2024-10-07 11:29:04.473586] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.988 [2024-10-07 11:29:04.482769] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.988 [2024-10-07 11:29:04.482849] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.988 [2024-10-07 11:29:04.483057] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.988 [2024-10-07 11:29:04.483121] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:33.988 [2024-10-07 11:29:04.483140] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:33.988 [2024-10-07 11:29:04.483189] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.988 [2024-10-07 11:29:04.483227] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.989 [2024-10-07 11:29:04.483242] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.989 [2024-10-07 11:29:04.483350] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:33.989 [2024-10-07 11:29:04.483374] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.989 [2024-10-07 11:29:04.483525] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.989 [2024-10-07 11:29:04.483549] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.989 [2024-10-07 11:29:04.483563] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.989 [2024-10-07 11:29:04.483580] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.989 [2024-10-07 11:29:04.483594] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.989 [2024-10-07 11:29:04.483607] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.989 [2024-10-07 11:29:04.483716] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.989 [2024-10-07 11:29:04.483736] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.989 [2024-10-07 11:29:04.493971] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.989 [2024-10-07 11:29:04.494019] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.989 [2024-10-07 11:29:04.494211] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.989 [2024-10-07 11:29:04.494241] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.989 [2024-10-07 11:29:04.494258] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.989 [2024-10-07 11:29:04.494320] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.989 [2024-10-07 11:29:04.494342] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:33.989 [2024-10-07 11:29:04.494357] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:33.989 [2024-10-07 11:29:04.494531] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.989 [2024-10-07 11:29:04.494560] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:33.989 [2024-10-07 11:29:04.494609] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.989 [2024-10-07 11:29:04.494629] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.989 [2024-10-07 11:29:04.494643] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.989 [2024-10-07 11:29:04.494659] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.989 [2024-10-07 11:29:04.494673] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.989 [2024-10-07 11:29:04.494686] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.989 [2024-10-07 11:29:04.494708] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.989 [2024-10-07 11:29:04.494722] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.989 [2024-10-07 11:29:04.504290] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.989 [2024-10-07 11:29:04.504341] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.989 [2024-10-07 11:29:04.504455] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.989 [2024-10-07 11:29:04.504485] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:33.989 [2024-10-07 11:29:04.504502] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:33.989 [2024-10-07 11:29:04.504570] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.989 [2024-10-07 11:29:04.504594] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.989 [2024-10-07 11:29:04.504609] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.989 [2024-10-07 11:29:04.504634] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:33.989 [2024-10-07 11:29:04.504653] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.989 [2024-10-07 11:29:04.504673] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.989 [2024-10-07 11:29:04.504687] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.989 [2024-10-07 11:29:04.504701] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.989 [2024-10-07 11:29:04.504716] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.989 [2024-10-07 11:29:04.504730] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.989 [2024-10-07 11:29:04.504743] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.989 [2024-10-07 11:29:04.504765] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.989 [2024-10-07 11:29:04.504779] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.989 [2024-10-07 11:29:04.514416] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.989 [2024-10-07 11:29:04.514506] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.989 [2024-10-07 11:29:04.514582] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.989 [2024-10-07 11:29:04.514609] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.989 [2024-10-07 11:29:04.514625] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.989 [2024-10-07 11:29:04.514677] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.989 [2024-10-07 11:29:04.514700] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:33.989 [2024-10-07 11:29:04.514716] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:33.989 [2024-10-07 11:29:04.514733] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.989 [2024-10-07 11:29:04.515633] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:33.989 [2024-10-07 11:29:04.515669] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.989 [2024-10-07 11:29:04.515701] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.989 [2024-10-07 11:29:04.515715] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.989 [2024-10-07 11:29:04.515849] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.989 [2024-10-07 11:29:04.515871] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.989 [2024-10-07 11:29:04.515884] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.989 [2024-10-07 11:29:04.515897] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.989 [2024-10-07 11:29:04.515934] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.989 [2024-10-07 11:29:04.525889] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.989 [2024-10-07 11:29:04.525938] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.989 [2024-10-07 11:29:04.526247] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.989 [2024-10-07 11:29:04.526289] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.989 [2024-10-07 11:29:04.526314] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.989 [2024-10-07 11:29:04.526363] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.989 [2024-10-07 11:29:04.526386] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:33.989 [2024-10-07 11:29:04.526401] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:33.989 [2024-10-07 11:29:04.526619] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.989 [2024-10-07 11:29:04.526649] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:33.989 [2024-10-07 11:29:04.526704] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.989 [2024-10-07 11:29:04.526726] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.989 [2024-10-07 11:29:04.526740] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.989 [2024-10-07 11:29:04.526756] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.990 [2024-10-07 11:29:04.526770] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.990 [2024-10-07 11:29:04.526783] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.990 [2024-10-07 11:29:04.526963] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.990 [2024-10-07 11:29:04.526985] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.990 [2024-10-07 11:29:04.540598] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.990 [2024-10-07 11:29:04.540646] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.990 [2024-10-07 11:29:04.540738] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.990 [2024-10-07 11:29:04.540781] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:33.990 [2024-10-07 11:29:04.540797] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:33.990 [2024-10-07 11:29:04.540859] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.990 [2024-10-07 11:29:04.540881] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.990 [2024-10-07 11:29:04.540897] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.990 [2024-10-07 11:29:04.540921] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:33.990 [2024-10-07 11:29:04.540941] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.990 [2024-10-07 11:29:04.540960] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.990 [2024-10-07 11:29:04.540998] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.990 [2024-10-07 11:29:04.541014] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.990 [2024-10-07 11:29:04.541030] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.990 [2024-10-07 11:29:04.541044] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.990 [2024-10-07 11:29:04.541057] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.990 [2024-10-07 11:29:04.541081] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.990 [2024-10-07 11:29:04.541095] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.990 [2024-10-07 11:29:04.554771] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.990 [2024-10-07 11:29:04.554820] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.990 [2024-10-07 11:29:04.554915] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.990 [2024-10-07 11:29:04.554943] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.990 [2024-10-07 11:29:04.554960] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.990 [2024-10-07 11:29:04.555015] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.990 [2024-10-07 11:29:04.555037] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:33.990 [2024-10-07 11:29:04.555053] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:33.990 [2024-10-07 11:29:04.555633] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.990 [2024-10-07 11:29:04.555673] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:33.990 [2024-10-07 11:29:04.555767] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.990 [2024-10-07 11:29:04.555789] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.990 [2024-10-07 11:29:04.555803] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.990 [2024-10-07 11:29:04.555819] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.990 [2024-10-07 11:29:04.555833] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.990 [2024-10-07 11:29:04.555847] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.990 [2024-10-07 11:29:04.555870] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.990 [2024-10-07 11:29:04.555884] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.990 [2024-10-07 11:29:04.565873] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.990 [2024-10-07 11:29:04.565949] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.990 [2024-10-07 11:29:04.566190] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.990 [2024-10-07 11:29:04.566242] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:33.990 [2024-10-07 11:29:04.566268] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:33.990 [2024-10-07 11:29:04.566343] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.990 [2024-10-07 11:29:04.566402] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.990 [2024-10-07 11:29:04.566445] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.990 [2024-10-07 11:29:04.566574] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:33.990 [2024-10-07 11:29:04.566604] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.990 [2024-10-07 11:29:04.566734] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.990 [2024-10-07 11:29:04.566771] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.990 [2024-10-07 11:29:04.566793] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.990 [2024-10-07 11:29:04.566817] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.990 [2024-10-07 11:29:04.566836] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.990 [2024-10-07 11:29:04.566854] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.990 [2024-10-07 11:29:04.569291] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.990 [2024-10-07 11:29:04.569336] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.990 [2024-10-07 11:29:04.578034] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.990 [2024-10-07 11:29:04.578082] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.990 [2024-10-07 11:29:04.578280] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.990 [2024-10-07 11:29:04.578321] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.990 [2024-10-07 11:29:04.578341] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.990 [2024-10-07 11:29:04.578390] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.990 [2024-10-07 11:29:04.578427] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:33.990 [2024-10-07 11:29:04.578446] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:33.990 [2024-10-07 11:29:04.578605] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.990 [2024-10-07 11:29:04.578634] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:33.990 [2024-10-07 11:29:04.578753] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.990 [2024-10-07 11:29:04.578785] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.990 [2024-10-07 11:29:04.578801] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.990 [2024-10-07 11:29:04.578818] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.990 [2024-10-07 11:29:04.578832] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.990 [2024-10-07 11:29:04.578846] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.990 [2024-10-07 11:29:04.578958] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.990 [2024-10-07 11:29:04.578978] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.990 [2024-10-07 11:29:04.588733] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.990 [2024-10-07 11:29:04.588779] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.990 [2024-10-07 11:29:04.588981] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.990 [2024-10-07 11:29:04.589018] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:33.990 [2024-10-07 11:29:04.589037] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:33.990 [2024-10-07 11:29:04.589086] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.990 [2024-10-07 11:29:04.589108] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.990 [2024-10-07 11:29:04.589124] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.990 [2024-10-07 11:29:04.589226] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:33.990 [2024-10-07 11:29:04.589250] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.990 [2024-10-07 11:29:04.589345] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.990 [2024-10-07 11:29:04.589364] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.990 [2024-10-07 11:29:04.589378] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.990 [2024-10-07 11:29:04.589394] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.990 [2024-10-07 11:29:04.589421] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.990 [2024-10-07 11:29:04.589437] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.990 [2024-10-07 11:29:04.591555] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.990 [2024-10-07 11:29:04.591593] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.990 [2024-10-07 11:29:04.604121] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.990 [2024-10-07 11:29:04.604170] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.991 [2024-10-07 11:29:04.606002] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.991 [2024-10-07 11:29:04.606045] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.991 [2024-10-07 11:29:04.606065] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.991 [2024-10-07 11:29:04.606115] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.991 [2024-10-07 11:29:04.606138] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:33.991 [2024-10-07 11:29:04.606153] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:33.991 [2024-10-07 11:29:04.607093] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.991 [2024-10-07 11:29:04.607140] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:33.991 [2024-10-07 11:29:04.607431] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.991 [2024-10-07 11:29:04.607467] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.991 [2024-10-07 11:29:04.607499] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.991 [2024-10-07 11:29:04.607518] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.991 [2024-10-07 11:29:04.607544] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.991 [2024-10-07 11:29:04.607557] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.991 [2024-10-07 11:29:04.607614] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.991 [2024-10-07 11:29:04.607635] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.991 [2024-10-07 11:29:04.615562] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.991 [2024-10-07 11:29:04.615612] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.991 [2024-10-07 11:29:04.620406] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.991 [2024-10-07 11:29:04.620478] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:33.991 [2024-10-07 11:29:04.620499] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:33.991 [2024-10-07 11:29:04.620551] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.991 [2024-10-07 11:29:04.620573] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.991 [2024-10-07 11:29:04.620589] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.991 [2024-10-07 11:29:04.621444] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:33.991 [2024-10-07 11:29:04.621512] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.991 [2024-10-07 11:29:04.621933] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.991 [2024-10-07 11:29:04.621979] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.991 [2024-10-07 11:29:04.621997] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.991 [2024-10-07 11:29:04.622015] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.991 [2024-10-07 11:29:04.622029] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.991 [2024-10-07 11:29:04.622042] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.991 [2024-10-07 11:29:04.622335] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.991 [2024-10-07 11:29:04.622395] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.991 [2024-10-07 11:29:04.626020] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.991 [2024-10-07 11:29:04.626066] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.991 [2024-10-07 11:29:04.626151] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.991 [2024-10-07 11:29:04.626179] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.991 [2024-10-07 11:29:04.626196] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.991 [2024-10-07 11:29:04.626243] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.991 [2024-10-07 11:29:04.626266] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:33.991 [2024-10-07 11:29:04.626324] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:33.991 [2024-10-07 11:29:04.626348] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.991 [2024-10-07 11:29:04.626366] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:33.991 [2024-10-07 11:29:04.626401] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.991 [2024-10-07 11:29:04.626416] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.991 [2024-10-07 11:29:04.626429] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.991 [2024-10-07 11:29:04.626459] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.991 [2024-10-07 11:29:04.626476] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.991 [2024-10-07 11:29:04.626489] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.991 [2024-10-07 11:29:04.626512] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.991 [2024-10-07 11:29:04.626526] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.991 [2024-10-07 11:29:04.636127] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.991 [2024-10-07 11:29:04.636192] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.991 [2024-10-07 11:29:04.636267] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.991 [2024-10-07 11:29:04.636295] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:33.991 [2024-10-07 11:29:04.636312] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:33.991 [2024-10-07 11:29:04.636366] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.991 [2024-10-07 11:29:04.636389] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.991 [2024-10-07 11:29:04.636404] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.991 [2024-10-07 11:29:04.636437] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:33.991 [2024-10-07 11:29:04.636463] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.991 [2024-10-07 11:29:04.636480] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.991 [2024-10-07 11:29:04.636493] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.991 [2024-10-07 11:29:04.636507] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.991 [2024-10-07 11:29:04.636529] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.991 [2024-10-07 11:29:04.636543] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.991 [2024-10-07 11:29:04.636556] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.991 [2024-10-07 11:29:04.636569] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.991 [2024-10-07 11:29:04.636597] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.991 [2024-10-07 11:29:04.649310] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.991 [2024-10-07 11:29:04.649373] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.991 [2024-10-07 11:29:04.650023] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.991 [2024-10-07 11:29:04.650068] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:33.991 [2024-10-07 11:29:04.650087] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:33.991 [2024-10-07 11:29:04.650135] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.991 [2024-10-07 11:29:04.650158] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.991 [2024-10-07 11:29:04.650173] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.991 [2024-10-07 11:29:04.650579] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:33.991 [2024-10-07 11:29:04.650649] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.991 [2024-10-07 11:29:04.650861] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.991 [2024-10-07 11:29:04.650895] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.992 [2024-10-07 11:29:04.650911] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.992 [2024-10-07 11:29:04.650943] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.992 [2024-10-07 11:29:04.650957] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.992 [2024-10-07 11:29:04.650969] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.992 [2024-10-07 11:29:04.651046] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.992 [2024-10-07 11:29:04.651066] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.992 [2024-10-07 11:29:04.663281] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.992 [2024-10-07 11:29:04.663333] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.992 [2024-10-07 11:29:04.663602] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.992 [2024-10-07 11:29:04.663633] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.992 [2024-10-07 11:29:04.663650] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.992 [2024-10-07 11:29:04.663697] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.992 [2024-10-07 11:29:04.663720] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:33.992 [2024-10-07 11:29:04.663735] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:33.992 [2024-10-07 11:29:04.663837] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.992 [2024-10-07 11:29:04.663861] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:33.992 [2024-10-07 11:29:04.663957] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.992 [2024-10-07 11:29:04.663975] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.992 [2024-10-07 11:29:04.663989] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.992 [2024-10-07 11:29:04.664021] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.992 [2024-10-07 11:29:04.664037] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.992 [2024-10-07 11:29:04.664050] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.992 [2024-10-07 11:29:04.664407] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.992 [2024-10-07 11:29:04.664455] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.992 [2024-10-07 11:29:04.673396] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.992 [2024-10-07 11:29:04.673469] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.992 [2024-10-07 11:29:04.673546] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.992 [2024-10-07 11:29:04.673574] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:33.992 [2024-10-07 11:29:04.673590] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:33.992 [2024-10-07 11:29:04.673645] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.992 [2024-10-07 11:29:04.673668] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.992 [2024-10-07 11:29:04.673684] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.992 [2024-10-07 11:29:04.673702] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:33.992 [2024-10-07 11:29:04.673726] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.992 [2024-10-07 11:29:04.673743] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.992 [2024-10-07 11:29:04.673756] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.992 [2024-10-07 11:29:04.673770] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.992 [2024-10-07 11:29:04.673792] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.992 [2024-10-07 11:29:04.673806] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.992 [2024-10-07 11:29:04.673819] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.992 [2024-10-07 11:29:04.673833] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.992 [2024-10-07 11:29:04.675337] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.992 [2024-10-07 11:29:04.683487] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.992 [2024-10-07 11:29:04.683594] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.992 [2024-10-07 11:29:04.683625] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:33.992 [2024-10-07 11:29:04.683643] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:33.992 [2024-10-07 11:29:04.683680] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:33.992 [2024-10-07 11:29:04.686126] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.992 [2024-10-07 11:29:04.686187] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.992 [2024-10-07 11:29:04.686205] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.992 [2024-10-07 11:29:04.686235] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.992 [2024-10-07 11:29:04.686821] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.992 [2024-10-07 11:29:04.686902] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.992 [2024-10-07 11:29:04.686929] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.992 [2024-10-07 11:29:04.686947] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.992 [2024-10-07 11:29:04.687296] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.992 [2024-10-07 11:29:04.687481] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.992 [2024-10-07 11:29:04.687514] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.992 [2024-10-07 11:29:04.687530] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.992 [2024-10-07 11:29:04.687663] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.992 [2024-10-07 11:29:04.693566] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.992 [2024-10-07 11:29:04.693671] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.992 [2024-10-07 11:29:04.693701] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:33.992 [2024-10-07 11:29:04.693718] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:33.992 [2024-10-07 11:29:04.693741] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:33.992 [2024-10-07 11:29:04.693763] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.992 [2024-10-07 11:29:04.693777] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.992 [2024-10-07 11:29:04.693791] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.992 [2024-10-07 11:29:04.693813] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.992 [2024-10-07 11:29:04.698495] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.992 [2024-10-07 11:29:04.698706] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.992 [2024-10-07 11:29:04.698738] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.992 [2024-10-07 11:29:04.698756] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.992 [2024-10-07 11:29:04.698866] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.992 [2024-10-07 11:29:04.698971] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.992 [2024-10-07 11:29:04.698989] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.992 [2024-10-07 11:29:04.699004] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.992 [2024-10-07 11:29:04.699108] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.992 [2024-10-07 11:29:04.703644] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.992 [2024-10-07 11:29:04.703745] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.992 [2024-10-07 11:29:04.703796] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:33.992 [2024-10-07 11:29:04.703816] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:33.992 [2024-10-07 11:29:04.706375] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:33.992 [2024-10-07 11:29:04.707326] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.992 [2024-10-07 11:29:04.707364] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.992 [2024-10-07 11:29:04.707381] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.992 [2024-10-07 11:29:04.707505] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.992 [2024-10-07 11:29:04.708577] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.992 [2024-10-07 11:29:04.708680] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.992 [2024-10-07 11:29:04.708710] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.992 [2024-10-07 11:29:04.708731] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.992 [2024-10-07 11:29:04.708756] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.992 [2024-10-07 11:29:04.708778] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.992 [2024-10-07 11:29:04.708792] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.992 [2024-10-07 11:29:04.708805] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.992 [2024-10-07 11:29:04.708828] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.992 [2024-10-07 11:29:04.713722] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.992 [2024-10-07 11:29:04.713822] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.993 [2024-10-07 11:29:04.713851] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:33.993 [2024-10-07 11:29:04.713873] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:33.993 [2024-10-07 11:29:04.713896] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:33.993 [2024-10-07 11:29:04.713918] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.993 [2024-10-07 11:29:04.713932] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.993 [2024-10-07 11:29:04.713946] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.993 [2024-10-07 11:29:04.713978] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.993 [2024-10-07 11:29:04.722371] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.993 [2024-10-07 11:29:04.722484] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.993 [2024-10-07 11:29:04.722514] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.993 [2024-10-07 11:29:04.722531] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.993 [2024-10-07 11:29:04.722555] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.993 [2024-10-07 11:29:04.722597] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.993 [2024-10-07 11:29:04.722614] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.993 [2024-10-07 11:29:04.722627] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.993 [2024-10-07 11:29:04.722651] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.993 [2024-10-07 11:29:04.723923] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.993 [2024-10-07 11:29:04.724510] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.993 [2024-10-07 11:29:04.724554] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:33.993 [2024-10-07 11:29:04.724573] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:33.993 [2024-10-07 11:29:04.724824] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:33.993 [2024-10-07 11:29:04.725039] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.993 [2024-10-07 11:29:04.725065] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.993 [2024-10-07 11:29:04.725082] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.993 [2024-10-07 11:29:04.725144] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.993 [2024-10-07 11:29:04.737330] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.993 [2024-10-07 11:29:04.737486] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.993 [2024-10-07 11:29:04.737572] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.993 [2024-10-07 11:29:04.737600] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.993 [2024-10-07 11:29:04.737618] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.993 [2024-10-07 11:29:04.737674] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.993 [2024-10-07 11:29:04.737698] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:33.993 [2024-10-07 11:29:04.737714] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:33.993 [2024-10-07 11:29:04.737732] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.993 [2024-10-07 11:29:04.737756] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:33.993 [2024-10-07 11:29:04.737773] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.993 [2024-10-07 11:29:04.737787] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.993 [2024-10-07 11:29:04.737800] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.993 [2024-10-07 11:29:04.737823] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.993 [2024-10-07 11:29:04.737838] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.993 [2024-10-07 11:29:04.737851] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.993 [2024-10-07 11:29:04.737864] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.993 [2024-10-07 11:29:04.737885] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.993 [2024-10-07 11:29:04.750061] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.993 [2024-10-07 11:29:04.750111] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.993 [2024-10-07 11:29:04.750238] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.993 [2024-10-07 11:29:04.750268] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.993 [2024-10-07 11:29:04.750286] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.993 [2024-10-07 11:29:04.750332] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.993 [2024-10-07 11:29:04.750354] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:33.993 [2024-10-07 11:29:04.750370] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:33.993 [2024-10-07 11:29:04.750422] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.993 [2024-10-07 11:29:04.750448] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:33.993 [2024-10-07 11:29:04.750476] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.993 [2024-10-07 11:29:04.750490] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.993 [2024-10-07 11:29:04.750504] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.993 [2024-10-07 11:29:04.750520] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.993 [2024-10-07 11:29:04.750535] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.993 [2024-10-07 11:29:04.750547] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.993 [2024-10-07 11:29:04.750570] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.993 [2024-10-07 11:29:04.750584] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.993 [2024-10-07 11:29:04.764192] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.993 [2024-10-07 11:29:04.764244] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.993 [2024-10-07 11:29:04.764711] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.993 [2024-10-07 11:29:04.764754] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:33.993 [2024-10-07 11:29:04.764772] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:33.993 [2024-10-07 11:29:04.764823] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.993 [2024-10-07 11:29:04.764846] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.993 [2024-10-07 11:29:04.764861] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.993 [2024-10-07 11:29:04.764927] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:33.993 [2024-10-07 11:29:04.764953] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.993 [2024-10-07 11:29:04.764974] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.993 [2024-10-07 11:29:04.764988] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.993 [2024-10-07 11:29:04.765018] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.993 [2024-10-07 11:29:04.765036] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.993 [2024-10-07 11:29:04.765050] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.993 [2024-10-07 11:29:04.765063] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.993 [2024-10-07 11:29:04.765087] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.993 [2024-10-07 11:29:04.765101] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.993 [2024-10-07 11:29:04.776399] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.993 [2024-10-07 11:29:04.776465] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.993 [2024-10-07 11:29:04.776683] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.993 [2024-10-07 11:29:04.776714] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.993 [2024-10-07 11:29:04.776732] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.993 [2024-10-07 11:29:04.776779] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.993 [2024-10-07 11:29:04.776801] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:33.993 [2024-10-07 11:29:04.776816] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:33.993 [2024-10-07 11:29:04.776953] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.993 [2024-10-07 11:29:04.776981] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:33.993 [2024-10-07 11:29:04.777089] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.993 [2024-10-07 11:29:04.777110] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.993 [2024-10-07 11:29:04.777124] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.993 [2024-10-07 11:29:04.777140] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.993 [2024-10-07 11:29:04.777155] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.993 [2024-10-07 11:29:04.777168] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.993 [2024-10-07 11:29:04.777268] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.993 [2024-10-07 11:29:04.777286] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.994 [2024-10-07 11:29:04.787906] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.994 [2024-10-07 11:29:04.787956] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.994 [2024-10-07 11:29:04.788150] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.994 [2024-10-07 11:29:04.788181] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:33.994 [2024-10-07 11:29:04.788198] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:33.994 [2024-10-07 11:29:04.788245] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.994 [2024-10-07 11:29:04.788267] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.994 [2024-10-07 11:29:04.788303] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.994 [2024-10-07 11:29:04.788451] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:33.994 [2024-10-07 11:29:04.788481] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.994 [2024-10-07 11:29:04.788592] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.994 [2024-10-07 11:29:04.788613] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.994 [2024-10-07 11:29:04.788627] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.994 [2024-10-07 11:29:04.788650] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.994 [2024-10-07 11:29:04.788664] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.994 [2024-10-07 11:29:04.788677] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.994 [2024-10-07 11:29:04.789101] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.994 [2024-10-07 11:29:04.789137] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.994 [2024-10-07 11:29:04.798020] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.994 [2024-10-07 11:29:04.798085] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.994 [2024-10-07 11:29:04.798165] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.994 [2024-10-07 11:29:04.798194] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.994 [2024-10-07 11:29:04.798212] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.994 [2024-10-07 11:29:04.798266] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.994 [2024-10-07 11:29:04.798290] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:33.994 [2024-10-07 11:29:04.798305] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:33.994 [2024-10-07 11:29:04.798324] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.994 [2024-10-07 11:29:04.798347] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:33.994 [2024-10-07 11:29:04.798365] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.994 [2024-10-07 11:29:04.798378] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.994 [2024-10-07 11:29:04.798392] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.994 [2024-10-07 11:29:04.798429] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.994 [2024-10-07 11:29:04.798447] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.994 [2024-10-07 11:29:04.798460] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.994 [2024-10-07 11:29:04.798473] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.994 [2024-10-07 11:29:04.798494] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.994 [2024-10-07 11:29:04.810846] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.994 [2024-10-07 11:29:04.810910] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.994 [2024-10-07 11:29:04.811270] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.994 [2024-10-07 11:29:04.811312] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.994 [2024-10-07 11:29:04.811332] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.994 [2024-10-07 11:29:04.811382] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.994 [2024-10-07 11:29:04.811405] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:33.994 [2024-10-07 11:29:04.811435] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:33.994 [2024-10-07 11:29:04.811566] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.994 [2024-10-07 11:29:04.811594] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:33.994 [2024-10-07 11:29:04.811656] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.994 [2024-10-07 11:29:04.811679] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.994 [2024-10-07 11:29:04.811693] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.994 [2024-10-07 11:29:04.811710] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.994 [2024-10-07 11:29:04.811724] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.994 [2024-10-07 11:29:04.811737] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.994 [2024-10-07 11:29:04.811784] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.994 [2024-10-07 11:29:04.811804] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.994 [2024-10-07 11:29:04.822353] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.994 [2024-10-07 11:29:04.822402] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.994 [2024-10-07 11:29:04.822612] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.994 [2024-10-07 11:29:04.822642] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:33.994 [2024-10-07 11:29:04.822659] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:33.994 [2024-10-07 11:29:04.822706] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.994 [2024-10-07 11:29:04.822729] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.994 [2024-10-07 11:29:04.822744] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.994 [2024-10-07 11:29:04.822896] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:33.994 [2024-10-07 11:29:04.822925] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.994 [2024-10-07 11:29:04.823049] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.994 [2024-10-07 11:29:04.823071] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.994 [2024-10-07 11:29:04.823086] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.994 [2024-10-07 11:29:04.823117] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.994 [2024-10-07 11:29:04.823134] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.994 [2024-10-07 11:29:04.823147] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.994 [2024-10-07 11:29:04.823275] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.994 [2024-10-07 11:29:04.823296] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.994 [2024-10-07 11:29:04.833011] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.994 [2024-10-07 11:29:04.833059] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.994 [2024-10-07 11:29:04.833142] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.994 [2024-10-07 11:29:04.833170] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.994 [2024-10-07 11:29:04.833186] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.994 [2024-10-07 11:29:04.833232] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.994 [2024-10-07 11:29:04.833254] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:33.994 [2024-10-07 11:29:04.833270] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:33.994 [2024-10-07 11:29:04.833293] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.994 [2024-10-07 11:29:04.833314] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:33.994 [2024-10-07 11:29:04.833334] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.994 [2024-10-07 11:29:04.833348] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.994 [2024-10-07 11:29:04.833361] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.994 [2024-10-07 11:29:04.833378] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.994 [2024-10-07 11:29:04.833391] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.994 [2024-10-07 11:29:04.833404] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.994 [2024-10-07 11:29:04.833443] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.994 [2024-10-07 11:29:04.833458] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.994 [2024-10-07 11:29:04.844109] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.994 [2024-10-07 11:29:04.844158] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.994 [2024-10-07 11:29:04.845044] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.994 [2024-10-07 11:29:04.845086] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:33.994 [2024-10-07 11:29:04.845106] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:33.994 [2024-10-07 11:29:04.845154] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.994 [2024-10-07 11:29:04.845177] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.994 [2024-10-07 11:29:04.845192] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.995 [2024-10-07 11:29:04.845461] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:33.995 [2024-10-07 11:29:04.845494] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.995 [2024-10-07 11:29:04.845653] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.995 [2024-10-07 11:29:04.845679] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.995 [2024-10-07 11:29:04.845693] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.995 [2024-10-07 11:29:04.845709] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.995 [2024-10-07 11:29:04.845723] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.995 [2024-10-07 11:29:04.845737] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.995 [2024-10-07 11:29:04.845787] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.995 [2024-10-07 11:29:04.845807] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.995 [2024-10-07 11:29:04.855370] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.995 [2024-10-07 11:29:04.855438] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.995 [2024-10-07 11:29:04.855561] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.995 [2024-10-07 11:29:04.855592] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.995 [2024-10-07 11:29:04.855611] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.995 [2024-10-07 11:29:04.855658] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.995 [2024-10-07 11:29:04.855680] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:33.995 [2024-10-07 11:29:04.855696] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:33.995 [2024-10-07 11:29:04.855728] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.995 [2024-10-07 11:29:04.855748] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:33.995 [2024-10-07 11:29:04.855767] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.995 [2024-10-07 11:29:04.855782] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.995 [2024-10-07 11:29:04.855796] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.995 [2024-10-07 11:29:04.855812] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.995 [2024-10-07 11:29:04.855826] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.995 [2024-10-07 11:29:04.855839] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.995 [2024-10-07 11:29:04.855862] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.995 [2024-10-07 11:29:04.855876] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.995 [2024-10-07 11:29:04.868652] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.995 [2024-10-07 11:29:04.868700] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.995 [2024-10-07 11:29:04.868940] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.995 [2024-10-07 11:29:04.868978] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:33.995 [2024-10-07 11:29:04.868997] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:33.995 [2024-10-07 11:29:04.869045] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.995 [2024-10-07 11:29:04.869067] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.995 [2024-10-07 11:29:04.869083] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.995 [2024-10-07 11:29:04.869268] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:33.995 [2024-10-07 11:29:04.869298] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.995 [2024-10-07 11:29:04.869437] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.995 [2024-10-07 11:29:04.869462] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.995 [2024-10-07 11:29:04.869477] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.995 [2024-10-07 11:29:04.869494] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.995 [2024-10-07 11:29:04.869507] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.995 [2024-10-07 11:29:04.869521] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.995 [2024-10-07 11:29:04.869622] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.995 [2024-10-07 11:29:04.869640] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.995 [2024-10-07 11:29:04.881708] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.995 [2024-10-07 11:29:04.881757] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.995 [2024-10-07 11:29:04.882924] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.995 [2024-10-07 11:29:04.882966] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.995 [2024-10-07 11:29:04.882986] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.995 [2024-10-07 11:29:04.883035] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.995 [2024-10-07 11:29:04.883058] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:33.995 [2024-10-07 11:29:04.883074] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:33.995 [2024-10-07 11:29:04.884160] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.995 [2024-10-07 11:29:04.884201] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:33.995 [2024-10-07 11:29:04.884671] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.995 [2024-10-07 11:29:04.884711] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.995 [2024-10-07 11:29:04.884728] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.995 [2024-10-07 11:29:04.884746] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.995 [2024-10-07 11:29:04.884786] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.995 [2024-10-07 11:29:04.884800] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.995 [2024-10-07 11:29:04.884875] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.995 [2024-10-07 11:29:04.884896] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.995 [2024-10-07 11:29:04.893518] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.995 [2024-10-07 11:29:04.893570] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.995 [2024-10-07 11:29:04.893749] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.995 [2024-10-07 11:29:04.893780] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:33.995 [2024-10-07 11:29:04.893797] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:33.995 [2024-10-07 11:29:04.893844] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.995 [2024-10-07 11:29:04.893867] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.995 [2024-10-07 11:29:04.893883] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.995 [2024-10-07 11:29:04.894017] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:33.995 [2024-10-07 11:29:04.894045] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.995 [2024-10-07 11:29:04.894146] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.995 [2024-10-07 11:29:04.894165] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.995 [2024-10-07 11:29:04.894179] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.995 [2024-10-07 11:29:04.894195] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.995 [2024-10-07 11:29:04.894209] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.995 [2024-10-07 11:29:04.894223] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.995 [2024-10-07 11:29:04.896497] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.995 [2024-10-07 11:29:04.896535] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.995 [2024-10-07 11:29:04.903638] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.995 [2024-10-07 11:29:04.903703] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.995 [2024-10-07 11:29:04.903782] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.995 [2024-10-07 11:29:04.903810] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.995 [2024-10-07 11:29:04.903828] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.995 [2024-10-07 11:29:04.903885] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.995 [2024-10-07 11:29:04.903920] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:33.995 [2024-10-07 11:29:04.903949] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:33.995 [2024-10-07 11:29:04.903971] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.995 [2024-10-07 11:29:04.904014] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:33.995 [2024-10-07 11:29:04.904032] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.995 [2024-10-07 11:29:04.904046] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.995 [2024-10-07 11:29:04.904059] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.995 [2024-10-07 11:29:04.904083] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.995 [2024-10-07 11:29:04.904098] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.995 [2024-10-07 11:29:04.904111] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.996 [2024-10-07 11:29:04.904125] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.996 [2024-10-07 11:29:04.904145] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.996 [2024-10-07 11:29:04.913718] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.996 [2024-10-07 11:29:04.913853] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.996 [2024-10-07 11:29:04.913885] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.996 [2024-10-07 11:29:04.913902] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.996 [2024-10-07 11:29:04.914193] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.996 [2024-10-07 11:29:04.914462] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.996 [2024-10-07 11:29:04.914510] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.996 [2024-10-07 11:29:04.914528] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.996 [2024-10-07 11:29:04.914543] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.996 [2024-10-07 11:29:04.914656] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.996 [2024-10-07 11:29:04.914734] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.996 [2024-10-07 11:29:04.914759] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:33.996 [2024-10-07 11:29:04.914775] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:33.996 [2024-10-07 11:29:04.914891] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:33.996 [2024-10-07 11:29:04.914999] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.996 [2024-10-07 11:29:04.915024] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.996 [2024-10-07 11:29:04.915038] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.996 [2024-10-07 11:29:04.915084] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.996 [2024-10-07 11:29:04.925055] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.996 [2024-10-07 11:29:04.925107] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.996 [2024-10-07 11:29:04.925843] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.996 [2024-10-07 11:29:04.925889] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.996 [2024-10-07 11:29:04.925926] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.996 [2024-10-07 11:29:04.925990] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.996 [2024-10-07 11:29:04.926015] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:33.996 [2024-10-07 11:29:04.926031] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:33.996 [2024-10-07 11:29:04.926125] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.996 [2024-10-07 11:29:04.926151] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:33.996 [2024-10-07 11:29:04.926172] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.996 [2024-10-07 11:29:04.926187] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.996 [2024-10-07 11:29:04.926201] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.996 [2024-10-07 11:29:04.926218] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.996 [2024-10-07 11:29:04.926232] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.996 [2024-10-07 11:29:04.926245] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.996 [2024-10-07 11:29:04.926277] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.996 [2024-10-07 11:29:04.926292] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.996 [2024-10-07 11:29:04.935173] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.996 [2024-10-07 11:29:04.935237] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.996 [2024-10-07 11:29:04.935311] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.996 [2024-10-07 11:29:04.935339] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:33.996 [2024-10-07 11:29:04.935355] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:33.996 [2024-10-07 11:29:04.935793] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.996 [2024-10-07 11:29:04.935834] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.996 [2024-10-07 11:29:04.935853] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.996 [2024-10-07 11:29:04.935872] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:33.996 [2024-10-07 11:29:04.935940] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.996 [2024-10-07 11:29:04.935963] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.996 [2024-10-07 11:29:04.935978] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.996 [2024-10-07 11:29:04.935992] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.996 [2024-10-07 11:29:04.938231] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.996 [2024-10-07 11:29:04.938271] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.996 [2024-10-07 11:29:04.938308] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.996 [2024-10-07 11:29:04.938339] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.996 [2024-10-07 11:29:04.939068] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.996 [2024-10-07 11:29:04.945645] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.996 [2024-10-07 11:29:04.945710] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.996 [2024-10-07 11:29:04.945944] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.996 [2024-10-07 11:29:04.945998] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:33.996 [2024-10-07 11:29:04.946016] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:33.996 [2024-10-07 11:29:04.946065] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.996 [2024-10-07 11:29:04.946087] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.996 [2024-10-07 11:29:04.946103] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.996 [2024-10-07 11:29:04.946227] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:33.996 [2024-10-07 11:29:04.946255] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.996 [2024-10-07 11:29:04.946363] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.996 [2024-10-07 11:29:04.946383] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.996 [2024-10-07 11:29:04.946398] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.996 [2024-10-07 11:29:04.946442] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.996 [2024-10-07 11:29:04.946459] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.996 [2024-10-07 11:29:04.946472] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.996 [2024-10-07 11:29:04.947943] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.996 [2024-10-07 11:29:04.947979] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.996 [2024-10-07 11:29:04.956105] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.996 [2024-10-07 11:29:04.956151] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.996 [2024-10-07 11:29:04.956235] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.996 [2024-10-07 11:29:04.956264] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.996 [2024-10-07 11:29:04.956281] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.996 [2024-10-07 11:29:04.956327] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.996 [2024-10-07 11:29:04.956349] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:33.996 [2024-10-07 11:29:04.956366] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:33.996 [2024-10-07 11:29:04.956566] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.996 [2024-10-07 11:29:04.956596] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:33.996 [2024-10-07 11:29:04.956667] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.996 [2024-10-07 11:29:04.956689] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.996 [2024-10-07 11:29:04.956704] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.997 [2024-10-07 11:29:04.956721] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.997 [2024-10-07 11:29:04.956735] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.997 [2024-10-07 11:29:04.956748] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.997 [2024-10-07 11:29:04.956771] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.997 [2024-10-07 11:29:04.956785] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.997 [2024-10-07 11:29:04.969279] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.997 [2024-10-07 11:29:04.969332] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.997 [2024-10-07 11:29:04.969627] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.997 [2024-10-07 11:29:04.969670] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:33.997 [2024-10-07 11:29:04.969689] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:33.997 [2024-10-07 11:29:04.969738] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.997 [2024-10-07 11:29:04.969761] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.997 [2024-10-07 11:29:04.969776] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.997 [2024-10-07 11:29:04.969990] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:33.997 [2024-10-07 11:29:04.970021] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.997 [2024-10-07 11:29:04.970078] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.997 [2024-10-07 11:29:04.970099] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.997 [2024-10-07 11:29:04.970114] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.997 [2024-10-07 11:29:04.970131] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.997 [2024-10-07 11:29:04.970145] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.997 [2024-10-07 11:29:04.970158] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.997 [2024-10-07 11:29:04.970182] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.997 [2024-10-07 11:29:04.970196] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.997 [2024-10-07 11:29:04.979781] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.997 [2024-10-07 11:29:04.979845] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.997 [2024-10-07 11:29:04.980151] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.997 [2024-10-07 11:29:04.980184] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.997 [2024-10-07 11:29:04.980231] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.997 [2024-10-07 11:29:04.980284] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.997 [2024-10-07 11:29:04.980308] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:33.997 [2024-10-07 11:29:04.980323] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:33.997 [2024-10-07 11:29:04.980403] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.997 [2024-10-07 11:29:04.980939] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:33.997 [2024-10-07 11:29:04.981801] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.997 [2024-10-07 11:29:04.981836] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.997 [2024-10-07 11:29:04.981853] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.997 [2024-10-07 11:29:04.981872] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.997 [2024-10-07 11:29:04.981887] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.997 [2024-10-07 11:29:04.981900] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.997 [2024-10-07 11:29:04.985602] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.997 [2024-10-07 11:29:04.985641] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.997 [2024-10-07 11:29:04.989909] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.997 [2024-10-07 11:29:04.989997] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.997 [2024-10-07 11:29:04.990074] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.997 [2024-10-07 11:29:04.990103] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:33.997 [2024-10-07 11:29:04.990120] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:33.997 [2024-10-07 11:29:04.990173] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.997 [2024-10-07 11:29:04.990197] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.997 [2024-10-07 11:29:04.990212] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.997 [2024-10-07 11:29:04.990232] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:33.997 [2024-10-07 11:29:04.990256] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.997 [2024-10-07 11:29:04.990273] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.997 [2024-10-07 11:29:04.990287] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.997 [2024-10-07 11:29:04.990300] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.997 [2024-10-07 11:29:04.990323] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.997 [2024-10-07 11:29:04.990338] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.997 [2024-10-07 11:29:04.990351] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.997 [2024-10-07 11:29:04.990379] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.997 [2024-10-07 11:29:04.990403] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.997 [2024-10-07 11:29:05.004235] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.997 [2024-10-07 11:29:05.004296] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.997 [2024-10-07 11:29:05.004486] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.997 [2024-10-07 11:29:05.004518] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:33.997 [2024-10-07 11:29:05.004535] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:33.997 [2024-10-07 11:29:05.004582] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.997 [2024-10-07 11:29:05.004605] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.997 [2024-10-07 11:29:05.004621] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.997 [2024-10-07 11:29:05.004646] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:33.997 [2024-10-07 11:29:05.004666] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.997 [2024-10-07 11:29:05.004686] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.997 [2024-10-07 11:29:05.004700] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.997 [2024-10-07 11:29:05.004714] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.997 [2024-10-07 11:29:05.004730] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.997 [2024-10-07 11:29:05.004745] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.997 [2024-10-07 11:29:05.004757] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.997 [2024-10-07 11:29:05.004781] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.997 [2024-10-07 11:29:05.004795] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.997 [2024-10-07 11:29:05.017272] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.997 [2024-10-07 11:29:05.017326] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.997 [2024-10-07 11:29:05.017428] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.997 [2024-10-07 11:29:05.017458] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.997 [2024-10-07 11:29:05.017476] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.997 [2024-10-07 11:29:05.017525] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.997 [2024-10-07 11:29:05.017548] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:33.997 [2024-10-07 11:29:05.017564] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:33.997 [2024-10-07 11:29:05.018150] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.997 [2024-10-07 11:29:05.018217] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:33.997 [2024-10-07 11:29:05.018317] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.997 [2024-10-07 11:29:05.018370] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.997 [2024-10-07 11:29:05.018386] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.997 [2024-10-07 11:29:05.018404] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.997 [2024-10-07 11:29:05.018434] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.997 [2024-10-07 11:29:05.018449] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.997 [2024-10-07 11:29:05.018474] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.997 [2024-10-07 11:29:05.018489] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.997 [2024-10-07 11:29:05.027878] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.997 [2024-10-07 11:29:05.027926] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.997 [2024-10-07 11:29:05.028101] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.998 [2024-10-07 11:29:05.028131] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:33.998 [2024-10-07 11:29:05.028148] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:33.998 [2024-10-07 11:29:05.028196] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.998 [2024-10-07 11:29:05.028219] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.998 [2024-10-07 11:29:05.028235] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.998 [2024-10-07 11:29:05.028367] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:33.998 [2024-10-07 11:29:05.028395] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.998 [2024-10-07 11:29:05.028554] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.998 [2024-10-07 11:29:05.028580] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.998 [2024-10-07 11:29:05.028595] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.998 [2024-10-07 11:29:05.028612] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.998 [2024-10-07 11:29:05.028626] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.998 [2024-10-07 11:29:05.028639] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.998 [2024-10-07 11:29:05.028993] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.998 [2024-10-07 11:29:05.029016] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.998 [2024-10-07 11:29:05.038011] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.998 [2024-10-07 11:29:05.038082] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.998 [2024-10-07 11:29:05.038163] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.998 [2024-10-07 11:29:05.038193] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.998 [2024-10-07 11:29:05.038210] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.998 [2024-10-07 11:29:05.038285] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.998 [2024-10-07 11:29:05.038311] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:33.998 [2024-10-07 11:29:05.038328] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:33.998 [2024-10-07 11:29:05.038346] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.998 [2024-10-07 11:29:05.038371] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:33.998 [2024-10-07 11:29:05.038387] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.998 [2024-10-07 11:29:05.038401] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.998 [2024-10-07 11:29:05.038429] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.998 [2024-10-07 11:29:05.038456] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.998 [2024-10-07 11:29:05.038471] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.998 [2024-10-07 11:29:05.038484] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.998 [2024-10-07 11:29:05.038497] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.998 [2024-10-07 11:29:05.038526] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.998 [2024-10-07 11:29:05.049300] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.998 [2024-10-07 11:29:05.049350] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.998 [2024-10-07 11:29:05.049492] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.998 [2024-10-07 11:29:05.049523] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.998 [2024-10-07 11:29:05.049540] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.998 [2024-10-07 11:29:05.049587] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.998 [2024-10-07 11:29:05.049610] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:33.998 [2024-10-07 11:29:05.049626] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:33.998 [2024-10-07 11:29:05.049651] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.998 [2024-10-07 11:29:05.049671] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:33.998 [2024-10-07 11:29:05.049691] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.998 [2024-10-07 11:29:05.049706] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.998 [2024-10-07 11:29:05.049719] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.998 [2024-10-07 11:29:05.049736] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.998 [2024-10-07 11:29:05.049750] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.998 [2024-10-07 11:29:05.049763] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.998 [2024-10-07 11:29:05.049785] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.998 [2024-10-07 11:29:05.049799] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.998 [2024-10-07 11:29:05.061037] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.998 [2024-10-07 11:29:05.061087] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.998 [2024-10-07 11:29:05.061200] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.998 [2024-10-07 11:29:05.061230] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:33.998 [2024-10-07 11:29:05.061246] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:33.998 [2024-10-07 11:29:05.061294] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.998 [2024-10-07 11:29:05.061317] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.998 [2024-10-07 11:29:05.061332] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.998 [2024-10-07 11:29:05.061356] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:33.998 [2024-10-07 11:29:05.061376] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.998 [2024-10-07 11:29:05.061422] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.998 [2024-10-07 11:29:05.061442] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.998 [2024-10-07 11:29:05.061456] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.998 [2024-10-07 11:29:05.061472] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.998 [2024-10-07 11:29:05.061486] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.998 [2024-10-07 11:29:05.061499] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.998 [2024-10-07 11:29:05.061522] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.998 [2024-10-07 11:29:05.061536] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.998 [2024-10-07 11:29:05.073072] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.998 [2024-10-07 11:29:05.073129] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.998 [2024-10-07 11:29:05.073369] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.998 [2024-10-07 11:29:05.073400] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.998 [2024-10-07 11:29:05.073445] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.998 [2024-10-07 11:29:05.073496] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.998 [2024-10-07 11:29:05.073519] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:33.998 [2024-10-07 11:29:05.073534] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:33.998 [2024-10-07 11:29:05.073676] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.998 [2024-10-07 11:29:05.073704] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:33.998 [2024-10-07 11:29:05.073811] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.998 [2024-10-07 11:29:05.073832] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.998 [2024-10-07 11:29:05.073862] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.998 [2024-10-07 11:29:05.073886] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.998 [2024-10-07 11:29:05.073901] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.998 [2024-10-07 11:29:05.073914] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.998 [2024-10-07 11:29:05.074027] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.998 [2024-10-07 11:29:05.074048] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.998 [2024-10-07 11:29:05.083192] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.998 [2024-10-07 11:29:05.083289] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.998 [2024-10-07 11:29:05.083364] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.998 [2024-10-07 11:29:05.083391] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:33.998 [2024-10-07 11:29:05.083408] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:33.998 [2024-10-07 11:29:05.083650] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.998 [2024-10-07 11:29:05.083680] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.998 [2024-10-07 11:29:05.083697] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.998 [2024-10-07 11:29:05.083715] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:33.998 [2024-10-07 11:29:05.083893] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.998 [2024-10-07 11:29:05.083921] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.999 [2024-10-07 11:29:05.083935] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.999 [2024-10-07 11:29:05.083949] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.999 [2024-10-07 11:29:05.084060] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.999 [2024-10-07 11:29:05.084080] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.999 [2024-10-07 11:29:05.084094] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.999 [2024-10-07 11:29:05.084107] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.999 [2024-10-07 11:29:05.084205] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.999 [2024-10-07 11:29:05.093881] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.999 [2024-10-07 11:29:05.093954] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.999 [2024-10-07 11:29:05.094072] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.999 [2024-10-07 11:29:05.094107] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:33.999 [2024-10-07 11:29:05.094129] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:33.999 [2024-10-07 11:29:05.094189] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.999 [2024-10-07 11:29:05.094217] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.999 [2024-10-07 11:29:05.094256] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.999 [2024-10-07 11:29:05.094288] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:33.999 [2024-10-07 11:29:05.094314] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.999 [2024-10-07 11:29:05.094340] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.999 [2024-10-07 11:29:05.094359] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.999 [2024-10-07 11:29:05.094379] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.999 [2024-10-07 11:29:05.094399] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.999 [2024-10-07 11:29:05.094436] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.999 [2024-10-07 11:29:05.094455] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.999 [2024-10-07 11:29:05.094496] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.999 [2024-10-07 11:29:05.094514] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.999 [2024-10-07 11:29:05.104527] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.999 [2024-10-07 11:29:05.104576] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.999 [2024-10-07 11:29:05.104663] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.999 [2024-10-07 11:29:05.104692] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.999 [2024-10-07 11:29:05.104709] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.999 [2024-10-07 11:29:05.104756] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.999 [2024-10-07 11:29:05.104793] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:33.999 [2024-10-07 11:29:05.104824] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:33.999 [2024-10-07 11:29:05.104848] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.999 [2024-10-07 11:29:05.104867] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:33.999 [2024-10-07 11:29:05.104887] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.999 [2024-10-07 11:29:05.104901] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.999 [2024-10-07 11:29:05.104915] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.999 [2024-10-07 11:29:05.104931] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.999 [2024-10-07 11:29:05.104945] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.999 [2024-10-07 11:29:05.104958] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.999 [2024-10-07 11:29:05.107192] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.999 [2024-10-07 11:29:05.107230] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.999 [2024-10-07 11:29:05.114673] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.999 [2024-10-07 11:29:05.114752] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.999 [2024-10-07 11:29:05.114828] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.999 [2024-10-07 11:29:05.114856] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:33.999 [2024-10-07 11:29:05.114873] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:33.999 [2024-10-07 11:29:05.114927] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.999 [2024-10-07 11:29:05.114961] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.999 [2024-10-07 11:29:05.114978] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.999 [2024-10-07 11:29:05.114996] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:33.999 [2024-10-07 11:29:05.115019] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.999 [2024-10-07 11:29:05.115036] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.999 [2024-10-07 11:29:05.115050] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.999 [2024-10-07 11:29:05.115063] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.999 [2024-10-07 11:29:05.115086] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.999 [2024-10-07 11:29:05.115101] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.999 [2024-10-07 11:29:05.115114] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.999 [2024-10-07 11:29:05.115127] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.999 [2024-10-07 11:29:05.115147] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.999 [2024-10-07 11:29:05.124769] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.999 [2024-10-07 11:29:05.124878] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.999 [2024-10-07 11:29:05.124908] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:33.999 [2024-10-07 11:29:05.124925] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:33.999 [2024-10-07 11:29:05.124963] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:33.999 [2024-10-07 11:29:05.124992] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.999 [2024-10-07 11:29:05.125019] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.999 [2024-10-07 11:29:05.125035] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.999 [2024-10-07 11:29:05.125049] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.999 [2024-10-07 11:29:05.125070] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.999 [2024-10-07 11:29:05.125129] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.999 [2024-10-07 11:29:05.125153] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.999 [2024-10-07 11:29:05.125169] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.999 [2024-10-07 11:29:05.127508] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.999 [2024-10-07 11:29:05.128239] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.999 [2024-10-07 11:29:05.128274] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.999 [2024-10-07 11:29:05.128306] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.999 [2024-10-07 11:29:05.128565] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.999 [2024-10-07 11:29:05.136530] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.999 [2024-10-07 11:29:05.136596] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:33.999 [2024-10-07 11:29:05.136673] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.999 [2024-10-07 11:29:05.136701] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:33.999 [2024-10-07 11:29:05.136718] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:33.999 [2024-10-07 11:29:05.136771] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:33.999 [2024-10-07 11:29:05.136794] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:33.999 [2024-10-07 11:29:05.136811] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:33.999 [2024-10-07 11:29:05.136829] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:33.999 [2024-10-07 11:29:05.136863] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:33.999 [2024-10-07 11:29:05.136879] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.999 [2024-10-07 11:29:05.136893] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.999 [2024-10-07 11:29:05.136906] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.999 [2024-10-07 11:29:05.136929] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.999 [2024-10-07 11:29:05.136944] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:33.999 [2024-10-07 11:29:05.136957] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:33.999 [2024-10-07 11:29:05.136970] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:33.999 [2024-10-07 11:29:05.136990] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:33.999 [2024-10-07 11:29:05.148272] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.000 [2024-10-07 11:29:05.148328] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.000 [2024-10-07 11:29:05.148430] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.000 [2024-10-07 11:29:05.148461] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.000 [2024-10-07 11:29:05.148479] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.000 [2024-10-07 11:29:05.148527] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.000 [2024-10-07 11:29:05.148550] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.000 [2024-10-07 11:29:05.148566] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.000 [2024-10-07 11:29:05.148623] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.000 [2024-10-07 11:29:05.148656] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.000 [2024-10-07 11:29:05.148703] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.000 [2024-10-07 11:29:05.148727] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.000 [2024-10-07 11:29:05.148746] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.000 [2024-10-07 11:29:05.148767] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.000 [2024-10-07 11:29:05.148786] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.000 [2024-10-07 11:29:05.148804] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.000 [2024-10-07 11:29:05.148844] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.000 [2024-10-07 11:29:05.148862] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.000 [2024-10-07 11:29:05.158390] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.000 [2024-10-07 11:29:05.158467] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.000 [2024-10-07 11:29:05.158573] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.000 [2024-10-07 11:29:05.158601] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.000 [2024-10-07 11:29:05.158618] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.000 [2024-10-07 11:29:05.158672] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.000 [2024-10-07 11:29:05.158696] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.000 [2024-10-07 11:29:05.158712] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.000 [2024-10-07 11:29:05.158731] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.000 [2024-10-07 11:29:05.158755] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.000 [2024-10-07 11:29:05.158772] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.000 [2024-10-07 11:29:05.158786] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.000 [2024-10-07 11:29:05.158800] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.000 [2024-10-07 11:29:05.159429] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.000 [2024-10-07 11:29:05.159463] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.000 [2024-10-07 11:29:05.159479] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.000 [2024-10-07 11:29:05.159493] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.000 [2024-10-07 11:29:05.160034] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.000 [2024-10-07 11:29:05.170306] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.000 [2024-10-07 11:29:05.170358] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.000 [2024-10-07 11:29:05.170668] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.000 [2024-10-07 11:29:05.170719] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.000 [2024-10-07 11:29:05.170739] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.000 [2024-10-07 11:29:05.170789] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.000 [2024-10-07 11:29:05.170811] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.000 [2024-10-07 11:29:05.170827] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.000 [2024-10-07 11:29:05.170871] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.000 [2024-10-07 11:29:05.170893] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.000 [2024-10-07 11:29:05.170914] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.000 [2024-10-07 11:29:05.170928] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.000 [2024-10-07 11:29:05.170942] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.000 [2024-10-07 11:29:05.170959] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.000 [2024-10-07 11:29:05.170973] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.000 [2024-10-07 11:29:05.170986] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.000 [2024-10-07 11:29:05.171173] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.000 [2024-10-07 11:29:05.171213] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.000 [2024-10-07 11:29:05.180470] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.000 [2024-10-07 11:29:05.180531] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.000 [2024-10-07 11:29:05.180607] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.000 [2024-10-07 11:29:05.180637] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.000 [2024-10-07 11:29:05.180654] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.000 [2024-10-07 11:29:05.180707] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.000 [2024-10-07 11:29:05.180730] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.000 [2024-10-07 11:29:05.180746] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.000 [2024-10-07 11:29:05.180764] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.000 [2024-10-07 11:29:05.180788] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.000 [2024-10-07 11:29:05.180805] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.000 [2024-10-07 11:29:05.180818] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.000 [2024-10-07 11:29:05.180832] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.000 [2024-10-07 11:29:05.180854] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.000 [2024-10-07 11:29:05.180888] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.000 [2024-10-07 11:29:05.180903] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.000 [2024-10-07 11:29:05.180917] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.000 [2024-10-07 11:29:05.180939] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.000 [2024-10-07 11:29:05.190548] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.000 [2024-10-07 11:29:05.190652] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.000 [2024-10-07 11:29:05.190683] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.000 [2024-10-07 11:29:05.190701] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.000 [2024-10-07 11:29:05.190737] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.000 [2024-10-07 11:29:05.190766] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.000 [2024-10-07 11:29:05.190793] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.000 [2024-10-07 11:29:05.190809] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.000 [2024-10-07 11:29:05.190823] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.000 [2024-10-07 11:29:05.190844] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.000 [2024-10-07 11:29:05.190899] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.000 [2024-10-07 11:29:05.190923] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.000 [2024-10-07 11:29:05.190939] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.000 [2024-10-07 11:29:05.190962] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.001 [2024-10-07 11:29:05.190998] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.001 [2024-10-07 11:29:05.191016] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.001 [2024-10-07 11:29:05.191030] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.001 [2024-10-07 11:29:05.191054] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.001 [2024-10-07 11:29:05.204281] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.001 [2024-10-07 11:29:05.204330] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.001 [2024-10-07 11:29:05.204521] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.001 [2024-10-07 11:29:05.204555] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.001 [2024-10-07 11:29:05.204573] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.001 [2024-10-07 11:29:05.204620] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.001 [2024-10-07 11:29:05.204643] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.001 [2024-10-07 11:29:05.204659] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.001 [2024-10-07 11:29:05.205239] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.001 [2024-10-07 11:29:05.205311] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.001 [2024-10-07 11:29:05.205425] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.001 [2024-10-07 11:29:05.205449] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.001 [2024-10-07 11:29:05.205464] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.001 [2024-10-07 11:29:05.205482] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.001 [2024-10-07 11:29:05.205496] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.001 [2024-10-07 11:29:05.205509] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.001 [2024-10-07 11:29:05.205533] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.001 [2024-10-07 11:29:05.205548] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.001 [2024-10-07 11:29:05.216222] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.001 [2024-10-07 11:29:05.216275] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.001 [2024-10-07 11:29:05.216575] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.001 [2024-10-07 11:29:05.216618] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.001 [2024-10-07 11:29:05.216637] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.001 [2024-10-07 11:29:05.216685] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.001 [2024-10-07 11:29:05.216708] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.001 [2024-10-07 11:29:05.216728] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.001 [2024-10-07 11:29:05.216929] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.001 [2024-10-07 11:29:05.216960] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.001 [2024-10-07 11:29:05.217154] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.001 [2024-10-07 11:29:05.217179] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.001 [2024-10-07 11:29:05.217194] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.001 [2024-10-07 11:29:05.217211] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.001 [2024-10-07 11:29:05.217237] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.001 [2024-10-07 11:29:05.217250] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.001 [2024-10-07 11:29:05.217322] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.001 [2024-10-07 11:29:05.217345] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.001 [2024-10-07 11:29:05.226587] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.001 [2024-10-07 11:29:05.226638] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.001 [2024-10-07 11:29:05.226809] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.001 [2024-10-07 11:29:05.226859] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.001 [2024-10-07 11:29:05.226878] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.001 [2024-10-07 11:29:05.226929] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.001 [2024-10-07 11:29:05.226952] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.001 [2024-10-07 11:29:05.226968] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.001 [2024-10-07 11:29:05.227086] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.001 [2024-10-07 11:29:05.227111] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.001 [2024-10-07 11:29:05.227685] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.001 [2024-10-07 11:29:05.227721] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.001 [2024-10-07 11:29:05.227737] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.001 [2024-10-07 11:29:05.227754] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.001 [2024-10-07 11:29:05.227770] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.001 [2024-10-07 11:29:05.227783] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.001 [2024-10-07 11:29:05.230861] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.001 [2024-10-07 11:29:05.230901] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.001 [2024-10-07 11:29:05.236699] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.001 [2024-10-07 11:29:05.236761] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.001 [2024-10-07 11:29:05.236835] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.001 [2024-10-07 11:29:05.236863] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.001 [2024-10-07 11:29:05.236879] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.001 [2024-10-07 11:29:05.237076] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.001 [2024-10-07 11:29:05.237106] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.001 [2024-10-07 11:29:05.237122] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.001 [2024-10-07 11:29:05.237141] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.001 [2024-10-07 11:29:05.237321] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.001 [2024-10-07 11:29:05.237348] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.001 [2024-10-07 11:29:05.237363] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.001 [2024-10-07 11:29:05.237377] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.001 [2024-10-07 11:29:05.237514] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.001 [2024-10-07 11:29:05.237538] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.001 [2024-10-07 11:29:05.237566] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.001 [2024-10-07 11:29:05.237581] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.001 [2024-10-07 11:29:05.237692] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.001 [2024-10-07 11:29:05.249104] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.001 [2024-10-07 11:29:05.249154] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.001 [2024-10-07 11:29:05.249267] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.001 [2024-10-07 11:29:05.249297] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.001 [2024-10-07 11:29:05.249313] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.001 [2024-10-07 11:29:05.249370] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.001 [2024-10-07 11:29:05.249393] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.001 [2024-10-07 11:29:05.249422] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.001 [2024-10-07 11:29:05.249451] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.001 [2024-10-07 11:29:05.249471] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.001 [2024-10-07 11:29:05.249490] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.001 [2024-10-07 11:29:05.249505] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.001 [2024-10-07 11:29:05.249518] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.001 [2024-10-07 11:29:05.249534] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.001 [2024-10-07 11:29:05.249548] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.001 [2024-10-07 11:29:05.249561] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.001 [2024-10-07 11:29:05.249584] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.001 [2024-10-07 11:29:05.249597] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.001 [2024-10-07 11:29:05.261066] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.001 [2024-10-07 11:29:05.261122] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.001 [2024-10-07 11:29:05.261329] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.001 [2024-10-07 11:29:05.261360] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.002 [2024-10-07 11:29:05.261377] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.002 [2024-10-07 11:29:05.261438] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.002 [2024-10-07 11:29:05.261464] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.002 [2024-10-07 11:29:05.261480] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.002 [2024-10-07 11:29:05.261602] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.002 [2024-10-07 11:29:05.261630] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.002 [2024-10-07 11:29:05.261765] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.002 [2024-10-07 11:29:05.261786] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.002 [2024-10-07 11:29:05.261801] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.002 [2024-10-07 11:29:05.261817] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.002 [2024-10-07 11:29:05.261832] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.002 [2024-10-07 11:29:05.261845] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.002 [2024-10-07 11:29:05.261967] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.002 [2024-10-07 11:29:05.261988] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.002 [2024-10-07 11:29:05.271183] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.002 [2024-10-07 11:29:05.271290] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.002 [2024-10-07 11:29:05.271363] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.002 [2024-10-07 11:29:05.271390] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.002 [2024-10-07 11:29:05.271406] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.002 [2024-10-07 11:29:05.271475] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.002 [2024-10-07 11:29:05.271500] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.002 [2024-10-07 11:29:05.271516] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.002 [2024-10-07 11:29:05.271533] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.002 [2024-10-07 11:29:05.271556] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.002 [2024-10-07 11:29:05.271573] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.002 [2024-10-07 11:29:05.271586] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.002 [2024-10-07 11:29:05.271599] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.002 [2024-10-07 11:29:05.271621] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.002 [2024-10-07 11:29:05.271635] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.002 [2024-10-07 11:29:05.271648] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.002 [2024-10-07 11:29:05.271660] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.002 [2024-10-07 11:29:05.271680] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.002 [2024-10-07 11:29:05.281988] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.002 [2024-10-07 11:29:05.282036] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.002 [2024-10-07 11:29:05.282131] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.002 [2024-10-07 11:29:05.282159] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.002 [2024-10-07 11:29:05.282197] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.002 [2024-10-07 11:29:05.282248] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.002 [2024-10-07 11:29:05.282271] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.002 [2024-10-07 11:29:05.282287] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.002 [2024-10-07 11:29:05.282311] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.002 [2024-10-07 11:29:05.282331] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.002 [2024-10-07 11:29:05.282350] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.002 [2024-10-07 11:29:05.282365] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.002 [2024-10-07 11:29:05.282378] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.002 [2024-10-07 11:29:05.282394] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.002 [2024-10-07 11:29:05.282421] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.002 [2024-10-07 11:29:05.282438] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.002 [2024-10-07 11:29:05.282593] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.002 [2024-10-07 11:29:05.282618] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.002 [2024-10-07 11:29:05.294845] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.002 [2024-10-07 11:29:05.294895] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.002 [2024-10-07 11:29:05.295021] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.002 [2024-10-07 11:29:05.295051] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.002 [2024-10-07 11:29:05.295068] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.002 [2024-10-07 11:29:05.295114] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.002 [2024-10-07 11:29:05.295137] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.002 [2024-10-07 11:29:05.295153] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.002 [2024-10-07 11:29:05.295177] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.002 [2024-10-07 11:29:05.295197] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.002 [2024-10-07 11:29:05.295217] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.002 [2024-10-07 11:29:05.295231] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.002 [2024-10-07 11:29:05.295245] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.002 [2024-10-07 11:29:05.295261] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.002 [2024-10-07 11:29:05.295275] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.002 [2024-10-07 11:29:05.295288] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.002 [2024-10-07 11:29:05.295327] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.002 [2024-10-07 11:29:05.295343] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.002 [2024-10-07 11:29:05.305651] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.002 [2024-10-07 11:29:05.305699] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.002 [2024-10-07 11:29:05.305898] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.002 [2024-10-07 11:29:05.305929] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.002 [2024-10-07 11:29:05.305946] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.002 [2024-10-07 11:29:05.306007] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.002 [2024-10-07 11:29:05.306031] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.002 [2024-10-07 11:29:05.306047] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.002 [2024-10-07 11:29:05.306160] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.002 [2024-10-07 11:29:05.306186] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.002 [2024-10-07 11:29:05.306312] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.002 [2024-10-07 11:29:05.306335] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.002 [2024-10-07 11:29:05.306349] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.002 [2024-10-07 11:29:05.306366] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.002 [2024-10-07 11:29:05.306380] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.002 [2024-10-07 11:29:05.306393] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.002 [2024-10-07 11:29:05.306522] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.002 [2024-10-07 11:29:05.306545] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.002 [2024-10-07 11:29:05.316194] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.002 [2024-10-07 11:29:05.316241] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.002 [2024-10-07 11:29:05.316340] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.002 [2024-10-07 11:29:05.316368] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.002 [2024-10-07 11:29:05.316385] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.002 [2024-10-07 11:29:05.316445] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.002 [2024-10-07 11:29:05.316470] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.002 [2024-10-07 11:29:05.316486] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.002 [2024-10-07 11:29:05.316937] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.002 [2024-10-07 11:29:05.316977] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.002 [2024-10-07 11:29:05.317201] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.003 [2024-10-07 11:29:05.317254] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.003 [2024-10-07 11:29:05.317271] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.003 [2024-10-07 11:29:05.317288] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.003 [2024-10-07 11:29:05.317303] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.003 [2024-10-07 11:29:05.317316] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.003 [2024-10-07 11:29:05.317538] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.003 [2024-10-07 11:29:05.317563] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.003 [2024-10-07 11:29:05.328815] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.003 [2024-10-07 11:29:05.328865] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.003 [2024-10-07 11:29:05.328957] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.003 [2024-10-07 11:29:05.328986] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.003 [2024-10-07 11:29:05.329003] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.003 [2024-10-07 11:29:05.329049] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.003 [2024-10-07 11:29:05.329071] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.003 [2024-10-07 11:29:05.329087] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.003 [2024-10-07 11:29:05.329670] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.003 [2024-10-07 11:29:05.329733] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.003 [2024-10-07 11:29:05.329832] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.003 [2024-10-07 11:29:05.329854] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.003 [2024-10-07 11:29:05.329868] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.003 [2024-10-07 11:29:05.329886] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.003 [2024-10-07 11:29:05.329900] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.003 [2024-10-07 11:29:05.329913] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.003 [2024-10-07 11:29:05.329936] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.003 [2024-10-07 11:29:05.329950] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.003 [2024-10-07 11:29:05.339454] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.003 [2024-10-07 11:29:05.339552] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.003 [2024-10-07 11:29:05.340364] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.003 [2024-10-07 11:29:05.340406] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.003 [2024-10-07 11:29:05.340439] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.003 [2024-10-07 11:29:05.340535] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.003 [2024-10-07 11:29:05.340565] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.003 [2024-10-07 11:29:05.340582] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.003 [2024-10-07 11:29:05.340992] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.003 [2024-10-07 11:29:05.341051] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.003 [2024-10-07 11:29:05.341104] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.003 [2024-10-07 11:29:05.341125] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.003 [2024-10-07 11:29:05.341140] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.003 [2024-10-07 11:29:05.341158] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.003 [2024-10-07 11:29:05.341172] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.003 [2024-10-07 11:29:05.341185] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.003 [2024-10-07 11:29:05.341209] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.003 [2024-10-07 11:29:05.341224] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.003 [2024-10-07 11:29:05.350001] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.003 [2024-10-07 11:29:05.350054] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.003 [2024-10-07 11:29:05.350458] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.003 [2024-10-07 11:29:05.350511] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.003 [2024-10-07 11:29:05.350547] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.003 [2024-10-07 11:29:05.350598] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.003 [2024-10-07 11:29:05.350622] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.003 [2024-10-07 11:29:05.350637] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.003 [2024-10-07 11:29:05.350784] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.003 [2024-10-07 11:29:05.350812] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.003 [2024-10-07 11:29:05.350931] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.003 [2024-10-07 11:29:05.350949] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.003 [2024-10-07 11:29:05.350961] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.003 [2024-10-07 11:29:05.350976] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.003 [2024-10-07 11:29:05.350989] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.003 [2024-10-07 11:29:05.351002] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.003 [2024-10-07 11:29:05.351049] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.003 [2024-10-07 11:29:05.351084] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.003 [2024-10-07 11:29:05.364528] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.003 [2024-10-07 11:29:05.364575] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.003 [2024-10-07 11:29:05.364672] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.003 [2024-10-07 11:29:05.364700] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.003 [2024-10-07 11:29:05.364717] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.003 [2024-10-07 11:29:05.364762] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.003 [2024-10-07 11:29:05.364783] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.003 [2024-10-07 11:29:05.364799] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.003 [2024-10-07 11:29:05.364822] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.003 [2024-10-07 11:29:05.364841] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.003 [2024-10-07 11:29:05.364860] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.003 [2024-10-07 11:29:05.364874] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.003 [2024-10-07 11:29:05.364887] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.003 [2024-10-07 11:29:05.364903] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.003 [2024-10-07 11:29:05.364916] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.003 [2024-10-07 11:29:05.364928] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.003 [2024-10-07 11:29:05.364950] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.003 [2024-10-07 11:29:05.364963] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.003 [2024-10-07 11:29:05.379801] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.003 [2024-10-07 11:29:05.379853] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.003 [2024-10-07 11:29:05.380294] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.003 [2024-10-07 11:29:05.380355] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.003 [2024-10-07 11:29:05.380374] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.003 [2024-10-07 11:29:05.380435] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.003 [2024-10-07 11:29:05.380461] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.003 [2024-10-07 11:29:05.380478] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.003 [2024-10-07 11:29:05.380694] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.003 [2024-10-07 11:29:05.380725] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.003 [2024-10-07 11:29:05.380781] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.003 [2024-10-07 11:29:05.380802] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.003 [2024-10-07 11:29:05.380836] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.003 [2024-10-07 11:29:05.380854] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.003 [2024-10-07 11:29:05.380869] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.003 [2024-10-07 11:29:05.380883] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.003 [2024-10-07 11:29:05.381056] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.003 [2024-10-07 11:29:05.381078] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.003 [2024-10-07 11:29:05.390170] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.004 [2024-10-07 11:29:05.390219] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.004 [2024-10-07 11:29:05.390401] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.004 [2024-10-07 11:29:05.390446] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.004 [2024-10-07 11:29:05.390464] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.004 [2024-10-07 11:29:05.390516] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.004 [2024-10-07 11:29:05.390539] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.004 [2024-10-07 11:29:05.390554] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.004 [2024-10-07 11:29:05.390668] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.004 [2024-10-07 11:29:05.390694] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.004 [2024-10-07 11:29:05.393310] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.004 [2024-10-07 11:29:05.393348] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.004 [2024-10-07 11:29:05.393381] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.004 [2024-10-07 11:29:05.393398] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.004 [2024-10-07 11:29:05.393413] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.004 [2024-10-07 11:29:05.393438] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.004 [2024-10-07 11:29:05.395214] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.004 [2024-10-07 11:29:05.395252] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.004 [2024-10-07 11:29:05.403064] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.004 [2024-10-07 11:29:05.403109] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.004 8831.83 IOPS, 34.50 MiB/s [2024-10-07T11:29:15.715Z] [2024-10-07 11:29:05.403320] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.004 [2024-10-07 11:29:05.403349] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.004 [2024-10-07 11:29:05.403366] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.004 [2024-10-07 11:29:05.403411] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.004 [2024-10-07 11:29:05.403464] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.004 [2024-10-07 11:29:05.403482] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.004 [2024-10-07 11:29:05.404285] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.004 [2024-10-07 11:29:05.404327] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.004 [2024-10-07 11:29:05.405137] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.004 [2024-10-07 11:29:05.405174] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.004 [2024-10-07 11:29:05.405190] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.004 [2024-10-07 11:29:05.405208] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.004 [2024-10-07 11:29:05.405222] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.004 [2024-10-07 11:29:05.405235] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.004 [2024-10-07 11:29:05.406497] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.004 [2024-10-07 11:29:05.406533] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.004 [2024-10-07 11:29:05.413424] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.004 [2024-10-07 11:29:05.413473] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.004 [2024-10-07 11:29:05.413713] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.004 [2024-10-07 11:29:05.413751] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.004 [2024-10-07 11:29:05.413769] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.004 [2024-10-07 11:29:05.413818] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.004 [2024-10-07 11:29:05.413840] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.004 [2024-10-07 11:29:05.413856] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.004 [2024-10-07 11:29:05.413911] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.004 [2024-10-07 11:29:05.413936] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.004 [2024-10-07 11:29:05.414118] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.004 [2024-10-07 11:29:05.414142] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.004 [2024-10-07 11:29:05.414156] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.004 [2024-10-07 11:29:05.414173] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.004 [2024-10-07 11:29:05.414188] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.004 [2024-10-07 11:29:05.414200] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.004 [2024-10-07 11:29:05.414257] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.004 [2024-10-07 11:29:05.414277] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.004 [2024-10-07 11:29:05.426102] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.004 [2024-10-07 11:29:05.426152] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.004 [2024-10-07 11:29:05.426262] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.004 [2024-10-07 11:29:05.426293] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.004 [2024-10-07 11:29:05.426310] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.004 [2024-10-07 11:29:05.426358] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.004 [2024-10-07 11:29:05.426380] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.004 [2024-10-07 11:29:05.426396] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.004 [2024-10-07 11:29:05.426435] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.004 [2024-10-07 11:29:05.426458] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.004 [2024-10-07 11:29:05.426477] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.004 [2024-10-07 11:29:05.426491] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.004 [2024-10-07 11:29:05.426505] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.004 [2024-10-07 11:29:05.426522] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.004 [2024-10-07 11:29:05.426536] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.004 [2024-10-07 11:29:05.426549] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.004 [2024-10-07 11:29:05.426572] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.004 [2024-10-07 11:29:05.426586] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.004 [2024-10-07 11:29:05.439669] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.004 [2024-10-07 11:29:05.439717] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.004 [2024-10-07 11:29:05.439816] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.004 [2024-10-07 11:29:05.439844] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.004 [2024-10-07 11:29:05.439860] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.004 [2024-10-07 11:29:05.439905] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.004 [2024-10-07 11:29:05.439927] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.004 [2024-10-07 11:29:05.439942] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.004 [2024-10-07 11:29:05.439964] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.004 [2024-10-07 11:29:05.439984] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.004 [2024-10-07 11:29:05.440003] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.004 [2024-10-07 11:29:05.440016] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.004 [2024-10-07 11:29:05.440046] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.004 [2024-10-07 11:29:05.440064] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.004 [2024-10-07 11:29:05.440078] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.004 [2024-10-07 11:29:05.440091] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.005 [2024-10-07 11:29:05.440114] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.005 [2024-10-07 11:29:05.440128] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.005 [2024-10-07 11:29:05.452339] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.005 [2024-10-07 11:29:05.452387] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.005 [2024-10-07 11:29:05.452485] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.005 [2024-10-07 11:29:05.452514] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.005 [2024-10-07 11:29:05.452532] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.005 [2024-10-07 11:29:05.452577] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.005 [2024-10-07 11:29:05.452600] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.005 [2024-10-07 11:29:05.452615] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.005 [2024-10-07 11:29:05.453187] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.005 [2024-10-07 11:29:05.453227] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.005 [2024-10-07 11:29:05.453318] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.005 [2024-10-07 11:29:05.453340] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.005 [2024-10-07 11:29:05.453354] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.005 [2024-10-07 11:29:05.453386] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.005 [2024-10-07 11:29:05.453400] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.005 [2024-10-07 11:29:05.453413] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.005 [2024-10-07 11:29:05.453449] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.005 [2024-10-07 11:29:05.453467] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.005 [2024-10-07 11:29:05.462666] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.005 [2024-10-07 11:29:05.462825] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.005 [2024-10-07 11:29:05.462903] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.005 [2024-10-07 11:29:05.462930] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.005 [2024-10-07 11:29:05.462947] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.005 [2024-10-07 11:29:05.463302] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.005 [2024-10-07 11:29:05.463342] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.005 [2024-10-07 11:29:05.463380] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.005 [2024-10-07 11:29:05.463402] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.005 [2024-10-07 11:29:05.465423] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.005 [2024-10-07 11:29:05.465474] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.005 [2024-10-07 11:29:05.465506] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.005 [2024-10-07 11:29:05.465520] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.005 [2024-10-07 11:29:05.466357] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.005 [2024-10-07 11:29:05.466392] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.005 [2024-10-07 11:29:05.466446] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.005 [2024-10-07 11:29:05.466462] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.005 [2024-10-07 11:29:05.466581] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.005 [2024-10-07 11:29:05.476559] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.005 [2024-10-07 11:29:05.476610] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.005 [2024-10-07 11:29:05.476786] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.005 [2024-10-07 11:29:05.476816] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.005 [2024-10-07 11:29:05.476834] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.005 [2024-10-07 11:29:05.476881] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.005 [2024-10-07 11:29:05.476904] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.005 [2024-10-07 11:29:05.476921] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.005 [2024-10-07 11:29:05.478399] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.005 [2024-10-07 11:29:05.478463] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.005 [2024-10-07 11:29:05.480102] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.005 [2024-10-07 11:29:05.480139] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.005 [2024-10-07 11:29:05.480173] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.005 [2024-10-07 11:29:05.480191] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.005 [2024-10-07 11:29:05.480206] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.005 [2024-10-07 11:29:05.480219] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.005 [2024-10-07 11:29:05.480733] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.005 [2024-10-07 11:29:05.480760] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.005 [2024-10-07 11:29:05.487758] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.005 [2024-10-07 11:29:05.487808] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.005 [2024-10-07 11:29:05.487913] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.005 [2024-10-07 11:29:05.487942] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.005 [2024-10-07 11:29:05.487959] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.005 [2024-10-07 11:29:05.488006] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.005 [2024-10-07 11:29:05.488029] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.005 [2024-10-07 11:29:05.488045] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.005 [2024-10-07 11:29:05.490269] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.005 [2024-10-07 11:29:05.490314] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.005 [2024-10-07 11:29:05.490857] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.005 [2024-10-07 11:29:05.490894] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.005 [2024-10-07 11:29:05.490910] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.005 [2024-10-07 11:29:05.490928] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.005 [2024-10-07 11:29:05.490942] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.005 [2024-10-07 11:29:05.490955] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.005 [2024-10-07 11:29:05.491387] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.005 [2024-10-07 11:29:05.491427] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.005 [2024-10-07 11:29:05.501144] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.005 [2024-10-07 11:29:05.501192] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.005 [2024-10-07 11:29:05.501292] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.005 [2024-10-07 11:29:05.501320] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.005 [2024-10-07 11:29:05.501337] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.005 [2024-10-07 11:29:05.501381] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.005 [2024-10-07 11:29:05.501402] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.005 [2024-10-07 11:29:05.501417] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.005 [2024-10-07 11:29:05.501473] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.005 [2024-10-07 11:29:05.501493] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.005 [2024-10-07 11:29:05.501764] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.005 [2024-10-07 11:29:05.501790] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.005 [2024-10-07 11:29:05.501806] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.005 [2024-10-07 11:29:05.501838] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.005 [2024-10-07 11:29:05.501866] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.005 [2024-10-07 11:29:05.501880] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.005 [2024-10-07 11:29:05.502072] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.005 [2024-10-07 11:29:05.502096] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.005 [2024-10-07 11:29:05.511267] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.005 [2024-10-07 11:29:05.511348] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.005 [2024-10-07 11:29:05.511440] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.005 [2024-10-07 11:29:05.511470] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.005 [2024-10-07 11:29:05.511487] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.005 [2024-10-07 11:29:05.511543] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.006 [2024-10-07 11:29:05.511566] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.006 [2024-10-07 11:29:05.511581] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.006 [2024-10-07 11:29:05.511599] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.006 [2024-10-07 11:29:05.511624] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.006 [2024-10-07 11:29:05.511641] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.006 [2024-10-07 11:29:05.511654] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.006 [2024-10-07 11:29:05.511668] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.006 [2024-10-07 11:29:05.511691] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.006 [2024-10-07 11:29:05.511706] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.006 [2024-10-07 11:29:05.511719] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.006 [2024-10-07 11:29:05.511732] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.006 [2024-10-07 11:29:05.511752] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.006 [2024-10-07 11:29:05.523533] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.006 [2024-10-07 11:29:05.523580] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.006 [2024-10-07 11:29:05.523680] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.006 [2024-10-07 11:29:05.523708] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.006 [2024-10-07 11:29:05.523725] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.006 [2024-10-07 11:29:05.523770] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.006 [2024-10-07 11:29:05.523792] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.006 [2024-10-07 11:29:05.523806] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.006 [2024-10-07 11:29:05.523845] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.006 [2024-10-07 11:29:05.523865] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.006 [2024-10-07 11:29:05.523884] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.006 [2024-10-07 11:29:05.523898] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.006 [2024-10-07 11:29:05.523911] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.006 [2024-10-07 11:29:05.523927] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.006 [2024-10-07 11:29:05.523941] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.006 [2024-10-07 11:29:05.523953] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.006 [2024-10-07 11:29:05.524006] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.006 [2024-10-07 11:29:05.524040] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.006 [2024-10-07 11:29:05.535327] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.006 [2024-10-07 11:29:05.535375] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.006 [2024-10-07 11:29:05.535954] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.006 [2024-10-07 11:29:05.536010] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.006 [2024-10-07 11:29:05.536028] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.006 [2024-10-07 11:29:05.536075] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.006 [2024-10-07 11:29:05.536097] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.006 [2024-10-07 11:29:05.536111] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.006 [2024-10-07 11:29:05.538346] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.006 [2024-10-07 11:29:05.538390] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.006 [2024-10-07 11:29:05.538712] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.006 [2024-10-07 11:29:05.538750] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.006 [2024-10-07 11:29:05.538767] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.006 [2024-10-07 11:29:05.538784] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.006 [2024-10-07 11:29:05.538798] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.006 [2024-10-07 11:29:05.538811] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.006 [2024-10-07 11:29:05.538968] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.006 [2024-10-07 11:29:05.538990] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.006 [2024-10-07 11:29:05.545805] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.006 [2024-10-07 11:29:05.545850] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.006 [2024-10-07 11:29:05.545944] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.006 [2024-10-07 11:29:05.546018] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.006 [2024-10-07 11:29:05.546037] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.006 [2024-10-07 11:29:05.546089] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.006 [2024-10-07 11:29:05.546112] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.006 [2024-10-07 11:29:05.546128] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.006 [2024-10-07 11:29:05.546152] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.006 [2024-10-07 11:29:05.546172] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.006 [2024-10-07 11:29:05.546192] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.006 [2024-10-07 11:29:05.546206] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.006 [2024-10-07 11:29:05.546219] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.006 [2024-10-07 11:29:05.546235] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.006 [2024-10-07 11:29:05.546250] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.006 [2024-10-07 11:29:05.546262] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.006 [2024-10-07 11:29:05.546316] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.006 [2024-10-07 11:29:05.546329] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.006 [2024-10-07 11:29:05.557507] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.006 [2024-10-07 11:29:05.557557] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.006 [2024-10-07 11:29:05.557908] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.006 [2024-10-07 11:29:05.557949] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.006 [2024-10-07 11:29:05.558005] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.006 [2024-10-07 11:29:05.558057] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.006 [2024-10-07 11:29:05.558080] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.006 [2024-10-07 11:29:05.558096] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.006 [2024-10-07 11:29:05.558775] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.006 [2024-10-07 11:29:05.558830] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.006 [2024-10-07 11:29:05.559388] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.006 [2024-10-07 11:29:05.559466] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.006 [2024-10-07 11:29:05.559484] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.006 [2024-10-07 11:29:05.559502] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.006 [2024-10-07 11:29:05.559516] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.006 [2024-10-07 11:29:05.559547] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.006 [2024-10-07 11:29:05.559845] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.006 [2024-10-07 11:29:05.559869] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.006 [2024-10-07 11:29:05.568400] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.006 [2024-10-07 11:29:05.568454] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.006 [2024-10-07 11:29:05.571076] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.006 [2024-10-07 11:29:05.571137] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.006 [2024-10-07 11:29:05.571156] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.006 [2024-10-07 11:29:05.571202] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.006 [2024-10-07 11:29:05.571223] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.006 [2024-10-07 11:29:05.571237] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.006 [2024-10-07 11:29:05.571607] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.006 [2024-10-07 11:29:05.571639] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.006 [2024-10-07 11:29:05.572141] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.006 [2024-10-07 11:29:05.572172] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.007 [2024-10-07 11:29:05.572204] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.007 [2024-10-07 11:29:05.572220] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.007 [2024-10-07 11:29:05.572234] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.007 [2024-10-07 11:29:05.572246] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.007 [2024-10-07 11:29:05.573290] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.007 [2024-10-07 11:29:05.573339] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.007 [2024-10-07 11:29:05.578533] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.007 [2024-10-07 11:29:05.578610] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.007 [2024-10-07 11:29:05.578685] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.007 [2024-10-07 11:29:05.578713] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.007 [2024-10-07 11:29:05.578729] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.007 [2024-10-07 11:29:05.578783] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.007 [2024-10-07 11:29:05.578806] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.007 [2024-10-07 11:29:05.578837] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.007 [2024-10-07 11:29:05.578854] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.007 [2024-10-07 11:29:05.578897] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.007 [2024-10-07 11:29:05.578915] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.007 [2024-10-07 11:29:05.578928] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.007 [2024-10-07 11:29:05.578941] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.007 [2024-10-07 11:29:05.578963] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.007 [2024-10-07 11:29:05.578977] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.007 [2024-10-07 11:29:05.578990] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.007 [2024-10-07 11:29:05.579003] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.007 [2024-10-07 11:29:05.579022] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.007 [2024-10-07 11:29:05.589895] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.007 [2024-10-07 11:29:05.589984] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.007 [2024-10-07 11:29:05.590271] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.007 [2024-10-07 11:29:05.590343] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.007 [2024-10-07 11:29:05.590378] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.007 [2024-10-07 11:29:05.590438] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.007 [2024-10-07 11:29:05.590476] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.007 [2024-10-07 11:29:05.590494] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.007 [2024-10-07 11:29:05.590552] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.007 [2024-10-07 11:29:05.590578] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.007 [2024-10-07 11:29:05.590599] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.007 [2024-10-07 11:29:05.590613] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.007 [2024-10-07 11:29:05.590628] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.007 [2024-10-07 11:29:05.590644] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.007 [2024-10-07 11:29:05.590658] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.007 [2024-10-07 11:29:05.590671] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.007 [2024-10-07 11:29:05.590694] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.007 [2024-10-07 11:29:05.590708] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.007 [2024-10-07 11:29:05.601529] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.007 [2024-10-07 11:29:05.601575] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.007 [2024-10-07 11:29:05.601812] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.007 [2024-10-07 11:29:05.601848] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.007 [2024-10-07 11:29:05.601880] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.007 [2024-10-07 11:29:05.601929] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.007 [2024-10-07 11:29:05.601952] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.007 [2024-10-07 11:29:05.601994] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.007 [2024-10-07 11:29:05.602126] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.007 [2024-10-07 11:29:05.602153] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.007 [2024-10-07 11:29:05.602280] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.007 [2024-10-07 11:29:05.602314] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.007 [2024-10-07 11:29:05.602328] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.007 [2024-10-07 11:29:05.602344] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.007 [2024-10-07 11:29:05.602357] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.007 [2024-10-07 11:29:05.602369] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.007 [2024-10-07 11:29:05.602500] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.007 [2024-10-07 11:29:05.602522] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.007 [2024-10-07 11:29:05.611647] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.007 [2024-10-07 11:29:05.611722] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.007 [2024-10-07 11:29:05.611792] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.007 [2024-10-07 11:29:05.611851] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.007 [2024-10-07 11:29:05.611868] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.007 [2024-10-07 11:29:05.611921] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.007 [2024-10-07 11:29:05.611944] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.007 [2024-10-07 11:29:05.611960] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.007 [2024-10-07 11:29:05.611978] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.007 [2024-10-07 11:29:05.612002] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.007 [2024-10-07 11:29:05.612018] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.007 [2024-10-07 11:29:05.612032] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.007 [2024-10-07 11:29:05.612046] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.007 [2024-10-07 11:29:05.612069] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.007 [2024-10-07 11:29:05.612083] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.007 [2024-10-07 11:29:05.612096] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.007 [2024-10-07 11:29:05.612125] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.007 [2024-10-07 11:29:05.612362] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.007 [2024-10-07 11:29:05.622644] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.007 [2024-10-07 11:29:05.622693] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.007 [2024-10-07 11:29:05.623740] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.007 [2024-10-07 11:29:05.623783] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.007 [2024-10-07 11:29:05.623803] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.007 [2024-10-07 11:29:05.623851] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.007 [2024-10-07 11:29:05.623874] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.007 [2024-10-07 11:29:05.623889] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.007 [2024-10-07 11:29:05.624104] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.007 [2024-10-07 11:29:05.624137] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.007 [2024-10-07 11:29:05.624183] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.007 [2024-10-07 11:29:05.624205] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.007 [2024-10-07 11:29:05.624219] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.007 [2024-10-07 11:29:05.624236] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.007 [2024-10-07 11:29:05.624250] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.007 [2024-10-07 11:29:05.624264] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.007 [2024-10-07 11:29:05.624287] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.007 [2024-10-07 11:29:05.624301] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.007 [2024-10-07 11:29:05.633144] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.007 [2024-10-07 11:29:05.633208] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.007 [2024-10-07 11:29:05.633308] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.008 [2024-10-07 11:29:05.633337] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.008 [2024-10-07 11:29:05.633354] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.008 [2024-10-07 11:29:05.633401] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.008 [2024-10-07 11:29:05.633423] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.008 [2024-10-07 11:29:05.633454] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.008 [2024-10-07 11:29:05.633479] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.008 [2024-10-07 11:29:05.633499] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.008 [2024-10-07 11:29:05.633540] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.008 [2024-10-07 11:29:05.633555] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.008 [2024-10-07 11:29:05.633569] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.008 [2024-10-07 11:29:05.633585] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.008 [2024-10-07 11:29:05.633599] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.008 [2024-10-07 11:29:05.633613] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.008 [2024-10-07 11:29:05.633799] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.008 [2024-10-07 11:29:05.633827] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.008 [2024-10-07 11:29:05.646453] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.008 [2024-10-07 11:29:05.646501] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.008 [2024-10-07 11:29:05.646658] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.008 [2024-10-07 11:29:05.646688] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.008 [2024-10-07 11:29:05.646706] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.008 [2024-10-07 11:29:05.646752] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.008 [2024-10-07 11:29:05.646775] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.008 [2024-10-07 11:29:05.646791] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.008 [2024-10-07 11:29:05.646816] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.008 [2024-10-07 11:29:05.646835] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.008 [2024-10-07 11:29:05.646855] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.008 [2024-10-07 11:29:05.646869] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.008 [2024-10-07 11:29:05.646882] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.008 [2024-10-07 11:29:05.646898] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.008 [2024-10-07 11:29:05.646912] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.008 [2024-10-07 11:29:05.646925] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.008 [2024-10-07 11:29:05.646948] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.008 [2024-10-07 11:29:05.646962] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.008 [2024-10-07 11:29:05.661760] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.008 [2024-10-07 11:29:05.661809] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.008 [2024-10-07 11:29:05.661909] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.008 [2024-10-07 11:29:05.661938] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.008 [2024-10-07 11:29:05.661954] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.008 [2024-10-07 11:29:05.662046] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.008 [2024-10-07 11:29:05.662070] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.008 [2024-10-07 11:29:05.662091] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.008 [2024-10-07 11:29:05.662116] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.008 [2024-10-07 11:29:05.662135] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.008 [2024-10-07 11:29:05.662155] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.008 [2024-10-07 11:29:05.662169] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.008 [2024-10-07 11:29:05.662183] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.008 [2024-10-07 11:29:05.662200] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.008 [2024-10-07 11:29:05.662214] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.008 [2024-10-07 11:29:05.662227] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.008 [2024-10-07 11:29:05.662249] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.008 [2024-10-07 11:29:05.662263] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.008 [2024-10-07 11:29:05.673624] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.008 [2024-10-07 11:29:05.673673] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.008 [2024-10-07 11:29:05.673756] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.008 [2024-10-07 11:29:05.673785] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.008 [2024-10-07 11:29:05.673802] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.008 [2024-10-07 11:29:05.673848] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.008 [2024-10-07 11:29:05.673870] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.008 [2024-10-07 11:29:05.673891] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.008 [2024-10-07 11:29:05.673915] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.008 [2024-10-07 11:29:05.673934] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.008 [2024-10-07 11:29:05.673954] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.008 [2024-10-07 11:29:05.673979] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.008 [2024-10-07 11:29:05.673993] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.008 [2024-10-07 11:29:05.674008] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.008 [2024-10-07 11:29:05.674022] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.008 [2024-10-07 11:29:05.674035] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.008 [2024-10-07 11:29:05.674058] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.008 [2024-10-07 11:29:05.674087] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.008 [2024-10-07 11:29:05.686899] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.008 [2024-10-07 11:29:05.686950] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.008 [2024-10-07 11:29:05.687582] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.008 [2024-10-07 11:29:05.687637] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.008 [2024-10-07 11:29:05.687656] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.008 [2024-10-07 11:29:05.687704] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.008 [2024-10-07 11:29:05.687726] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.008 [2024-10-07 11:29:05.687741] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.008 [2024-10-07 11:29:05.689314] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.008 [2024-10-07 11:29:05.689357] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.008 [2024-10-07 11:29:05.689569] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.008 [2024-10-07 11:29:05.689596] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.008 [2024-10-07 11:29:05.689610] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.008 [2024-10-07 11:29:05.689628] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.008 [2024-10-07 11:29:05.689642] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.008 [2024-10-07 11:29:05.689655] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.008 [2024-10-07 11:29:05.689709] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.008 [2024-10-07 11:29:05.689729] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.008 [2024-10-07 11:29:05.697392] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.009 [2024-10-07 11:29:05.697479] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.009 [2024-10-07 11:29:05.697555] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.009 [2024-10-07 11:29:05.697583] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.009 [2024-10-07 11:29:05.697600] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.009 [2024-10-07 11:29:05.697654] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.009 [2024-10-07 11:29:05.697677] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.009 [2024-10-07 11:29:05.697693] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.009 [2024-10-07 11:29:05.697711] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.009 [2024-10-07 11:29:05.697739] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.009 [2024-10-07 11:29:05.697774] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.009 [2024-10-07 11:29:05.697813] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.009 [2024-10-07 11:29:05.697833] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.009 [2024-10-07 11:29:05.697863] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.009 [2024-10-07 11:29:05.697881] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.009 [2024-10-07 11:29:05.697900] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.009 [2024-10-07 11:29:05.697918] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.009 [2024-10-07 11:29:05.697943] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.009 [2024-10-07 11:29:05.711636] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.009 [2024-10-07 11:29:05.711702] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.009 [2024-10-07 11:29:05.712365] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.009 [2024-10-07 11:29:05.712421] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.009 [2024-10-07 11:29:05.712452] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.009 [2024-10-07 11:29:05.712504] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.009 [2024-10-07 11:29:05.712527] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.009 [2024-10-07 11:29:05.712543] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.009 [2024-10-07 11:29:05.712905] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.009 [2024-10-07 11:29:05.712938] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.009 [2024-10-07 11:29:05.713002] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.009 [2024-10-07 11:29:05.713023] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.009 [2024-10-07 11:29:05.713037] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.009 [2024-10-07 11:29:05.713054] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.009 [2024-10-07 11:29:05.713069] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.009 [2024-10-07 11:29:05.713082] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.009 [2024-10-07 11:29:05.713252] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.009 [2024-10-07 11:29:05.713274] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.009 [2024-10-07 11:29:05.721830] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.009 [2024-10-07 11:29:05.721928] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.009 [2024-10-07 11:29:05.722012] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.009 [2024-10-07 11:29:05.722041] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.009 [2024-10-07 11:29:05.722058] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.009 [2024-10-07 11:29:05.724667] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.009 [2024-10-07 11:29:05.724747] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.009 [2024-10-07 11:29:05.724778] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.009 [2024-10-07 11:29:05.724807] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.009 [2024-10-07 11:29:05.725569] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.009 [2024-10-07 11:29:05.725611] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.009 [2024-10-07 11:29:05.725628] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.009 [2024-10-07 11:29:05.725643] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.009 [2024-10-07 11:29:05.725993] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.009 [2024-10-07 11:29:05.726023] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.009 [2024-10-07 11:29:05.726037] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.009 [2024-10-07 11:29:05.726052] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.009 [2024-10-07 11:29:05.726356] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.009 [2024-10-07 11:29:05.732179] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.009 [2024-10-07 11:29:05.732324] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.009 [2024-10-07 11:29:05.732405] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.009 [2024-10-07 11:29:05.732447] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.009 [2024-10-07 11:29:05.732465] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.009 [2024-10-07 11:29:05.732892] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.009 [2024-10-07 11:29:05.732933] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.009 [2024-10-07 11:29:05.732951] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.009 [2024-10-07 11:29:05.732970] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.009 [2024-10-07 11:29:05.733201] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.009 [2024-10-07 11:29:05.733241] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.009 [2024-10-07 11:29:05.733258] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.009 [2024-10-07 11:29:05.733272] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.009 [2024-10-07 11:29:05.733333] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.009 [2024-10-07 11:29:05.733354] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.009 [2024-10-07 11:29:05.733369] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.009 [2024-10-07 11:29:05.733382] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.009 [2024-10-07 11:29:05.733404] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.009 [2024-10-07 11:29:05.742259] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.009 [2024-10-07 11:29:05.742363] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.009 [2024-10-07 11:29:05.742392] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.009 [2024-10-07 11:29:05.742421] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.009 [2024-10-07 11:29:05.742449] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.009 [2024-10-07 11:29:05.742484] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.009 [2024-10-07 11:29:05.742502] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.009 [2024-10-07 11:29:05.742517] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.009 [2024-10-07 11:29:05.742541] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.009 [2024-10-07 11:29:05.742560] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.009 [2024-10-07 11:29:05.742622] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.009 [2024-10-07 11:29:05.742647] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.009 [2024-10-07 11:29:05.742664] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.009 [2024-10-07 11:29:05.742686] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.009 [2024-10-07 11:29:05.742708] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.009 [2024-10-07 11:29:05.742722] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.009 [2024-10-07 11:29:05.742735] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.009 [2024-10-07 11:29:05.742757] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.009 [2024-10-07 11:29:05.752600] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.009 [2024-10-07 11:29:05.752818] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.009 [2024-10-07 11:29:05.752850] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.009 [2024-10-07 11:29:05.752868] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.009 [2024-10-07 11:29:05.752981] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.009 [2024-10-07 11:29:05.753017] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.009 [2024-10-07 11:29:05.753157] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.009 [2024-10-07 11:29:05.753214] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.010 [2024-10-07 11:29:05.753232] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.010 [2024-10-07 11:29:05.753247] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.010 [2024-10-07 11:29:05.753260] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.010 [2024-10-07 11:29:05.753273] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.010 [2024-10-07 11:29:05.753881] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.010 [2024-10-07 11:29:05.753938] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.010 [2024-10-07 11:29:05.757954] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.010 [2024-10-07 11:29:05.758002] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.010 [2024-10-07 11:29:05.758019] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.010 [2024-10-07 11:29:05.758557] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.010 [2024-10-07 11:29:05.763393] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.010 [2024-10-07 11:29:05.763447] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.010 [2024-10-07 11:29:05.763532] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.010 [2024-10-07 11:29:05.763560] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.010 [2024-10-07 11:29:05.763577] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.010 [2024-10-07 11:29:05.763623] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.010 [2024-10-07 11:29:05.763645] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.010 [2024-10-07 11:29:05.763661] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.010 [2024-10-07 11:29:05.763684] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.010 [2024-10-07 11:29:05.763704] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.010 [2024-10-07 11:29:05.763723] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.010 [2024-10-07 11:29:05.763737] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.010 [2024-10-07 11:29:05.763751] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.010 [2024-10-07 11:29:05.763767] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.010 [2024-10-07 11:29:05.763780] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.010 [2024-10-07 11:29:05.763793] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.010 [2024-10-07 11:29:05.763816] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.010 [2024-10-07 11:29:05.763829] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.010 [2024-10-07 11:29:05.773519] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.010 [2024-10-07 11:29:05.773594] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.010 [2024-10-07 11:29:05.773666] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.010 [2024-10-07 11:29:05.773694] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.010 [2024-10-07 11:29:05.773710] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.010 [2024-10-07 11:29:05.773762] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.010 [2024-10-07 11:29:05.773784] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.010 [2024-10-07 11:29:05.773835] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.010 [2024-10-07 11:29:05.773854] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.010 [2024-10-07 11:29:05.773878] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.010 [2024-10-07 11:29:05.773895] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.010 [2024-10-07 11:29:05.773909] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.010 [2024-10-07 11:29:05.773922] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.010 [2024-10-07 11:29:05.773945] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.010 [2024-10-07 11:29:05.773970] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.010 [2024-10-07 11:29:05.773985] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.010 [2024-10-07 11:29:05.773999] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.010 [2024-10-07 11:29:05.774020] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.010 [2024-10-07 11:29:05.786116] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.010 [2024-10-07 11:29:05.786177] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.010 [2024-10-07 11:29:05.786545] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.010 [2024-10-07 11:29:05.786601] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.010 [2024-10-07 11:29:05.786626] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.010 [2024-10-07 11:29:05.786689] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.010 [2024-10-07 11:29:05.786716] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.010 [2024-10-07 11:29:05.786732] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.010 [2024-10-07 11:29:05.786785] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.010 [2024-10-07 11:29:05.786811] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.010 [2024-10-07 11:29:05.786831] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.010 [2024-10-07 11:29:05.786846] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.010 [2024-10-07 11:29:05.786860] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.010 [2024-10-07 11:29:05.786876] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.010 [2024-10-07 11:29:05.786891] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.010 [2024-10-07 11:29:05.786904] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.010 [2024-10-07 11:29:05.786927] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.010 [2024-10-07 11:29:05.786942] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.010 [2024-10-07 11:29:05.800094] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.010 [2024-10-07 11:29:05.800170] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.010 [2024-10-07 11:29:05.800256] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.010 [2024-10-07 11:29:05.800285] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.010 [2024-10-07 11:29:05.800302] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.010 [2024-10-07 11:29:05.800348] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.010 [2024-10-07 11:29:05.800370] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.010 [2024-10-07 11:29:05.800386] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.010 [2024-10-07 11:29:05.800422] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.010 [2024-10-07 11:29:05.800446] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.010 [2024-10-07 11:29:05.800466] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.010 [2024-10-07 11:29:05.800481] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.010 [2024-10-07 11:29:05.800494] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.010 [2024-10-07 11:29:05.800510] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.010 [2024-10-07 11:29:05.800524] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.010 [2024-10-07 11:29:05.800537] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.010 [2024-10-07 11:29:05.800559] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.010 [2024-10-07 11:29:05.800572] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.010 [2024-10-07 11:29:05.813832] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.010 [2024-10-07 11:29:05.813899] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.010 [2024-10-07 11:29:05.814011] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.010 [2024-10-07 11:29:05.814040] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.010 [2024-10-07 11:29:05.814058] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.010 [2024-10-07 11:29:05.814104] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.010 [2024-10-07 11:29:05.814127] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.010 [2024-10-07 11:29:05.814151] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.010 [2024-10-07 11:29:05.814176] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.010 [2024-10-07 11:29:05.814195] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.010 [2024-10-07 11:29:05.814215] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.010 [2024-10-07 11:29:05.814229] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.010 [2024-10-07 11:29:05.814243] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.010 [2024-10-07 11:29:05.814259] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.010 [2024-10-07 11:29:05.814292] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.010 [2024-10-07 11:29:05.814306] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.011 [2024-10-07 11:29:05.814330] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.011 [2024-10-07 11:29:05.814345] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.011 [2024-10-07 11:29:05.825625] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.011 [2024-10-07 11:29:05.828024] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.011 [2024-10-07 11:29:05.828142] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.011 [2024-10-07 11:29:05.828173] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.011 [2024-10-07 11:29:05.828190] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.011 [2024-10-07 11:29:05.828555] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.011 [2024-10-07 11:29:05.828597] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.011 [2024-10-07 11:29:05.828616] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.011 [2024-10-07 11:29:05.828635] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.011 [2024-10-07 11:29:05.828765] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.011 [2024-10-07 11:29:05.828791] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.011 [2024-10-07 11:29:05.828806] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.011 [2024-10-07 11:29:05.828820] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.011 [2024-10-07 11:29:05.828999] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.011 [2024-10-07 11:29:05.829023] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.011 [2024-10-07 11:29:05.829038] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.011 [2024-10-07 11:29:05.829052] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.011 [2024-10-07 11:29:05.829102] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.011 [2024-10-07 11:29:05.838889] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.011 [2024-10-07 11:29:05.839906] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.011 [2024-10-07 11:29:05.840031] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.011 [2024-10-07 11:29:05.840059] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.011 [2024-10-07 11:29:05.840080] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.011 [2024-10-07 11:29:05.840282] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.011 [2024-10-07 11:29:05.840310] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.011 [2024-10-07 11:29:05.840326] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.011 [2024-10-07 11:29:05.840378] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.011 [2024-10-07 11:29:05.840535] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.011 [2024-10-07 11:29:05.840562] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.011 [2024-10-07 11:29:05.840576] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.011 [2024-10-07 11:29:05.840590] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.011 [2024-10-07 11:29:05.840639] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.011 [2024-10-07 11:29:05.840659] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.011 [2024-10-07 11:29:05.840671] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.011 [2024-10-07 11:29:05.840684] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.011 [2024-10-07 11:29:05.840704] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.011 [2024-10-07 11:29:05.851907] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.011 [2024-10-07 11:29:05.851970] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.011 [2024-10-07 11:29:05.853180] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.011 [2024-10-07 11:29:05.853235] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.011 [2024-10-07 11:29:05.853254] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.011 [2024-10-07 11:29:05.853300] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.011 [2024-10-07 11:29:05.853323] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.011 [2024-10-07 11:29:05.853337] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.011 [2024-10-07 11:29:05.853933] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.011 [2024-10-07 11:29:05.853998] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.011 [2024-10-07 11:29:05.854366] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.011 [2024-10-07 11:29:05.854399] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.011 [2024-10-07 11:29:05.854451] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.011 [2024-10-07 11:29:05.854471] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.011 [2024-10-07 11:29:05.854485] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.011 [2024-10-07 11:29:05.854498] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.011 [2024-10-07 11:29:05.854706] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.011 [2024-10-07 11:29:05.854730] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.011 [2024-10-07 11:29:05.862529] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.011 [2024-10-07 11:29:05.862583] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.011 [2024-10-07 11:29:05.862799] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.011 [2024-10-07 11:29:05.862848] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.011 [2024-10-07 11:29:05.862867] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.011 [2024-10-07 11:29:05.862926] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.011 [2024-10-07 11:29:05.862949] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.011 [2024-10-07 11:29:05.862965] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.011 [2024-10-07 11:29:05.863097] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.011 [2024-10-07 11:29:05.863126] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.011 [2024-10-07 11:29:05.863278] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.011 [2024-10-07 11:29:05.863302] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.011 [2024-10-07 11:29:05.863316] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.011 [2024-10-07 11:29:05.863341] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.011 [2024-10-07 11:29:05.863368] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.011 [2024-10-07 11:29:05.863393] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.011 [2024-10-07 11:29:05.863546] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.011 [2024-10-07 11:29:05.863569] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.011 [2024-10-07 11:29:05.874443] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.011 [2024-10-07 11:29:05.874492] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.011 [2024-10-07 11:29:05.874607] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.011 [2024-10-07 11:29:05.874637] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.011 [2024-10-07 11:29:05.874665] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.011 [2024-10-07 11:29:05.874711] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.011 [2024-10-07 11:29:05.874734] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.011 [2024-10-07 11:29:05.874750] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.011 [2024-10-07 11:29:05.874774] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.011 [2024-10-07 11:29:05.874793] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.011 [2024-10-07 11:29:05.874813] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.011 [2024-10-07 11:29:05.874827] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.011 [2024-10-07 11:29:05.874841] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.011 [2024-10-07 11:29:05.874857] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.011 [2024-10-07 11:29:05.874871] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.011 [2024-10-07 11:29:05.874902] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.011 [2024-10-07 11:29:05.874928] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.011 [2024-10-07 11:29:05.874943] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.011 [2024-10-07 11:29:05.884883] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.011 [2024-10-07 11:29:05.884934] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.011 [2024-10-07 11:29:05.885095] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.011 [2024-10-07 11:29:05.885125] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.011 [2024-10-07 11:29:05.885142] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.011 [2024-10-07 11:29:05.885188] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.012 [2024-10-07 11:29:05.885210] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.012 [2024-10-07 11:29:05.885226] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.012 [2024-10-07 11:29:05.885263] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.012 [2024-10-07 11:29:05.885286] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.012 [2024-10-07 11:29:05.885306] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.012 [2024-10-07 11:29:05.885320] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.012 [2024-10-07 11:29:05.885334] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.012 [2024-10-07 11:29:05.885349] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.012 [2024-10-07 11:29:05.885364] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.012 [2024-10-07 11:29:05.885377] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.012 [2024-10-07 11:29:05.885400] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.012 [2024-10-07 11:29:05.885428] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.012 [2024-10-07 11:29:05.894994] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.012 [2024-10-07 11:29:05.895056] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.012 [2024-10-07 11:29:05.895131] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.012 [2024-10-07 11:29:05.895159] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.012 [2024-10-07 11:29:05.895175] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.012 [2024-10-07 11:29:05.895227] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.012 [2024-10-07 11:29:05.895250] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.012 [2024-10-07 11:29:05.895266] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.012 [2024-10-07 11:29:05.895284] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.012 [2024-10-07 11:29:05.895478] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.012 [2024-10-07 11:29:05.895508] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.012 [2024-10-07 11:29:05.895525] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.012 [2024-10-07 11:29:05.895538] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.012 [2024-10-07 11:29:05.895684] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.012 [2024-10-07 11:29:05.895708] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.012 [2024-10-07 11:29:05.895721] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.012 [2024-10-07 11:29:05.895735] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.012 [2024-10-07 11:29:05.895851] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.012 [2024-10-07 11:29:05.906291] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.012 [2024-10-07 11:29:05.906340] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.012 [2024-10-07 11:29:05.906666] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.012 [2024-10-07 11:29:05.906701] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.012 [2024-10-07 11:29:05.906719] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.012 [2024-10-07 11:29:05.906765] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.012 [2024-10-07 11:29:05.906788] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.012 [2024-10-07 11:29:05.906804] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.012 [2024-10-07 11:29:05.906938] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.012 [2024-10-07 11:29:05.906966] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.012 [2024-10-07 11:29:05.907081] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.012 [2024-10-07 11:29:05.907102] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.012 [2024-10-07 11:29:05.907116] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.012 [2024-10-07 11:29:05.907133] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.012 [2024-10-07 11:29:05.907147] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.012 [2024-10-07 11:29:05.907160] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.012 [2024-10-07 11:29:05.907273] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.012 [2024-10-07 11:29:05.907293] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.012 [2024-10-07 11:29:05.916401] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.012 [2024-10-07 11:29:05.916476] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.012 [2024-10-07 11:29:05.916550] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.012 [2024-10-07 11:29:05.916578] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.012 [2024-10-07 11:29:05.916611] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.012 [2024-10-07 11:29:05.916679] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.012 [2024-10-07 11:29:05.916703] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.012 [2024-10-07 11:29:05.916719] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.012 [2024-10-07 11:29:05.916737] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.012 [2024-10-07 11:29:05.916761] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.012 [2024-10-07 11:29:05.916778] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.012 [2024-10-07 11:29:05.916791] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.012 [2024-10-07 11:29:05.916804] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.012 [2024-10-07 11:29:05.916828] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.012 [2024-10-07 11:29:05.916842] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.012 [2024-10-07 11:29:05.916855] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.012 [2024-10-07 11:29:05.916868] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.012 [2024-10-07 11:29:05.916889] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.012 [2024-10-07 11:29:05.927492] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.012 [2024-10-07 11:29:05.927547] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.012 [2024-10-07 11:29:05.927692] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.012 [2024-10-07 11:29:05.927737] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.012 [2024-10-07 11:29:05.927764] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.012 [2024-10-07 11:29:05.927818] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.012 [2024-10-07 11:29:05.927841] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.012 [2024-10-07 11:29:05.927857] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.012 [2024-10-07 11:29:05.927882] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.012 [2024-10-07 11:29:05.927902] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.012 [2024-10-07 11:29:05.927922] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.012 [2024-10-07 11:29:05.927937] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.012 [2024-10-07 11:29:05.927951] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.012 [2024-10-07 11:29:05.927968] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.012 [2024-10-07 11:29:05.927982] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.012 [2024-10-07 11:29:05.927995] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.012 [2024-10-07 11:29:05.928034] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.012 [2024-10-07 11:29:05.928050] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.012 [2024-10-07 11:29:05.937733] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.012 [2024-10-07 11:29:05.937782] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.012 [2024-10-07 11:29:05.940073] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.012 [2024-10-07 11:29:05.940120] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.012 [2024-10-07 11:29:05.940139] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.012 [2024-10-07 11:29:05.940189] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.012 [2024-10-07 11:29:05.940211] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.012 [2024-10-07 11:29:05.940227] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.012 [2024-10-07 11:29:05.940642] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.012 [2024-10-07 11:29:05.940702] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.012 [2024-10-07 11:29:05.940793] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.012 [2024-10-07 11:29:05.940816] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.012 [2024-10-07 11:29:05.940830] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.012 [2024-10-07 11:29:05.940848] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.013 [2024-10-07 11:29:05.940862] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.013 [2024-10-07 11:29:05.940875] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.013 [2024-10-07 11:29:05.940899] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.013 [2024-10-07 11:29:05.940913] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.013 [2024-10-07 11:29:05.947852] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.013 [2024-10-07 11:29:05.947931] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.013 [2024-10-07 11:29:05.948027] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.013 [2024-10-07 11:29:05.948061] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.013 [2024-10-07 11:29:05.948083] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.013 [2024-10-07 11:29:05.948150] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.013 [2024-10-07 11:29:05.948179] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.013 [2024-10-07 11:29:05.948200] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.013 [2024-10-07 11:29:05.948224] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.013 [2024-10-07 11:29:05.948255] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.013 [2024-10-07 11:29:05.948323] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.013 [2024-10-07 11:29:05.948345] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.013 [2024-10-07 11:29:05.948364] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.013 [2024-10-07 11:29:05.948394] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.013 [2024-10-07 11:29:05.948429] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.013 [2024-10-07 11:29:05.948450] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.013 [2024-10-07 11:29:05.948469] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.013 [2024-10-07 11:29:05.948495] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.013 [2024-10-07 11:29:05.958237] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.013 [2024-10-07 11:29:05.958290] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.013 [2024-10-07 11:29:05.958498] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.013 [2024-10-07 11:29:05.958531] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.013 [2024-10-07 11:29:05.958549] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.013 [2024-10-07 11:29:05.958596] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.013 [2024-10-07 11:29:05.958618] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.013 [2024-10-07 11:29:05.958634] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.013 [2024-10-07 11:29:05.958762] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.013 [2024-10-07 11:29:05.958789] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.013 [2024-10-07 11:29:05.958889] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.013 [2024-10-07 11:29:05.958908] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.013 [2024-10-07 11:29:05.958922] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.013 [2024-10-07 11:29:05.958939] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.013 [2024-10-07 11:29:05.958953] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.013 [2024-10-07 11:29:05.958966] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.013 [2024-10-07 11:29:05.959722] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.013 [2024-10-07 11:29:05.959757] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.013 [2024-10-07 11:29:05.968871] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.013 [2024-10-07 11:29:05.968922] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.013 [2024-10-07 11:29:05.969081] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.013 [2024-10-07 11:29:05.969113] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.013 [2024-10-07 11:29:05.969130] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.013 [2024-10-07 11:29:05.969215] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.013 [2024-10-07 11:29:05.969239] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.013 [2024-10-07 11:29:05.969254] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.013 [2024-10-07 11:29:05.969297] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.013 [2024-10-07 11:29:05.969323] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.013 [2024-10-07 11:29:05.969343] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.013 [2024-10-07 11:29:05.969358] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.013 [2024-10-07 11:29:05.969372] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.013 [2024-10-07 11:29:05.969388] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.013 [2024-10-07 11:29:05.969403] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.013 [2024-10-07 11:29:05.969456] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.013 [2024-10-07 11:29:05.969483] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.013 [2024-10-07 11:29:05.969498] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.013 [2024-10-07 11:29:05.978984] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.013 [2024-10-07 11:29:05.979050] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.013 [2024-10-07 11:29:05.979125] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.013 [2024-10-07 11:29:05.979154] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.013 [2024-10-07 11:29:05.979170] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.013 [2024-10-07 11:29:05.979224] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.013 [2024-10-07 11:29:05.979247] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.013 [2024-10-07 11:29:05.979263] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.013 [2024-10-07 11:29:05.979281] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.013 [2024-10-07 11:29:05.981336] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.013 [2024-10-07 11:29:05.981383] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.013 [2024-10-07 11:29:05.981400] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.013 [2024-10-07 11:29:05.981427] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.013 [2024-10-07 11:29:05.982081] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.013 [2024-10-07 11:29:05.982122] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.013 [2024-10-07 11:29:05.982140] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.013 [2024-10-07 11:29:05.982154] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.013 [2024-10-07 11:29:05.982454] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.013 [2024-10-07 11:29:05.989399] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.013 [2024-10-07 11:29:05.989459] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.013 [2024-10-07 11:29:05.989653] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.013 [2024-10-07 11:29:05.989686] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.013 [2024-10-07 11:29:05.989704] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.013 [2024-10-07 11:29:05.989752] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.013 [2024-10-07 11:29:05.989774] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.013 [2024-10-07 11:29:05.989790] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.013 [2024-10-07 11:29:05.989922] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.013 [2024-10-07 11:29:05.989950] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.013 [2024-10-07 11:29:05.990242] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.014 [2024-10-07 11:29:05.990277] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.014 [2024-10-07 11:29:05.990294] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.014 [2024-10-07 11:29:05.990311] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.014 [2024-10-07 11:29:05.990326] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.014 [2024-10-07 11:29:05.990339] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.014 [2024-10-07 11:29:05.990488] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.014 [2024-10-07 11:29:05.990511] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.014 [2024-10-07 11:29:05.999836] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.014 [2024-10-07 11:29:05.999883] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.014 [2024-10-07 11:29:06.000055] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.014 [2024-10-07 11:29:06.000096] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.014 [2024-10-07 11:29:06.000113] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.014 [2024-10-07 11:29:06.000161] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.014 [2024-10-07 11:29:06.000184] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.014 [2024-10-07 11:29:06.000200] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.014 [2024-10-07 11:29:06.000439] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.014 [2024-10-07 11:29:06.000470] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.014 [2024-10-07 11:29:06.002363] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.014 [2024-10-07 11:29:06.002427] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.014 [2024-10-07 11:29:06.002447] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.014 [2024-10-07 11:29:06.002464] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.014 [2024-10-07 11:29:06.002479] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.014 [2024-10-07 11:29:06.002492] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.014 [2024-10-07 11:29:06.003107] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.014 [2024-10-07 11:29:06.003141] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.014 [2024-10-07 11:29:06.011657] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.014 [2024-10-07 11:29:06.011704] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.014 [2024-10-07 11:29:06.011788] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.014 [2024-10-07 11:29:06.011817] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.014 [2024-10-07 11:29:06.011833] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.014 [2024-10-07 11:29:06.011879] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.014 [2024-10-07 11:29:06.011902] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.014 [2024-10-07 11:29:06.011917] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.014 [2024-10-07 11:29:06.011941] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.014 [2024-10-07 11:29:06.011961] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.014 [2024-10-07 11:29:06.011981] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.014 [2024-10-07 11:29:06.011995] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.014 [2024-10-07 11:29:06.012009] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.014 [2024-10-07 11:29:06.012025] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.014 [2024-10-07 11:29:06.012038] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.014 [2024-10-07 11:29:06.012052] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.014 [2024-10-07 11:29:06.012074] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.014 [2024-10-07 11:29:06.012088] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.014 [2024-10-07 11:29:06.021765] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.014 [2024-10-07 11:29:06.021831] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.014 [2024-10-07 11:29:06.021908] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.014 [2024-10-07 11:29:06.021936] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.014 [2024-10-07 11:29:06.021953] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.014 [2024-10-07 11:29:06.022019] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.014 [2024-10-07 11:29:06.022062] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.014 [2024-10-07 11:29:06.022080] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.014 [2024-10-07 11:29:06.022099] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.014 [2024-10-07 11:29:06.022124] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.014 [2024-10-07 11:29:06.022140] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.014 [2024-10-07 11:29:06.022154] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.014 [2024-10-07 11:29:06.022168] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.014 [2024-10-07 11:29:06.022191] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.014 [2024-10-07 11:29:06.022206] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.014 [2024-10-07 11:29:06.022219] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.014 [2024-10-07 11:29:06.022232] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.014 [2024-10-07 11:29:06.022252] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.014 [2024-10-07 11:29:06.034031] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.014 [2024-10-07 11:29:06.034081] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.014 [2024-10-07 11:29:06.034712] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.014 [2024-10-07 11:29:06.034766] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.014 [2024-10-07 11:29:06.034786] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.014 [2024-10-07 11:29:06.034835] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.014 [2024-10-07 11:29:06.034859] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.014 [2024-10-07 11:29:06.034875] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.014 [2024-10-07 11:29:06.037172] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.014 [2024-10-07 11:29:06.037219] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.014 [2024-10-07 11:29:06.037582] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.014 [2024-10-07 11:29:06.037619] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.014 [2024-10-07 11:29:06.037636] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.014 [2024-10-07 11:29:06.037654] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.014 [2024-10-07 11:29:06.037669] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.014 [2024-10-07 11:29:06.037682] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.014 [2024-10-07 11:29:06.037838] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.014 [2024-10-07 11:29:06.037861] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.014 [2024-10-07 11:29:06.046723] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.014 [2024-10-07 11:29:06.046774] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.014 [2024-10-07 11:29:06.047104] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.014 [2024-10-07 11:29:06.047145] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.014 [2024-10-07 11:29:06.047164] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.014 [2024-10-07 11:29:06.047213] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.014 [2024-10-07 11:29:06.047235] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.014 [2024-10-07 11:29:06.047251] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.014 [2024-10-07 11:29:06.047303] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.014 [2024-10-07 11:29:06.047329] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.014 [2024-10-07 11:29:06.047350] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.014 [2024-10-07 11:29:06.047365] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.014 [2024-10-07 11:29:06.047378] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.014 [2024-10-07 11:29:06.047394] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.014 [2024-10-07 11:29:06.047421] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.014 [2024-10-07 11:29:06.047438] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.014 [2024-10-07 11:29:06.047462] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.014 [2024-10-07 11:29:06.047477] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.014 [2024-10-07 11:29:06.057402] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.015 [2024-10-07 11:29:06.057461] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.015 [2024-10-07 11:29:06.057770] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.015 [2024-10-07 11:29:06.057815] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.015 [2024-10-07 11:29:06.057835] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.015 [2024-10-07 11:29:06.057884] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.015 [2024-10-07 11:29:06.057907] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.015 [2024-10-07 11:29:06.057923] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.015 [2024-10-07 11:29:06.057991] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.015 [2024-10-07 11:29:06.058019] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.015 [2024-10-07 11:29:06.058039] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.015 [2024-10-07 11:29:06.058054] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.015 [2024-10-07 11:29:06.058085] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.015 [2024-10-07 11:29:06.058103] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.015 [2024-10-07 11:29:06.058118] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.015 [2024-10-07 11:29:06.058131] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.015 [2024-10-07 11:29:06.058180] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.015 [2024-10-07 11:29:06.058197] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.015 [2024-10-07 11:29:06.070550] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.015 [2024-10-07 11:29:06.070601] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.015 [2024-10-07 11:29:06.070768] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.015 [2024-10-07 11:29:06.070798] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.015 [2024-10-07 11:29:06.070815] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.015 [2024-10-07 11:29:06.070862] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.015 [2024-10-07 11:29:06.070884] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.015 [2024-10-07 11:29:06.070900] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.015 [2024-10-07 11:29:06.071215] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.015 [2024-10-07 11:29:06.071244] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.015 [2024-10-07 11:29:06.071313] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.015 [2024-10-07 11:29:06.071335] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.015 [2024-10-07 11:29:06.071349] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.015 [2024-10-07 11:29:06.071365] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.015 [2024-10-07 11:29:06.071380] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.015 [2024-10-07 11:29:06.071393] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.015 [2024-10-07 11:29:06.071430] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.015 [2024-10-07 11:29:06.071448] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.015 [2024-10-07 11:29:06.082442] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.015 [2024-10-07 11:29:06.082501] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.015 [2024-10-07 11:29:06.082964] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.015 [2024-10-07 11:29:06.083006] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.015 [2024-10-07 11:29:06.083025] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.015 [2024-10-07 11:29:06.083077] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.015 [2024-10-07 11:29:06.083100] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.015 [2024-10-07 11:29:06.083136] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.015 [2024-10-07 11:29:06.083355] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.015 [2024-10-07 11:29:06.083386] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.015 [2024-10-07 11:29:06.083597] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.015 [2024-10-07 11:29:06.083633] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.015 [2024-10-07 11:29:06.083649] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.015 [2024-10-07 11:29:06.083666] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.015 [2024-10-07 11:29:06.083680] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.015 [2024-10-07 11:29:06.083694] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.015 [2024-10-07 11:29:06.083753] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.015 [2024-10-07 11:29:06.083774] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.015 [2024-10-07 11:29:06.092872] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.015 [2024-10-07 11:29:06.092920] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.015 [2024-10-07 11:29:06.093106] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.015 [2024-10-07 11:29:06.093151] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.015 [2024-10-07 11:29:06.093170] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.015 [2024-10-07 11:29:06.093226] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.015 [2024-10-07 11:29:06.093249] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.015 [2024-10-07 11:29:06.093265] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.015 [2024-10-07 11:29:06.093377] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.015 [2024-10-07 11:29:06.093402] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.015 [2024-10-07 11:29:06.093548] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.015 [2024-10-07 11:29:06.093581] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.015 [2024-10-07 11:29:06.093598] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.015 [2024-10-07 11:29:06.093615] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.015 [2024-10-07 11:29:06.093629] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.015 [2024-10-07 11:29:06.093642] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.015 [2024-10-07 11:29:06.093753] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.015 [2024-10-07 11:29:06.093772] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.015 [2024-10-07 11:29:06.103100] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.015 [2024-10-07 11:29:06.103164] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.015 [2024-10-07 11:29:06.103250] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.015 [2024-10-07 11:29:06.103279] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.015 [2024-10-07 11:29:06.103295] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.015 [2024-10-07 11:29:06.103342] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.015 [2024-10-07 11:29:06.103364] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.015 [2024-10-07 11:29:06.103380] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.015 [2024-10-07 11:29:06.103427] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.015 [2024-10-07 11:29:06.103450] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.015 [2024-10-07 11:29:06.103470] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.015 [2024-10-07 11:29:06.103485] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.015 [2024-10-07 11:29:06.103498] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.015 [2024-10-07 11:29:06.103514] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.015 [2024-10-07 11:29:06.103528] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.015 [2024-10-07 11:29:06.103541] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.015 [2024-10-07 11:29:06.103564] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.015 [2024-10-07 11:29:06.103577] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.015 [2024-10-07 11:29:06.113228] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.015 [2024-10-07 11:29:06.113297] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.015 [2024-10-07 11:29:06.113377] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.015 [2024-10-07 11:29:06.113405] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.015 [2024-10-07 11:29:06.113440] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.015 [2024-10-07 11:29:06.113498] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.015 [2024-10-07 11:29:06.113523] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.015 [2024-10-07 11:29:06.113538] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.015 [2024-10-07 11:29:06.113556] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.016 [2024-10-07 11:29:06.113580] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.016 [2024-10-07 11:29:06.113597] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.016 [2024-10-07 11:29:06.113610] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.016 [2024-10-07 11:29:06.113624] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.016 [2024-10-07 11:29:06.113663] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.016 [2024-10-07 11:29:06.113680] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.016 [2024-10-07 11:29:06.113694] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.016 [2024-10-07 11:29:06.113707] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.016 [2024-10-07 11:29:06.113727] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.016 [2024-10-07 11:29:06.125524] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.016 [2024-10-07 11:29:06.125574] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.016 [2024-10-07 11:29:06.125809] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.016 [2024-10-07 11:29:06.125853] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.016 [2024-10-07 11:29:06.125872] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.016 [2024-10-07 11:29:06.125922] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.016 [2024-10-07 11:29:06.125945] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.016 [2024-10-07 11:29:06.125972] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.016 [2024-10-07 11:29:06.126087] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.016 [2024-10-07 11:29:06.126113] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.016 [2024-10-07 11:29:06.126210] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.016 [2024-10-07 11:29:06.126230] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.016 [2024-10-07 11:29:06.126244] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.016 [2024-10-07 11:29:06.126260] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.016 [2024-10-07 11:29:06.126275] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.016 [2024-10-07 11:29:06.126288] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.016 [2024-10-07 11:29:06.127594] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.016 [2024-10-07 11:29:06.127628] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.016 [2024-10-07 11:29:06.135636] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.016 [2024-10-07 11:29:06.135713] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.016 [2024-10-07 11:29:06.135788] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.016 [2024-10-07 11:29:06.135816] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.016 [2024-10-07 11:29:06.135833] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.016 [2024-10-07 11:29:06.135885] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.016 [2024-10-07 11:29:06.135908] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.016 [2024-10-07 11:29:06.135923] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.016 [2024-10-07 11:29:06.135958] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.016 [2024-10-07 11:29:06.135983] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.016 [2024-10-07 11:29:06.136000] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.016 [2024-10-07 11:29:06.136013] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.016 [2024-10-07 11:29:06.136027] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.016 [2024-10-07 11:29:06.136475] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.016 [2024-10-07 11:29:06.136502] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.016 [2024-10-07 11:29:06.136516] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.016 [2024-10-07 11:29:06.136530] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.016 [2024-10-07 11:29:06.136723] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.016 [2024-10-07 11:29:06.147115] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.016 [2024-10-07 11:29:06.147166] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.016 [2024-10-07 11:29:06.147484] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.016 [2024-10-07 11:29:06.147526] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.016 [2024-10-07 11:29:06.147546] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.016 [2024-10-07 11:29:06.147595] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.016 [2024-10-07 11:29:06.147618] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.016 [2024-10-07 11:29:06.147633] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.016 [2024-10-07 11:29:06.147658] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.016 [2024-10-07 11:29:06.147678] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.016 [2024-10-07 11:29:06.147698] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.016 [2024-10-07 11:29:06.147713] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.016 [2024-10-07 11:29:06.147726] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.016 [2024-10-07 11:29:06.147742] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.016 [2024-10-07 11:29:06.147757] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.016 [2024-10-07 11:29:06.147769] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.016 [2024-10-07 11:29:06.147792] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.016 [2024-10-07 11:29:06.147806] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.016 [2024-10-07 11:29:06.157366] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.016 [2024-10-07 11:29:06.157413] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.016 [2024-10-07 11:29:06.157531] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.016 [2024-10-07 11:29:06.157560] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.016 [2024-10-07 11:29:06.157577] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.016 [2024-10-07 11:29:06.157624] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.016 [2024-10-07 11:29:06.157646] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.016 [2024-10-07 11:29:06.157661] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.016 [2024-10-07 11:29:06.157869] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.016 [2024-10-07 11:29:06.157897] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.016 [2024-10-07 11:29:06.157950] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.016 [2024-10-07 11:29:06.157984] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.016 [2024-10-07 11:29:06.157999] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.016 [2024-10-07 11:29:06.158015] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.016 [2024-10-07 11:29:06.158029] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.016 [2024-10-07 11:29:06.158042] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.016 [2024-10-07 11:29:06.158065] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.016 [2024-10-07 11:29:06.158079] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.016 [2024-10-07 11:29:06.167756] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.016 [2024-10-07 11:29:06.167805] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.016 [2024-10-07 11:29:06.167993] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.016 [2024-10-07 11:29:06.168023] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.016 [2024-10-07 11:29:06.168040] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.016 [2024-10-07 11:29:06.168086] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.016 [2024-10-07 11:29:06.168108] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.016 [2024-10-07 11:29:06.168124] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.016 [2024-10-07 11:29:06.168766] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.016 [2024-10-07 11:29:06.168807] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.016 [2024-10-07 11:29:06.171999] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.016 [2024-10-07 11:29:06.172039] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.016 [2024-10-07 11:29:06.172057] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.016 [2024-10-07 11:29:06.172074] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.016 [2024-10-07 11:29:06.172088] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.016 [2024-10-07 11:29:06.172115] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.016 [2024-10-07 11:29:06.172563] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.017 [2024-10-07 11:29:06.172609] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.017 [2024-10-07 11:29:06.177870] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.017 [2024-10-07 11:29:06.177932] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.017 [2024-10-07 11:29:06.178016] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.017 [2024-10-07 11:29:06.178044] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.017 [2024-10-07 11:29:06.178061] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.017 [2024-10-07 11:29:06.178116] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.017 [2024-10-07 11:29:06.178139] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.017 [2024-10-07 11:29:06.178155] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.017 [2024-10-07 11:29:06.178173] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.017 [2024-10-07 11:29:06.178197] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.017 [2024-10-07 11:29:06.178214] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.017 [2024-10-07 11:29:06.178228] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.017 [2024-10-07 11:29:06.178241] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.017 [2024-10-07 11:29:06.178264] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.017 [2024-10-07 11:29:06.178278] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.017 [2024-10-07 11:29:06.178291] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.017 [2024-10-07 11:29:06.178304] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.017 [2024-10-07 11:29:06.178325] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.017 [2024-10-07 11:29:06.188046] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.017 [2024-10-07 11:29:06.188095] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.017 [2024-10-07 11:29:06.188178] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.017 [2024-10-07 11:29:06.188207] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.017 [2024-10-07 11:29:06.188224] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.017 [2024-10-07 11:29:06.188281] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.017 [2024-10-07 11:29:06.188303] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.017 [2024-10-07 11:29:06.188319] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.017 [2024-10-07 11:29:06.188343] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.017 [2024-10-07 11:29:06.188381] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.017 [2024-10-07 11:29:06.188431] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.017 [2024-10-07 11:29:06.188452] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.017 [2024-10-07 11:29:06.188466] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.017 [2024-10-07 11:29:06.188482] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.017 [2024-10-07 11:29:06.188496] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.017 [2024-10-07 11:29:06.188509] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.017 [2024-10-07 11:29:06.188533] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.017 [2024-10-07 11:29:06.188546] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.017 [2024-10-07 11:29:06.198219] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.017 [2024-10-07 11:29:06.198267] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.017 [2024-10-07 11:29:06.198351] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.017 [2024-10-07 11:29:06.198379] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.017 [2024-10-07 11:29:06.198396] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.017 [2024-10-07 11:29:06.198457] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.017 [2024-10-07 11:29:06.198482] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.017 [2024-10-07 11:29:06.198498] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.017 [2024-10-07 11:29:06.198522] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.017 [2024-10-07 11:29:06.198542] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.017 [2024-10-07 11:29:06.198561] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.017 [2024-10-07 11:29:06.198576] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.017 [2024-10-07 11:29:06.198590] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.017 [2024-10-07 11:29:06.198605] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.017 [2024-10-07 11:29:06.198619] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.017 [2024-10-07 11:29:06.198632] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.017 [2024-10-07 11:29:06.198654] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.017 [2024-10-07 11:29:06.198668] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.017 [2024-10-07 11:29:06.208334] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.017 [2024-10-07 11:29:06.208402] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.017 [2024-10-07 11:29:06.208505] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.017 [2024-10-07 11:29:06.208534] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.017 [2024-10-07 11:29:06.208571] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.017 [2024-10-07 11:29:06.208630] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.017 [2024-10-07 11:29:06.208654] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.017 [2024-10-07 11:29:06.208669] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.017 [2024-10-07 11:29:06.208688] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.017 [2024-10-07 11:29:06.208712] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.017 [2024-10-07 11:29:06.208730] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.017 [2024-10-07 11:29:06.208743] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.017 [2024-10-07 11:29:06.208757] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.017 [2024-10-07 11:29:06.208781] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.017 [2024-10-07 11:29:06.208795] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.017 [2024-10-07 11:29:06.208809] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.017 [2024-10-07 11:29:06.208822] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.017 [2024-10-07 11:29:06.208843] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.017 [2024-10-07 11:29:06.220497] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.017 [2024-10-07 11:29:06.220545] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.017 [2024-10-07 11:29:06.220631] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.017 [2024-10-07 11:29:06.220660] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.017 [2024-10-07 11:29:06.220676] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.017 [2024-10-07 11:29:06.220723] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.017 [2024-10-07 11:29:06.220746] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.017 [2024-10-07 11:29:06.220762] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.017 [2024-10-07 11:29:06.221325] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.017 [2024-10-07 11:29:06.221366] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.017 [2024-10-07 11:29:06.221474] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.017 [2024-10-07 11:29:06.221498] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.017 [2024-10-07 11:29:06.221512] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.017 [2024-10-07 11:29:06.221529] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.017 [2024-10-07 11:29:06.221544] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.018 [2024-10-07 11:29:06.221572] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.018 [2024-10-07 11:29:06.221599] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.018 [2024-10-07 11:29:06.221614] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.018 [2024-10-07 11:29:06.231117] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.018 [2024-10-07 11:29:06.231166] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.018 [2024-10-07 11:29:06.231338] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.018 [2024-10-07 11:29:06.231369] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.018 [2024-10-07 11:29:06.231386] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.018 [2024-10-07 11:29:06.231447] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.018 [2024-10-07 11:29:06.231472] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.018 [2024-10-07 11:29:06.231488] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.018 [2024-10-07 11:29:06.231591] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.018 [2024-10-07 11:29:06.231614] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.018 [2024-10-07 11:29:06.231727] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.018 [2024-10-07 11:29:06.231748] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.018 [2024-10-07 11:29:06.231762] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.018 [2024-10-07 11:29:06.231779] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.018 [2024-10-07 11:29:06.231794] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.018 [2024-10-07 11:29:06.231807] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.018 [2024-10-07 11:29:06.232154] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.018 [2024-10-07 11:29:06.232179] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.018 [2024-10-07 11:29:06.241230] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.018 [2024-10-07 11:29:06.241293] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.018 [2024-10-07 11:29:06.241369] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.018 [2024-10-07 11:29:06.241397] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.018 [2024-10-07 11:29:06.241430] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.018 [2024-10-07 11:29:06.241488] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.018 [2024-10-07 11:29:06.241512] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.018 [2024-10-07 11:29:06.241528] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.018 [2024-10-07 11:29:06.241546] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.018 [2024-10-07 11:29:06.241569] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.018 [2024-10-07 11:29:06.241602] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.018 [2024-10-07 11:29:06.241617] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.018 [2024-10-07 11:29:06.241631] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.018 [2024-10-07 11:29:06.241654] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.018 [2024-10-07 11:29:06.241669] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.018 [2024-10-07 11:29:06.241682] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.018 [2024-10-07 11:29:06.241695] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.018 [2024-10-07 11:29:06.241715] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.018 [2024-10-07 11:29:06.252843] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.018 [2024-10-07 11:29:06.252892] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.018 [2024-10-07 11:29:06.253003] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.018 [2024-10-07 11:29:06.253034] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.018 [2024-10-07 11:29:06.253051] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.018 [2024-10-07 11:29:06.253097] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.018 [2024-10-07 11:29:06.253120] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.018 [2024-10-07 11:29:06.253135] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.018 [2024-10-07 11:29:06.253159] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.018 [2024-10-07 11:29:06.253178] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.018 [2024-10-07 11:29:06.253198] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.018 [2024-10-07 11:29:06.253212] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.018 [2024-10-07 11:29:06.253225] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.018 [2024-10-07 11:29:06.253241] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.018 [2024-10-07 11:29:06.253255] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.018 [2024-10-07 11:29:06.253268] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.018 [2024-10-07 11:29:06.253307] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.018 [2024-10-07 11:29:06.253325] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.018 [2024-10-07 11:29:06.263017] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.018 [2024-10-07 11:29:06.263063] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.018 [2024-10-07 11:29:06.263146] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.018 [2024-10-07 11:29:06.263174] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.018 [2024-10-07 11:29:06.263191] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.018 [2024-10-07 11:29:06.263254] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.018 [2024-10-07 11:29:06.263278] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.018 [2024-10-07 11:29:06.263294] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.018 [2024-10-07 11:29:06.263892] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.018 [2024-10-07 11:29:06.263933] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.018 [2024-10-07 11:29:06.264027] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.018 [2024-10-07 11:29:06.264049] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.018 [2024-10-07 11:29:06.264064] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.018 [2024-10-07 11:29:06.264080] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.018 [2024-10-07 11:29:06.264094] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.018 [2024-10-07 11:29:06.264107] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.018 [2024-10-07 11:29:06.264130] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.018 [2024-10-07 11:29:06.264144] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.018 [2024-10-07 11:29:06.275584] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.018 [2024-10-07 11:29:06.275635] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.018 [2024-10-07 11:29:06.275769] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.018 [2024-10-07 11:29:06.275799] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.018 [2024-10-07 11:29:06.275817] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.018 [2024-10-07 11:29:06.275863] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.018 [2024-10-07 11:29:06.275885] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.018 [2024-10-07 11:29:06.275901] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.018 [2024-10-07 11:29:06.275925] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.018 [2024-10-07 11:29:06.275945] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.018 [2024-10-07 11:29:06.275981] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.018 [2024-10-07 11:29:06.276000] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.018 [2024-10-07 11:29:06.276014] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.018 [2024-10-07 11:29:06.276030] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.018 [2024-10-07 11:29:06.276044] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.018 [2024-10-07 11:29:06.276057] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.018 [2024-10-07 11:29:06.276080] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.018 [2024-10-07 11:29:06.276110] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.018 [2024-10-07 11:29:06.290056] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.018 [2024-10-07 11:29:06.290108] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.018 [2024-10-07 11:29:06.290554] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.018 [2024-10-07 11:29:06.290597] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.018 [2024-10-07 11:29:06.290616] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.019 [2024-10-07 11:29:06.290664] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.019 [2024-10-07 11:29:06.290686] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.019 [2024-10-07 11:29:06.290702] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.019 [2024-10-07 11:29:06.291232] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.019 [2024-10-07 11:29:06.291273] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.019 [2024-10-07 11:29:06.291513] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.019 [2024-10-07 11:29:06.291548] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.019 [2024-10-07 11:29:06.291566] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.019 [2024-10-07 11:29:06.291583] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.019 [2024-10-07 11:29:06.291598] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.019 [2024-10-07 11:29:06.291611] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.019 [2024-10-07 11:29:06.291814] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.019 [2024-10-07 11:29:06.291839] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.019 [2024-10-07 11:29:06.303310] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.019 [2024-10-07 11:29:06.303360] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.019 [2024-10-07 11:29:06.304218] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.019 [2024-10-07 11:29:06.304260] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.019 [2024-10-07 11:29:06.304279] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.019 [2024-10-07 11:29:06.304328] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.019 [2024-10-07 11:29:06.304350] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.019 [2024-10-07 11:29:06.304366] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.019 [2024-10-07 11:29:06.304630] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.019 [2024-10-07 11:29:06.304662] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.019 [2024-10-07 11:29:06.304711] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.019 [2024-10-07 11:29:06.304749] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.019 [2024-10-07 11:29:06.304764] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.019 [2024-10-07 11:29:06.304788] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.019 [2024-10-07 11:29:06.304803] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.019 [2024-10-07 11:29:06.304816] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.019 [2024-10-07 11:29:06.304954] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.019 [2024-10-07 11:29:06.304978] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.019 [2024-10-07 11:29:06.314290] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.019 [2024-10-07 11:29:06.314341] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.019 [2024-10-07 11:29:06.314532] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.019 [2024-10-07 11:29:06.314563] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.019 [2024-10-07 11:29:06.314581] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.019 [2024-10-07 11:29:06.314630] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.019 [2024-10-07 11:29:06.314653] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.019 [2024-10-07 11:29:06.314669] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.019 [2024-10-07 11:29:06.314773] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.019 [2024-10-07 11:29:06.314797] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.019 [2024-10-07 11:29:06.316777] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.019 [2024-10-07 11:29:06.316830] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.019 [2024-10-07 11:29:06.316853] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.019 [2024-10-07 11:29:06.316871] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.019 [2024-10-07 11:29:06.316885] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.019 [2024-10-07 11:29:06.316899] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.019 [2024-10-07 11:29:06.319073] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.019 [2024-10-07 11:29:06.319116] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.019 [2024-10-07 11:29:06.330159] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.019 [2024-10-07 11:29:06.330210] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.019 [2024-10-07 11:29:06.330671] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.019 [2024-10-07 11:29:06.330714] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.019 [2024-10-07 11:29:06.330734] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.019 [2024-10-07 11:29:06.330783] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.019 [2024-10-07 11:29:06.330825] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.019 [2024-10-07 11:29:06.330843] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.019 [2024-10-07 11:29:06.330911] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.019 [2024-10-07 11:29:06.330937] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.019 [2024-10-07 11:29:06.330958] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.019 [2024-10-07 11:29:06.330973] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.019 [2024-10-07 11:29:06.330987] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.019 [2024-10-07 11:29:06.331003] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.019 [2024-10-07 11:29:06.331018] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.019 [2024-10-07 11:29:06.331030] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.019 [2024-10-07 11:29:06.331054] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.019 [2024-10-07 11:29:06.331069] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.019 [2024-10-07 11:29:06.340909] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.019 [2024-10-07 11:29:06.340957] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.019 [2024-10-07 11:29:06.341129] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.019 [2024-10-07 11:29:06.341159] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.019 [2024-10-07 11:29:06.341177] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.019 [2024-10-07 11:29:06.341224] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.019 [2024-10-07 11:29:06.341246] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.019 [2024-10-07 11:29:06.341262] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.019 [2024-10-07 11:29:06.344838] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.019 [2024-10-07 11:29:06.344888] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.019 [2024-10-07 11:29:06.345093] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.019 [2024-10-07 11:29:06.345120] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.019 [2024-10-07 11:29:06.345135] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.019 [2024-10-07 11:29:06.345153] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.019 [2024-10-07 11:29:06.345167] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.019 [2024-10-07 11:29:06.345180] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.019 [2024-10-07 11:29:06.345319] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.019 [2024-10-07 11:29:06.345341] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.019 [2024-10-07 11:29:06.351436] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.019 [2024-10-07 11:29:06.351495] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.019 [2024-10-07 11:29:06.351581] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.019 [2024-10-07 11:29:06.351611] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.019 [2024-10-07 11:29:06.351628] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.019 [2024-10-07 11:29:06.351674] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.019 [2024-10-07 11:29:06.351697] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.019 [2024-10-07 11:29:06.351712] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.019 [2024-10-07 11:29:06.353295] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.019 [2024-10-07 11:29:06.353339] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.019 [2024-10-07 11:29:06.354154] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.019 [2024-10-07 11:29:06.354191] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.020 [2024-10-07 11:29:06.354208] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.020 [2024-10-07 11:29:06.354226] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.020 [2024-10-07 11:29:06.354240] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.020 [2024-10-07 11:29:06.354253] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.020 [2024-10-07 11:29:06.354357] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.020 [2024-10-07 11:29:06.354378] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.020 [2024-10-07 11:29:06.361557] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.020 [2024-10-07 11:29:06.361619] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.020 [2024-10-07 11:29:06.361702] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.020 [2024-10-07 11:29:06.361730] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.020 [2024-10-07 11:29:06.361747] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.020 [2024-10-07 11:29:06.361816] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.020 [2024-10-07 11:29:06.361839] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.020 [2024-10-07 11:29:06.361854] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.020 [2024-10-07 11:29:06.361872] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.020 [2024-10-07 11:29:06.361895] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.020 [2024-10-07 11:29:06.361911] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.020 [2024-10-07 11:29:06.361925] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.020 [2024-10-07 11:29:06.361956] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.020 [2024-10-07 11:29:06.362028] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.020 [2024-10-07 11:29:06.362047] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.020 [2024-10-07 11:29:06.362060] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.020 [2024-10-07 11:29:06.362074] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.020 [2024-10-07 11:29:06.362094] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.020 [2024-10-07 11:29:06.374223] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.020 [2024-10-07 11:29:06.374275] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.020 [2024-10-07 11:29:06.374473] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.020 [2024-10-07 11:29:06.374504] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.020 [2024-10-07 11:29:06.374522] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.020 [2024-10-07 11:29:06.374568] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.020 [2024-10-07 11:29:06.374591] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.020 [2024-10-07 11:29:06.374606] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.020 [2024-10-07 11:29:06.374770] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.020 [2024-10-07 11:29:06.374799] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.020 [2024-10-07 11:29:06.375024] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.020 [2024-10-07 11:29:06.375049] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.020 [2024-10-07 11:29:06.375065] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.020 [2024-10-07 11:29:06.375081] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.020 [2024-10-07 11:29:06.375095] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.020 [2024-10-07 11:29:06.375108] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.020 [2024-10-07 11:29:06.375246] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.020 [2024-10-07 11:29:06.375270] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.020 [2024-10-07 11:29:06.384338] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.020 [2024-10-07 11:29:06.384401] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.020 [2024-10-07 11:29:06.384492] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.020 [2024-10-07 11:29:06.384520] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.020 [2024-10-07 11:29:06.384537] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.020 [2024-10-07 11:29:06.384593] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.020 [2024-10-07 11:29:06.384616] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.020 [2024-10-07 11:29:06.384650] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.020 [2024-10-07 11:29:06.384670] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.020 [2024-10-07 11:29:06.386908] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.020 [2024-10-07 11:29:06.386952] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.020 [2024-10-07 11:29:06.386973] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.020 [2024-10-07 11:29:06.387001] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.020 [2024-10-07 11:29:06.387722] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.020 [2024-10-07 11:29:06.387758] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.020 [2024-10-07 11:29:06.387774] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.020 [2024-10-07 11:29:06.387788] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.020 [2024-10-07 11:29:06.387909] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.020 [2024-10-07 11:29:06.394419] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.020 [2024-10-07 11:29:06.394570] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.020 [2024-10-07 11:29:06.394601] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.020 [2024-10-07 11:29:06.394619] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.020 [2024-10-07 11:29:06.394673] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.020 [2024-10-07 11:29:06.394703] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.020 [2024-10-07 11:29:06.394729] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.020 [2024-10-07 11:29:06.394744] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.020 [2024-10-07 11:29:06.394757] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.020 [2024-10-07 11:29:06.394777] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.020 [2024-10-07 11:29:06.394829] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.020 [2024-10-07 11:29:06.394853] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.020 [2024-10-07 11:29:06.394868] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.020 [2024-10-07 11:29:06.394890] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.020 [2024-10-07 11:29:06.394912] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.020 [2024-10-07 11:29:06.394926] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.020 [2024-10-07 11:29:06.394939] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.020 [2024-10-07 11:29:06.394960] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.020 8854.71 IOPS, 34.59 MiB/s [2024-10-07T11:29:15.731Z] [2024-10-07 11:29:06.405671] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.020 [2024-10-07 11:29:06.405733] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.020 [2024-10-07 11:29:06.405944] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.020 [2024-10-07 11:29:06.405987] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.020 [2024-10-07 11:29:06.406012] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.020 [2024-10-07 11:29:06.406060] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.020 [2024-10-07 11:29:06.406083] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.020 [2024-10-07 11:29:06.406099] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.020 [2024-10-07 11:29:06.406214] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.020 [2024-10-07 11:29:06.406239] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.020 [2024-10-07 11:29:06.406337] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.020 [2024-10-07 11:29:06.406356] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.020 [2024-10-07 11:29:06.406369] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.020 [2024-10-07 11:29:06.406385] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.020 [2024-10-07 11:29:06.406399] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.020 [2024-10-07 11:29:06.406428] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.020 [2024-10-07 11:29:06.406544] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.020 [2024-10-07 11:29:06.406564] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.020 [2024-10-07 11:29:06.416333] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.020 [2024-10-07 11:29:06.416382] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.021 [2024-10-07 11:29:06.416632] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.021 [2024-10-07 11:29:06.416666] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.021 [2024-10-07 11:29:06.416683] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.021 [2024-10-07 11:29:06.416730] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.021 [2024-10-07 11:29:06.416752] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.021 [2024-10-07 11:29:06.416768] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.021 [2024-10-07 11:29:06.416823] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.021 [2024-10-07 11:29:06.416849] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.021 [2024-10-07 11:29:06.416869] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.021 [2024-10-07 11:29:06.416884] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.021 [2024-10-07 11:29:06.416898] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.021 [2024-10-07 11:29:06.416929] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.021 [2024-10-07 11:29:06.416945] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.021 [2024-10-07 11:29:06.416958] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.021 [2024-10-07 11:29:06.416981] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.021 [2024-10-07 11:29:06.416995] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.021 [2024-10-07 11:29:06.429714] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.021 [2024-10-07 11:29:06.429766] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.021 [2024-10-07 11:29:06.429850] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.021 [2024-10-07 11:29:06.429879] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.021 [2024-10-07 11:29:06.429896] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.021 [2024-10-07 11:29:06.429943] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.021 [2024-10-07 11:29:06.429977] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.021 [2024-10-07 11:29:06.429994] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.021 [2024-10-07 11:29:06.430615] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.021 [2024-10-07 11:29:06.430658] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.021 [2024-10-07 11:29:06.430746] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.021 [2024-10-07 11:29:06.430767] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.021 [2024-10-07 11:29:06.430782] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.021 [2024-10-07 11:29:06.430798] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.021 [2024-10-07 11:29:06.430812] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.021 [2024-10-07 11:29:06.430825] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.021 [2024-10-07 11:29:06.430848] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.021 [2024-10-07 11:29:06.430863] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.021 [2024-10-07 11:29:06.440909] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.021 [2024-10-07 11:29:06.440957] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.021 [2024-10-07 11:29:06.441152] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.021 [2024-10-07 11:29:06.441183] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.021 [2024-10-07 11:29:06.441200] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.021 [2024-10-07 11:29:06.441246] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.021 [2024-10-07 11:29:06.441268] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.021 [2024-10-07 11:29:06.441283] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.021 [2024-10-07 11:29:06.441512] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.021 [2024-10-07 11:29:06.441543] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.021 [2024-10-07 11:29:06.441696] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.021 [2024-10-07 11:29:06.441720] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.021 [2024-10-07 11:29:06.441734] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.021 [2024-10-07 11:29:06.441767] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.021 [2024-10-07 11:29:06.441780] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.021 [2024-10-07 11:29:06.441793] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.021 [2024-10-07 11:29:06.442523] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.021 [2024-10-07 11:29:06.442573] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.021 [2024-10-07 11:29:06.451546] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.021 [2024-10-07 11:29:06.451608] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.021 [2024-10-07 11:29:06.451708] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.021 [2024-10-07 11:29:06.451736] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.021 [2024-10-07 11:29:06.451753] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.021 [2024-10-07 11:29:06.451799] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.021 [2024-10-07 11:29:06.451822] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.021 [2024-10-07 11:29:06.451837] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.021 [2024-10-07 11:29:06.451860] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.021 [2024-10-07 11:29:06.451879] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.021 [2024-10-07 11:29:06.451899] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.021 [2024-10-07 11:29:06.451914] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.021 [2024-10-07 11:29:06.451927] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.021 [2024-10-07 11:29:06.451943] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.021 [2024-10-07 11:29:06.451957] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.021 [2024-10-07 11:29:06.451969] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.021 [2024-10-07 11:29:06.451993] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.021 [2024-10-07 11:29:06.452006] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.021 [2024-10-07 11:29:06.464492] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.021 [2024-10-07 11:29:06.464544] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.021 [2024-10-07 11:29:06.464648] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.021 [2024-10-07 11:29:06.464678] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.021 [2024-10-07 11:29:06.464695] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.021 [2024-10-07 11:29:06.464742] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.021 [2024-10-07 11:29:06.464765] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.021 [2024-10-07 11:29:06.464780] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.021 [2024-10-07 11:29:06.464804] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.021 [2024-10-07 11:29:06.464838] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.021 [2024-10-07 11:29:06.464858] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.021 [2024-10-07 11:29:06.464872] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.021 [2024-10-07 11:29:06.464885] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.021 [2024-10-07 11:29:06.464901] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.021 [2024-10-07 11:29:06.464914] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.021 [2024-10-07 11:29:06.464928] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.021 [2024-10-07 11:29:06.464950] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.022 [2024-10-07 11:29:06.464963] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.022 [2024-10-07 11:29:06.475166] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.022 [2024-10-07 11:29:06.475214] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.022 [2024-10-07 11:29:06.475314] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.022 [2024-10-07 11:29:06.475342] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.022 [2024-10-07 11:29:06.475359] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.022 [2024-10-07 11:29:06.475422] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.022 [2024-10-07 11:29:06.475457] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.022 [2024-10-07 11:29:06.475491] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.022 [2024-10-07 11:29:06.475515] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.022 [2024-10-07 11:29:06.475534] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.022 [2024-10-07 11:29:06.477518] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.022 [2024-10-07 11:29:06.477554] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.022 [2024-10-07 11:29:06.477587] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.022 [2024-10-07 11:29:06.477604] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.022 [2024-10-07 11:29:06.477634] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.022 [2024-10-07 11:29:06.477649] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.022 [2024-10-07 11:29:06.478308] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.022 [2024-10-07 11:29:06.478360] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.022 [2024-10-07 11:29:06.486065] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.022 [2024-10-07 11:29:06.486235] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.022 [2024-10-07 11:29:06.486330] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.022 [2024-10-07 11:29:06.486357] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.022 [2024-10-07 11:29:06.486373] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.022 [2024-10-07 11:29:06.486652] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.022 [2024-10-07 11:29:06.486691] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.022 [2024-10-07 11:29:06.486709] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.022 [2024-10-07 11:29:06.486727] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.022 [2024-10-07 11:29:06.486849] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.022 [2024-10-07 11:29:06.486873] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.022 [2024-10-07 11:29:06.486887] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.022 [2024-10-07 11:29:06.486899] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.022 [2024-10-07 11:29:06.487351] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.022 [2024-10-07 11:29:06.487387] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.022 [2024-10-07 11:29:06.487419] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.022 [2024-10-07 11:29:06.487456] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.022 [2024-10-07 11:29:06.487626] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.022 [2024-10-07 11:29:06.496145] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.022 [2024-10-07 11:29:06.496249] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.022 [2024-10-07 11:29:06.496279] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.022 [2024-10-07 11:29:06.496296] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.022 [2024-10-07 11:29:06.496320] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.022 [2024-10-07 11:29:06.496355] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.022 [2024-10-07 11:29:06.496382] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.022 [2024-10-07 11:29:06.496406] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.022 [2024-10-07 11:29:06.496461] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.022 [2024-10-07 11:29:06.496501] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.022 [2024-10-07 11:29:06.496571] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.022 [2024-10-07 11:29:06.496599] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.022 [2024-10-07 11:29:06.496615] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.022 [2024-10-07 11:29:06.496639] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.022 [2024-10-07 11:29:06.496661] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.022 [2024-10-07 11:29:06.496675] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.022 [2024-10-07 11:29:06.496688] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.022 [2024-10-07 11:29:06.496710] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.022 [2024-10-07 11:29:06.506673] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.022 [2024-10-07 11:29:06.506738] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.022 [2024-10-07 11:29:06.506813] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.022 [2024-10-07 11:29:06.506841] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.022 [2024-10-07 11:29:06.506864] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.022 [2024-10-07 11:29:06.507491] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.022 [2024-10-07 11:29:06.507531] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.022 [2024-10-07 11:29:06.507550] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.022 [2024-10-07 11:29:06.507569] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.022 [2024-10-07 11:29:06.507680] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.022 [2024-10-07 11:29:06.507707] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.022 [2024-10-07 11:29:06.507721] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.022 [2024-10-07 11:29:06.507735] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.022 [2024-10-07 11:29:06.507769] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.022 [2024-10-07 11:29:06.507786] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.022 [2024-10-07 11:29:06.507800] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.022 [2024-10-07 11:29:06.507813] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.022 [2024-10-07 11:29:06.507834] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.022 [2024-10-07 11:29:06.517021] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.022 [2024-10-07 11:29:06.517071] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.022 [2024-10-07 11:29:06.517507] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.022 [2024-10-07 11:29:06.517565] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.022 [2024-10-07 11:29:06.517586] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.022 [2024-10-07 11:29:06.517647] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.022 [2024-10-07 11:29:06.517670] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.022 [2024-10-07 11:29:06.517686] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.022 [2024-10-07 11:29:06.519545] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.022 [2024-10-07 11:29:06.519590] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.022 [2024-10-07 11:29:06.520218] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.022 [2024-10-07 11:29:06.520254] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.022 [2024-10-07 11:29:06.520271] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.022 [2024-10-07 11:29:06.520288] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.022 [2024-10-07 11:29:06.520302] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.022 [2024-10-07 11:29:06.520315] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.022 [2024-10-07 11:29:06.520571] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.022 [2024-10-07 11:29:06.520597] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.022 [2024-10-07 11:29:06.528380] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.022 [2024-10-07 11:29:06.528440] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.022 [2024-10-07 11:29:06.528633] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.022 [2024-10-07 11:29:06.528664] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.022 [2024-10-07 11:29:06.528681] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.022 [2024-10-07 11:29:06.528729] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.023 [2024-10-07 11:29:06.528752] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.023 [2024-10-07 11:29:06.528767] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.023 [2024-10-07 11:29:06.528936] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.023 [2024-10-07 11:29:06.528965] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.023 [2024-10-07 11:29:06.529080] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.023 [2024-10-07 11:29:06.529101] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.023 [2024-10-07 11:29:06.529115] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.023 [2024-10-07 11:29:06.529131] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.023 [2024-10-07 11:29:06.529145] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.023 [2024-10-07 11:29:06.529173] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.023 [2024-10-07 11:29:06.529276] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.023 [2024-10-07 11:29:06.529295] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.023 [2024-10-07 11:29:06.540651] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.023 [2024-10-07 11:29:06.540698] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.023 [2024-10-07 11:29:06.540839] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.023 [2024-10-07 11:29:06.540868] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.023 [2024-10-07 11:29:06.540885] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.023 [2024-10-07 11:29:06.540931] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.023 [2024-10-07 11:29:06.540969] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.023 [2024-10-07 11:29:06.540985] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.023 [2024-10-07 11:29:06.541010] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.023 [2024-10-07 11:29:06.541029] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.023 [2024-10-07 11:29:06.541049] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.023 [2024-10-07 11:29:06.541063] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.023 [2024-10-07 11:29:06.541077] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.023 [2024-10-07 11:29:06.541093] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.023 [2024-10-07 11:29:06.541107] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.023 [2024-10-07 11:29:06.541120] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.023 [2024-10-07 11:29:06.541144] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.023 [2024-10-07 11:29:06.541157] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.023 [2024-10-07 11:29:06.551665] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.023 [2024-10-07 11:29:06.551713] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.023 [2024-10-07 11:29:06.551797] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.023 [2024-10-07 11:29:06.551826] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.023 [2024-10-07 11:29:06.551843] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.023 [2024-10-07 11:29:06.551890] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.023 [2024-10-07 11:29:06.551912] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.023 [2024-10-07 11:29:06.551928] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.023 [2024-10-07 11:29:06.551953] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.023 [2024-10-07 11:29:06.551972] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.023 [2024-10-07 11:29:06.552008] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.023 [2024-10-07 11:29:06.552024] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.023 [2024-10-07 11:29:06.552038] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.023 [2024-10-07 11:29:06.552054] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.023 [2024-10-07 11:29:06.552067] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.023 [2024-10-07 11:29:06.552081] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.023 [2024-10-07 11:29:06.552273] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.023 [2024-10-07 11:29:06.552303] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.023 [2024-10-07 11:29:06.562268] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.023 [2024-10-07 11:29:06.562318] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.023 [2024-10-07 11:29:06.562406] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.023 [2024-10-07 11:29:06.562450] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.023 [2024-10-07 11:29:06.562468] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.023 [2024-10-07 11:29:06.562517] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.023 [2024-10-07 11:29:06.562540] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.023 [2024-10-07 11:29:06.562556] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.023 [2024-10-07 11:29:06.562580] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.023 [2024-10-07 11:29:06.562600] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.023 [2024-10-07 11:29:06.562620] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.023 [2024-10-07 11:29:06.562634] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.023 [2024-10-07 11:29:06.562648] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.023 [2024-10-07 11:29:06.562664] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.023 [2024-10-07 11:29:06.562694] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.023 [2024-10-07 11:29:06.562706] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.023 [2024-10-07 11:29:06.562729] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.023 [2024-10-07 11:29:06.562742] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.023 [2024-10-07 11:29:06.572584] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.023 [2024-10-07 11:29:06.572629] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.023 [2024-10-07 11:29:06.572715] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.023 [2024-10-07 11:29:06.572744] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.023 [2024-10-07 11:29:06.572775] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.023 [2024-10-07 11:29:06.572826] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.023 [2024-10-07 11:29:06.572850] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.023 [2024-10-07 11:29:06.572865] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.023 [2024-10-07 11:29:06.572889] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.023 [2024-10-07 11:29:06.572908] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.023 [2024-10-07 11:29:06.572928] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.023 [2024-10-07 11:29:06.572942] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.023 [2024-10-07 11:29:06.572956] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.023 [2024-10-07 11:29:06.572971] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.023 [2024-10-07 11:29:06.572985] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.023 [2024-10-07 11:29:06.572998] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.023 [2024-10-07 11:29:06.573021] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.023 [2024-10-07 11:29:06.573035] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.023 [2024-10-07 11:29:06.583426] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.023 [2024-10-07 11:29:06.583500] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.023 [2024-10-07 11:29:06.583610] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.023 [2024-10-07 11:29:06.583657] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.023 [2024-10-07 11:29:06.583674] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.023 [2024-10-07 11:29:06.583721] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.023 [2024-10-07 11:29:06.583743] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.023 [2024-10-07 11:29:06.583758] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.023 [2024-10-07 11:29:06.583797] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.023 [2024-10-07 11:29:06.583816] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.023 [2024-10-07 11:29:06.583835] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.023 [2024-10-07 11:29:06.583849] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.023 [2024-10-07 11:29:06.583863] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.023 [2024-10-07 11:29:06.583878] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.024 [2024-10-07 11:29:06.583908] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.024 [2024-10-07 11:29:06.583921] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.024 [2024-10-07 11:29:06.583961] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.024 [2024-10-07 11:29:06.583977] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.024 [2024-10-07 11:29:06.598103] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.024 [2024-10-07 11:29:06.598155] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.024 [2024-10-07 11:29:06.598506] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.024 [2024-10-07 11:29:06.598548] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.024 [2024-10-07 11:29:06.598567] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.024 [2024-10-07 11:29:06.598617] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.024 [2024-10-07 11:29:06.598640] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.024 [2024-10-07 11:29:06.598655] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.024 [2024-10-07 11:29:06.598710] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.024 [2024-10-07 11:29:06.598735] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.024 [2024-10-07 11:29:06.598756] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.024 [2024-10-07 11:29:06.598770] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.024 [2024-10-07 11:29:06.598784] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.024 [2024-10-07 11:29:06.598802] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.024 [2024-10-07 11:29:06.598816] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.024 [2024-10-07 11:29:06.598830] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.024 [2024-10-07 11:29:06.598853] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.024 [2024-10-07 11:29:06.598867] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.024 [2024-10-07 11:29:06.611489] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.024 [2024-10-07 11:29:06.611536] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.024 [2024-10-07 11:29:06.611664] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.024 [2024-10-07 11:29:06.611694] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.024 [2024-10-07 11:29:06.611711] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.024 [2024-10-07 11:29:06.611757] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.024 [2024-10-07 11:29:06.611779] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.024 [2024-10-07 11:29:06.611794] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.024 [2024-10-07 11:29:06.611818] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.024 [2024-10-07 11:29:06.611838] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.024 [2024-10-07 11:29:06.611858] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.024 [2024-10-07 11:29:06.611896] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.024 [2024-10-07 11:29:06.611912] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.024 [2024-10-07 11:29:06.611928] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.024 [2024-10-07 11:29:06.611943] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.024 [2024-10-07 11:29:06.611956] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.024 [2024-10-07 11:29:06.612216] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.024 [2024-10-07 11:29:06.612241] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.024 [2024-10-07 11:29:06.621612] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.024 [2024-10-07 11:29:06.621662] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.024 [2024-10-07 11:29:06.621748] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.024 [2024-10-07 11:29:06.621777] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.024 [2024-10-07 11:29:06.621794] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.024 [2024-10-07 11:29:06.621841] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.024 [2024-10-07 11:29:06.621863] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.024 [2024-10-07 11:29:06.621879] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.024 [2024-10-07 11:29:06.621903] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.024 [2024-10-07 11:29:06.621922] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.024 [2024-10-07 11:29:06.621942] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.024 [2024-10-07 11:29:06.621956] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.024 [2024-10-07 11:29:06.621983] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.024 [2024-10-07 11:29:06.621999] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.024 [2024-10-07 11:29:06.622013] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.024 [2024-10-07 11:29:06.622036] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.024 [2024-10-07 11:29:06.622058] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.024 [2024-10-07 11:29:06.622072] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.024 [2024-10-07 11:29:06.633841] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.024 [2024-10-07 11:29:06.633889] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.024 [2024-10-07 11:29:06.634561] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.024 [2024-10-07 11:29:06.634617] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.024 [2024-10-07 11:29:06.634636] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.024 [2024-10-07 11:29:06.634703] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.024 [2024-10-07 11:29:06.634727] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.024 [2024-10-07 11:29:06.634741] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.024 [2024-10-07 11:29:06.635054] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.024 [2024-10-07 11:29:06.635084] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.024 [2024-10-07 11:29:06.635226] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.024 [2024-10-07 11:29:06.635248] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.024 [2024-10-07 11:29:06.635262] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.024 [2024-10-07 11:29:06.635278] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.024 [2024-10-07 11:29:06.635292] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.024 [2024-10-07 11:29:06.635304] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.024 [2024-10-07 11:29:06.635417] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.024 [2024-10-07 11:29:06.635435] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.024 [2024-10-07 11:29:06.645078] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.024 [2024-10-07 11:29:06.645158] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.024 [2024-10-07 11:29:06.645410] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.024 [2024-10-07 11:29:06.645483] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.024 [2024-10-07 11:29:06.645503] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.024 [2024-10-07 11:29:06.645552] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.024 [2024-10-07 11:29:06.645574] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.024 [2024-10-07 11:29:06.645590] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.024 [2024-10-07 11:29:06.645635] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.024 [2024-10-07 11:29:06.645659] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.024 [2024-10-07 11:29:06.645696] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.024 [2024-10-07 11:29:06.645711] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.024 [2024-10-07 11:29:06.645724] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.024 [2024-10-07 11:29:06.645740] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.024 [2024-10-07 11:29:06.645754] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.024 [2024-10-07 11:29:06.645767] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.024 [2024-10-07 11:29:06.645790] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.024 [2024-10-07 11:29:06.645819] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.024 [2024-10-07 11:29:06.657791] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.024 [2024-10-07 11:29:06.657869] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.024 [2024-10-07 11:29:06.659077] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.024 [2024-10-07 11:29:06.659133] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.025 [2024-10-07 11:29:06.659152] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.025 [2024-10-07 11:29:06.659199] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.025 [2024-10-07 11:29:06.659221] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.025 [2024-10-07 11:29:06.659236] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.025 [2024-10-07 11:29:06.659583] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.025 [2024-10-07 11:29:06.659614] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.025 [2024-10-07 11:29:06.659965] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.025 [2024-10-07 11:29:06.659999] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.025 [2024-10-07 11:29:06.660015] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.025 [2024-10-07 11:29:06.660031] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.025 [2024-10-07 11:29:06.660045] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.025 [2024-10-07 11:29:06.660057] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.025 [2024-10-07 11:29:06.660910] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.025 [2024-10-07 11:29:06.660945] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.025 [2024-10-07 11:29:06.674389] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.025 [2024-10-07 11:29:06.674446] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.025 [2024-10-07 11:29:06.674635] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.025 [2024-10-07 11:29:06.674666] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.025 [2024-10-07 11:29:06.674683] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.025 [2024-10-07 11:29:06.674730] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.025 [2024-10-07 11:29:06.674753] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.025 [2024-10-07 11:29:06.674768] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.025 [2024-10-07 11:29:06.674806] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.025 [2024-10-07 11:29:06.674826] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.025 [2024-10-07 11:29:06.674845] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.025 [2024-10-07 11:29:06.674859] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.025 [2024-10-07 11:29:06.674888] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.025 [2024-10-07 11:29:06.674906] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.025 [2024-10-07 11:29:06.674920] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.025 [2024-10-07 11:29:06.674933] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.025 [2024-10-07 11:29:06.674956] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.025 [2024-10-07 11:29:06.674970] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.025 [2024-10-07 11:29:06.685261] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.025 [2024-10-07 11:29:06.685312] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.025 [2024-10-07 11:29:06.685398] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.025 [2024-10-07 11:29:06.685441] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.025 [2024-10-07 11:29:06.685460] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.025 [2024-10-07 11:29:06.685509] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.025 [2024-10-07 11:29:06.685532] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.025 [2024-10-07 11:29:06.685547] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.025 [2024-10-07 11:29:06.685762] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.025 [2024-10-07 11:29:06.685793] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.025 [2024-10-07 11:29:06.685954] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.025 [2024-10-07 11:29:06.685996] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.025 [2024-10-07 11:29:06.686011] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.025 [2024-10-07 11:29:06.686029] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.025 [2024-10-07 11:29:06.686043] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.025 [2024-10-07 11:29:06.686056] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.025 [2024-10-07 11:29:06.686187] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.025 [2024-10-07 11:29:06.686210] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.025 [2024-10-07 11:29:06.695373] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.025 [2024-10-07 11:29:06.695477] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.025 [2024-10-07 11:29:06.695555] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.025 [2024-10-07 11:29:06.695592] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.025 [2024-10-07 11:29:06.695609] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.025 [2024-10-07 11:29:06.695664] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.025 [2024-10-07 11:29:06.695687] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.025 [2024-10-07 11:29:06.695718] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.025 [2024-10-07 11:29:06.695738] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.025 [2024-10-07 11:29:06.695762] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.025 [2024-10-07 11:29:06.695779] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.025 [2024-10-07 11:29:06.695793] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.025 [2024-10-07 11:29:06.695807] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.025 [2024-10-07 11:29:06.695829] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.025 [2024-10-07 11:29:06.695844] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.025 [2024-10-07 11:29:06.695857] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.025 [2024-10-07 11:29:06.695870] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.025 [2024-10-07 11:29:06.695890] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.025 [2024-10-07 11:29:06.705503] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.025 [2024-10-07 11:29:06.705649] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.025 [2024-10-07 11:29:06.705686] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.025 [2024-10-07 11:29:06.705709] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.025 [2024-10-07 11:29:06.705754] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.025 [2024-10-07 11:29:06.705790] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.025 [2024-10-07 11:29:06.705826] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.025 [2024-10-07 11:29:06.705847] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.025 [2024-10-07 11:29:06.705866] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.025 [2024-10-07 11:29:06.706851] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.025 [2024-10-07 11:29:06.706964] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.025 [2024-10-07 11:29:06.706992] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.025 [2024-10-07 11:29:06.707010] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.025 [2024-10-07 11:29:06.707129] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.025 [2024-10-07 11:29:06.707158] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.025 [2024-10-07 11:29:06.707173] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.025 [2024-10-07 11:29:06.707187] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.025 [2024-10-07 11:29:06.707210] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.025 [2024-10-07 11:29:06.715601] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.025 [2024-10-07 11:29:06.715742] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.025 [2024-10-07 11:29:06.715772] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.026 [2024-10-07 11:29:06.715804] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.026 [2024-10-07 11:29:06.715827] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.026 [2024-10-07 11:29:06.716456] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.026 [2024-10-07 11:29:06.716530] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.026 [2024-10-07 11:29:06.716549] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.026 [2024-10-07 11:29:06.716630] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.026 [2024-10-07 11:29:06.716656] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.026 [2024-10-07 11:29:06.716724] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.026 [2024-10-07 11:29:06.716751] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.026 [2024-10-07 11:29:06.716767] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.026 [2024-10-07 11:29:06.716789] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.026 [2024-10-07 11:29:06.716826] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.026 [2024-10-07 11:29:06.716841] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.026 [2024-10-07 11:29:06.716854] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.026 [2024-10-07 11:29:06.716876] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.026 [2024-10-07 11:29:06.727391] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.026 [2024-10-07 11:29:06.727605] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.026 [2024-10-07 11:29:06.727686] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.026 [2024-10-07 11:29:06.727713] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.026 [2024-10-07 11:29:06.727730] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.026 [2024-10-07 11:29:06.731644] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.026 [2024-10-07 11:29:06.731687] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.026 [2024-10-07 11:29:06.731707] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.026 [2024-10-07 11:29:06.731726] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.026 [2024-10-07 11:29:06.732827] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.026 [2024-10-07 11:29:06.732879] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.026 [2024-10-07 11:29:06.732910] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.026 [2024-10-07 11:29:06.732922] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.026 [2024-10-07 11:29:06.733199] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.026 [2024-10-07 11:29:06.733240] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.026 [2024-10-07 11:29:06.733254] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.026 [2024-10-07 11:29:06.733267] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.026 [2024-10-07 11:29:06.733621] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.026 [2024-10-07 11:29:06.737510] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.026 [2024-10-07 11:29:06.737637] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.026 [2024-10-07 11:29:06.737665] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.026 [2024-10-07 11:29:06.737682] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.026 [2024-10-07 11:29:06.737705] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.026 [2024-10-07 11:29:06.737752] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.026 [2024-10-07 11:29:06.737768] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.026 [2024-10-07 11:29:06.737781] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.026 [2024-10-07 11:29:06.737803] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.026 [2024-10-07 11:29:06.737820] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.026 [2024-10-07 11:29:06.737877] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.026 [2024-10-07 11:29:06.737901] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.026 [2024-10-07 11:29:06.737916] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.026 [2024-10-07 11:29:06.738734] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.026 [2024-10-07 11:29:06.738976] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.026 [2024-10-07 11:29:06.739008] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.026 [2024-10-07 11:29:06.739023] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.026 [2024-10-07 11:29:06.739165] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.026 [2024-10-07 11:29:06.748602] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.026 [2024-10-07 11:29:06.748650] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.026 [2024-10-07 11:29:06.748832] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.026 [2024-10-07 11:29:06.748861] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.026 [2024-10-07 11:29:06.748878] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.026 [2024-10-07 11:29:06.748940] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.026 [2024-10-07 11:29:06.748969] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.026 [2024-10-07 11:29:06.748984] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.026 [2024-10-07 11:29:06.749025] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.026 [2024-10-07 11:29:06.749046] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.026 [2024-10-07 11:29:06.749066] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.026 [2024-10-07 11:29:06.749082] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.026 [2024-10-07 11:29:06.749104] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.026 [2024-10-07 11:29:06.749125] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.026 [2024-10-07 11:29:06.749140] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.026 [2024-10-07 11:29:06.749153] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.026 [2024-10-07 11:29:06.749176] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.026 [2024-10-07 11:29:06.749190] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.026 [2024-10-07 11:29:06.760366] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.026 [2024-10-07 11:29:06.760442] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.026 [2024-10-07 11:29:06.760527] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.026 [2024-10-07 11:29:06.760556] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.026 [2024-10-07 11:29:06.760572] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.026 [2024-10-07 11:29:06.760617] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.026 [2024-10-07 11:29:06.760638] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.026 [2024-10-07 11:29:06.760653] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.026 [2024-10-07 11:29:06.760676] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.026 [2024-10-07 11:29:06.760695] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.026 [2024-10-07 11:29:06.760714] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.026 [2024-10-07 11:29:06.760728] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.026 [2024-10-07 11:29:06.760741] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.026 [2024-10-07 11:29:06.760757] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.026 [2024-10-07 11:29:06.760770] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.026 [2024-10-07 11:29:06.760783] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.026 [2024-10-07 11:29:06.760806] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.026 [2024-10-07 11:29:06.760819] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.026 [2024-10-07 11:29:06.772410] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.026 [2024-10-07 11:29:06.772468] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.026 [2024-10-07 11:29:06.772666] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.026 [2024-10-07 11:29:06.772695] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.026 [2024-10-07 11:29:06.772711] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.026 [2024-10-07 11:29:06.772755] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.026 [2024-10-07 11:29:06.772777] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.026 [2024-10-07 11:29:06.772791] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.026 [2024-10-07 11:29:06.772888] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.026 [2024-10-07 11:29:06.772911] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.026 [2024-10-07 11:29:06.773034] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.027 [2024-10-07 11:29:06.773053] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.027 [2024-10-07 11:29:06.773067] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.027 [2024-10-07 11:29:06.773083] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.027 [2024-10-07 11:29:06.773098] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.027 [2024-10-07 11:29:06.773112] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.027 [2024-10-07 11:29:06.773425] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.027 [2024-10-07 11:29:06.773450] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.027 [2024-10-07 11:29:06.783239] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.027 [2024-10-07 11:29:06.783285] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.027 [2024-10-07 11:29:06.783529] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.027 [2024-10-07 11:29:06.783560] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.027 [2024-10-07 11:29:06.783576] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.027 [2024-10-07 11:29:06.783623] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.027 [2024-10-07 11:29:06.783645] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.027 [2024-10-07 11:29:06.783660] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.027 [2024-10-07 11:29:06.783781] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.027 [2024-10-07 11:29:06.783808] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.027 [2024-10-07 11:29:06.783925] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.027 [2024-10-07 11:29:06.783945] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.027 [2024-10-07 11:29:06.783958] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.027 [2024-10-07 11:29:06.783974] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.027 [2024-10-07 11:29:06.784004] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.027 [2024-10-07 11:29:06.784017] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.027 [2024-10-07 11:29:06.784113] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.027 [2024-10-07 11:29:06.784131] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.027 [2024-10-07 11:29:06.793827] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.027 [2024-10-07 11:29:06.793879] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.027 [2024-10-07 11:29:06.793982] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.027 [2024-10-07 11:29:06.794013] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.027 [2024-10-07 11:29:06.794030] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.027 [2024-10-07 11:29:06.794077] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.027 [2024-10-07 11:29:06.794100] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.027 [2024-10-07 11:29:06.794115] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.027 [2024-10-07 11:29:06.794139] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.027 [2024-10-07 11:29:06.794166] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.027 [2024-10-07 11:29:06.794186] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.027 [2024-10-07 11:29:06.794200] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.027 [2024-10-07 11:29:06.794215] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.027 [2024-10-07 11:29:06.794230] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.027 [2024-10-07 11:29:06.794244] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.027 [2024-10-07 11:29:06.794258] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.027 [2024-10-07 11:29:06.794281] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.027 [2024-10-07 11:29:06.794294] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.027 [2024-10-07 11:29:06.806830] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.027 [2024-10-07 11:29:06.806876] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.027 [2024-10-07 11:29:06.806974] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.027 [2024-10-07 11:29:06.807001] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.027 [2024-10-07 11:29:06.807018] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.027 [2024-10-07 11:29:06.807078] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.027 [2024-10-07 11:29:06.807100] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.027 [2024-10-07 11:29:06.807116] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.027 [2024-10-07 11:29:06.807139] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.027 [2024-10-07 11:29:06.807180] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.027 [2024-10-07 11:29:06.807201] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.027 [2024-10-07 11:29:06.807215] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.027 [2024-10-07 11:29:06.807228] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.027 [2024-10-07 11:29:06.807244] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.027 [2024-10-07 11:29:06.807258] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.027 [2024-10-07 11:29:06.807271] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.027 [2024-10-07 11:29:06.807526] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.027 [2024-10-07 11:29:06.807552] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.027 [2024-10-07 11:29:06.820518] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.027 [2024-10-07 11:29:06.820566] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.027 [2024-10-07 11:29:06.820666] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.027 [2024-10-07 11:29:06.820694] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.027 [2024-10-07 11:29:06.820712] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.027 [2024-10-07 11:29:06.820758] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.027 [2024-10-07 11:29:06.820781] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.027 [2024-10-07 11:29:06.820796] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.027 [2024-10-07 11:29:06.820835] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.027 [2024-10-07 11:29:06.820854] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.027 [2024-10-07 11:29:06.820873] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.027 [2024-10-07 11:29:06.820887] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.027 [2024-10-07 11:29:06.820901] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.027 [2024-10-07 11:29:06.820916] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.027 [2024-10-07 11:29:06.820944] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.027 [2024-10-07 11:29:06.820957] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.027 [2024-10-07 11:29:06.820978] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.027 [2024-10-07 11:29:06.820991] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.027 [2024-10-07 11:29:06.833051] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.027 [2024-10-07 11:29:06.833096] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.027 [2024-10-07 11:29:06.833191] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.027 [2024-10-07 11:29:06.833232] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.027 [2024-10-07 11:29:06.833249] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.027 [2024-10-07 11:29:06.833296] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.027 [2024-10-07 11:29:06.833318] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.027 [2024-10-07 11:29:06.833333] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.027 [2024-10-07 11:29:06.833879] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.027 [2024-10-07 11:29:06.833918] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.027 [2024-10-07 11:29:06.834039] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.027 [2024-10-07 11:29:06.834062] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.027 [2024-10-07 11:29:06.834076] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.027 [2024-10-07 11:29:06.834093] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.027 [2024-10-07 11:29:06.834108] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.027 [2024-10-07 11:29:06.834122] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.027 [2024-10-07 11:29:06.834163] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.027 [2024-10-07 11:29:06.834181] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.028 [2024-10-07 11:29:06.843168] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.028 [2024-10-07 11:29:06.843260] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.028 [2024-10-07 11:29:06.843334] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.028 [2024-10-07 11:29:06.843361] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.028 [2024-10-07 11:29:06.843377] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.028 [2024-10-07 11:29:06.845336] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.028 [2024-10-07 11:29:06.845391] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.028 [2024-10-07 11:29:06.845409] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.028 [2024-10-07 11:29:06.845439] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.028 [2024-10-07 11:29:06.846072] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.028 [2024-10-07 11:29:06.846109] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.028 [2024-10-07 11:29:06.846126] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.028 [2024-10-07 11:29:06.846140] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.028 [2024-10-07 11:29:06.846615] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.028 [2024-10-07 11:29:06.846642] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.028 [2024-10-07 11:29:06.846672] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.028 [2024-10-07 11:29:06.846687] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.028 [2024-10-07 11:29:06.846789] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.028 [2024-10-07 11:29:06.856441] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.028 [2024-10-07 11:29:06.856499] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.028 [2024-10-07 11:29:06.856674] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.028 [2024-10-07 11:29:06.856703] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.028 [2024-10-07 11:29:06.856720] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.028 [2024-10-07 11:29:06.856765] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.028 [2024-10-07 11:29:06.856787] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.028 [2024-10-07 11:29:06.856802] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.028 [2024-10-07 11:29:06.858094] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.028 [2024-10-07 11:29:06.858139] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.028 [2024-10-07 11:29:06.859956] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.028 [2024-10-07 11:29:06.859999] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.028 [2024-10-07 11:29:06.860032] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.028 [2024-10-07 11:29:06.860057] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.028 [2024-10-07 11:29:06.860076] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.028 [2024-10-07 11:29:06.860094] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.028 [2024-10-07 11:29:06.860828] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.028 [2024-10-07 11:29:06.860870] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.028 [2024-10-07 11:29:06.867508] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.028 [2024-10-07 11:29:06.867554] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.028 [2024-10-07 11:29:06.867754] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.028 [2024-10-07 11:29:06.867784] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.028 [2024-10-07 11:29:06.867800] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.028 [2024-10-07 11:29:06.867860] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.028 [2024-10-07 11:29:06.867882] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.028 [2024-10-07 11:29:06.867896] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.028 [2024-10-07 11:29:06.868027] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.028 [2024-10-07 11:29:06.868053] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.028 [2024-10-07 11:29:06.868191] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.028 [2024-10-07 11:29:06.868213] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.028 [2024-10-07 11:29:06.868227] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.028 [2024-10-07 11:29:06.868243] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.028 [2024-10-07 11:29:06.868257] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.028 [2024-10-07 11:29:06.868269] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.028 [2024-10-07 11:29:06.868374] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.028 [2024-10-07 11:29:06.868393] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.028 [2024-10-07 11:29:06.878492] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.028 [2024-10-07 11:29:06.878538] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.028 [2024-10-07 11:29:06.878661] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.028 [2024-10-07 11:29:06.878690] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.028 [2024-10-07 11:29:06.878706] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.028 [2024-10-07 11:29:06.878750] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.028 [2024-10-07 11:29:06.878772] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.028 [2024-10-07 11:29:06.878786] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.028 [2024-10-07 11:29:06.878809] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.028 [2024-10-07 11:29:06.878827] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.028 [2024-10-07 11:29:06.878845] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.028 [2024-10-07 11:29:06.878859] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.028 [2024-10-07 11:29:06.878872] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.028 [2024-10-07 11:29:06.878887] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.028 [2024-10-07 11:29:06.878900] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.028 [2024-10-07 11:29:06.878912] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.028 [2024-10-07 11:29:06.878934] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.028 [2024-10-07 11:29:06.878948] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.028 [2024-10-07 11:29:06.888613] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.028 [2024-10-07 11:29:06.888689] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.028 [2024-10-07 11:29:06.888762] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.028 [2024-10-07 11:29:06.888789] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.028 [2024-10-07 11:29:06.888820] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.028 [2024-10-07 11:29:06.888890] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.028 [2024-10-07 11:29:06.888912] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.028 [2024-10-07 11:29:06.888927] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.028 [2024-10-07 11:29:06.888945] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.028 [2024-10-07 11:29:06.888967] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.028 [2024-10-07 11:29:06.888983] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.028 [2024-10-07 11:29:06.888996] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.028 [2024-10-07 11:29:06.889008] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.028 [2024-10-07 11:29:06.889030] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.028 [2024-10-07 11:29:06.889044] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.028 [2024-10-07 11:29:06.889056] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.028 [2024-10-07 11:29:06.889069] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.028 [2024-10-07 11:29:06.889088] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.028 [2024-10-07 11:29:06.898799] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.028 [2024-10-07 11:29:06.898876] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.028 [2024-10-07 11:29:06.898947] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.028 [2024-10-07 11:29:06.898973] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.028 [2024-10-07 11:29:06.898989] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.028 [2024-10-07 11:29:06.899039] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.028 [2024-10-07 11:29:06.899061] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.028 [2024-10-07 11:29:06.899076] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.029 [2024-10-07 11:29:06.899093] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.029 [2024-10-07 11:29:06.899116] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.029 [2024-10-07 11:29:06.899132] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.029 [2024-10-07 11:29:06.899144] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.029 [2024-10-07 11:29:06.899157] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.029 [2024-10-07 11:29:06.900852] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.029 [2024-10-07 11:29:06.900889] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.029 [2024-10-07 11:29:06.900920] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.029 [2024-10-07 11:29:06.900956] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.029 [2024-10-07 11:29:06.901016] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.029 [2024-10-07 11:29:06.910895] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.029 [2024-10-07 11:29:06.910940] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.029 [2024-10-07 11:29:06.911080] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.029 [2024-10-07 11:29:06.911108] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.029 [2024-10-07 11:29:06.911124] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.029 [2024-10-07 11:29:06.911170] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.029 [2024-10-07 11:29:06.911192] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.029 [2024-10-07 11:29:06.911207] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.029 [2024-10-07 11:29:06.911241] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.029 [2024-10-07 11:29:06.911262] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.029 [2024-10-07 11:29:06.911282] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.029 [2024-10-07 11:29:06.911296] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.029 [2024-10-07 11:29:06.911309] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.029 [2024-10-07 11:29:06.911325] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.029 [2024-10-07 11:29:06.911339] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.029 [2024-10-07 11:29:06.911366] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.029 [2024-10-07 11:29:06.911387] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.029 [2024-10-07 11:29:06.911400] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.029 [2024-10-07 11:29:06.923287] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.029 [2024-10-07 11:29:06.923334] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.029 [2024-10-07 11:29:06.923487] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.029 [2024-10-07 11:29:06.923517] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.029 [2024-10-07 11:29:06.923534] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.029 [2024-10-07 11:29:06.923579] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.029 [2024-10-07 11:29:06.923602] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.029 [2024-10-07 11:29:06.923617] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.029 [2024-10-07 11:29:06.923655] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.029 [2024-10-07 11:29:06.923678] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.029 [2024-10-07 11:29:06.923698] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.029 [2024-10-07 11:29:06.923727] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.029 [2024-10-07 11:29:06.923742] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.029 [2024-10-07 11:29:06.923758] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.029 [2024-10-07 11:29:06.923787] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.029 [2024-10-07 11:29:06.923799] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.029 [2024-10-07 11:29:06.923821] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.029 [2024-10-07 11:29:06.923834] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.029 [2024-10-07 11:29:06.935860] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.029 [2024-10-07 11:29:06.935907] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.029 [2024-10-07 11:29:06.936222] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.029 [2024-10-07 11:29:06.936252] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.029 [2024-10-07 11:29:06.936268] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.029 [2024-10-07 11:29:06.936311] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.029 [2024-10-07 11:29:06.936332] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.029 [2024-10-07 11:29:06.936347] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.029 [2024-10-07 11:29:06.936867] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.029 [2024-10-07 11:29:06.936908] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.029 [2024-10-07 11:29:06.937120] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.029 [2024-10-07 11:29:06.937154] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.029 [2024-10-07 11:29:06.937169] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.029 [2024-10-07 11:29:06.937186] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.029 [2024-10-07 11:29:06.937199] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.029 [2024-10-07 11:29:06.937212] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.029 [2024-10-07 11:29:06.937263] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.029 [2024-10-07 11:29:06.937282] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.029 [2024-10-07 11:29:06.946181] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.029 [2024-10-07 11:29:06.950339] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.029 [2024-10-07 11:29:06.950462] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.029 [2024-10-07 11:29:06.950491] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.029 [2024-10-07 11:29:06.950507] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.029 [2024-10-07 11:29:06.951524] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.029 [2024-10-07 11:29:06.951580] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.029 [2024-10-07 11:29:06.951599] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.029 [2024-10-07 11:29:06.951617] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.029 [2024-10-07 11:29:06.951953] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.029 [2024-10-07 11:29:06.951983] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.029 [2024-10-07 11:29:06.951997] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.029 [2024-10-07 11:29:06.952010] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.029 [2024-10-07 11:29:06.952126] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.029 [2024-10-07 11:29:06.952149] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.029 [2024-10-07 11:29:06.952161] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.029 [2024-10-07 11:29:06.952174] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.029 [2024-10-07 11:29:06.952195] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.029 [2024-10-07 11:29:06.956861] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.029 [2024-10-07 11:29:06.957033] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.029 [2024-10-07 11:29:06.957063] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.029 [2024-10-07 11:29:06.957079] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.029 [2024-10-07 11:29:06.957175] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.029 [2024-10-07 11:29:06.957258] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.029 [2024-10-07 11:29:06.957276] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.029 [2024-10-07 11:29:06.957289] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.029 [2024-10-07 11:29:06.957311] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.029 [2024-10-07 11:29:06.964433] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.029 [2024-10-07 11:29:06.964729] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.029 [2024-10-07 11:29:06.964785] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.029 [2024-10-07 11:29:06.964804] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.030 [2024-10-07 11:29:06.965177] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.030 [2024-10-07 11:29:06.965257] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.030 [2024-10-07 11:29:06.965278] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.030 [2024-10-07 11:29:06.965292] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.030 [2024-10-07 11:29:06.966121] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.030 [2024-10-07 11:29:06.966977] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.030 [2024-10-07 11:29:06.967084] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.030 [2024-10-07 11:29:06.967112] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.030 [2024-10-07 11:29:06.967128] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.030 [2024-10-07 11:29:06.967150] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.030 [2024-10-07 11:29:06.967170] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.030 [2024-10-07 11:29:06.967183] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.030 [2024-10-07 11:29:06.967196] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.030 [2024-10-07 11:29:06.967218] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.030 [2024-10-07 11:29:06.977140] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.030 [2024-10-07 11:29:06.977234] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.030 [2024-10-07 11:29:06.977310] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.030 [2024-10-07 11:29:06.977337] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.030 [2024-10-07 11:29:06.977354] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.030 [2024-10-07 11:29:06.977407] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.030 [2024-10-07 11:29:06.977430] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.030 [2024-10-07 11:29:06.977460] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.030 [2024-10-07 11:29:06.977480] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.030 [2024-10-07 11:29:06.977505] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.030 [2024-10-07 11:29:06.977522] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.030 [2024-10-07 11:29:06.977535] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.030 [2024-10-07 11:29:06.977549] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.030 [2024-10-07 11:29:06.977571] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.030 [2024-10-07 11:29:06.977585] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.030 [2024-10-07 11:29:06.977601] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.030 [2024-10-07 11:29:06.977623] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.030 [2024-10-07 11:29:06.977650] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.030 [2024-10-07 11:29:06.989655] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.030 [2024-10-07 11:29:06.989701] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.030 [2024-10-07 11:29:06.989859] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.030 [2024-10-07 11:29:06.989901] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.030 [2024-10-07 11:29:06.989919] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.030 [2024-10-07 11:29:06.989993] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.030 [2024-10-07 11:29:06.990018] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.030 [2024-10-07 11:29:06.990034] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.030 [2024-10-07 11:29:06.990074] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.030 [2024-10-07 11:29:06.990098] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.030 [2024-10-07 11:29:06.990118] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.030 [2024-10-07 11:29:06.990132] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.030 [2024-10-07 11:29:06.990146] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.030 [2024-10-07 11:29:06.990162] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.030 [2024-10-07 11:29:06.990176] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.030 [2024-10-07 11:29:06.990189] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.030 [2024-10-07 11:29:06.990212] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.030 [2024-10-07 11:29:06.990226] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.030 [2024-10-07 11:29:07.000405] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.030 [2024-10-07 11:29:07.000466] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.030 [2024-10-07 11:29:07.000664] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.030 [2024-10-07 11:29:07.000711] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.030 [2024-10-07 11:29:07.000729] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.030 [2024-10-07 11:29:07.000776] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.030 [2024-10-07 11:29:07.000814] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.030 [2024-10-07 11:29:07.000830] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.030 [2024-10-07 11:29:07.000944] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.030 [2024-10-07 11:29:07.000969] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.030 [2024-10-07 11:29:07.001062] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.030 [2024-10-07 11:29:07.001095] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.030 [2024-10-07 11:29:07.001108] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.030 [2024-10-07 11:29:07.001123] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.030 [2024-10-07 11:29:07.001137] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.030 [2024-10-07 11:29:07.001164] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.030 [2024-10-07 11:29:07.003575] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.030 [2024-10-07 11:29:07.003613] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.030 [2024-10-07 11:29:07.011043] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.030 [2024-10-07 11:29:07.011088] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.030 [2024-10-07 11:29:07.011184] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.030 [2024-10-07 11:29:07.011212] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.030 [2024-10-07 11:29:07.011228] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.030 [2024-10-07 11:29:07.011271] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.030 [2024-10-07 11:29:07.011292] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.030 [2024-10-07 11:29:07.011307] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.030 [2024-10-07 11:29:07.011329] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.030 [2024-10-07 11:29:07.011347] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.030 [2024-10-07 11:29:07.011366] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.030 [2024-10-07 11:29:07.011379] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.030 [2024-10-07 11:29:07.011392] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.031 [2024-10-07 11:29:07.011407] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.031 [2024-10-07 11:29:07.011420] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.031 [2024-10-07 11:29:07.011448] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.031 [2024-10-07 11:29:07.011472] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.031 [2024-10-07 11:29:07.011485] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.031 [2024-10-07 11:29:07.021318] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.031 [2024-10-07 11:29:07.021367] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.031 [2024-10-07 11:29:07.021464] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.031 [2024-10-07 11:29:07.021493] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.031 [2024-10-07 11:29:07.021510] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.031 [2024-10-07 11:29:07.021557] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.031 [2024-10-07 11:29:07.021579] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.031 [2024-10-07 11:29:07.021595] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.031 [2024-10-07 11:29:07.021619] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.031 [2024-10-07 11:29:07.021655] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.031 [2024-10-07 11:29:07.021678] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.031 [2024-10-07 11:29:07.021693] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.032 [2024-10-07 11:29:07.021707] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.032 [2024-10-07 11:29:07.021723] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.032 [2024-10-07 11:29:07.021737] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.032 [2024-10-07 11:29:07.021750] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.032 [2024-10-07 11:29:07.021772] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.032 [2024-10-07 11:29:07.021787] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.032 [2024-10-07 11:29:07.031427] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.032 [2024-10-07 11:29:07.031514] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.032 [2024-10-07 11:29:07.031600] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.032 [2024-10-07 11:29:07.031628] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.032 [2024-10-07 11:29:07.031644] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.032 [2024-10-07 11:29:07.031696] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.032 [2024-10-07 11:29:07.031719] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.032 [2024-10-07 11:29:07.031750] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.032 [2024-10-07 11:29:07.031767] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.032 [2024-10-07 11:29:07.031789] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.032 [2024-10-07 11:29:07.031805] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.032 [2024-10-07 11:29:07.031818] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.032 [2024-10-07 11:29:07.031831] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.032 [2024-10-07 11:29:07.031852] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.032 [2024-10-07 11:29:07.031866] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.032 [2024-10-07 11:29:07.031878] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.032 [2024-10-07 11:29:07.031890] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.032 [2024-10-07 11:29:07.031910] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.032 [2024-10-07 11:29:07.043822] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.032 [2024-10-07 11:29:07.043867] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.032 [2024-10-07 11:29:07.043961] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.032 [2024-10-07 11:29:07.043988] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.032 [2024-10-07 11:29:07.044021] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.032 [2024-10-07 11:29:07.044069] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.032 [2024-10-07 11:29:07.044091] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.032 [2024-10-07 11:29:07.044106] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.032 [2024-10-07 11:29:07.044942] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.032 [2024-10-07 11:29:07.044981] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.032 [2024-10-07 11:29:07.045179] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.032 [2024-10-07 11:29:07.045202] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.032 [2024-10-07 11:29:07.045215] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.032 [2024-10-07 11:29:07.045232] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.032 [2024-10-07 11:29:07.045246] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.032 [2024-10-07 11:29:07.045258] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.032 [2024-10-07 11:29:07.046073] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.032 [2024-10-07 11:29:07.046106] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.032 [2024-10-07 11:29:07.053944] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.032 [2024-10-07 11:29:07.054019] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.032 [2024-10-07 11:29:07.054095] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.032 [2024-10-07 11:29:07.054123] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.032 [2024-10-07 11:29:07.054139] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.032 [2024-10-07 11:29:07.054192] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.032 [2024-10-07 11:29:07.054215] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.032 [2024-10-07 11:29:07.054231] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.032 [2024-10-07 11:29:07.054249] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.032 [2024-10-07 11:29:07.054273] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.032 [2024-10-07 11:29:07.054290] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.032 [2024-10-07 11:29:07.054303] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.032 [2024-10-07 11:29:07.054317] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.032 [2024-10-07 11:29:07.054340] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.032 [2024-10-07 11:29:07.054354] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.032 [2024-10-07 11:29:07.054367] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.032 [2024-10-07 11:29:07.054397] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.032 [2024-10-07 11:29:07.054436] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.032 [2024-10-07 11:29:07.064959] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.032 [2024-10-07 11:29:07.065005] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.032 [2024-10-07 11:29:07.065102] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.032 [2024-10-07 11:29:07.065130] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.032 [2024-10-07 11:29:07.065146] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.032 [2024-10-07 11:29:07.065209] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.032 [2024-10-07 11:29:07.065232] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.032 [2024-10-07 11:29:07.065248] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.032 [2024-10-07 11:29:07.065788] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.032 [2024-10-07 11:29:07.065846] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.032 [2024-10-07 11:29:07.066031] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.032 [2024-10-07 11:29:07.066064] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.032 [2024-10-07 11:29:07.066080] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.032 [2024-10-07 11:29:07.066098] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.032 [2024-10-07 11:29:07.066113] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.032 [2024-10-07 11:29:07.066126] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.032 [2024-10-07 11:29:07.066227] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.032 [2024-10-07 11:29:07.066245] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.032 [2024-10-07 11:29:07.078524] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.032 [2024-10-07 11:29:07.078571] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.032 [2024-10-07 11:29:07.079019] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.032 [2024-10-07 11:29:07.079060] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.032 [2024-10-07 11:29:07.079079] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.032 [2024-10-07 11:29:07.079126] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.032 [2024-10-07 11:29:07.079164] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.032 [2024-10-07 11:29:07.079180] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.032 [2024-10-07 11:29:07.079232] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.032 [2024-10-07 11:29:07.079258] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.032 [2024-10-07 11:29:07.079550] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.032 [2024-10-07 11:29:07.079579] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.032 [2024-10-07 11:29:07.079593] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.032 [2024-10-07 11:29:07.079610] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.032 [2024-10-07 11:29:07.079624] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.032 [2024-10-07 11:29:07.079638] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.032 [2024-10-07 11:29:07.079772] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.032 [2024-10-07 11:29:07.079796] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.033 [2024-10-07 11:29:07.093895] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.033 [2024-10-07 11:29:07.093944] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.033 [2024-10-07 11:29:07.094187] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.033 [2024-10-07 11:29:07.094218] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.033 [2024-10-07 11:29:07.094236] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.033 [2024-10-07 11:29:07.094283] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.033 [2024-10-07 11:29:07.094305] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.033 [2024-10-07 11:29:07.094321] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.033 [2024-10-07 11:29:07.094346] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.033 [2024-10-07 11:29:07.094367] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.033 [2024-10-07 11:29:07.094387] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.033 [2024-10-07 11:29:07.094402] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.033 [2024-10-07 11:29:07.094415] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.033 [2024-10-07 11:29:07.094444] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.033 [2024-10-07 11:29:07.094462] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.033 [2024-10-07 11:29:07.094476] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.033 [2024-10-07 11:29:07.094500] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.033 [2024-10-07 11:29:07.094514] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.033 [2024-10-07 11:29:07.108144] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.033 [2024-10-07 11:29:07.108192] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.033 [2024-10-07 11:29:07.108293] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.033 [2024-10-07 11:29:07.108321] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.033 [2024-10-07 11:29:07.108338] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.033 [2024-10-07 11:29:07.108402] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.033 [2024-10-07 11:29:07.108438] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.033 [2024-10-07 11:29:07.108457] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.033 [2024-10-07 11:29:07.108482] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.033 [2024-10-07 11:29:07.108501] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.033 [2024-10-07 11:29:07.108521] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.033 [2024-10-07 11:29:07.108548] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.033 [2024-10-07 11:29:07.108561] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.033 [2024-10-07 11:29:07.108578] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.033 [2024-10-07 11:29:07.108591] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.033 [2024-10-07 11:29:07.108604] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.033 [2024-10-07 11:29:07.108627] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.033 [2024-10-07 11:29:07.108640] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.033 [2024-10-07 11:29:07.123189] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.033 [2024-10-07 11:29:07.123255] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.033 [2024-10-07 11:29:07.123342] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.033 [2024-10-07 11:29:07.123371] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.033 [2024-10-07 11:29:07.123388] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.033 [2024-10-07 11:29:07.123452] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.033 [2024-10-07 11:29:07.123477] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.033 [2024-10-07 11:29:07.123492] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.033 [2024-10-07 11:29:07.123517] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.033 [2024-10-07 11:29:07.123536] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.033 [2024-10-07 11:29:07.123556] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.033 [2024-10-07 11:29:07.123571] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.033 [2024-10-07 11:29:07.123585] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.033 [2024-10-07 11:29:07.123603] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.033 [2024-10-07 11:29:07.123617] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.033 [2024-10-07 11:29:07.123630] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.033 [2024-10-07 11:29:07.123662] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.033 [2024-10-07 11:29:07.123691] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.033 [2024-10-07 11:29:07.135071] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.033 [2024-10-07 11:29:07.135122] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.033 [2024-10-07 11:29:07.135207] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.033 [2024-10-07 11:29:07.135236] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.033 [2024-10-07 11:29:07.135253] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.033 [2024-10-07 11:29:07.135301] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.033 [2024-10-07 11:29:07.135323] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.033 [2024-10-07 11:29:07.135339] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.033 [2024-10-07 11:29:07.135363] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.033 [2024-10-07 11:29:07.135383] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.033 [2024-10-07 11:29:07.135402] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.033 [2024-10-07 11:29:07.135435] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.033 [2024-10-07 11:29:07.135451] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.033 [2024-10-07 11:29:07.135468] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.033 [2024-10-07 11:29:07.135482] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.033 [2024-10-07 11:29:07.135495] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.033 [2024-10-07 11:29:07.135518] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.033 [2024-10-07 11:29:07.135532] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.033 [2024-10-07 11:29:07.146142] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.033 [2024-10-07 11:29:07.146190] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.033 [2024-10-07 11:29:07.148149] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.033 [2024-10-07 11:29:07.148206] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.033 [2024-10-07 11:29:07.148225] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.033 [2024-10-07 11:29:07.148273] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.033 [2024-10-07 11:29:07.148295] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.033 [2024-10-07 11:29:07.148310] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.033 [2024-10-07 11:29:07.149589] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.033 [2024-10-07 11:29:07.149635] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.033 [2024-10-07 11:29:07.149911] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.033 [2024-10-07 11:29:07.149945] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.033 [2024-10-07 11:29:07.150005] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.033 [2024-10-07 11:29:07.150024] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.033 [2024-10-07 11:29:07.150039] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.033 [2024-10-07 11:29:07.150052] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.033 [2024-10-07 11:29:07.150190] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.033 [2024-10-07 11:29:07.150213] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.033 [2024-10-07 11:29:07.156252] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.033 [2024-10-07 11:29:07.156329] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.033 [2024-10-07 11:29:07.156403] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.033 [2024-10-07 11:29:07.156461] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.033 [2024-10-07 11:29:07.156481] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.033 [2024-10-07 11:29:07.158249] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.033 [2024-10-07 11:29:07.158293] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.033 [2024-10-07 11:29:07.158331] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.034 [2024-10-07 11:29:07.158349] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.034 [2024-10-07 11:29:07.158871] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.034 [2024-10-07 11:29:07.158910] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.034 [2024-10-07 11:29:07.158943] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.034 [2024-10-07 11:29:07.158957] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.034 [2024-10-07 11:29:07.159042] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.034 [2024-10-07 11:29:07.159063] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.034 [2024-10-07 11:29:07.159077] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.034 [2024-10-07 11:29:07.159091] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.034 [2024-10-07 11:29:07.159112] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.034 [2024-10-07 11:29:07.168359] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.034 [2024-10-07 11:29:07.168406] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.034 [2024-10-07 11:29:07.168565] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.034 [2024-10-07 11:29:07.168596] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.034 [2024-10-07 11:29:07.168613] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.034 [2024-10-07 11:29:07.168658] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.034 [2024-10-07 11:29:07.168697] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.034 [2024-10-07 11:29:07.168715] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.034 [2024-10-07 11:29:07.168739] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.034 [2024-10-07 11:29:07.168759] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.034 [2024-10-07 11:29:07.168779] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.034 [2024-10-07 11:29:07.168794] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.034 [2024-10-07 11:29:07.168822] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.034 [2024-10-07 11:29:07.168838] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.034 [2024-10-07 11:29:07.168852] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.034 [2024-10-07 11:29:07.168865] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.034 [2024-10-07 11:29:07.168887] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.034 [2024-10-07 11:29:07.168900] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.034 [2024-10-07 11:29:07.178977] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.034 [2024-10-07 11:29:07.179024] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.034 [2024-10-07 11:29:07.179223] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.034 [2024-10-07 11:29:07.179253] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.034 [2024-10-07 11:29:07.179270] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.034 [2024-10-07 11:29:07.179315] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.034 [2024-10-07 11:29:07.179337] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.034 [2024-10-07 11:29:07.179352] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.034 [2024-10-07 11:29:07.179495] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.034 [2024-10-07 11:29:07.179523] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.034 [2024-10-07 11:29:07.180626] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.034 [2024-10-07 11:29:07.180662] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.034 [2024-10-07 11:29:07.180679] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.034 [2024-10-07 11:29:07.180696] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.034 [2024-10-07 11:29:07.180711] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.034 [2024-10-07 11:29:07.180724] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.034 [2024-10-07 11:29:07.180851] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.034 [2024-10-07 11:29:07.180873] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.034 [2024-10-07 11:29:07.192584] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.034 [2024-10-07 11:29:07.192632] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.034 [2024-10-07 11:29:07.192819] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.034 [2024-10-07 11:29:07.192848] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.034 [2024-10-07 11:29:07.192864] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.034 [2024-10-07 11:29:07.192909] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.034 [2024-10-07 11:29:07.192930] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.034 [2024-10-07 11:29:07.192945] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.034 [2024-10-07 11:29:07.192968] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.034 [2024-10-07 11:29:07.192987] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.034 [2024-10-07 11:29:07.193006] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.034 [2024-10-07 11:29:07.193020] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.034 [2024-10-07 11:29:07.193034] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.034 [2024-10-07 11:29:07.193049] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.034 [2024-10-07 11:29:07.193063] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.034 [2024-10-07 11:29:07.193076] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.034 [2024-10-07 11:29:07.193098] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.034 [2024-10-07 11:29:07.193112] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.034 [2024-10-07 11:29:07.207082] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.034 [2024-10-07 11:29:07.207131] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.034 [2024-10-07 11:29:07.207230] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.034 [2024-10-07 11:29:07.207258] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.034 [2024-10-07 11:29:07.207275] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.034 [2024-10-07 11:29:07.207319] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.034 [2024-10-07 11:29:07.207342] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.034 [2024-10-07 11:29:07.207357] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.034 [2024-10-07 11:29:07.207380] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.034 [2024-10-07 11:29:07.207399] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.034 [2024-10-07 11:29:07.207418] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.034 [2024-10-07 11:29:07.207446] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.034 [2024-10-07 11:29:07.207461] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.034 [2024-10-07 11:29:07.207496] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.034 [2024-10-07 11:29:07.207512] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.034 [2024-10-07 11:29:07.207525] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.034 [2024-10-07 11:29:07.207548] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.034 [2024-10-07 11:29:07.207562] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.034 [2024-10-07 11:29:07.221562] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.034 [2024-10-07 11:29:07.221610] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.034 [2024-10-07 11:29:07.221694] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.034 [2024-10-07 11:29:07.221722] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.034 [2024-10-07 11:29:07.221739] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.034 [2024-10-07 11:29:07.221786] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.034 [2024-10-07 11:29:07.221808] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.034 [2024-10-07 11:29:07.221824] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.034 [2024-10-07 11:29:07.221848] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.034 [2024-10-07 11:29:07.221867] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.034 [2024-10-07 11:29:07.221887] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.034 [2024-10-07 11:29:07.221901] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.034 [2024-10-07 11:29:07.221915] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.034 [2024-10-07 11:29:07.221931] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.034 [2024-10-07 11:29:07.221944] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.034 [2024-10-07 11:29:07.221957] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.035 [2024-10-07 11:29:07.221993] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.035 [2024-10-07 11:29:07.222007] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.035 [2024-10-07 11:29:07.232766] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.035 [2024-10-07 11:29:07.232814] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.035 [2024-10-07 11:29:07.235731] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.035 [2024-10-07 11:29:07.235778] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.035 [2024-10-07 11:29:07.235797] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.035 [2024-10-07 11:29:07.235847] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.035 [2024-10-07 11:29:07.235871] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.035 [2024-10-07 11:29:07.235910] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.035 [2024-10-07 11:29:07.236794] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.035 [2024-10-07 11:29:07.236868] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.035 [2024-10-07 11:29:07.237080] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.035 [2024-10-07 11:29:07.237105] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.035 [2024-10-07 11:29:07.237120] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.035 [2024-10-07 11:29:07.237137] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.035 [2024-10-07 11:29:07.237151] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.035 [2024-10-07 11:29:07.237166] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.035 [2024-10-07 11:29:07.237290] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.035 [2024-10-07 11:29:07.237311] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.035 [2024-10-07 11:29:07.245807] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.035 [2024-10-07 11:29:07.245854] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.035 [2024-10-07 11:29:07.246006] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.035 [2024-10-07 11:29:07.246037] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.035 [2024-10-07 11:29:07.246053] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.035 [2024-10-07 11:29:07.246100] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.035 [2024-10-07 11:29:07.246122] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.035 [2024-10-07 11:29:07.246138] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.035 [2024-10-07 11:29:07.246164] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.035 [2024-10-07 11:29:07.246183] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.035 [2024-10-07 11:29:07.246203] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.035 [2024-10-07 11:29:07.246217] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.035 [2024-10-07 11:29:07.246230] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.035 [2024-10-07 11:29:07.246247] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.035 [2024-10-07 11:29:07.246261] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.035 [2024-10-07 11:29:07.246274] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.035 [2024-10-07 11:29:07.246297] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.035 [2024-10-07 11:29:07.246311] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.035 [2024-10-07 11:29:07.257433] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.035 [2024-10-07 11:29:07.257494] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.035 [2024-10-07 11:29:07.257741] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.035 [2024-10-07 11:29:07.257778] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.035 [2024-10-07 11:29:07.257797] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.035 [2024-10-07 11:29:07.257842] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.035 [2024-10-07 11:29:07.257865] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.035 [2024-10-07 11:29:07.257879] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.035 [2024-10-07 11:29:07.257923] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.035 [2024-10-07 11:29:07.257947] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.035 [2024-10-07 11:29:07.257995] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.035 [2024-10-07 11:29:07.258011] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.035 [2024-10-07 11:29:07.258025] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.035 [2024-10-07 11:29:07.258041] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.035 [2024-10-07 11:29:07.258055] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.035 [2024-10-07 11:29:07.258068] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.035 [2024-10-07 11:29:07.258091] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.035 [2024-10-07 11:29:07.258105] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.035 [2024-10-07 11:29:07.267589] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.035 [2024-10-07 11:29:07.267652] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.035 [2024-10-07 11:29:07.267727] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.035 [2024-10-07 11:29:07.267755] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.035 [2024-10-07 11:29:07.267772] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.035 [2024-10-07 11:29:07.270565] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.035 [2024-10-07 11:29:07.270623] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.035 [2024-10-07 11:29:07.270642] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.035 [2024-10-07 11:29:07.270661] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.035 [2024-10-07 11:29:07.271550] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.035 [2024-10-07 11:29:07.271587] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.035 [2024-10-07 11:29:07.271620] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.035 [2024-10-07 11:29:07.271633] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.035 [2024-10-07 11:29:07.271874] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.035 [2024-10-07 11:29:07.271914] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.035 [2024-10-07 11:29:07.271930] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.035 [2024-10-07 11:29:07.271944] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.035 [2024-10-07 11:29:07.272066] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.035 [2024-10-07 11:29:07.277909] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.035 [2024-10-07 11:29:07.277956] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.035 [2024-10-07 11:29:07.278191] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.035 [2024-10-07 11:29:07.278223] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.035 [2024-10-07 11:29:07.278240] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.035 [2024-10-07 11:29:07.278286] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.035 [2024-10-07 11:29:07.278308] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.035 [2024-10-07 11:29:07.278338] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.035 [2024-10-07 11:29:07.278389] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.035 [2024-10-07 11:29:07.278413] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.035 [2024-10-07 11:29:07.278448] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.036 [2024-10-07 11:29:07.278464] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.036 [2024-10-07 11:29:07.278477] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.036 [2024-10-07 11:29:07.278493] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.036 [2024-10-07 11:29:07.278507] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.036 [2024-10-07 11:29:07.278520] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.036 [2024-10-07 11:29:07.278542] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.036 [2024-10-07 11:29:07.278556] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.036 [2024-10-07 11:29:07.290889] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.036 [2024-10-07 11:29:07.290953] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.036 [2024-10-07 11:29:07.291266] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.036 [2024-10-07 11:29:07.291307] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.036 [2024-10-07 11:29:07.291326] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.036 [2024-10-07 11:29:07.291390] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.036 [2024-10-07 11:29:07.291412] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.036 [2024-10-07 11:29:07.291441] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.036 [2024-10-07 11:29:07.291532] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.036 [2024-10-07 11:29:07.291561] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.036 [2024-10-07 11:29:07.291581] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.036 [2024-10-07 11:29:07.291596] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.036 [2024-10-07 11:29:07.291609] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.036 [2024-10-07 11:29:07.291626] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.036 [2024-10-07 11:29:07.291641] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.036 [2024-10-07 11:29:07.291654] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.036 [2024-10-07 11:29:07.291677] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.036 [2024-10-07 11:29:07.291706] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.036 [2024-10-07 11:29:07.305170] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.036 [2024-10-07 11:29:07.305220] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.036 [2024-10-07 11:29:07.306485] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.036 [2024-10-07 11:29:07.306548] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.036 [2024-10-07 11:29:07.306567] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.036 [2024-10-07 11:29:07.306618] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.036 [2024-10-07 11:29:07.306641] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.036 [2024-10-07 11:29:07.306656] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.036 [2024-10-07 11:29:07.306784] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.036 [2024-10-07 11:29:07.306811] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.036 [2024-10-07 11:29:07.306832] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.036 [2024-10-07 11:29:07.306847] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.036 [2024-10-07 11:29:07.306860] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.036 [2024-10-07 11:29:07.306879] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.036 [2024-10-07 11:29:07.306893] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.036 [2024-10-07 11:29:07.306906] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.036 [2024-10-07 11:29:07.306929] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.036 [2024-10-07 11:29:07.306944] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.036 [2024-10-07 11:29:07.319023] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.036 [2024-10-07 11:29:07.319072] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.036 [2024-10-07 11:29:07.319806] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.036 [2024-10-07 11:29:07.319875] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.036 [2024-10-07 11:29:07.319895] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.036 [2024-10-07 11:29:07.319945] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.036 [2024-10-07 11:29:07.319967] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.036 [2024-10-07 11:29:07.319982] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.036 [2024-10-07 11:29:07.320710] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.036 [2024-10-07 11:29:07.320751] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.036 [2024-10-07 11:29:07.321013] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.036 [2024-10-07 11:29:07.321040] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.036 [2024-10-07 11:29:07.321054] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.036 [2024-10-07 11:29:07.321071] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.036 [2024-10-07 11:29:07.321085] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.036 [2024-10-07 11:29:07.321097] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.036 [2024-10-07 11:29:07.321289] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.036 [2024-10-07 11:29:07.321315] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.036 [2024-10-07 11:29:07.331944] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.036 [2024-10-07 11:29:07.331991] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.036 [2024-10-07 11:29:07.332091] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.036 [2024-10-07 11:29:07.332120] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.036 [2024-10-07 11:29:07.332136] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.036 [2024-10-07 11:29:07.332183] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.036 [2024-10-07 11:29:07.332206] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.036 [2024-10-07 11:29:07.332222] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.036 [2024-10-07 11:29:07.332797] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.036 [2024-10-07 11:29:07.332836] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.036 [2024-10-07 11:29:07.332928] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.036 [2024-10-07 11:29:07.332966] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.036 [2024-10-07 11:29:07.332982] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.036 [2024-10-07 11:29:07.332999] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.036 [2024-10-07 11:29:07.333013] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.036 [2024-10-07 11:29:07.333044] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.036 [2024-10-07 11:29:07.333070] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.036 [2024-10-07 11:29:07.333084] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.036 [2024-10-07 11:29:07.342068] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.036 [2024-10-07 11:29:07.343400] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.036 [2024-10-07 11:29:07.343518] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.036 [2024-10-07 11:29:07.343554] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.036 [2024-10-07 11:29:07.343577] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.036 [2024-10-07 11:29:07.344236] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.036 [2024-10-07 11:29:07.344277] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.036 [2024-10-07 11:29:07.344296] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.036 [2024-10-07 11:29:07.344315] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.036 [2024-10-07 11:29:07.344564] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.036 [2024-10-07 11:29:07.344595] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.036 [2024-10-07 11:29:07.344609] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.036 [2024-10-07 11:29:07.344623] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.036 [2024-10-07 11:29:07.344832] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.036 [2024-10-07 11:29:07.344860] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.036 [2024-10-07 11:29:07.344875] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.036 [2024-10-07 11:29:07.344889] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.036 [2024-10-07 11:29:07.344946] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.036 [2024-10-07 11:29:07.352954] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.037 [2024-10-07 11:29:07.353180] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.037 [2024-10-07 11:29:07.353211] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.037 [2024-10-07 11:29:07.353228] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.037 [2024-10-07 11:29:07.353370] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.037 [2024-10-07 11:29:07.353532] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.037 [2024-10-07 11:29:07.353574] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.037 [2024-10-07 11:29:07.353590] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.037 [2024-10-07 11:29:07.353701] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.037 [2024-10-07 11:29:07.354327] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.037 [2024-10-07 11:29:07.356202] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.037 [2024-10-07 11:29:07.356243] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.037 [2024-10-07 11:29:07.356278] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.037 [2024-10-07 11:29:07.357297] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.037 [2024-10-07 11:29:07.357652] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.037 [2024-10-07 11:29:07.357690] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.037 [2024-10-07 11:29:07.357707] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.037 [2024-10-07 11:29:07.357881] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.037 [2024-10-07 11:29:07.363800] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.037 [2024-10-07 11:29:07.363916] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.037 [2024-10-07 11:29:07.363945] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.037 [2024-10-07 11:29:07.363963] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.037 [2024-10-07 11:29:07.363986] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.037 [2024-10-07 11:29:07.364007] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.037 [2024-10-07 11:29:07.364021] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.037 [2024-10-07 11:29:07.364034] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.037 [2024-10-07 11:29:07.364056] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.037 [2024-10-07 11:29:07.364397] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.037 [2024-10-07 11:29:07.364498] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.037 [2024-10-07 11:29:07.364526] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.037 [2024-10-07 11:29:07.364542] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.037 [2024-10-07 11:29:07.364565] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.037 [2024-10-07 11:29:07.364587] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.037 [2024-10-07 11:29:07.364601] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.037 [2024-10-07 11:29:07.364614] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.037 [2024-10-07 11:29:07.364637] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.037 [2024-10-07 11:29:07.375932] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.037 [2024-10-07 11:29:07.375980] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.037 [2024-10-07 11:29:07.376271] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.037 [2024-10-07 11:29:07.376313] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.037 [2024-10-07 11:29:07.376347] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.037 [2024-10-07 11:29:07.376400] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.037 [2024-10-07 11:29:07.376438] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.037 [2024-10-07 11:29:07.376455] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.037 [2024-10-07 11:29:07.376945] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.037 [2024-10-07 11:29:07.376986] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.037 [2024-10-07 11:29:07.377198] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.037 [2024-10-07 11:29:07.377232] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.037 [2024-10-07 11:29:07.377247] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.037 [2024-10-07 11:29:07.377264] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.037 [2024-10-07 11:29:07.377278] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.037 [2024-10-07 11:29:07.377291] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.037 [2024-10-07 11:29:07.377528] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.037 [2024-10-07 11:29:07.377554] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.037 [2024-10-07 11:29:07.388421] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.037 [2024-10-07 11:29:07.388467] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.037 [2024-10-07 11:29:07.388915] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.037 [2024-10-07 11:29:07.388957] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.037 [2024-10-07 11:29:07.388975] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.037 [2024-10-07 11:29:07.389023] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.037 [2024-10-07 11:29:07.389045] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.037 [2024-10-07 11:29:07.389060] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.037 [2024-10-07 11:29:07.389395] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.037 [2024-10-07 11:29:07.389465] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.037 [2024-10-07 11:29:07.389539] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.037 [2024-10-07 11:29:07.389561] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.037 [2024-10-07 11:29:07.389575] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.037 [2024-10-07 11:29:07.389591] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.037 [2024-10-07 11:29:07.389606] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.037 [2024-10-07 11:29:07.389619] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.037 [2024-10-07 11:29:07.389657] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.037 [2024-10-07 11:29:07.389674] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.037 [2024-10-07 11:29:07.405489] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.037 [2024-10-07 11:29:07.405537] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.037 8885.88 IOPS, 34.71 MiB/s [2024-10-07T11:29:15.748Z] [2024-10-07 11:29:07.405650] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.037 [2024-10-07 11:29:07.405678] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.037 [2024-10-07 11:29:07.405696] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.037 [2024-10-07 11:29:07.405742] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.037 [2024-10-07 11:29:07.405764] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.037 [2024-10-07 11:29:07.405779] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.037 [2024-10-07 11:29:07.405803] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.037 [2024-10-07 11:29:07.405823] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.037 [2024-10-07 11:29:07.405857] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.037 [2024-10-07 11:29:07.405871] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.037 [2024-10-07 11:29:07.405885] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.037 [2024-10-07 11:29:07.405900] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.037 [2024-10-07 11:29:07.405914] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.037 [2024-10-07 11:29:07.405927] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.037 [2024-10-07 11:29:07.406980] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.037 [2024-10-07 11:29:07.407030] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.037 [2024-10-07 11:29:07.418424] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.037 [2024-10-07 11:29:07.418502] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.037 [2024-10-07 11:29:07.418799] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.038 [2024-10-07 11:29:07.418833] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.038 [2024-10-07 11:29:07.418851] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.038 [2024-10-07 11:29:07.418898] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.038 [2024-10-07 11:29:07.418920] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.038 [2024-10-07 11:29:07.418936] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.038 [2024-10-07 11:29:07.419137] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.038 [2024-10-07 11:29:07.419167] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.038 [2024-10-07 11:29:07.419381] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.038 [2024-10-07 11:29:07.419428] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.038 [2024-10-07 11:29:07.419447] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.038 [2024-10-07 11:29:07.419464] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.038 [2024-10-07 11:29:07.419478] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.038 [2024-10-07 11:29:07.419491] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.038 [2024-10-07 11:29:07.419550] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.038 [2024-10-07 11:29:07.419571] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.038 [2024-10-07 11:29:07.428849] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.038 [2024-10-07 11:29:07.428897] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.038 [2024-10-07 11:29:07.429096] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.038 [2024-10-07 11:29:07.429126] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.038 [2024-10-07 11:29:07.429142] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.038 [2024-10-07 11:29:07.429188] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.038 [2024-10-07 11:29:07.429210] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.038 [2024-10-07 11:29:07.429226] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.038 [2024-10-07 11:29:07.431777] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.038 [2024-10-07 11:29:07.431822] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.038 [2024-10-07 11:29:07.433670] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.038 [2024-10-07 11:29:07.433707] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.038 [2024-10-07 11:29:07.433740] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.038 [2024-10-07 11:29:07.433758] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.038 [2024-10-07 11:29:07.433772] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.038 [2024-10-07 11:29:07.433785] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.038 [2024-10-07 11:29:07.434033] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.038 [2024-10-07 11:29:07.434059] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.038 [2024-10-07 11:29:07.438973] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.038 [2024-10-07 11:29:07.439046] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.038 [2024-10-07 11:29:07.439119] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.038 [2024-10-07 11:29:07.439146] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.038 [2024-10-07 11:29:07.439162] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.038 [2024-10-07 11:29:07.439232] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.038 [2024-10-07 11:29:07.439256] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.038 [2024-10-07 11:29:07.439271] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.038 [2024-10-07 11:29:07.439289] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.038 [2024-10-07 11:29:07.439312] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.038 [2024-10-07 11:29:07.439329] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.038 [2024-10-07 11:29:07.439343] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.038 [2024-10-07 11:29:07.439355] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.038 [2024-10-07 11:29:07.439378] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.038 [2024-10-07 11:29:07.439392] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.038 [2024-10-07 11:29:07.439405] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.038 [2024-10-07 11:29:07.439418] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.038 [2024-10-07 11:29:07.439453] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.038 [2024-10-07 11:29:07.449096] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.038 [2024-10-07 11:29:07.449213] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.038 [2024-10-07 11:29:07.449244] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.038 [2024-10-07 11:29:07.449263] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.038 [2024-10-07 11:29:07.449288] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.038 [2024-10-07 11:29:07.449318] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.038 [2024-10-07 11:29:07.449377] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.038 [2024-10-07 11:29:07.449400] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.038 [2024-10-07 11:29:07.449431] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.038 [2024-10-07 11:29:07.449448] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.038 [2024-10-07 11:29:07.449461] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.038 [2024-10-07 11:29:07.449475] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.038 [2024-10-07 11:29:07.449499] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.038 [2024-10-07 11:29:07.449517] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.038 [2024-10-07 11:29:07.449758] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.038 [2024-10-07 11:29:07.449800] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.038 [2024-10-07 11:29:07.449814] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.038 [2024-10-07 11:29:07.450020] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.038 [2024-10-07 11:29:07.460597] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.038 [2024-10-07 11:29:07.460644] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.038 [2024-10-07 11:29:07.460741] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.038 [2024-10-07 11:29:07.460769] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.038 [2024-10-07 11:29:07.460785] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.038 [2024-10-07 11:29:07.460829] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.038 [2024-10-07 11:29:07.460851] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.038 [2024-10-07 11:29:07.460866] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.038 [2024-10-07 11:29:07.460889] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.038 [2024-10-07 11:29:07.460908] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.038 [2024-10-07 11:29:07.460927] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.038 [2024-10-07 11:29:07.460941] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.038 [2024-10-07 11:29:07.460954] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.038 [2024-10-07 11:29:07.460970] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.038 [2024-10-07 11:29:07.460983] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.038 [2024-10-07 11:29:07.460996] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.038 [2024-10-07 11:29:07.461018] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.038 [2024-10-07 11:29:07.461031] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.038 [2024-10-07 11:29:07.472462] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.038 [2024-10-07 11:29:07.472510] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.038 [2024-10-07 11:29:07.473095] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.038 [2024-10-07 11:29:07.473166] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.038 [2024-10-07 11:29:07.473201] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.038 [2024-10-07 11:29:07.473250] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.038 [2024-10-07 11:29:07.473274] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.038 [2024-10-07 11:29:07.473290] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.038 [2024-10-07 11:29:07.475564] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.038 [2024-10-07 11:29:07.475612] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.039 [2024-10-07 11:29:07.475955] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.039 [2024-10-07 11:29:07.476016] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.039 [2024-10-07 11:29:07.476034] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.039 [2024-10-07 11:29:07.476052] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.039 [2024-10-07 11:29:07.476067] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.039 [2024-10-07 11:29:07.476080] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.039 [2024-10-07 11:29:07.476230] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.039 [2024-10-07 11:29:07.476254] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.039 [2024-10-07 11:29:07.483500] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.039 [2024-10-07 11:29:07.483547] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.039 [2024-10-07 11:29:07.483648] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.039 [2024-10-07 11:29:07.483676] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.039 [2024-10-07 11:29:07.483694] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.039 [2024-10-07 11:29:07.483754] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.039 [2024-10-07 11:29:07.483777] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.039 [2024-10-07 11:29:07.483792] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.039 [2024-10-07 11:29:07.483829] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.039 [2024-10-07 11:29:07.483852] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.039 [2024-10-07 11:29:07.483872] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.039 [2024-10-07 11:29:07.483886] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.039 [2024-10-07 11:29:07.483899] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.039 [2024-10-07 11:29:07.483915] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.039 [2024-10-07 11:29:07.483928] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.039 [2024-10-07 11:29:07.483941] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.039 [2024-10-07 11:29:07.483963] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.039 [2024-10-07 11:29:07.483976] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.039 [2024-10-07 11:29:07.495571] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.039 [2024-10-07 11:29:07.495618] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.039 [2024-10-07 11:29:07.495959] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.039 [2024-10-07 11:29:07.496000] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.039 [2024-10-07 11:29:07.496018] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.039 [2024-10-07 11:29:07.496068] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.039 [2024-10-07 11:29:07.496105] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.039 [2024-10-07 11:29:07.496122] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.039 [2024-10-07 11:29:07.496195] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.039 [2024-10-07 11:29:07.496223] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.039 [2024-10-07 11:29:07.496243] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.039 [2024-10-07 11:29:07.496258] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.039 [2024-10-07 11:29:07.496271] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.039 [2024-10-07 11:29:07.496287] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.039 [2024-10-07 11:29:07.496300] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.039 [2024-10-07 11:29:07.496313] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.039 [2024-10-07 11:29:07.496335] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.039 [2024-10-07 11:29:07.496349] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.039 [2024-10-07 11:29:07.508311] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.039 [2024-10-07 11:29:07.508358] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.039 [2024-10-07 11:29:07.509200] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.039 [2024-10-07 11:29:07.509257] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.039 [2024-10-07 11:29:07.509276] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.039 [2024-10-07 11:29:07.509324] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.039 [2024-10-07 11:29:07.509346] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.039 [2024-10-07 11:29:07.509361] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.039 [2024-10-07 11:29:07.509703] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.039 [2024-10-07 11:29:07.509735] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.039 [2024-10-07 11:29:07.509874] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.039 [2024-10-07 11:29:07.509897] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.039 [2024-10-07 11:29:07.509911] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.039 [2024-10-07 11:29:07.509928] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.039 [2024-10-07 11:29:07.509942] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.039 [2024-10-07 11:29:07.509955] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.039 [2024-10-07 11:29:07.510019] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.039 [2024-10-07 11:29:07.510036] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.039 [2024-10-07 11:29:07.519418] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.039 [2024-10-07 11:29:07.519480] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.039 [2024-10-07 11:29:07.519658] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.039 [2024-10-07 11:29:07.519687] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.039 [2024-10-07 11:29:07.519703] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.039 [2024-10-07 11:29:07.519749] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.039 [2024-10-07 11:29:07.519770] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.039 [2024-10-07 11:29:07.519786] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.039 [2024-10-07 11:29:07.519902] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.039 [2024-10-07 11:29:07.519929] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.039 [2024-10-07 11:29:07.520032] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.039 [2024-10-07 11:29:07.520052] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.039 [2024-10-07 11:29:07.520067] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.039 [2024-10-07 11:29:07.520083] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.039 [2024-10-07 11:29:07.520097] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.039 [2024-10-07 11:29:07.520109] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.039 [2024-10-07 11:29:07.520622] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.039 [2024-10-07 11:29:07.520656] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.039 [2024-10-07 11:29:07.529843] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.039 [2024-10-07 11:29:07.529890] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.039 [2024-10-07 11:29:07.530090] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.039 [2024-10-07 11:29:07.530121] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.039 [2024-10-07 11:29:07.530138] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.039 [2024-10-07 11:29:07.530185] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.040 [2024-10-07 11:29:07.530207] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.040 [2024-10-07 11:29:07.530223] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.040 [2024-10-07 11:29:07.531622] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.040 [2024-10-07 11:29:07.531664] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.040 [2024-10-07 11:29:07.534096] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.040 [2024-10-07 11:29:07.534132] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.040 [2024-10-07 11:29:07.534165] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.040 [2024-10-07 11:29:07.534184] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.040 [2024-10-07 11:29:07.534199] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.040 [2024-10-07 11:29:07.534212] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.040 [2024-10-07 11:29:07.534945] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.040 [2024-10-07 11:29:07.534972] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.040 [2024-10-07 11:29:07.539964] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.040 [2024-10-07 11:29:07.541838] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.040 [2024-10-07 11:29:07.541950] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.040 [2024-10-07 11:29:07.541989] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.040 [2024-10-07 11:29:07.542007] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.040 [2024-10-07 11:29:07.542585] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.040 [2024-10-07 11:29:07.542626] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.040 [2024-10-07 11:29:07.542645] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.040 [2024-10-07 11:29:07.542664] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.040 [2024-10-07 11:29:07.542867] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.040 [2024-10-07 11:29:07.542896] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.040 [2024-10-07 11:29:07.542911] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.040 [2024-10-07 11:29:07.542924] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.040 [2024-10-07 11:29:07.543086] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.040 [2024-10-07 11:29:07.543112] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.040 [2024-10-07 11:29:07.543127] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.040 [2024-10-07 11:29:07.543140] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.040 [2024-10-07 11:29:07.543189] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.040 [2024-10-07 11:29:07.550565] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.040 [2024-10-07 11:29:07.550759] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.040 [2024-10-07 11:29:07.550800] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.040 [2024-10-07 11:29:07.550834] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.040 [2024-10-07 11:29:07.550935] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.040 [2024-10-07 11:29:07.551670] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.040 [2024-10-07 11:29:07.551706] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.040 [2024-10-07 11:29:07.551739] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.040 [2024-10-07 11:29:07.554022] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.040 [2024-10-07 11:29:07.554546] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.040 [2024-10-07 11:29:07.554760] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.040 [2024-10-07 11:29:07.554801] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.040 [2024-10-07 11:29:07.554821] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.040 [2024-10-07 11:29:07.554923] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.040 [2024-10-07 11:29:07.555059] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.040 [2024-10-07 11:29:07.555091] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.040 [2024-10-07 11:29:07.555107] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.040 [2024-10-07 11:29:07.555233] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.040 [2024-10-07 11:29:07.560645] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.040 [2024-10-07 11:29:07.560766] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.040 [2024-10-07 11:29:07.560795] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.040 [2024-10-07 11:29:07.560811] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.040 [2024-10-07 11:29:07.561545] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.040 [2024-10-07 11:29:07.562885] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.040 [2024-10-07 11:29:07.562922] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.040 [2024-10-07 11:29:07.562955] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.040 [2024-10-07 11:29:07.563370] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.040 [2024-10-07 11:29:07.564620] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.040 [2024-10-07 11:29:07.564729] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.040 [2024-10-07 11:29:07.564758] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.040 [2024-10-07 11:29:07.564775] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.040 [2024-10-07 11:29:07.564798] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.040 [2024-10-07 11:29:07.564820] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.040 [2024-10-07 11:29:07.564834] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.040 [2024-10-07 11:29:07.564848] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.040 [2024-10-07 11:29:07.564870] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.040 [2024-10-07 11:29:07.572924] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.040 [2024-10-07 11:29:07.573274] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.040 [2024-10-07 11:29:07.573317] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.040 [2024-10-07 11:29:07.573337] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.040 [2024-10-07 11:29:07.573554] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.040 [2024-10-07 11:29:07.573633] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.040 [2024-10-07 11:29:07.573655] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.040 [2024-10-07 11:29:07.573669] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.040 [2024-10-07 11:29:07.573693] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.040 [2024-10-07 11:29:07.575055] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.040 [2024-10-07 11:29:07.575167] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.040 [2024-10-07 11:29:07.575195] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.040 [2024-10-07 11:29:07.575212] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.040 [2024-10-07 11:29:07.575234] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.040 [2024-10-07 11:29:07.575256] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.040 [2024-10-07 11:29:07.575271] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.040 [2024-10-07 11:29:07.575284] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.040 [2024-10-07 11:29:07.575305] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.040 [2024-10-07 11:29:07.585812] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.040 [2024-10-07 11:29:07.585861] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.040 [2024-10-07 11:29:07.586103] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.040 [2024-10-07 11:29:07.586135] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.040 [2024-10-07 11:29:07.586152] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.040 [2024-10-07 11:29:07.586199] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.040 [2024-10-07 11:29:07.586222] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.040 [2024-10-07 11:29:07.586237] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.040 [2024-10-07 11:29:07.586351] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.040 [2024-10-07 11:29:07.586377] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.040 [2024-10-07 11:29:07.586488] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.040 [2024-10-07 11:29:07.586510] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.040 [2024-10-07 11:29:07.586524] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.040 [2024-10-07 11:29:07.586558] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.041 [2024-10-07 11:29:07.586575] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.041 [2024-10-07 11:29:07.586588] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.041 [2024-10-07 11:29:07.586954] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.041 [2024-10-07 11:29:07.586988] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.041 [2024-10-07 11:29:07.597902] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.041 [2024-10-07 11:29:07.597949] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.041 [2024-10-07 11:29:07.600262] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.041 [2024-10-07 11:29:07.600322] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.041 [2024-10-07 11:29:07.600342] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.041 [2024-10-07 11:29:07.600389] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.041 [2024-10-07 11:29:07.600411] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.041 [2024-10-07 11:29:07.600440] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.041 [2024-10-07 11:29:07.600686] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.041 [2024-10-07 11:29:07.600717] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.041 [2024-10-07 11:29:07.600766] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.041 [2024-10-07 11:29:07.600787] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.041 [2024-10-07 11:29:07.600801] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.041 [2024-10-07 11:29:07.600833] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.041 [2024-10-07 11:29:07.600847] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.041 [2024-10-07 11:29:07.600861] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.041 [2024-10-07 11:29:07.601013] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.041 [2024-10-07 11:29:07.601037] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.041 [2024-10-07 11:29:07.608056] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.041 [2024-10-07 11:29:07.608133] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.041 [2024-10-07 11:29:07.608214] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.041 [2024-10-07 11:29:07.608242] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.041 [2024-10-07 11:29:07.608259] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.041 [2024-10-07 11:29:07.608311] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.041 [2024-10-07 11:29:07.608334] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.041 [2024-10-07 11:29:07.608349] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.041 [2024-10-07 11:29:07.608385] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.041 [2024-10-07 11:29:07.608410] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.041 [2024-10-07 11:29:07.608440] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.041 [2024-10-07 11:29:07.608456] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.041 [2024-10-07 11:29:07.608470] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.041 [2024-10-07 11:29:07.608493] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.041 [2024-10-07 11:29:07.608508] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.041 [2024-10-07 11:29:07.608521] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.041 [2024-10-07 11:29:07.608533] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.041 [2024-10-07 11:29:07.608553] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.041 [2024-10-07 11:29:07.621486] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.041 [2024-10-07 11:29:07.621532] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.041 [2024-10-07 11:29:07.621632] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.041 [2024-10-07 11:29:07.621661] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.041 [2024-10-07 11:29:07.621677] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.041 [2024-10-07 11:29:07.621722] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.041 [2024-10-07 11:29:07.621744] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.041 [2024-10-07 11:29:07.621759] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.041 [2024-10-07 11:29:07.621782] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.041 [2024-10-07 11:29:07.621801] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.041 [2024-10-07 11:29:07.621820] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.041 [2024-10-07 11:29:07.621834] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.041 [2024-10-07 11:29:07.621848] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.041 [2024-10-07 11:29:07.621863] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.041 [2024-10-07 11:29:07.621877] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.041 [2024-10-07 11:29:07.621889] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.041 [2024-10-07 11:29:07.621912] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.041 [2024-10-07 11:29:07.621925] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.041 [2024-10-07 11:29:07.632712] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.041 [2024-10-07 11:29:07.632761] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.041 [2024-10-07 11:29:07.633026] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.041 [2024-10-07 11:29:07.633070] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.041 [2024-10-07 11:29:07.633089] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.041 [2024-10-07 11:29:07.633237] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.041 [2024-10-07 11:29:07.633348] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.041 [2024-10-07 11:29:07.633375] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.041 [2024-10-07 11:29:07.633389] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.041 [2024-10-07 11:29:07.635896] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.041 [2024-10-07 11:29:07.642934] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.041 [2024-10-07 11:29:07.643340] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.041 [2024-10-07 11:29:07.643384] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.041 [2024-10-07 11:29:07.643403] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.041 [2024-10-07 11:29:07.643606] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.041 [2024-10-07 11:29:07.643759] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.041 [2024-10-07 11:29:07.643808] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.041 [2024-10-07 11:29:07.643824] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.041 [2024-10-07 11:29:07.643938] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.041 [2024-10-07 11:29:07.653030] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.041 [2024-10-07 11:29:07.653136] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.041 [2024-10-07 11:29:07.653166] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.041 [2024-10-07 11:29:07.653184] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.041 [2024-10-07 11:29:07.653209] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.041 [2024-10-07 11:29:07.653231] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.041 [2024-10-07 11:29:07.653245] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.041 [2024-10-07 11:29:07.653259] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.041 [2024-10-07 11:29:07.653283] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.041 [2024-10-07 11:29:07.655710] bdev_nvme.c:2183:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:18:34.041 [2024-10-07 11:29:07.667166] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.041 [2024-10-07 11:29:07.667282] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.041 [2024-10-07 11:29:07.667311] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.041 [2024-10-07 11:29:07.667328] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.041 [2024-10-07 11:29:07.667366] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.041 [2024-10-07 11:29:07.667388] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.041 [2024-10-07 11:29:07.667401] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.041 [2024-10-07 11:29:07.667415] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.041 [2024-10-07 11:29:07.667450] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.041 [2024-10-07 11:29:07.678710] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.041 [2024-10-07 11:29:07.678923] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.042 [2024-10-07 11:29:07.678954] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.042 [2024-10-07 11:29:07.678971] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.042 [2024-10-07 11:29:07.679086] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.042 [2024-10-07 11:29:07.679898] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.042 [2024-10-07 11:29:07.679936] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.042 [2024-10-07 11:29:07.679953] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.042 [2024-10-07 11:29:07.681263] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.042 [2024-10-07 11:29:07.689269] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.042 [2024-10-07 11:29:07.689511] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.042 [2024-10-07 11:29:07.689543] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.042 [2024-10-07 11:29:07.689560] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.042 [2024-10-07 11:29:07.689683] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.042 [2024-10-07 11:29:07.689796] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.042 [2024-10-07 11:29:07.689818] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.042 [2024-10-07 11:29:07.689832] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.042 [2024-10-07 11:29:07.689931] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.042 [2024-10-07 11:29:07.699698] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.042 [2024-10-07 11:29:07.699819] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.042 [2024-10-07 11:29:07.699848] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.042 [2024-10-07 11:29:07.699864] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.042 [2024-10-07 11:29:07.699888] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.042 [2024-10-07 11:29:07.699909] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.042 [2024-10-07 11:29:07.699923] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.042 [2024-10-07 11:29:07.699951] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.042 [2024-10-07 11:29:07.699975] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.042 [2024-10-07 11:29:07.711948] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.042 [2024-10-07 11:29:07.712293] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.042 [2024-10-07 11:29:07.712337] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.042 [2024-10-07 11:29:07.712356] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.042 [2024-10-07 11:29:07.712422] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.042 [2024-10-07 11:29:07.712471] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.042 [2024-10-07 11:29:07.712490] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.042 [2024-10-07 11:29:07.712504] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.042 [2024-10-07 11:29:07.712528] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.042 [2024-10-07 11:29:07.722301] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.042 [2024-10-07 11:29:07.725394] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.042 [2024-10-07 11:29:07.725494] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.042 [2024-10-07 11:29:07.725515] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.042 [2024-10-07 11:29:07.727231] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.042 [2024-10-07 11:29:07.727322] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.042 [2024-10-07 11:29:07.727345] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.042 [2024-10-07 11:29:07.727360] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.042 [2024-10-07 11:29:07.727384] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.042 [2024-10-07 11:29:07.732536] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.042 [2024-10-07 11:29:07.732640] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.042 [2024-10-07 11:29:07.732669] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.042 [2024-10-07 11:29:07.732687] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.042 [2024-10-07 11:29:07.732711] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.042 [2024-10-07 11:29:07.732733] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.042 [2024-10-07 11:29:07.732747] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.042 [2024-10-07 11:29:07.732761] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.042 [2024-10-07 11:29:07.732783] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.042 [2024-10-07 11:29:07.743343] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.042 [2024-10-07 11:29:07.743584] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.042 [2024-10-07 11:29:07.743658] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.042 [2024-10-07 11:29:07.743679] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.042 [2024-10-07 11:29:07.743784] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.042 [2024-10-07 11:29:07.743916] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.042 [2024-10-07 11:29:07.743936] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.042 [2024-10-07 11:29:07.743952] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.042 [2024-10-07 11:29:07.746052] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.042 [2024-10-07 11:29:07.753698] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.042 [2024-10-07 11:29:07.753815] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.042 [2024-10-07 11:29:07.753845] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.042 [2024-10-07 11:29:07.753862] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.042 [2024-10-07 11:29:07.753886] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.042 [2024-10-07 11:29:07.753907] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.042 [2024-10-07 11:29:07.753921] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.042 [2024-10-07 11:29:07.753934] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.042 [2024-10-07 11:29:07.753956] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.042 [2024-10-07 11:29:07.765771] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.042 [2024-10-07 11:29:07.765948] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.042 [2024-10-07 11:29:07.766007] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.042 [2024-10-07 11:29:07.766025] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.042 [2024-10-07 11:29:07.766050] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.042 [2024-10-07 11:29:07.766295] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.042 [2024-10-07 11:29:07.766344] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.042 [2024-10-07 11:29:07.766360] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.042 [2024-10-07 11:29:07.766441] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.042 [2024-10-07 11:29:07.778566] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.042 [2024-10-07 11:29:07.778676] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.042 [2024-10-07 11:29:07.778713] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.042 [2024-10-07 11:29:07.778736] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.042 [2024-10-07 11:29:07.778767] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.042 [2024-10-07 11:29:07.778815] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.042 [2024-10-07 11:29:07.778836] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.042 [2024-10-07 11:29:07.778855] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.042 [2024-10-07 11:29:07.778884] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.042 [2024-10-07 11:29:07.788650] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.042 [2024-10-07 11:29:07.788757] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.042 [2024-10-07 11:29:07.788787] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.042 [2024-10-07 11:29:07.788805] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.042 [2024-10-07 11:29:07.788844] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.042 [2024-10-07 11:29:07.788866] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.042 [2024-10-07 11:29:07.788880] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.042 [2024-10-07 11:29:07.788893] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.042 [2024-10-07 11:29:07.788916] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.042 [2024-10-07 11:29:07.800517] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.043 [2024-10-07 11:29:07.800662] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.043 [2024-10-07 11:29:07.800693] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.043 [2024-10-07 11:29:07.800710] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.043 [2024-10-07 11:29:07.800733] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.043 [2024-10-07 11:29:07.800755] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.043 [2024-10-07 11:29:07.800769] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.043 [2024-10-07 11:29:07.800782] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.043 [2024-10-07 11:29:07.800805] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.043 [2024-10-07 11:29:07.811840] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.043 [2024-10-07 11:29:07.812082] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.043 [2024-10-07 11:29:07.812115] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.043 [2024-10-07 11:29:07.812132] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.043 [2024-10-07 11:29:07.812262] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.043 [2024-10-07 11:29:07.812404] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.043 [2024-10-07 11:29:07.812440] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.043 [2024-10-07 11:29:07.812466] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.043 [2024-10-07 11:29:07.812593] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.043 [2024-10-07 11:29:07.822413] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.043 [2024-10-07 11:29:07.822645] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.043 [2024-10-07 11:29:07.822682] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.043 [2024-10-07 11:29:07.822699] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.043 [2024-10-07 11:29:07.822817] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.043 [2024-10-07 11:29:07.822926] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.043 [2024-10-07 11:29:07.822947] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.043 [2024-10-07 11:29:07.822961] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.043 [2024-10-07 11:29:07.823057] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.043 [2024-10-07 11:29:07.835079] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.043 [2024-10-07 11:29:07.837119] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.043 [2024-10-07 11:29:07.837164] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.043 [2024-10-07 11:29:07.837185] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.043 [2024-10-07 11:29:07.837455] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.043 [2024-10-07 11:29:07.837521] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.043 [2024-10-07 11:29:07.837542] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.043 [2024-10-07 11:29:07.837557] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.043 [2024-10-07 11:29:07.837582] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.043 [2024-10-07 11:29:07.845176] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.043 [2024-10-07 11:29:07.845283] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.043 [2024-10-07 11:29:07.845313] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.043 [2024-10-07 11:29:07.845330] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.043 [2024-10-07 11:29:07.845355] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.043 [2024-10-07 11:29:07.845376] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.043 [2024-10-07 11:29:07.845390] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.043 [2024-10-07 11:29:07.845402] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.043 [2024-10-07 11:29:07.845465] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.043 [2024-10-07 11:29:07.856641] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.043 [2024-10-07 11:29:07.856756] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.043 [2024-10-07 11:29:07.856785] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.043 [2024-10-07 11:29:07.856825] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.043 [2024-10-07 11:29:07.856849] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.043 [2024-10-07 11:29:07.856870] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.043 [2024-10-07 11:29:07.856885] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.043 [2024-10-07 11:29:07.856897] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.043 [2024-10-07 11:29:07.856920] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.043 [2024-10-07 11:29:07.871275] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.043 [2024-10-07 11:29:07.871408] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.043 [2024-10-07 11:29:07.871454] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.043 [2024-10-07 11:29:07.871486] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.043 [2024-10-07 11:29:07.871511] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.043 [2024-10-07 11:29:07.871533] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.043 [2024-10-07 11:29:07.871549] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.043 [2024-10-07 11:29:07.871563] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.043 [2024-10-07 11:29:07.871586] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.043 [2024-10-07 11:29:07.886426] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.043 [2024-10-07 11:29:07.887333] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.043 [2024-10-07 11:29:07.887390] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.043 [2024-10-07 11:29:07.887408] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.043 [2024-10-07 11:29:07.887802] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.043 [2024-10-07 11:29:07.888035] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.043 [2024-10-07 11:29:07.888068] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.043 [2024-10-07 11:29:07.888083] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.043 [2024-10-07 11:29:07.888140] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.043 [2024-10-07 11:29:07.896784] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.043 [2024-10-07 11:29:07.896972] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.043 [2024-10-07 11:29:07.897004] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.043 [2024-10-07 11:29:07.897021] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.043 [2024-10-07 11:29:07.897133] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.043 [2024-10-07 11:29:07.897805] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.043 [2024-10-07 11:29:07.897859] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.043 [2024-10-07 11:29:07.897877] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.043 [2024-10-07 11:29:07.901186] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.043 [2024-10-07 11:29:07.906960] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.043 [2024-10-07 11:29:07.907067] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.043 [2024-10-07 11:29:07.907097] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.043 [2024-10-07 11:29:07.907115] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.043 [2024-10-07 11:29:07.907140] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.043 [2024-10-07 11:29:07.907162] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.043 [2024-10-07 11:29:07.907177] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.044 [2024-10-07 11:29:07.907191] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.044 [2024-10-07 11:29:07.907228] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.044 [2024-10-07 11:29:07.917140] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.044 [2024-10-07 11:29:07.917265] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.044 [2024-10-07 11:29:07.917296] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.044 [2024-10-07 11:29:07.917314] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.044 [2024-10-07 11:29:07.919248] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.044 [2024-10-07 11:29:07.919904] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.044 [2024-10-07 11:29:07.919947] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.044 [2024-10-07 11:29:07.919963] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.044 [2024-10-07 11:29:07.920200] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.044 [2024-10-07 11:29:07.927772] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.044 [2024-10-07 11:29:07.928005] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.044 [2024-10-07 11:29:07.928037] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.044 [2024-10-07 11:29:07.928055] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.044 [2024-10-07 11:29:07.928181] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.044 [2024-10-07 11:29:07.928300] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.044 [2024-10-07 11:29:07.928322] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.044 [2024-10-07 11:29:07.928337] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.044 [2024-10-07 11:29:07.928466] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.044 [2024-10-07 11:29:07.937858] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.044 [2024-10-07 11:29:07.937995] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.044 [2024-10-07 11:29:07.938032] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.044 [2024-10-07 11:29:07.938055] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.044 [2024-10-07 11:29:07.938085] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.044 [2024-10-07 11:29:07.938114] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.044 [2024-10-07 11:29:07.938135] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.044 [2024-10-07 11:29:07.938155] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.044 [2024-10-07 11:29:07.938188] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.044 [2024-10-07 11:29:07.947950] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.044 [2024-10-07 11:29:07.948051] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.044 [2024-10-07 11:29:07.948080] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.044 [2024-10-07 11:29:07.948096] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.044 [2024-10-07 11:29:07.948354] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.044 [2024-10-07 11:29:07.948529] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.044 [2024-10-07 11:29:07.948561] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.044 [2024-10-07 11:29:07.948588] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.044 [2024-10-07 11:29:07.948685] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.044 [2024-10-07 11:29:07.958607] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.044 [2024-10-07 11:29:07.958725] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.044 [2024-10-07 11:29:07.958754] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.044 [2024-10-07 11:29:07.958772] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.044 [2024-10-07 11:29:07.958796] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.044 [2024-10-07 11:29:07.958832] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.044 [2024-10-07 11:29:07.958846] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.044 [2024-10-07 11:29:07.958858] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.044 [2024-10-07 11:29:07.958880] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.044 [2024-10-07 11:29:07.969109] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.044 [2024-10-07 11:29:07.969339] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.044 [2024-10-07 11:29:07.969382] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.044 [2024-10-07 11:29:07.969401] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.044 [2024-10-07 11:29:07.970774] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.044 [2024-10-07 11:29:07.971024] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.044 [2024-10-07 11:29:07.971049] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.044 [2024-10-07 11:29:07.971063] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.044 [2024-10-07 11:29:07.971413] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.044 [2024-10-07 11:29:07.979187] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.044 [2024-10-07 11:29:07.979335] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.044 [2024-10-07 11:29:07.979365] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.044 [2024-10-07 11:29:07.979381] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.044 [2024-10-07 11:29:07.979405] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.044 [2024-10-07 11:29:07.979443] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.044 [2024-10-07 11:29:07.979474] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.044 [2024-10-07 11:29:07.979490] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.044 [2024-10-07 11:29:07.979514] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.044 [2024-10-07 11:29:07.989259] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.044 [2024-10-07 11:29:07.989376] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.044 [2024-10-07 11:29:07.989406] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.044 [2024-10-07 11:29:07.989423] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.044 [2024-10-07 11:29:07.989464] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.044 [2024-10-07 11:29:07.989486] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.044 [2024-10-07 11:29:07.989501] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.044 [2024-10-07 11:29:07.989514] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.044 [2024-10-07 11:29:07.989537] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.044 [2024-10-07 11:29:07.999352] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.044 [2024-10-07 11:29:07.999471] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.044 [2024-10-07 11:29:07.999502] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.044 [2024-10-07 11:29:07.999519] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.044 [2024-10-07 11:29:07.999543] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.044 [2024-10-07 11:29:07.999566] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.044 [2024-10-07 11:29:07.999580] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.044 [2024-10-07 11:29:07.999613] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.044 [2024-10-07 11:29:07.999639] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.044 [2024-10-07 11:29:08.009850] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.044 [2024-10-07 11:29:08.010213] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.044 [2024-10-07 11:29:08.010257] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.044 [2024-10-07 11:29:08.010277] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.044 [2024-10-07 11:29:08.010431] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.044 [2024-10-07 11:29:08.010560] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.044 [2024-10-07 11:29:08.010582] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.045 [2024-10-07 11:29:08.010597] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.045 [2024-10-07 11:29:08.010826] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.045 [2024-10-07 11:29:08.019953] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.045 [2024-10-07 11:29:08.020071] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.045 [2024-10-07 11:29:08.020101] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.045 [2024-10-07 11:29:08.020118] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.045 [2024-10-07 11:29:08.020141] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.045 [2024-10-07 11:29:08.020162] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.045 [2024-10-07 11:29:08.020176] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.045 [2024-10-07 11:29:08.020189] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.045 [2024-10-07 11:29:08.020211] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.045 [2024-10-07 11:29:08.030636] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.045 [2024-10-07 11:29:08.030778] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.045 [2024-10-07 11:29:08.030808] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.045 [2024-10-07 11:29:08.030825] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.045 [2024-10-07 11:29:08.030848] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.045 [2024-10-07 11:29:08.030870] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.045 [2024-10-07 11:29:08.030884] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.045 [2024-10-07 11:29:08.030896] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.045 [2024-10-07 11:29:08.030918] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.045 [2024-10-07 11:29:08.043500] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.045 [2024-10-07 11:29:08.043702] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.045 [2024-10-07 11:29:08.043733] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.045 [2024-10-07 11:29:08.043750] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.045 [2024-10-07 11:29:08.043804] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.045 [2024-10-07 11:29:08.043829] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.045 [2024-10-07 11:29:08.043843] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.045 [2024-10-07 11:29:08.043856] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.045 [2024-10-07 11:29:08.043878] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.045 [2024-10-07 11:29:08.055115] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.045 [2024-10-07 11:29:08.055278] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.045 [2024-10-07 11:29:08.055309] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.045 [2024-10-07 11:29:08.055341] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.045 [2024-10-07 11:29:08.055365] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.045 [2024-10-07 11:29:08.055403] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.045 [2024-10-07 11:29:08.055418] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.045 [2024-10-07 11:29:08.055448] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.045 [2024-10-07 11:29:08.055484] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.045 [2024-10-07 11:29:08.067908] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.045 [2024-10-07 11:29:08.068051] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.045 [2024-10-07 11:29:08.068080] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.045 [2024-10-07 11:29:08.068097] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.045 [2024-10-07 11:29:08.068973] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.045 [2024-10-07 11:29:08.069764] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.045 [2024-10-07 11:29:08.069798] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.045 [2024-10-07 11:29:08.069830] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.045 [2024-10-07 11:29:08.070393] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.045 [2024-10-07 11:29:08.081544] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.045 [2024-10-07 11:29:08.081819] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.045 [2024-10-07 11:29:08.081861] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.045 [2024-10-07 11:29:08.081880] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.045 [2024-10-07 11:29:08.082144] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.045 [2024-10-07 11:29:08.082231] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.045 [2024-10-07 11:29:08.082254] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.045 [2024-10-07 11:29:08.082269] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.045 [2024-10-07 11:29:08.082295] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.045 [2024-10-07 11:29:08.094573] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.045 [2024-10-07 11:29:08.094883] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.045 [2024-10-07 11:29:08.094944] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.045 [2024-10-07 11:29:08.094963] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.045 [2024-10-07 11:29:08.095020] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.045 [2024-10-07 11:29:08.095048] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.045 [2024-10-07 11:29:08.095062] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.045 [2024-10-07 11:29:08.095075] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.045 [2024-10-07 11:29:08.095098] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.045 [2024-10-07 11:29:08.108111] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.045 [2024-10-07 11:29:08.108228] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.045 [2024-10-07 11:29:08.108256] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.045 [2024-10-07 11:29:08.108273] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.045 [2024-10-07 11:29:08.108296] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.045 [2024-10-07 11:29:08.108317] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.045 [2024-10-07 11:29:08.108331] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.045 [2024-10-07 11:29:08.108344] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.045 [2024-10-07 11:29:08.108366] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.045 [2024-10-07 11:29:08.121828] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.045 [2024-10-07 11:29:08.121950] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.045 [2024-10-07 11:29:08.121992] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.045 [2024-10-07 11:29:08.122010] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.045 [2024-10-07 11:29:08.122035] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.045 [2024-10-07 11:29:08.122057] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.045 [2024-10-07 11:29:08.122072] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.045 [2024-10-07 11:29:08.122085] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.045 [2024-10-07 11:29:08.122126] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.045 [2024-10-07 11:29:08.134128] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.045 [2024-10-07 11:29:08.134281] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.045 [2024-10-07 11:29:08.134314] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.045 [2024-10-07 11:29:08.134331] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.045 [2024-10-07 11:29:08.134356] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.045 [2024-10-07 11:29:08.134378] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.045 [2024-10-07 11:29:08.134394] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.045 [2024-10-07 11:29:08.134407] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.045 [2024-10-07 11:29:08.134448] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.045 [2024-10-07 11:29:08.147807] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.045 [2024-10-07 11:29:08.149113] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.045 [2024-10-07 11:29:08.149157] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.045 [2024-10-07 11:29:08.149177] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.045 [2024-10-07 11:29:08.149793] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.045 [2024-10-07 11:29:08.150061] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.046 [2024-10-07 11:29:08.150097] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.046 [2024-10-07 11:29:08.150114] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.046 [2024-10-07 11:29:08.150318] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.046 [2024-10-07 11:29:08.158303] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.046 [2024-10-07 11:29:08.158535] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.046 [2024-10-07 11:29:08.158576] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.046 [2024-10-07 11:29:08.158595] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.046 [2024-10-07 11:29:08.158716] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.046 [2024-10-07 11:29:08.158844] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.046 [2024-10-07 11:29:08.158865] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.046 [2024-10-07 11:29:08.158880] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.046 [2024-10-07 11:29:08.158982] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.046 [2024-10-07 11:29:08.168387] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.046 [2024-10-07 11:29:08.168518] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.046 [2024-10-07 11:29:08.168548] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.046 [2024-10-07 11:29:08.168591] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.046 [2024-10-07 11:29:08.168616] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.046 [2024-10-07 11:29:08.168638] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.046 [2024-10-07 11:29:08.168652] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.046 [2024-10-07 11:29:08.168665] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.046 [2024-10-07 11:29:08.168687] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.046 [2024-10-07 11:29:08.178852] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.046 [2024-10-07 11:29:08.178969] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.046 [2024-10-07 11:29:08.178998] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.046 [2024-10-07 11:29:08.179014] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.046 [2024-10-07 11:29:08.179038] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.046 [2024-10-07 11:29:08.179059] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.046 [2024-10-07 11:29:08.179073] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.046 [2024-10-07 11:29:08.179086] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.046 [2024-10-07 11:29:08.179107] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.046 [2024-10-07 11:29:08.189296] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.046 [2024-10-07 11:29:08.189500] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.046 [2024-10-07 11:29:08.189542] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.046 [2024-10-07 11:29:08.189561] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.046 [2024-10-07 11:29:08.189658] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.046 [2024-10-07 11:29:08.189943] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.046 [2024-10-07 11:29:08.189987] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.046 [2024-10-07 11:29:08.190003] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.046 [2024-10-07 11:29:08.190190] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.046 [2024-10-07 11:29:08.199391] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.046 [2024-10-07 11:29:08.199523] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.046 [2024-10-07 11:29:08.199567] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.046 [2024-10-07 11:29:08.199589] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.046 [2024-10-07 11:29:08.199615] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.046 [2024-10-07 11:29:08.199637] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.046 [2024-10-07 11:29:08.199669] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.046 [2024-10-07 11:29:08.199684] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.046 [2024-10-07 11:29:08.199709] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.046 [2024-10-07 11:29:08.209488] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.046 [2024-10-07 11:29:08.209608] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.046 [2024-10-07 11:29:08.209638] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.046 [2024-10-07 11:29:08.209654] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.046 [2024-10-07 11:29:08.209677] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.046 [2024-10-07 11:29:08.209698] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.046 [2024-10-07 11:29:08.209711] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.046 [2024-10-07 11:29:08.209724] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.046 [2024-10-07 11:29:08.209745] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.046 [2024-10-07 11:29:08.221164] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.046 [2024-10-07 11:29:08.221286] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.046 [2024-10-07 11:29:08.221315] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.046 [2024-10-07 11:29:08.221332] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.046 [2024-10-07 11:29:08.221354] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.046 [2024-10-07 11:29:08.221375] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.046 [2024-10-07 11:29:08.221388] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.046 [2024-10-07 11:29:08.221401] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.046 [2024-10-07 11:29:08.221657] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.046 [2024-10-07 11:29:08.234069] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.046 [2024-10-07 11:29:08.234188] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.046 [2024-10-07 11:29:08.234217] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.046 [2024-10-07 11:29:08.234234] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.046 [2024-10-07 11:29:08.234258] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.046 [2024-10-07 11:29:08.234279] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.046 [2024-10-07 11:29:08.234295] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.046 [2024-10-07 11:29:08.234308] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.046 [2024-10-07 11:29:08.234331] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.046 [2024-10-07 11:29:08.246143] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.046 [2024-10-07 11:29:08.246355] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.046 [2024-10-07 11:29:08.246385] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.046 [2024-10-07 11:29:08.246402] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.046 [2024-10-07 11:29:08.247027] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.046 [2024-10-07 11:29:08.247711] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.046 [2024-10-07 11:29:08.247760] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.046 [2024-10-07 11:29:08.247792] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.046 [2024-10-07 11:29:08.247900] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.046 [2024-10-07 11:29:08.256239] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.046 [2024-10-07 11:29:08.256357] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.046 [2024-10-07 11:29:08.256386] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.046 [2024-10-07 11:29:08.256403] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.046 [2024-10-07 11:29:08.256440] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.046 [2024-10-07 11:29:08.256465] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.046 [2024-10-07 11:29:08.256479] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.046 [2024-10-07 11:29:08.256492] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.046 [2024-10-07 11:29:08.256513] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.046 [2024-10-07 11:29:08.267133] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.046 [2024-10-07 11:29:08.267327] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.046 [2024-10-07 11:29:08.267359] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.046 [2024-10-07 11:29:08.267376] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.046 [2024-10-07 11:29:08.267399] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.047 [2024-10-07 11:29:08.267422] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.047 [2024-10-07 11:29:08.267450] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.047 [2024-10-07 11:29:08.267465] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.047 [2024-10-07 11:29:08.267504] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.047 [2024-10-07 11:29:08.277665] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.047 [2024-10-07 11:29:08.277817] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.047 [2024-10-07 11:29:08.277854] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.047 [2024-10-07 11:29:08.277877] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.047 [2024-10-07 11:29:08.277939] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.047 [2024-10-07 11:29:08.278004] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.047 [2024-10-07 11:29:08.278031] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.047 [2024-10-07 11:29:08.278051] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.047 [2024-10-07 11:29:08.278086] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.047 [2024-10-07 11:29:08.291575] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.047 [2024-10-07 11:29:08.291876] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.047 [2024-10-07 11:29:08.291915] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.047 [2024-10-07 11:29:08.291934] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.047 [2024-10-07 11:29:08.292172] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.047 [2024-10-07 11:29:08.292240] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.047 [2024-10-07 11:29:08.292262] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.047 [2024-10-07 11:29:08.292277] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.047 [2024-10-07 11:29:08.292301] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.047 [2024-10-07 11:29:08.304989] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.047 [2024-10-07 11:29:08.305174] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.047 [2024-10-07 11:29:08.305204] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.047 [2024-10-07 11:29:08.305221] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.047 [2024-10-07 11:29:08.305243] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.047 [2024-10-07 11:29:08.305265] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.047 [2024-10-07 11:29:08.305279] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.047 [2024-10-07 11:29:08.305292] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.047 [2024-10-07 11:29:08.305314] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.047 [2024-10-07 11:29:08.315278] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.047 [2024-10-07 11:29:08.315497] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.047 [2024-10-07 11:29:08.315528] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.047 [2024-10-07 11:29:08.315545] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.047 [2024-10-07 11:29:08.315651] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.047 [2024-10-07 11:29:08.315751] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.047 [2024-10-07 11:29:08.315770] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.047 [2024-10-07 11:29:08.315800] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.047 [2024-10-07 11:29:08.316560] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.047 [2024-10-07 11:29:08.325371] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.047 [2024-10-07 11:29:08.325533] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.047 [2024-10-07 11:29:08.325564] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.047 [2024-10-07 11:29:08.325581] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.047 [2024-10-07 11:29:08.325605] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.047 [2024-10-07 11:29:08.325627] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.047 [2024-10-07 11:29:08.325641] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.047 [2024-10-07 11:29:08.325654] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.047 [2024-10-07 11:29:08.325678] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.047 [2024-10-07 11:29:08.335703] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.047 [2024-10-07 11:29:08.336069] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.047 [2024-10-07 11:29:08.336112] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.047 [2024-10-07 11:29:08.336131] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.047 [2024-10-07 11:29:08.336262] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.047 [2024-10-07 11:29:08.336372] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.047 [2024-10-07 11:29:08.336392] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.047 [2024-10-07 11:29:08.336405] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.047 [2024-10-07 11:29:08.337028] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.047 [2024-10-07 11:29:08.345937] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.047 [2024-10-07 11:29:08.346056] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.047 [2024-10-07 11:29:08.346086] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.047 [2024-10-07 11:29:08.346104] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.047 [2024-10-07 11:29:08.346127] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.047 [2024-10-07 11:29:08.346150] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.047 [2024-10-07 11:29:08.346164] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.047 [2024-10-07 11:29:08.346178] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.047 [2024-10-07 11:29:08.346206] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.047 [2024-10-07 11:29:08.359121] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.047 [2024-10-07 11:29:08.359660] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.047 [2024-10-07 11:29:08.359712] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.047 [2024-10-07 11:29:08.359732] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.047 [2024-10-07 11:29:08.360026] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.047 [2024-10-07 11:29:08.360712] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.047 [2024-10-07 11:29:08.360751] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.047 [2024-10-07 11:29:08.360769] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.047 [2024-10-07 11:29:08.360919] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.047 [2024-10-07 11:29:08.369295] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.047 [2024-10-07 11:29:08.369435] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.047 [2024-10-07 11:29:08.369471] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.047 [2024-10-07 11:29:08.369494] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.047 [2024-10-07 11:29:08.369526] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.047 [2024-10-07 11:29:08.369554] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.047 [2024-10-07 11:29:08.369574] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.047 [2024-10-07 11:29:08.369594] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.047 [2024-10-07 11:29:08.369623] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.047 [2024-10-07 11:29:08.381329] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.047 [2024-10-07 11:29:08.381752] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.047 [2024-10-07 11:29:08.381796] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.047 [2024-10-07 11:29:08.381816] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.047 [2024-10-07 11:29:08.381881] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.047 [2024-10-07 11:29:08.381910] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.047 [2024-10-07 11:29:08.381926] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.047 [2024-10-07 11:29:08.381939] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.047 [2024-10-07 11:29:08.381974] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.047 [2024-10-07 11:29:08.391438] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.047 [2024-10-07 11:29:08.391556] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.047 [2024-10-07 11:29:08.391586] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.047 [2024-10-07 11:29:08.391604] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.048 [2024-10-07 11:29:08.392376] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.048 [2024-10-07 11:29:08.392790] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.048 [2024-10-07 11:29:08.392828] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.048 [2024-10-07 11:29:08.392845] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.048 [2024-10-07 11:29:08.392999] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.048 [2024-10-07 11:29:08.401743] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.048 [2024-10-07 11:29:08.401944] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.048 [2024-10-07 11:29:08.402030] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.048 [2024-10-07 11:29:08.402049] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.048 [2024-10-07 11:29:08.402846] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.048 [2024-10-07 11:29:08.402982] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.048 [2024-10-07 11:29:08.403005] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.048 [2024-10-07 11:29:08.403020] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.048 [2024-10-07 11:29:08.403044] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.048 8928.22 IOPS, 34.88 MiB/s [2024-10-07T11:29:15.759Z] [2024-10-07 11:29:08.411891] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.048 [2024-10-07 11:29:08.412154] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.048 [2024-10-07 11:29:08.412187] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.048 [2024-10-07 11:29:08.412204] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.048 [2024-10-07 11:29:08.412322] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.048 [2024-10-07 11:29:08.412443] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.048 [2024-10-07 11:29:08.412466] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.048 [2024-10-07 11:29:08.412480] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.048 [2024-10-07 11:29:08.412504] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.048 [2024-10-07 11:29:08.422162] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.048 [2024-10-07 11:29:08.422277] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.048 [2024-10-07 11:29:08.422308] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.048 [2024-10-07 11:29:08.422326] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.048 [2024-10-07 11:29:08.422350] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.048 [2024-10-07 11:29:08.422372] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.048 [2024-10-07 11:29:08.422387] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.048 [2024-10-07 11:29:08.422402] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.048 [2024-10-07 11:29:08.422464] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.048 [2024-10-07 11:29:08.432252] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.048 [2024-10-07 11:29:08.432376] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.048 [2024-10-07 11:29:08.432423] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.048 [2024-10-07 11:29:08.432444] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.048 [2024-10-07 11:29:08.432903] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.048 [2024-10-07 11:29:08.433153] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.048 [2024-10-07 11:29:08.433196] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.048 [2024-10-07 11:29:08.433218] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.048 [2024-10-07 11:29:08.433498] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.048 [2024-10-07 11:29:08.446958] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.048 [2024-10-07 11:29:08.447067] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.048 [2024-10-07 11:29:08.447097] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.048 [2024-10-07 11:29:08.447115] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.048 [2024-10-07 11:29:08.447140] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.048 [2024-10-07 11:29:08.447162] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.048 [2024-10-07 11:29:08.447178] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.048 [2024-10-07 11:29:08.447192] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.048 [2024-10-07 11:29:08.447215] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.048 [2024-10-07 11:29:08.460248] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.048 [2024-10-07 11:29:08.460599] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.048 [2024-10-07 11:29:08.460632] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.048 [2024-10-07 11:29:08.460649] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.048 [2024-10-07 11:29:08.460844] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.048 [2024-10-07 11:29:08.460910] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.048 [2024-10-07 11:29:08.460930] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.048 [2024-10-07 11:29:08.460944] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.048 [2024-10-07 11:29:08.460967] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.048 [2024-10-07 11:29:08.472314] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.048 [2024-10-07 11:29:08.472766] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.048 [2024-10-07 11:29:08.472828] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.048 [2024-10-07 11:29:08.472849] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.048 [2024-10-07 11:29:08.472916] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.048 [2024-10-07 11:29:08.472945] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.048 [2024-10-07 11:29:08.472961] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.048 [2024-10-07 11:29:08.472974] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.048 [2024-10-07 11:29:08.472997] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.048 [2024-10-07 11:29:08.485676] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.048 [2024-10-07 11:29:08.485956] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.048 [2024-10-07 11:29:08.486016] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.048 [2024-10-07 11:29:08.486034] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.048 [2024-10-07 11:29:08.486080] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.048 [2024-10-07 11:29:08.486106] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.048 [2024-10-07 11:29:08.486121] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.048 [2024-10-07 11:29:08.486135] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.048 [2024-10-07 11:29:08.486159] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.048 [2024-10-07 11:29:08.499419] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.048 [2024-10-07 11:29:08.499565] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.049 [2024-10-07 11:29:08.499595] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.049 [2024-10-07 11:29:08.499613] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.049 [2024-10-07 11:29:08.499636] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.049 [2024-10-07 11:29:08.499657] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.049 [2024-10-07 11:29:08.499673] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.049 [2024-10-07 11:29:08.499686] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.049 [2024-10-07 11:29:08.499709] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.049 [2024-10-07 11:29:08.513169] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.049 [2024-10-07 11:29:08.513274] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.049 [2024-10-07 11:29:08.513303] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.049 [2024-10-07 11:29:08.513321] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.049 [2024-10-07 11:29:08.513345] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.049 [2024-10-07 11:29:08.513385] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.049 [2024-10-07 11:29:08.513401] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.049 [2024-10-07 11:29:08.513430] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.049 [2024-10-07 11:29:08.513456] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.049 [2024-10-07 11:29:08.527386] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.049 [2024-10-07 11:29:08.527564] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.049 [2024-10-07 11:29:08.527596] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.049 [2024-10-07 11:29:08.527614] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.049 [2024-10-07 11:29:08.527638] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.049 [2024-10-07 11:29:08.527677] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.049 [2024-10-07 11:29:08.527692] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.049 [2024-10-07 11:29:08.527706] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.049 [2024-10-07 11:29:08.527728] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.049 [2024-10-07 11:29:08.542458] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.049 [2024-10-07 11:29:08.543219] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.049 [2024-10-07 11:29:08.543277] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.049 [2024-10-07 11:29:08.543296] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.049 [2024-10-07 11:29:08.543559] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.049 [2024-10-07 11:29:08.543624] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.049 [2024-10-07 11:29:08.543645] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.049 [2024-10-07 11:29:08.543659] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.049 [2024-10-07 11:29:08.543684] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.049 [2024-10-07 11:29:08.554059] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.049 [2024-10-07 11:29:08.554244] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.049 [2024-10-07 11:29:08.554275] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.049 [2024-10-07 11:29:08.554294] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.049 [2024-10-07 11:29:08.554409] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.049 [2024-10-07 11:29:08.555117] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.049 [2024-10-07 11:29:08.555152] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.049 [2024-10-07 11:29:08.555186] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.049 [2024-10-07 11:29:08.557247] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.049 [2024-10-07 11:29:08.564141] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.049 [2024-10-07 11:29:08.564254] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.049 [2024-10-07 11:29:08.564283] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.049 [2024-10-07 11:29:08.564316] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.049 [2024-10-07 11:29:08.566729] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.049 [2024-10-07 11:29:08.567347] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.049 [2024-10-07 11:29:08.567383] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.049 [2024-10-07 11:29:08.567417] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.049 [2024-10-07 11:29:08.567533] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.049 [2024-10-07 11:29:08.574232] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.049 [2024-10-07 11:29:08.574336] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.049 [2024-10-07 11:29:08.574372] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.049 [2024-10-07 11:29:08.574390] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.049 [2024-10-07 11:29:08.574427] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.049 [2024-10-07 11:29:08.574453] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.049 [2024-10-07 11:29:08.574468] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.049 [2024-10-07 11:29:08.574482] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.049 [2024-10-07 11:29:08.574505] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.049 [2024-10-07 11:29:08.584382] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.049 [2024-10-07 11:29:08.584515] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.049 [2024-10-07 11:29:08.584547] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.049 [2024-10-07 11:29:08.584564] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.049 [2024-10-07 11:29:08.584588] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.049 [2024-10-07 11:29:08.584611] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.049 [2024-10-07 11:29:08.584626] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.049 [2024-10-07 11:29:08.584639] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.049 [2024-10-07 11:29:08.584662] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.049 [2024-10-07 11:29:08.594770] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.049 [2024-10-07 11:29:08.594950] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.049 [2024-10-07 11:29:08.594979] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.049 [2024-10-07 11:29:08.595013] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.049 [2024-10-07 11:29:08.595040] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.049 [2024-10-07 11:29:08.595062] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.049 [2024-10-07 11:29:08.595076] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.049 [2024-10-07 11:29:08.595089] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.049 [2024-10-07 11:29:08.595112] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.049 [2024-10-07 11:29:08.605047] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.049 [2024-10-07 11:29:08.605163] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.049 [2024-10-07 11:29:08.605192] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.049 [2024-10-07 11:29:08.605209] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.049 [2024-10-07 11:29:08.605677] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.049 [2024-10-07 11:29:08.605927] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.049 [2024-10-07 11:29:08.605968] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.049 [2024-10-07 11:29:08.606001] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.049 [2024-10-07 11:29:08.606056] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.049 [2024-10-07 11:29:08.619358] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.049 [2024-10-07 11:29:08.619667] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.049 [2024-10-07 11:29:08.619710] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.049 [2024-10-07 11:29:08.619730] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.049 [2024-10-07 11:29:08.619850] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.049 [2024-10-07 11:29:08.619947] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.049 [2024-10-07 11:29:08.619967] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.049 [2024-10-07 11:29:08.619981] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.049 [2024-10-07 11:29:08.620006] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.049 [2024-10-07 11:29:08.629925] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.050 [2024-10-07 11:29:08.630050] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.050 [2024-10-07 11:29:08.630080] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.050 [2024-10-07 11:29:08.630097] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.050 [2024-10-07 11:29:08.630121] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.050 [2024-10-07 11:29:08.630143] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.050 [2024-10-07 11:29:08.630158] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.050 [2024-10-07 11:29:08.630190] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.050 [2024-10-07 11:29:08.630219] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.050 [2024-10-07 11:29:08.642787] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.050 [2024-10-07 11:29:08.642997] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.050 [2024-10-07 11:29:08.643027] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.050 [2024-10-07 11:29:08.643044] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.050 [2024-10-07 11:29:08.643140] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.050 [2024-10-07 11:29:08.643319] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.050 [2024-10-07 11:29:08.643353] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.050 [2024-10-07 11:29:08.643369] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.050 [2024-10-07 11:29:08.643457] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.050 [2024-10-07 11:29:08.656313] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.050 [2024-10-07 11:29:08.656518] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.050 [2024-10-07 11:29:08.656550] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.050 [2024-10-07 11:29:08.656568] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.050 [2024-10-07 11:29:08.656592] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.050 [2024-10-07 11:29:08.656614] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.050 [2024-10-07 11:29:08.656629] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.050 [2024-10-07 11:29:08.656642] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.050 [2024-10-07 11:29:08.656667] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.050 [2024-10-07 11:29:08.669215] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.050 [2024-10-07 11:29:08.669400] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.050 [2024-10-07 11:29:08.669461] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.050 [2024-10-07 11:29:08.669481] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.050 [2024-10-07 11:29:08.669506] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.050 [2024-10-07 11:29:08.669528] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.050 [2024-10-07 11:29:08.669543] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.050 [2024-10-07 11:29:08.669557] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.050 [2024-10-07 11:29:08.669580] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.050 [2024-10-07 11:29:08.679310] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.050 [2024-10-07 11:29:08.679743] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.050 [2024-10-07 11:29:08.679787] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.050 [2024-10-07 11:29:08.679822] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.050 [2024-10-07 11:29:08.679978] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.050 [2024-10-07 11:29:08.680082] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.050 [2024-10-07 11:29:08.680101] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.050 [2024-10-07 11:29:08.680114] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.050 [2024-10-07 11:29:08.680212] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.050 [2024-10-07 11:29:08.691774] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.050 [2024-10-07 11:29:08.692152] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.050 [2024-10-07 11:29:08.692196] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.050 [2024-10-07 11:29:08.692215] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.050 [2024-10-07 11:29:08.692270] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.050 [2024-10-07 11:29:08.692471] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.050 [2024-10-07 11:29:08.692496] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.050 [2024-10-07 11:29:08.692511] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.050 [2024-10-07 11:29:08.692574] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.050 [2024-10-07 11:29:08.705501] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.050 [2024-10-07 11:29:08.706793] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.050 [2024-10-07 11:29:08.706852] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.050 [2024-10-07 11:29:08.706871] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.050 [2024-10-07 11:29:08.707475] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.050 [2024-10-07 11:29:08.707871] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.050 [2024-10-07 11:29:08.707906] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.050 [2024-10-07 11:29:08.707922] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.050 [2024-10-07 11:29:08.707991] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.050 [2024-10-07 11:29:08.715749] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.050 [2024-10-07 11:29:08.715943] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.050 [2024-10-07 11:29:08.715973] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.050 [2024-10-07 11:29:08.715990] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.050 [2024-10-07 11:29:08.716686] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.050 [2024-10-07 11:29:08.719799] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.050 [2024-10-07 11:29:08.719838] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.050 [2024-10-07 11:29:08.719872] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.050 [2024-10-07 11:29:08.720242] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.050 [2024-10-07 11:29:08.725921] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.050 [2024-10-07 11:29:08.726059] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.050 [2024-10-07 11:29:08.726090] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.050 [2024-10-07 11:29:08.726107] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.050 [2024-10-07 11:29:08.726131] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.050 [2024-10-07 11:29:08.726154] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.050 [2024-10-07 11:29:08.726168] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.050 [2024-10-07 11:29:08.726181] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.050 [2024-10-07 11:29:08.726204] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.050 [2024-10-07 11:29:08.736244] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.050 [2024-10-07 11:29:08.736351] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.050 [2024-10-07 11:29:08.736380] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.050 [2024-10-07 11:29:08.736398] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.050 [2024-10-07 11:29:08.736435] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.050 [2024-10-07 11:29:08.736460] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.050 [2024-10-07 11:29:08.736475] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.050 [2024-10-07 11:29:08.736489] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.050 [2024-10-07 11:29:08.736511] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.050 [2024-10-07 11:29:08.746328] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.050 [2024-10-07 11:29:08.746476] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.050 [2024-10-07 11:29:08.746507] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.050 [2024-10-07 11:29:08.746524] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.050 [2024-10-07 11:29:08.746549] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.050 [2024-10-07 11:29:08.746571] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.050 [2024-10-07 11:29:08.746586] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.050 [2024-10-07 11:29:08.746599] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.050 [2024-10-07 11:29:08.746641] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.051 [2024-10-07 11:29:08.756882] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.051 [2024-10-07 11:29:08.757000] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.051 [2024-10-07 11:29:08.757029] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.051 [2024-10-07 11:29:08.757063] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.051 [2024-10-07 11:29:08.757245] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.051 [2024-10-07 11:29:08.757310] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.051 [2024-10-07 11:29:08.757331] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.051 [2024-10-07 11:29:08.757345] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.051 [2024-10-07 11:29:08.757369] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.051 [2024-10-07 11:29:08.769591] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.051 [2024-10-07 11:29:08.769698] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.051 [2024-10-07 11:29:08.769728] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.051 [2024-10-07 11:29:08.769745] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.051 [2024-10-07 11:29:08.769769] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.051 [2024-10-07 11:29:08.769791] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.051 [2024-10-07 11:29:08.769805] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.051 [2024-10-07 11:29:08.769818] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.051 [2024-10-07 11:29:08.769841] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.051 [2024-10-07 11:29:08.781683] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.051 [2024-10-07 11:29:08.781865] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.051 [2024-10-07 11:29:08.781895] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.051 [2024-10-07 11:29:08.781912] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.051 [2024-10-07 11:29:08.781936] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.051 [2024-10-07 11:29:08.781957] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.051 [2024-10-07 11:29:08.782001] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.051 [2024-10-07 11:29:08.782016] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.051 [2024-10-07 11:29:08.782039] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.051 [2024-10-07 11:29:08.795660] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.051 [2024-10-07 11:29:08.795777] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.051 [2024-10-07 11:29:08.795824] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.051 [2024-10-07 11:29:08.795843] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.051 [2024-10-07 11:29:08.795867] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.051 [2024-10-07 11:29:08.795889] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.051 [2024-10-07 11:29:08.795903] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.051 [2024-10-07 11:29:08.795917] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.051 [2024-10-07 11:29:08.795939] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.051 [2024-10-07 11:29:08.806900] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.051 [2024-10-07 11:29:08.807115] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.051 [2024-10-07 11:29:08.807146] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.051 [2024-10-07 11:29:08.807163] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.051 [2024-10-07 11:29:08.807289] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.051 [2024-10-07 11:29:08.807401] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.051 [2024-10-07 11:29:08.807422] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.051 [2024-10-07 11:29:08.807451] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.051 [2024-10-07 11:29:08.807551] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.051 [2024-10-07 11:29:08.817148] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.051 [2024-10-07 11:29:08.817266] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.051 [2024-10-07 11:29:08.817296] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.051 [2024-10-07 11:29:08.817314] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.051 [2024-10-07 11:29:08.817338] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.051 [2024-10-07 11:29:08.817360] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.051 [2024-10-07 11:29:08.817374] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.051 [2024-10-07 11:29:08.817388] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.051 [2024-10-07 11:29:08.817411] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.051 [2024-10-07 11:29:08.827240] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.051 [2024-10-07 11:29:08.827361] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.051 [2024-10-07 11:29:08.827408] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.051 [2024-10-07 11:29:08.827425] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.051 [2024-10-07 11:29:08.827461] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.051 [2024-10-07 11:29:08.827502] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.051 [2024-10-07 11:29:08.827519] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.051 [2024-10-07 11:29:08.827533] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.051 [2024-10-07 11:29:08.827556] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.051 [2024-10-07 11:29:08.839246] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.051 [2024-10-07 11:29:08.840213] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.051 [2024-10-07 11:29:08.840271] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.051 [2024-10-07 11:29:08.840291] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.051 [2024-10-07 11:29:08.841032] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.051 [2024-10-07 11:29:08.841640] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.051 [2024-10-07 11:29:08.841674] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.051 [2024-10-07 11:29:08.841691] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.051 [2024-10-07 11:29:08.841922] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.051 [2024-10-07 11:29:08.850134] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.051 [2024-10-07 11:29:08.850319] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.051 [2024-10-07 11:29:08.850350] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.051 [2024-10-07 11:29:08.850367] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.051 [2024-10-07 11:29:08.851647] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.051 [2024-10-07 11:29:08.853407] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.051 [2024-10-07 11:29:08.853468] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.051 [2024-10-07 11:29:08.853488] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.051 [2024-10-07 11:29:08.854060] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.051 [2024-10-07 11:29:08.863386] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.051 [2024-10-07 11:29:08.863623] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.051 [2024-10-07 11:29:08.863654] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.051 [2024-10-07 11:29:08.863672] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.051 [2024-10-07 11:29:08.863771] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.051 [2024-10-07 11:29:08.863882] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.051 [2024-10-07 11:29:08.863903] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.051 [2024-10-07 11:29:08.863916] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.051 [2024-10-07 11:29:08.864515] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.051 [2024-10-07 11:29:08.873492] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.051 [2024-10-07 11:29:08.873613] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.051 [2024-10-07 11:29:08.873643] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.051 [2024-10-07 11:29:08.873660] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.051 [2024-10-07 11:29:08.873683] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.051 [2024-10-07 11:29:08.873705] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.051 [2024-10-07 11:29:08.873719] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.051 [2024-10-07 11:29:08.873733] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.052 [2024-10-07 11:29:08.873755] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.052 [2024-10-07 11:29:08.886898] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.052 [2024-10-07 11:29:08.887103] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.052 [2024-10-07 11:29:08.887135] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.052 [2024-10-07 11:29:08.887152] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.052 [2024-10-07 11:29:08.887262] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.052 [2024-10-07 11:29:08.887504] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.052 [2024-10-07 11:29:08.887535] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.052 [2024-10-07 11:29:08.887551] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.052 [2024-10-07 11:29:08.887606] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.052 [2024-10-07 11:29:08.900212] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.052 [2024-10-07 11:29:08.900527] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.052 [2024-10-07 11:29:08.900571] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.052 [2024-10-07 11:29:08.900591] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.052 [2024-10-07 11:29:08.900797] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.052 [2024-10-07 11:29:08.900865] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.052 [2024-10-07 11:29:08.900887] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.052 [2024-10-07 11:29:08.900901] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.052 [2024-10-07 11:29:08.900926] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.052 [2024-10-07 11:29:08.914169] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.052 [2024-10-07 11:29:08.914277] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.052 [2024-10-07 11:29:08.914317] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.052 [2024-10-07 11:29:08.914355] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.052 [2024-10-07 11:29:08.914382] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.052 [2024-10-07 11:29:08.914405] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.052 [2024-10-07 11:29:08.914436] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.052 [2024-10-07 11:29:08.914451] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.052 [2024-10-07 11:29:08.914475] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.052 [2024-10-07 11:29:08.925078] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.052 [2024-10-07 11:29:08.925276] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.052 [2024-10-07 11:29:08.925308] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.052 [2024-10-07 11:29:08.925326] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.052 [2024-10-07 11:29:08.925442] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.052 [2024-10-07 11:29:08.925549] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.052 [2024-10-07 11:29:08.925569] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.052 [2024-10-07 11:29:08.925584] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.052 [2024-10-07 11:29:08.928121] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.052 [2024-10-07 11:29:08.935987] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.052 [2024-10-07 11:29:08.936092] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.052 [2024-10-07 11:29:08.936122] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.052 [2024-10-07 11:29:08.936140] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.052 [2024-10-07 11:29:08.936164] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.052 [2024-10-07 11:29:08.936186] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.052 [2024-10-07 11:29:08.936201] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.052 [2024-10-07 11:29:08.936215] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.052 [2024-10-07 11:29:08.936249] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.052 [2024-10-07 11:29:08.946539] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.052 [2024-10-07 11:29:08.946642] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.052 [2024-10-07 11:29:08.946673] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.052 [2024-10-07 11:29:08.946690] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.052 [2024-10-07 11:29:08.946714] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.052 [2024-10-07 11:29:08.946737] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.052 [2024-10-07 11:29:08.946752] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.052 [2024-10-07 11:29:08.946782] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.052 [2024-10-07 11:29:08.946807] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.052 [2024-10-07 11:29:08.956621] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.052 [2024-10-07 11:29:08.956726] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.052 [2024-10-07 11:29:08.956757] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.052 [2024-10-07 11:29:08.956774] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.052 [2024-10-07 11:29:08.956828] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.052 [2024-10-07 11:29:08.956850] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.052 [2024-10-07 11:29:08.956864] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.052 [2024-10-07 11:29:08.956879] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.052 [2024-10-07 11:29:08.956902] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.052 [2024-10-07 11:29:08.967054] bdev_nvme.c:1730:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x69dbb0 was disconnected and freed. reset controller. 00:18:34.052 [2024-10-07 11:29:08.967207] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:18:34.052 [2024-10-07 11:29:08.967235] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.052 [2024-10-07 11:29:08.967253] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:18:34.052 [2024-10-07 11:29:08.967267] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.052 [2024-10-07 11:29:08.967281] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:18:34.052 [2024-10-07 11:29:08.967294] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.052 [2024-10-07 11:29:08.967309] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:18:34.052 [2024-10-07 11:29:08.967323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.052 [2024-10-07 11:29:08.967335] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.052 [2024-10-07 11:29:08.969597] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.052 [2024-10-07 11:29:08.969643] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.052 [2024-10-07 11:29:08.970670] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.052 [2024-10-07 11:29:08.970892] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.052 [2024-10-07 11:29:08.970923] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.052 [2024-10-07 11:29:08.970940] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.052 [2024-10-07 11:29:08.970988] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.052 [2024-10-07 11:29:08.971028] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.052 [2024-10-07 11:29:08.971046] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.053 [2024-10-07 11:29:08.971211] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.053 [2024-10-07 11:29:08.971241] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.053 [2024-10-07 11:29:08.971473] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.053 [2024-10-07 11:29:08.971504] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.053 [2024-10-07 11:29:08.971519] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.053 [2024-10-07 11:29:08.971537] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.053 [2024-10-07 11:29:08.971551] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.053 [2024-10-07 11:29:08.971565] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.053 [2024-10-07 11:29:08.971616] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.053 [2024-10-07 11:29:08.971636] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.053 [2024-10-07 11:29:08.984944] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.053 [2024-10-07 11:29:08.984993] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.053 [2024-10-07 11:29:08.985314] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.053 [2024-10-07 11:29:08.985348] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.053 [2024-10-07 11:29:08.985366] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.053 [2024-10-07 11:29:08.985414] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.053 [2024-10-07 11:29:08.985437] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.053 [2024-10-07 11:29:08.985469] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.053 [2024-10-07 11:29:08.985910] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.053 [2024-10-07 11:29:08.985952] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.053 [2024-10-07 11:29:08.986178] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.053 [2024-10-07 11:29:08.986218] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.053 [2024-10-07 11:29:08.986235] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.053 [2024-10-07 11:29:08.986252] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.053 [2024-10-07 11:29:08.986277] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.053 [2024-10-07 11:29:08.986291] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.053 [2024-10-07 11:29:08.986343] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.053 [2024-10-07 11:29:08.986363] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.053 [2024-10-07 11:29:08.995929] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.053 [2024-10-07 11:29:08.995990] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.053 [2024-10-07 11:29:08.997162] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.053 [2024-10-07 11:29:08.997205] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.053 [2024-10-07 11:29:08.997224] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.053 [2024-10-07 11:29:08.997273] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.053 [2024-10-07 11:29:08.997296] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.053 [2024-10-07 11:29:08.997311] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.053 [2024-10-07 11:29:08.999139] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.053 [2024-10-07 11:29:08.999198] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.053 [2024-10-07 11:29:08.999789] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.053 [2024-10-07 11:29:08.999840] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.053 [2024-10-07 11:29:08.999855] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.053 [2024-10-07 11:29:08.999872] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.053 [2024-10-07 11:29:08.999886] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.053 [2024-10-07 11:29:08.999898] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.053 [2024-10-07 11:29:09.000032] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.053 [2024-10-07 11:29:09.000056] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.053 [2024-10-07 11:29:09.007022] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.053 [2024-10-07 11:29:09.007064] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.053 [2024-10-07 11:29:09.007236] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.053 [2024-10-07 11:29:09.007265] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.053 [2024-10-07 11:29:09.007281] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.053 [2024-10-07 11:29:09.007325] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.053 [2024-10-07 11:29:09.007346] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.053 [2024-10-07 11:29:09.007361] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.053 [2024-10-07 11:29:09.007535] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.053 [2024-10-07 11:29:09.007565] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.053 [2024-10-07 11:29:09.008109] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.053 [2024-10-07 11:29:09.008138] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.053 [2024-10-07 11:29:09.008170] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.053 [2024-10-07 11:29:09.008188] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.053 [2024-10-07 11:29:09.008202] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.053 [2024-10-07 11:29:09.008214] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.053 [2024-10-07 11:29:09.011050] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.053 [2024-10-07 11:29:09.011086] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.053 [2024-10-07 11:29:09.020686] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.053 [2024-10-07 11:29:09.020732] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.053 [2024-10-07 11:29:09.020926] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.053 [2024-10-07 11:29:09.020955] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.053 [2024-10-07 11:29:09.020972] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.053 [2024-10-07 11:29:09.021016] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.053 [2024-10-07 11:29:09.021038] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.053 [2024-10-07 11:29:09.021053] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.053 [2024-10-07 11:29:09.021149] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.053 [2024-10-07 11:29:09.021172] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.053 [2024-10-07 11:29:09.021213] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.053 [2024-10-07 11:29:09.021231] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.053 [2024-10-07 11:29:09.021244] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.053 [2024-10-07 11:29:09.021260] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.053 [2024-10-07 11:29:09.021273] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.053 [2024-10-07 11:29:09.021287] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.053 [2024-10-07 11:29:09.021309] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.053 [2024-10-07 11:29:09.021323] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.053 [2024-10-07 11:29:09.030835] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.053 [2024-10-07 11:29:09.030913] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.053 [2024-10-07 11:29:09.030987] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.053 [2024-10-07 11:29:09.031016] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.053 [2024-10-07 11:29:09.031032] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.053 [2024-10-07 11:29:09.031098] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.053 [2024-10-07 11:29:09.031121] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.053 [2024-10-07 11:29:09.031142] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.053 [2024-10-07 11:29:09.031169] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.053 [2024-10-07 11:29:09.031193] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.053 [2024-10-07 11:29:09.031209] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.053 [2024-10-07 11:29:09.031232] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.053 [2024-10-07 11:29:09.031245] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.053 [2024-10-07 11:29:09.031278] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.053 [2024-10-07 11:29:09.031295] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.054 [2024-10-07 11:29:09.031307] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.054 [2024-10-07 11:29:09.031319] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.054 [2024-10-07 11:29:09.031339] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.054 [2024-10-07 11:29:09.041369] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.054 [2024-10-07 11:29:09.041714] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.054 [2024-10-07 11:29:09.041826] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.054 [2024-10-07 11:29:09.041866] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.054 [2024-10-07 11:29:09.041882] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.054 [2024-10-07 11:29:09.041971] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.054 [2024-10-07 11:29:09.042015] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.054 [2024-10-07 11:29:09.042031] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.054 [2024-10-07 11:29:09.042050] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.054 [2024-10-07 11:29:09.042074] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.054 [2024-10-07 11:29:09.042092] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.054 [2024-10-07 11:29:09.042106] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.054 [2024-10-07 11:29:09.042119] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.054 [2024-10-07 11:29:09.042142] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.054 [2024-10-07 11:29:09.042157] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.054 [2024-10-07 11:29:09.042170] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.054 [2024-10-07 11:29:09.042183] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.054 [2024-10-07 11:29:09.042203] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.054 [2024-10-07 11:29:09.055139] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.054 [2024-10-07 11:29:09.055544] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.054 [2024-10-07 11:29:09.055654] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.054 [2024-10-07 11:29:09.055683] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.054 [2024-10-07 11:29:09.055714] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.054 [2024-10-07 11:29:09.055940] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.054 [2024-10-07 11:29:09.055975] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.054 [2024-10-07 11:29:09.055992] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.054 [2024-10-07 11:29:09.056010] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.054 [2024-10-07 11:29:09.056536] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.054 [2024-10-07 11:29:09.056574] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.054 [2024-10-07 11:29:09.056591] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.054 [2024-10-07 11:29:09.056605] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.054 [2024-10-07 11:29:09.056858] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.054 [2024-10-07 11:29:09.056882] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.054 [2024-10-07 11:29:09.056896] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.054 [2024-10-07 11:29:09.056909] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.054 [2024-10-07 11:29:09.057096] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.054 [2024-10-07 11:29:09.070380] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.054 [2024-10-07 11:29:09.070471] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.054 [2024-10-07 11:29:09.070563] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.054 [2024-10-07 11:29:09.070592] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.054 [2024-10-07 11:29:09.070609] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.054 [2024-10-07 11:29:09.070655] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.054 [2024-10-07 11:29:09.070677] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.054 [2024-10-07 11:29:09.070693] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.054 [2024-10-07 11:29:09.070716] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.054 [2024-10-07 11:29:09.070737] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.054 [2024-10-07 11:29:09.070757] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.054 [2024-10-07 11:29:09.070771] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.054 [2024-10-07 11:29:09.070784] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.054 [2024-10-07 11:29:09.070800] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.054 [2024-10-07 11:29:09.070830] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.054 [2024-10-07 11:29:09.070844] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.054 [2024-10-07 11:29:09.070868] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.054 [2024-10-07 11:29:09.070882] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.054 [2024-10-07 11:29:09.083765] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.054 [2024-10-07 11:29:09.083814] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.054 [2024-10-07 11:29:09.084120] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.054 [2024-10-07 11:29:09.084177] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.054 [2024-10-07 11:29:09.084195] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.054 [2024-10-07 11:29:09.084242] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.054 [2024-10-07 11:29:09.084263] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.054 [2024-10-07 11:29:09.084278] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.054 [2024-10-07 11:29:09.084481] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.054 [2024-10-07 11:29:09.084512] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.054 [2024-10-07 11:29:09.084696] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.054 [2024-10-07 11:29:09.084720] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.054 [2024-10-07 11:29:09.084734] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.054 [2024-10-07 11:29:09.084750] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.054 [2024-10-07 11:29:09.084764] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.054 [2024-10-07 11:29:09.084776] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.054 [2024-10-07 11:29:09.084829] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.054 [2024-10-07 11:29:09.084849] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.054 [2024-10-07 11:29:09.097393] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.054 [2024-10-07 11:29:09.097465] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.054 [2024-10-07 11:29:09.097565] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.054 [2024-10-07 11:29:09.097594] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.054 [2024-10-07 11:29:09.097611] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.054 [2024-10-07 11:29:09.097658] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.054 [2024-10-07 11:29:09.097680] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.054 [2024-10-07 11:29:09.097696] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.054 [2024-10-07 11:29:09.097737] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.054 [2024-10-07 11:29:09.097758] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.054 [2024-10-07 11:29:09.097778] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.054 [2024-10-07 11:29:09.097792] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.054 [2024-10-07 11:29:09.097805] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.054 [2024-10-07 11:29:09.097836] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.054 [2024-10-07 11:29:09.097850] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.054 [2024-10-07 11:29:09.097862] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.054 [2024-10-07 11:29:09.097885] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.054 [2024-10-07 11:29:09.097898] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.054 [2024-10-07 11:29:09.108787] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.054 [2024-10-07 11:29:09.108835] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.054 [2024-10-07 11:29:09.109018] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.054 [2024-10-07 11:29:09.109059] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.054 [2024-10-07 11:29:09.109076] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.055 [2024-10-07 11:29:09.109122] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.055 [2024-10-07 11:29:09.109145] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.055 [2024-10-07 11:29:09.109160] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.055 [2024-10-07 11:29:09.109262] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.055 [2024-10-07 11:29:09.109286] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.055 [2024-10-07 11:29:09.109385] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.055 [2024-10-07 11:29:09.109403] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.055 [2024-10-07 11:29:09.109417] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.055 [2024-10-07 11:29:09.109434] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.055 [2024-10-07 11:29:09.109463] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.055 [2024-10-07 11:29:09.109477] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.055 [2024-10-07 11:29:09.112029] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.055 [2024-10-07 11:29:09.112066] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.055 [2024-10-07 11:29:09.118908] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.055 [2024-10-07 11:29:09.118983] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.055 [2024-10-07 11:29:09.119054] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.055 [2024-10-07 11:29:09.119094] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.055 [2024-10-07 11:29:09.119112] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.055 [2024-10-07 11:29:09.119787] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.055 [2024-10-07 11:29:09.119842] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.055 [2024-10-07 11:29:09.119877] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.055 [2024-10-07 11:29:09.119894] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.055 [2024-10-07 11:29:09.120090] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.055 [2024-10-07 11:29:09.120116] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.055 [2024-10-07 11:29:09.120130] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.055 [2024-10-07 11:29:09.120143] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.055 [2024-10-07 11:29:09.120286] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.055 [2024-10-07 11:29:09.120309] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.055 [2024-10-07 11:29:09.120322] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.055 [2024-10-07 11:29:09.120336] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.055 [2024-10-07 11:29:09.120477] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.055 [2024-10-07 11:29:09.129122] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.055 [2024-10-07 11:29:09.129170] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.055 [2024-10-07 11:29:09.129254] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.055 [2024-10-07 11:29:09.129282] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.055 [2024-10-07 11:29:09.129300] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.055 [2024-10-07 11:29:09.129346] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.055 [2024-10-07 11:29:09.129369] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.055 [2024-10-07 11:29:09.129384] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.055 [2024-10-07 11:29:09.129407] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.055 [2024-10-07 11:29:09.129444] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.055 [2024-10-07 11:29:09.129464] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.055 [2024-10-07 11:29:09.129479] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.055 [2024-10-07 11:29:09.129493] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.055 [2024-10-07 11:29:09.129509] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.055 [2024-10-07 11:29:09.129523] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.055 [2024-10-07 11:29:09.129558] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.055 [2024-10-07 11:29:09.129583] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.055 [2024-10-07 11:29:09.129597] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.055 [2024-10-07 11:29:09.139899] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.055 [2024-10-07 11:29:09.139949] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.055 [2024-10-07 11:29:09.140180] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.055 [2024-10-07 11:29:09.140212] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.055 [2024-10-07 11:29:09.140229] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.055 [2024-10-07 11:29:09.140277] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.055 [2024-10-07 11:29:09.140300] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.055 [2024-10-07 11:29:09.140315] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.055 [2024-10-07 11:29:09.140366] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.055 [2024-10-07 11:29:09.140392] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.055 [2024-10-07 11:29:09.140428] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.055 [2024-10-07 11:29:09.140446] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.055 [2024-10-07 11:29:09.140460] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.055 [2024-10-07 11:29:09.140476] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.055 [2024-10-07 11:29:09.140491] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.055 [2024-10-07 11:29:09.140504] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.055 [2024-10-07 11:29:09.140527] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.055 [2024-10-07 11:29:09.140541] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.055 [2024-10-07 11:29:09.152784] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.055 [2024-10-07 11:29:09.152833] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.055 [2024-10-07 11:29:09.152917] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.055 [2024-10-07 11:29:09.152946] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.055 [2024-10-07 11:29:09.152963] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.055 [2024-10-07 11:29:09.153009] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.055 [2024-10-07 11:29:09.153032] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.055 [2024-10-07 11:29:09.153047] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.055 [2024-10-07 11:29:09.153077] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.055 [2024-10-07 11:29:09.153117] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.055 [2024-10-07 11:29:09.154003] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.055 [2024-10-07 11:29:09.154043] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.055 [2024-10-07 11:29:09.154060] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.055 [2024-10-07 11:29:09.154077] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.055 [2024-10-07 11:29:09.154092] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.055 [2024-10-07 11:29:09.154105] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.055 [2024-10-07 11:29:09.154827] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.055 [2024-10-07 11:29:09.154862] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.055 [2024-10-07 11:29:09.165878] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.055 [2024-10-07 11:29:09.165926] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.055 [2024-10-07 11:29:09.166650] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.055 [2024-10-07 11:29:09.166707] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.055 [2024-10-07 11:29:09.166726] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.055 [2024-10-07 11:29:09.166774] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.055 [2024-10-07 11:29:09.166797] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.055 [2024-10-07 11:29:09.166812] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.055 [2024-10-07 11:29:09.167003] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.055 [2024-10-07 11:29:09.167034] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.055 [2024-10-07 11:29:09.167283] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.055 [2024-10-07 11:29:09.167310] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.055 [2024-10-07 11:29:09.167324] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.056 [2024-10-07 11:29:09.167341] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.056 [2024-10-07 11:29:09.167355] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.056 [2024-10-07 11:29:09.167369] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.056 [2024-10-07 11:29:09.167438] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.056 [2024-10-07 11:29:09.167461] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.056 [2024-10-07 11:29:09.176904] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.056 [2024-10-07 11:29:09.176952] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.056 [2024-10-07 11:29:09.177035] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.056 [2024-10-07 11:29:09.177064] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.056 [2024-10-07 11:29:09.177095] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.056 [2024-10-07 11:29:09.177146] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.056 [2024-10-07 11:29:09.177170] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.056 [2024-10-07 11:29:09.177185] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.056 [2024-10-07 11:29:09.177348] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.056 [2024-10-07 11:29:09.177380] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.056 [2024-10-07 11:29:09.177512] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.056 [2024-10-07 11:29:09.177536] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.056 [2024-10-07 11:29:09.177551] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.056 [2024-10-07 11:29:09.177568] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.056 [2024-10-07 11:29:09.177583] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.056 [2024-10-07 11:29:09.177596] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.056 [2024-10-07 11:29:09.177812] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.056 [2024-10-07 11:29:09.177835] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.056 [2024-10-07 11:29:09.187811] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.056 [2024-10-07 11:29:09.187856] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.056 [2024-10-07 11:29:09.188016] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.056 [2024-10-07 11:29:09.188060] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.056 [2024-10-07 11:29:09.188076] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.056 [2024-10-07 11:29:09.188120] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.056 [2024-10-07 11:29:09.188142] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.056 [2024-10-07 11:29:09.188157] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.056 [2024-10-07 11:29:09.188180] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.056 [2024-10-07 11:29:09.188199] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.056 [2024-10-07 11:29:09.188219] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.056 [2024-10-07 11:29:09.188232] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.056 [2024-10-07 11:29:09.188246] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.056 [2024-10-07 11:29:09.188262] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.056 [2024-10-07 11:29:09.188275] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.056 [2024-10-07 11:29:09.188287] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.056 [2024-10-07 11:29:09.188325] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.056 [2024-10-07 11:29:09.188341] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.056 [2024-10-07 11:29:09.198510] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.056 [2024-10-07 11:29:09.198571] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.056 [2024-10-07 11:29:09.198667] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.056 [2024-10-07 11:29:09.198694] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.056 [2024-10-07 11:29:09.198710] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.056 [2024-10-07 11:29:09.198754] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.056 [2024-10-07 11:29:09.198775] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.056 [2024-10-07 11:29:09.198790] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.056 [2024-10-07 11:29:09.198813] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.056 [2024-10-07 11:29:09.198831] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.056 [2024-10-07 11:29:09.198850] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.056 [2024-10-07 11:29:09.198863] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.056 [2024-10-07 11:29:09.198876] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.056 [2024-10-07 11:29:09.198891] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.056 [2024-10-07 11:29:09.198904] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.056 [2024-10-07 11:29:09.198917] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.056 [2024-10-07 11:29:09.198953] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.056 [2024-10-07 11:29:09.198970] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.056 [2024-10-07 11:29:09.208646] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.056 [2024-10-07 11:29:09.208720] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.056 [2024-10-07 11:29:09.208791] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.056 [2024-10-07 11:29:09.208818] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.056 [2024-10-07 11:29:09.208833] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.056 [2024-10-07 11:29:09.208883] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.056 [2024-10-07 11:29:09.208906] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.056 [2024-10-07 11:29:09.208920] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.056 [2024-10-07 11:29:09.208937] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.056 [2024-10-07 11:29:09.208960] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.056 [2024-10-07 11:29:09.208991] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.056 [2024-10-07 11:29:09.209005] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.056 [2024-10-07 11:29:09.209018] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.056 [2024-10-07 11:29:09.209041] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.056 [2024-10-07 11:29:09.209054] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.056 [2024-10-07 11:29:09.209067] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.056 [2024-10-07 11:29:09.209080] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.056 [2024-10-07 11:29:09.209099] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.056 [2024-10-07 11:29:09.221850] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.056 [2024-10-07 11:29:09.221897] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.056 [2024-10-07 11:29:09.222120] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.056 [2024-10-07 11:29:09.222151] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.056 [2024-10-07 11:29:09.222167] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.056 [2024-10-07 11:29:09.222212] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.057 [2024-10-07 11:29:09.222234] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.057 [2024-10-07 11:29:09.222249] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.057 [2024-10-07 11:29:09.222737] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.057 [2024-10-07 11:29:09.222766] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.057 [2024-10-07 11:29:09.224025] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.057 [2024-10-07 11:29:09.224060] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.057 [2024-10-07 11:29:09.224092] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.057 [2024-10-07 11:29:09.224109] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.057 [2024-10-07 11:29:09.224122] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.057 [2024-10-07 11:29:09.224136] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.057 [2024-10-07 11:29:09.224399] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.057 [2024-10-07 11:29:09.224422] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.057 [2024-10-07 11:29:09.231971] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.057 [2024-10-07 11:29:09.232047] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.057 [2024-10-07 11:29:09.232118] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.057 [2024-10-07 11:29:09.232146] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.057 [2024-10-07 11:29:09.232162] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.057 [2024-10-07 11:29:09.232236] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.057 [2024-10-07 11:29:09.232260] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.057 [2024-10-07 11:29:09.232275] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.057 [2024-10-07 11:29:09.232292] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.057 [2024-10-07 11:29:09.232314] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.057 [2024-10-07 11:29:09.232330] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.057 [2024-10-07 11:29:09.232343] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.057 [2024-10-07 11:29:09.232355] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.057 [2024-10-07 11:29:09.232377] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.057 [2024-10-07 11:29:09.232390] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.057 [2024-10-07 11:29:09.232403] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.057 [2024-10-07 11:29:09.232415] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.057 [2024-10-07 11:29:09.232447] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.057 [2024-10-07 11:29:09.242062] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.057 [2024-10-07 11:29:09.242176] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.057 [2024-10-07 11:29:09.242204] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.057 [2024-10-07 11:29:09.242220] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.057 [2024-10-07 11:29:09.242255] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.057 [2024-10-07 11:29:09.242282] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.057 [2024-10-07 11:29:09.242308] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.057 [2024-10-07 11:29:09.242323] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.057 [2024-10-07 11:29:09.242336] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.057 [2024-10-07 11:29:09.244577] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.057 [2024-10-07 11:29:09.244668] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.057 [2024-10-07 11:29:09.244694] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.057 [2024-10-07 11:29:09.244709] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.057 [2024-10-07 11:29:09.245332] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.057 [2024-10-07 11:29:09.245504] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.057 [2024-10-07 11:29:09.245536] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.057 [2024-10-07 11:29:09.245552] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.057 [2024-10-07 11:29:09.245678] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.057 [2024-10-07 11:29:09.252152] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.057 [2024-10-07 11:29:09.252275] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.057 [2024-10-07 11:29:09.252304] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.057 [2024-10-07 11:29:09.252321] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.057 [2024-10-07 11:29:09.252343] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.057 [2024-10-07 11:29:09.252377] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.057 [2024-10-07 11:29:09.252394] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.057 [2024-10-07 11:29:09.252407] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.057 [2024-10-07 11:29:09.252442] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.057 [2024-10-07 11:29:09.252464] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.057 [2024-10-07 11:29:09.252523] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.057 [2024-10-07 11:29:09.252548] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.057 [2024-10-07 11:29:09.252563] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.057 [2024-10-07 11:29:09.252585] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.057 [2024-10-07 11:29:09.252605] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.057 [2024-10-07 11:29:09.252619] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.057 [2024-10-07 11:29:09.252631] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.057 [2024-10-07 11:29:09.252652] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.057 [2024-10-07 11:29:09.262243] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.057 [2024-10-07 11:29:09.262361] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.057 [2024-10-07 11:29:09.262389] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.057 [2024-10-07 11:29:09.262406] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.057 [2024-10-07 11:29:09.262442] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.057 [2024-10-07 11:29:09.262471] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.057 [2024-10-07 11:29:09.262485] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.057 [2024-10-07 11:29:09.262498] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.057 [2024-10-07 11:29:09.262520] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.057 [2024-10-07 11:29:09.262567] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.057 [2024-10-07 11:29:09.262638] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.057 [2024-10-07 11:29:09.262663] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.057 [2024-10-07 11:29:09.262696] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.057 [2024-10-07 11:29:09.262719] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.057 [2024-10-07 11:29:09.262740] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.057 [2024-10-07 11:29:09.262753] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.057 [2024-10-07 11:29:09.262766] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.057 [2024-10-07 11:29:09.262787] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.057 [2024-10-07 11:29:09.272318] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.057 [2024-10-07 11:29:09.272449] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.057 [2024-10-07 11:29:09.272478] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.057 [2024-10-07 11:29:09.272495] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.057 [2024-10-07 11:29:09.272518] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.057 [2024-10-07 11:29:09.272539] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.057 [2024-10-07 11:29:09.272553] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.057 [2024-10-07 11:29:09.272565] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.057 [2024-10-07 11:29:09.272589] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.057 [2024-10-07 11:29:09.272626] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.057 [2024-10-07 11:29:09.272693] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.058 [2024-10-07 11:29:09.272718] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.058 [2024-10-07 11:29:09.272733] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.058 [2024-10-07 11:29:09.272754] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.058 [2024-10-07 11:29:09.272774] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.058 [2024-10-07 11:29:09.272788] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.058 [2024-10-07 11:29:09.272800] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.058 [2024-10-07 11:29:09.272821] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.058 [2024-10-07 11:29:09.285034] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.058 [2024-10-07 11:29:09.285099] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.058 [2024-10-07 11:29:09.285399] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.058 [2024-10-07 11:29:09.285443] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.058 [2024-10-07 11:29:09.285477] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.058 [2024-10-07 11:29:09.285523] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.058 [2024-10-07 11:29:09.285566] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.058 [2024-10-07 11:29:09.285582] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.058 [2024-10-07 11:29:09.285634] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.058 [2024-10-07 11:29:09.285659] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.058 [2024-10-07 11:29:09.285678] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.058 [2024-10-07 11:29:09.285692] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.058 [2024-10-07 11:29:09.285705] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.058 [2024-10-07 11:29:09.285721] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.058 [2024-10-07 11:29:09.285734] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.058 [2024-10-07 11:29:09.285747] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.058 [2024-10-07 11:29:09.285769] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.058 [2024-10-07 11:29:09.285782] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.058 [2024-10-07 11:29:09.296062] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.058 [2024-10-07 11:29:09.296113] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.058 [2024-10-07 11:29:09.298021] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.058 [2024-10-07 11:29:09.298073] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.058 [2024-10-07 11:29:09.298092] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.058 [2024-10-07 11:29:09.298141] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.058 [2024-10-07 11:29:09.298165] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.058 [2024-10-07 11:29:09.298180] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.058 [2024-10-07 11:29:09.298848] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.058 [2024-10-07 11:29:09.298888] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.058 [2024-10-07 11:29:09.298995] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.058 [2024-10-07 11:29:09.299018] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.058 [2024-10-07 11:29:09.299031] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.058 [2024-10-07 11:29:09.299048] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.058 [2024-10-07 11:29:09.299063] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.058 [2024-10-07 11:29:09.299075] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.058 [2024-10-07 11:29:09.299098] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.058 [2024-10-07 11:29:09.299112] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.058 [2024-10-07 11:29:09.307364] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.058 [2024-10-07 11:29:09.307454] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.058 [2024-10-07 11:29:09.307541] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.058 [2024-10-07 11:29:09.307569] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.058 [2024-10-07 11:29:09.307586] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.058 [2024-10-07 11:29:09.307644] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.058 [2024-10-07 11:29:09.307667] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.058 [2024-10-07 11:29:09.307683] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.058 [2024-10-07 11:29:09.309922] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.058 [2024-10-07 11:29:09.309986] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.058 [2024-10-07 11:29:09.310105] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.058 [2024-10-07 11:29:09.310128] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.058 [2024-10-07 11:29:09.310143] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.058 [2024-10-07 11:29:09.310159] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.058 [2024-10-07 11:29:09.310173] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.058 [2024-10-07 11:29:09.310186] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.058 [2024-10-07 11:29:09.310510] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.058 [2024-10-07 11:29:09.310536] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.058 [2024-10-07 11:29:09.317517] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.058 [2024-10-07 11:29:09.317624] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.058 [2024-10-07 11:29:09.317724] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.058 [2024-10-07 11:29:09.317766] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.058 [2024-10-07 11:29:09.317782] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.058 [2024-10-07 11:29:09.317834] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.058 [2024-10-07 11:29:09.317857] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.058 [2024-10-07 11:29:09.317873] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.058 [2024-10-07 11:29:09.317890] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.058 [2024-10-07 11:29:09.317912] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.058 [2024-10-07 11:29:09.317929] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.058 [2024-10-07 11:29:09.317942] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.058 [2024-10-07 11:29:09.317999] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.058 [2024-10-07 11:29:09.318027] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.058 [2024-10-07 11:29:09.318042] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.058 [2024-10-07 11:29:09.318056] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.058 [2024-10-07 11:29:09.318069] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.058 [2024-10-07 11:29:09.318090] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.058 [2024-10-07 11:29:09.329382] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.058 [2024-10-07 11:29:09.329437] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.058 [2024-10-07 11:29:09.329537] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.058 [2024-10-07 11:29:09.329565] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.058 [2024-10-07 11:29:09.329581] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.058 [2024-10-07 11:29:09.329624] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.058 [2024-10-07 11:29:09.329646] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.058 [2024-10-07 11:29:09.329660] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.058 [2024-10-07 11:29:09.329683] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.058 [2024-10-07 11:29:09.329702] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.058 [2024-10-07 11:29:09.329721] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.058 [2024-10-07 11:29:09.329734] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.058 [2024-10-07 11:29:09.329747] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.058 [2024-10-07 11:29:09.329762] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.058 [2024-10-07 11:29:09.329775] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.058 [2024-10-07 11:29:09.329788] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.058 [2024-10-07 11:29:09.329809] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.058 [2024-10-07 11:29:09.329822] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.059 [2024-10-07 11:29:09.342640] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.059 [2024-10-07 11:29:09.342687] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.059 [2024-10-07 11:29:09.342838] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.059 [2024-10-07 11:29:09.342866] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.059 [2024-10-07 11:29:09.342882] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.059 [2024-10-07 11:29:09.342926] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.059 [2024-10-07 11:29:09.342948] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.059 [2024-10-07 11:29:09.342980] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.059 [2024-10-07 11:29:09.343005] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.059 [2024-10-07 11:29:09.343025] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.059 [2024-10-07 11:29:09.343044] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.059 [2024-10-07 11:29:09.343059] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.059 [2024-10-07 11:29:09.343072] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.059 [2024-10-07 11:29:09.343087] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.059 [2024-10-07 11:29:09.343101] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.059 [2024-10-07 11:29:09.343113] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.059 [2024-10-07 11:29:09.343135] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.059 [2024-10-07 11:29:09.343163] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.059 [2024-10-07 11:29:09.354466] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.059 [2024-10-07 11:29:09.354525] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.059 [2024-10-07 11:29:09.355291] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.059 [2024-10-07 11:29:09.355347] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.059 [2024-10-07 11:29:09.355365] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.059 [2024-10-07 11:29:09.355429] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.059 [2024-10-07 11:29:09.355466] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.059 [2024-10-07 11:29:09.355483] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.059 [2024-10-07 11:29:09.356944] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.059 [2024-10-07 11:29:09.356984] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.059 [2024-10-07 11:29:09.358055] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.059 [2024-10-07 11:29:09.358093] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.059 [2024-10-07 11:29:09.358110] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.059 [2024-10-07 11:29:09.358127] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.059 [2024-10-07 11:29:09.358142] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.059 [2024-10-07 11:29:09.358156] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.059 [2024-10-07 11:29:09.358593] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.059 [2024-10-07 11:29:09.358619] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.059 [2024-10-07 11:29:09.364600] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.059 [2024-10-07 11:29:09.364689] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.059 [2024-10-07 11:29:09.364763] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.059 [2024-10-07 11:29:09.364790] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.059 [2024-10-07 11:29:09.364806] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.059 [2024-10-07 11:29:09.364856] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.059 [2024-10-07 11:29:09.364878] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.059 [2024-10-07 11:29:09.364893] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.059 [2024-10-07 11:29:09.364910] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.059 [2024-10-07 11:29:09.367303] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.059 [2024-10-07 11:29:09.367343] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.059 [2024-10-07 11:29:09.367376] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.059 [2024-10-07 11:29:09.367389] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.059 [2024-10-07 11:29:09.367940] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.059 [2024-10-07 11:29:09.367974] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.059 [2024-10-07 11:29:09.367990] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.059 [2024-10-07 11:29:09.368003] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.059 [2024-10-07 11:29:09.368309] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.059 [2024-10-07 11:29:09.374704] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.059 [2024-10-07 11:29:09.374837] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.059 [2024-10-07 11:29:09.374865] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.059 [2024-10-07 11:29:09.374882] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.059 [2024-10-07 11:29:09.376884] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.059 [2024-10-07 11:29:09.377261] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.059 [2024-10-07 11:29:09.377314] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.059 [2024-10-07 11:29:09.377332] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.059 [2024-10-07 11:29:09.377345] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.059 [2024-10-07 11:29:09.377533] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.059 [2024-10-07 11:29:09.377596] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.059 [2024-10-07 11:29:09.377620] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.059 [2024-10-07 11:29:09.377636] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.059 [2024-10-07 11:29:09.377784] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.059 [2024-10-07 11:29:09.377929] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.059 [2024-10-07 11:29:09.377951] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.059 [2024-10-07 11:29:09.377994] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.059 [2024-10-07 11:29:09.378123] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.059 [2024-10-07 11:29:09.384795] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.059 [2024-10-07 11:29:09.384908] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.059 [2024-10-07 11:29:09.384935] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.059 [2024-10-07 11:29:09.384951] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.059 [2024-10-07 11:29:09.384973] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.059 [2024-10-07 11:29:09.385009] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.059 [2024-10-07 11:29:09.385027] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.059 [2024-10-07 11:29:09.385041] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.059 [2024-10-07 11:29:09.385062] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.059 [2024-10-07 11:29:09.387336] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.059 [2024-10-07 11:29:09.387468] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.059 [2024-10-07 11:29:09.387498] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.059 [2024-10-07 11:29:09.387514] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.059 [2024-10-07 11:29:09.387537] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.059 [2024-10-07 11:29:09.387557] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.059 [2024-10-07 11:29:09.387571] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.059 [2024-10-07 11:29:09.387584] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.059 [2024-10-07 11:29:09.387605] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.059 [2024-10-07 11:29:09.395075] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.059 [2024-10-07 11:29:09.395190] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.059 [2024-10-07 11:29:09.395218] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.059 [2024-10-07 11:29:09.395234] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.059 [2024-10-07 11:29:09.395569] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.059 [2024-10-07 11:29:09.395695] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.059 [2024-10-07 11:29:09.395753] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.059 [2024-10-07 11:29:09.395769] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.060 [2024-10-07 11:29:09.395810] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.060 [2024-10-07 11:29:09.399745] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.060 [2024-10-07 11:29:09.400103] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.060 [2024-10-07 11:29:09.400146] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.060 [2024-10-07 11:29:09.400169] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.060 [2024-10-07 11:29:09.400224] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.060 [2024-10-07 11:29:09.400872] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.060 [2024-10-07 11:29:09.400922] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.060 [2024-10-07 11:29:09.400954] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.060 [2024-10-07 11:29:09.401190] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.060 8963.30 IOPS, 35.01 MiB/s [2024-10-07T11:29:15.771Z] [2024-10-07 11:29:09.405864] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.060 [2024-10-07 11:29:09.406103] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.060 [2024-10-07 11:29:09.406143] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.060 [2024-10-07 11:29:09.406161] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.060 [2024-10-07 11:29:09.406304] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.060 [2024-10-07 11:29:09.406488] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.060 [2024-10-07 11:29:09.406512] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.060 [2024-10-07 11:29:09.406527] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.060 [2024-10-07 11:29:09.406625] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.060 [2024-10-07 11:29:09.414767] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.060 [2024-10-07 11:29:09.414897] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.060 [2024-10-07 11:29:09.414925] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.060 [2024-10-07 11:29:09.414941] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.060 [2024-10-07 11:29:09.414963] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.060 [2024-10-07 11:29:09.414984] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.060 [2024-10-07 11:29:09.414998] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.060 [2024-10-07 11:29:09.415011] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.060 [2024-10-07 11:29:09.415033] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.060 [2024-10-07 11:29:09.415932] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.060 [2024-10-07 11:29:09.416055] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.060 [2024-10-07 11:29:09.416082] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.060 [2024-10-07 11:29:09.416114] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.060 [2024-10-07 11:29:09.416138] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.060 [2024-10-07 11:29:09.416159] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.060 [2024-10-07 11:29:09.416174] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.060 [2024-10-07 11:29:09.416186] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.060 [2024-10-07 11:29:09.416207] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.060 [2024-10-07 11:29:09.428094] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.060 [2024-10-07 11:29:09.428172] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.060 [2024-10-07 11:29:09.428245] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.060 [2024-10-07 11:29:09.428271] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.060 [2024-10-07 11:29:09.428287] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.060 [2024-10-07 11:29:09.429413] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.060 [2024-10-07 11:29:09.429478] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.060 [2024-10-07 11:29:09.429511] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.060 [2024-10-07 11:29:09.429530] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.060 [2024-10-07 11:29:09.430250] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.060 [2024-10-07 11:29:09.430291] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.060 [2024-10-07 11:29:09.430308] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.060 [2024-10-07 11:29:09.430322] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.060 [2024-10-07 11:29:09.430748] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.060 [2024-10-07 11:29:09.430814] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.060 [2024-10-07 11:29:09.430829] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.060 [2024-10-07 11:29:09.430844] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.060 [2024-10-07 11:29:09.431061] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.060 [2024-10-07 11:29:09.441492] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.060 [2024-10-07 11:29:09.441548] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.060 [2024-10-07 11:29:09.441630] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.060 [2024-10-07 11:29:09.441658] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.060 [2024-10-07 11:29:09.441674] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.060 [2024-10-07 11:29:09.441718] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.060 [2024-10-07 11:29:09.441770] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.060 [2024-10-07 11:29:09.441786] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.060 [2024-10-07 11:29:09.441809] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.060 [2024-10-07 11:29:09.441828] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.060 [2024-10-07 11:29:09.441846] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.060 [2024-10-07 11:29:09.441860] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.060 [2024-10-07 11:29:09.441873] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.060 [2024-10-07 11:29:09.441888] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.060 [2024-10-07 11:29:09.441902] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.060 [2024-10-07 11:29:09.441914] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.060 [2024-10-07 11:29:09.441935] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.060 [2024-10-07 11:29:09.441949] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.060 [2024-10-07 11:29:09.451607] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.060 [2024-10-07 11:29:09.453805] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.060 [2024-10-07 11:29:09.453896] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.060 [2024-10-07 11:29:09.453924] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.060 [2024-10-07 11:29:09.453942] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.060 [2024-10-07 11:29:09.454445] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.060 [2024-10-07 11:29:09.454496] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.060 [2024-10-07 11:29:09.454517] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.060 [2024-10-07 11:29:09.454537] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.060 [2024-10-07 11:29:09.454691] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.060 [2024-10-07 11:29:09.454734] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.060 [2024-10-07 11:29:09.454748] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.060 [2024-10-07 11:29:09.454761] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.060 [2024-10-07 11:29:09.455558] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.060 [2024-10-07 11:29:09.455592] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.060 [2024-10-07 11:29:09.455624] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.060 [2024-10-07 11:29:09.455637] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.060 [2024-10-07 11:29:09.457432] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.060 [2024-10-07 11:29:09.463431] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.061 [2024-10-07 11:29:09.463558] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.061 [2024-10-07 11:29:09.463586] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.061 [2024-10-07 11:29:09.463602] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.061 [2024-10-07 11:29:09.463624] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.061 [2024-10-07 11:29:09.463645] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.061 [2024-10-07 11:29:09.463659] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.061 [2024-10-07 11:29:09.463671] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.061 [2024-10-07 11:29:09.463693] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.061 [2024-10-07 11:29:09.464268] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.061 [2024-10-07 11:29:09.464454] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.061 [2024-10-07 11:29:09.464482] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.061 [2024-10-07 11:29:09.464499] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.061 [2024-10-07 11:29:09.464616] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.061 [2024-10-07 11:29:09.464740] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.061 [2024-10-07 11:29:09.464758] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.061 [2024-10-07 11:29:09.464771] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.061 [2024-10-07 11:29:09.464793] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.061 [2024-10-07 11:29:09.473973] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.061 [2024-10-07 11:29:09.474113] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.061 [2024-10-07 11:29:09.474153] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.061 [2024-10-07 11:29:09.474171] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.061 [2024-10-07 11:29:09.474198] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.061 [2024-10-07 11:29:09.474222] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.061 [2024-10-07 11:29:09.474236] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.061 [2024-10-07 11:29:09.474250] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.061 [2024-10-07 11:29:09.474272] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.061 [2024-10-07 11:29:09.474347] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.061 [2024-10-07 11:29:09.474438] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.061 [2024-10-07 11:29:09.474477] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.061 [2024-10-07 11:29:09.474522] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.061 [2024-10-07 11:29:09.474548] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.061 [2024-10-07 11:29:09.474570] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.061 [2024-10-07 11:29:09.474584] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.061 [2024-10-07 11:29:09.474597] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.061 [2024-10-07 11:29:09.474620] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.061 [2024-10-07 11:29:09.486888] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.061 [2024-10-07 11:29:09.486935] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.061 [2024-10-07 11:29:09.487071] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.061 [2024-10-07 11:29:09.487099] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.061 [2024-10-07 11:29:09.487116] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.061 [2024-10-07 11:29:09.487160] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.061 [2024-10-07 11:29:09.487182] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.061 [2024-10-07 11:29:09.487197] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.061 [2024-10-07 11:29:09.487219] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.061 [2024-10-07 11:29:09.487238] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.061 [2024-10-07 11:29:09.487257] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.061 [2024-10-07 11:29:09.487270] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.061 [2024-10-07 11:29:09.487283] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.061 [2024-10-07 11:29:09.487298] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.061 [2024-10-07 11:29:09.487311] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.061 [2024-10-07 11:29:09.487325] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.061 [2024-10-07 11:29:09.487346] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.061 [2024-10-07 11:29:09.487359] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.061 [2024-10-07 11:29:09.498474] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.061 [2024-10-07 11:29:09.498520] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.061 [2024-10-07 11:29:09.498721] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.061 [2024-10-07 11:29:09.498750] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.061 [2024-10-07 11:29:09.498767] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.061 [2024-10-07 11:29:09.498812] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.061 [2024-10-07 11:29:09.498834] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.061 [2024-10-07 11:29:09.498865] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.061 [2024-10-07 11:29:09.499023] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.061 [2024-10-07 11:29:09.499050] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.061 [2024-10-07 11:29:09.499168] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.061 [2024-10-07 11:29:09.499190] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.061 [2024-10-07 11:29:09.499204] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.061 [2024-10-07 11:29:09.499236] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.061 [2024-10-07 11:29:09.499249] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.061 [2024-10-07 11:29:09.499262] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.061 [2024-10-07 11:29:09.499368] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.061 [2024-10-07 11:29:09.499404] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.061 [2024-10-07 11:29:09.508598] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.061 [2024-10-07 11:29:09.508663] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.061 [2024-10-07 11:29:09.508738] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.061 [2024-10-07 11:29:09.508767] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.061 [2024-10-07 11:29:09.508784] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.061 [2024-10-07 11:29:09.508848] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.061 [2024-10-07 11:29:09.508887] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.061 [2024-10-07 11:29:09.508902] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.061 [2024-10-07 11:29:09.508920] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.061 [2024-10-07 11:29:09.508943] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.061 [2024-10-07 11:29:09.508990] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.061 [2024-10-07 11:29:09.509004] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.061 [2024-10-07 11:29:09.509017] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.061 [2024-10-07 11:29:09.509038] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.061 [2024-10-07 11:29:09.509052] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.061 [2024-10-07 11:29:09.509064] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.061 [2024-10-07 11:29:09.509077] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.061 [2024-10-07 11:29:09.509097] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.061 [2024-10-07 11:29:09.522185] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.061 [2024-10-07 11:29:09.522248] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.061 [2024-10-07 11:29:09.522381] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.061 [2024-10-07 11:29:09.522409] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.062 [2024-10-07 11:29:09.522442] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.062 [2024-10-07 11:29:09.522501] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.062 [2024-10-07 11:29:09.522526] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.062 [2024-10-07 11:29:09.522542] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.062 [2024-10-07 11:29:09.522566] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.062 [2024-10-07 11:29:09.522585] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.062 [2024-10-07 11:29:09.522605] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.062 [2024-10-07 11:29:09.522619] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.062 [2024-10-07 11:29:09.522632] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.062 [2024-10-07 11:29:09.522648] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.062 [2024-10-07 11:29:09.522662] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.062 [2024-10-07 11:29:09.522691] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.062 [2024-10-07 11:29:09.522713] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.062 [2024-10-07 11:29:09.522727] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.062 [2024-10-07 11:29:09.535656] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.062 [2024-10-07 11:29:09.535703] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.062 [2024-10-07 11:29:09.536022] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.062 [2024-10-07 11:29:09.536062] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.062 [2024-10-07 11:29:09.536080] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.062 [2024-10-07 11:29:09.536126] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.062 [2024-10-07 11:29:09.536147] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.062 [2024-10-07 11:29:09.536161] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.062 [2024-10-07 11:29:09.536223] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.062 [2024-10-07 11:29:09.536249] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.062 [2024-10-07 11:29:09.536268] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.062 [2024-10-07 11:29:09.536283] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.062 [2024-10-07 11:29:09.536296] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.062 [2024-10-07 11:29:09.536328] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.062 [2024-10-07 11:29:09.536344] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.062 [2024-10-07 11:29:09.536357] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.062 [2024-10-07 11:29:09.536379] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.062 [2024-10-07 11:29:09.536392] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.062 [2024-10-07 11:29:09.548657] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.062 [2024-10-07 11:29:09.548704] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.062 [2024-10-07 11:29:09.549132] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.062 [2024-10-07 11:29:09.549188] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.062 [2024-10-07 11:29:09.549207] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.062 [2024-10-07 11:29:09.549254] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.062 [2024-10-07 11:29:09.549276] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.062 [2024-10-07 11:29:09.549291] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.062 [2024-10-07 11:29:09.549513] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.062 [2024-10-07 11:29:09.549545] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.062 [2024-10-07 11:29:09.549613] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.062 [2024-10-07 11:29:09.549633] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.062 [2024-10-07 11:29:09.549646] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.062 [2024-10-07 11:29:09.549662] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.062 [2024-10-07 11:29:09.549676] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.062 [2024-10-07 11:29:09.549688] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.062 [2024-10-07 11:29:09.549710] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.062 [2024-10-07 11:29:09.549724] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.062 [2024-10-07 11:29:09.562174] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.062 [2024-10-07 11:29:09.562223] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.062 [2024-10-07 11:29:09.562319] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.062 [2024-10-07 11:29:09.562347] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.062 [2024-10-07 11:29:09.562363] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.062 [2024-10-07 11:29:09.562408] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.062 [2024-10-07 11:29:09.562455] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.062 [2024-10-07 11:29:09.562473] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.062 [2024-10-07 11:29:09.562513] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.062 [2024-10-07 11:29:09.562541] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.062 [2024-10-07 11:29:09.562561] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.062 [2024-10-07 11:29:09.562576] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.062 [2024-10-07 11:29:09.562589] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.062 [2024-10-07 11:29:09.562605] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.062 [2024-10-07 11:29:09.562619] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.062 [2024-10-07 11:29:09.562632] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.062 [2024-10-07 11:29:09.562655] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.062 [2024-10-07 11:29:09.562669] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.062 [2024-10-07 11:29:09.576888] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.062 [2024-10-07 11:29:09.576938] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.062 [2024-10-07 11:29:09.577185] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.062 [2024-10-07 11:29:09.577216] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.062 [2024-10-07 11:29:09.577233] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.062 [2024-10-07 11:29:09.577280] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.062 [2024-10-07 11:29:09.577302] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.062 [2024-10-07 11:29:09.577317] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.062 [2024-10-07 11:29:09.577514] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.062 [2024-10-07 11:29:09.577556] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.062 [2024-10-07 11:29:09.577685] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.062 [2024-10-07 11:29:09.577709] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.062 [2024-10-07 11:29:09.577724] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.062 [2024-10-07 11:29:09.577740] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.062 [2024-10-07 11:29:09.577756] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.062 [2024-10-07 11:29:09.577769] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.062 [2024-10-07 11:29:09.579572] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.062 [2024-10-07 11:29:09.579610] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.062 [2024-10-07 11:29:09.588383] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.062 [2024-10-07 11:29:09.588439] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.062 [2024-10-07 11:29:09.588632] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.062 [2024-10-07 11:29:09.588663] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.062 [2024-10-07 11:29:09.588679] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.062 [2024-10-07 11:29:09.588725] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.062 [2024-10-07 11:29:09.588748] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.062 [2024-10-07 11:29:09.588774] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.062 [2024-10-07 11:29:09.591488] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.062 [2024-10-07 11:29:09.591532] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.062 [2024-10-07 11:29:09.593558] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.062 [2024-10-07 11:29:09.593613] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.063 [2024-10-07 11:29:09.593632] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.063 [2024-10-07 11:29:09.593650] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.063 [2024-10-07 11:29:09.593665] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.063 [2024-10-07 11:29:09.593678] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.063 [2024-10-07 11:29:09.593778] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.063 [2024-10-07 11:29:09.593798] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.063 [2024-10-07 11:29:09.598538] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.063 [2024-10-07 11:29:09.598583] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.063 [2024-10-07 11:29:09.598667] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.063 [2024-10-07 11:29:09.598695] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.063 [2024-10-07 11:29:09.598712] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.063 [2024-10-07 11:29:09.598758] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.063 [2024-10-07 11:29:09.598781] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.063 [2024-10-07 11:29:09.598812] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.063 [2024-10-07 11:29:09.598835] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.063 [2024-10-07 11:29:09.598854] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.063 [2024-10-07 11:29:09.598873] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.063 [2024-10-07 11:29:09.598887] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.063 [2024-10-07 11:29:09.598900] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.063 [2024-10-07 11:29:09.598915] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.063 [2024-10-07 11:29:09.598944] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.063 [2024-10-07 11:29:09.598958] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.063 [2024-10-07 11:29:09.598982] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.063 [2024-10-07 11:29:09.598996] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.063 [2024-10-07 11:29:09.608773] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.063 [2024-10-07 11:29:09.608820] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.063 [2024-10-07 11:29:09.608917] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.063 [2024-10-07 11:29:09.608945] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.063 [2024-10-07 11:29:09.608961] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.063 [2024-10-07 11:29:09.609006] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.063 [2024-10-07 11:29:09.609028] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.063 [2024-10-07 11:29:09.609043] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.063 [2024-10-07 11:29:09.609066] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.063 [2024-10-07 11:29:09.609085] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.063 [2024-10-07 11:29:09.609104] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.063 [2024-10-07 11:29:09.609118] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.063 [2024-10-07 11:29:09.609131] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.063 [2024-10-07 11:29:09.609146] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.063 [2024-10-07 11:29:09.609160] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.063 [2024-10-07 11:29:09.609173] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.063 [2024-10-07 11:29:09.609194] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.063 [2024-10-07 11:29:09.609208] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.063 [2024-10-07 11:29:09.619490] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.063 [2024-10-07 11:29:09.619539] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.063 [2024-10-07 11:29:09.619666] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.063 [2024-10-07 11:29:09.619696] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.063 [2024-10-07 11:29:09.619713] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.063 [2024-10-07 11:29:09.619760] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.063 [2024-10-07 11:29:09.619783] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.063 [2024-10-07 11:29:09.619799] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.063 [2024-10-07 11:29:09.619823] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.063 [2024-10-07 11:29:09.619861] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.063 [2024-10-07 11:29:09.619882] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.063 [2024-10-07 11:29:09.619897] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.063 [2024-10-07 11:29:09.619911] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.063 [2024-10-07 11:29:09.619927] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.063 [2024-10-07 11:29:09.619943] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.063 [2024-10-07 11:29:09.619956] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.063 [2024-10-07 11:29:09.619979] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.063 [2024-10-07 11:29:09.619993] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.063 [2024-10-07 11:29:09.629914] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.063 [2024-10-07 11:29:09.629987] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.063 [2024-10-07 11:29:09.630089] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.063 [2024-10-07 11:29:09.630118] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.063 [2024-10-07 11:29:09.630135] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.063 [2024-10-07 11:29:09.630181] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.063 [2024-10-07 11:29:09.630204] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.063 [2024-10-07 11:29:09.630220] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.063 [2024-10-07 11:29:09.630411] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.063 [2024-10-07 11:29:09.630438] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.063 [2024-10-07 11:29:09.630511] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.063 [2024-10-07 11:29:09.630532] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.063 [2024-10-07 11:29:09.630545] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.063 [2024-10-07 11:29:09.630561] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.063 [2024-10-07 11:29:09.630575] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.063 [2024-10-07 11:29:09.630588] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.063 [2024-10-07 11:29:09.630755] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.063 [2024-10-07 11:29:09.630776] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.063 [2024-10-07 11:29:09.644067] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.063 [2024-10-07 11:29:09.644115] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.063 [2024-10-07 11:29:09.644355] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.063 [2024-10-07 11:29:09.644385] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.063 [2024-10-07 11:29:09.644417] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.063 [2024-10-07 11:29:09.644483] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.063 [2024-10-07 11:29:09.644507] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.063 [2024-10-07 11:29:09.644522] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.063 [2024-10-07 11:29:09.644622] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.063 [2024-10-07 11:29:09.644646] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.063 [2024-10-07 11:29:09.644738] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.063 [2024-10-07 11:29:09.644757] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.063 [2024-10-07 11:29:09.644771] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.063 [2024-10-07 11:29:09.644787] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.063 [2024-10-07 11:29:09.644801] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.063 [2024-10-07 11:29:09.644813] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.063 [2024-10-07 11:29:09.646715] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.063 [2024-10-07 11:29:09.646753] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.063 [2024-10-07 11:29:09.655433] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.063 [2024-10-07 11:29:09.655479] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.064 [2024-10-07 11:29:09.657736] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.064 [2024-10-07 11:29:09.657793] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.064 [2024-10-07 11:29:09.657812] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.064 [2024-10-07 11:29:09.657859] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.064 [2024-10-07 11:29:09.657881] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.064 [2024-10-07 11:29:09.657896] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.064 [2024-10-07 11:29:09.658033] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.064 [2024-10-07 11:29:09.658063] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.064 [2024-10-07 11:29:09.658349] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.064 [2024-10-07 11:29:09.658375] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.064 [2024-10-07 11:29:09.658389] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.064 [2024-10-07 11:29:09.658406] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.064 [2024-10-07 11:29:09.658420] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.064 [2024-10-07 11:29:09.658467] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.064 [2024-10-07 11:29:09.658650] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.064 [2024-10-07 11:29:09.658674] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.064 [2024-10-07 11:29:09.666149] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.064 [2024-10-07 11:29:09.666195] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.064 [2024-10-07 11:29:09.666292] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.064 [2024-10-07 11:29:09.666320] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.064 [2024-10-07 11:29:09.666336] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.064 [2024-10-07 11:29:09.666380] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.064 [2024-10-07 11:29:09.666402] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.064 [2024-10-07 11:29:09.666417] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.064 [2024-10-07 11:29:09.666458] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.064 [2024-10-07 11:29:09.666478] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.064 [2024-10-07 11:29:09.666513] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.064 [2024-10-07 11:29:09.666531] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.064 [2024-10-07 11:29:09.666545] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.064 [2024-10-07 11:29:09.666560] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.064 [2024-10-07 11:29:09.666574] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.064 [2024-10-07 11:29:09.666586] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.064 [2024-10-07 11:29:09.666608] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.064 [2024-10-07 11:29:09.666622] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.064 [2024-10-07 11:29:09.678216] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.064 [2024-10-07 11:29:09.678265] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.064 [2024-10-07 11:29:09.678515] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.064 [2024-10-07 11:29:09.678548] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.064 [2024-10-07 11:29:09.678565] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.064 [2024-10-07 11:29:09.678612] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.064 [2024-10-07 11:29:09.678635] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.064 [2024-10-07 11:29:09.678651] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.064 [2024-10-07 11:29:09.678775] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.064 [2024-10-07 11:29:09.678804] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.064 [2024-10-07 11:29:09.679169] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.064 [2024-10-07 11:29:09.679195] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.064 [2024-10-07 11:29:09.679210] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.064 [2024-10-07 11:29:09.679227] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.064 [2024-10-07 11:29:09.679241] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.064 [2024-10-07 11:29:09.679255] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.064 [2024-10-07 11:29:09.681157] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.064 [2024-10-07 11:29:09.681194] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.064 [2024-10-07 11:29:09.690598] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.064 [2024-10-07 11:29:09.690644] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.064 [2024-10-07 11:29:09.690770] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.064 [2024-10-07 11:29:09.690800] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.064 [2024-10-07 11:29:09.690816] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.064 [2024-10-07 11:29:09.690862] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.064 [2024-10-07 11:29:09.690884] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.064 [2024-10-07 11:29:09.690899] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.064 [2024-10-07 11:29:09.690922] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.064 [2024-10-07 11:29:09.690941] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.064 [2024-10-07 11:29:09.690961] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.064 [2024-10-07 11:29:09.690975] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.064 [2024-10-07 11:29:09.690988] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.064 [2024-10-07 11:29:09.691005] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.064 [2024-10-07 11:29:09.691018] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.064 [2024-10-07 11:29:09.691030] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.064 [2024-10-07 11:29:09.691052] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.064 [2024-10-07 11:29:09.691066] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.064 [2024-10-07 11:29:09.701149] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.064 [2024-10-07 11:29:09.701513] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.064 [2024-10-07 11:29:09.701604] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.064 [2024-10-07 11:29:09.701632] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.064 [2024-10-07 11:29:09.701649] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.064 [2024-10-07 11:29:09.701736] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.064 [2024-10-07 11:29:09.701763] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.064 [2024-10-07 11:29:09.701779] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.064 [2024-10-07 11:29:09.701796] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.064 [2024-10-07 11:29:09.701819] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.064 [2024-10-07 11:29:09.701836] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.064 [2024-10-07 11:29:09.701849] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.064 [2024-10-07 11:29:09.701862] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.064 [2024-10-07 11:29:09.701885] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.064 [2024-10-07 11:29:09.701899] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.064 [2024-10-07 11:29:09.701912] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.064 [2024-10-07 11:29:09.701925] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.064 [2024-10-07 11:29:09.701944] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.064 [2024-10-07 11:29:09.711248] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.064 [2024-10-07 11:29:09.711351] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.064 [2024-10-07 11:29:09.711380] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.064 [2024-10-07 11:29:09.711397] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.064 [2024-10-07 11:29:09.711434] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.064 [2024-10-07 11:29:09.711458] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.064 [2024-10-07 11:29:09.711473] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.064 [2024-10-07 11:29:09.711486] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.064 [2024-10-07 11:29:09.711509] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.064 [2024-10-07 11:29:09.711579] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.065 [2024-10-07 11:29:09.711651] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.065 [2024-10-07 11:29:09.711677] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.065 [2024-10-07 11:29:09.711694] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.065 [2024-10-07 11:29:09.711716] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.065 [2024-10-07 11:29:09.711737] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.065 [2024-10-07 11:29:09.711752] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.065 [2024-10-07 11:29:09.711780] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.065 [2024-10-07 11:29:09.712015] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.065 [2024-10-07 11:29:09.723220] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.065 [2024-10-07 11:29:09.723268] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.065 [2024-10-07 11:29:09.723487] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.065 [2024-10-07 11:29:09.723518] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.065 [2024-10-07 11:29:09.723535] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.065 [2024-10-07 11:29:09.723580] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.065 [2024-10-07 11:29:09.723602] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.065 [2024-10-07 11:29:09.723617] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.065 [2024-10-07 11:29:09.723750] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.065 [2024-10-07 11:29:09.723778] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.065 [2024-10-07 11:29:09.723896] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.065 [2024-10-07 11:29:09.723918] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.065 [2024-10-07 11:29:09.723932] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.065 [2024-10-07 11:29:09.723948] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.065 [2024-10-07 11:29:09.723962] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.065 [2024-10-07 11:29:09.723975] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.065 [2024-10-07 11:29:09.724097] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.065 [2024-10-07 11:29:09.724118] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.065 [2024-10-07 11:29:09.733344] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.065 [2024-10-07 11:29:09.733421] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.065 [2024-10-07 11:29:09.733509] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.065 [2024-10-07 11:29:09.733536] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.065 [2024-10-07 11:29:09.733553] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.065 [2024-10-07 11:29:09.733743] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.065 [2024-10-07 11:29:09.733773] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.065 [2024-10-07 11:29:09.733790] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.065 [2024-10-07 11:29:09.733808] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.065 [2024-10-07 11:29:09.733943] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.065 [2024-10-07 11:29:09.733997] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.065 [2024-10-07 11:29:09.734030] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.065 [2024-10-07 11:29:09.734045] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.065 [2024-10-07 11:29:09.734148] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.065 [2024-10-07 11:29:09.734168] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.065 [2024-10-07 11:29:09.734181] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.065 [2024-10-07 11:29:09.734194] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.065 [2024-10-07 11:29:09.734382] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.065 [2024-10-07 11:29:09.743438] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.065 [2024-10-07 11:29:09.743555] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.065 [2024-10-07 11:29:09.743615] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.065 [2024-10-07 11:29:09.743648] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.065 [2024-10-07 11:29:09.743683] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.065 [2024-10-07 11:29:09.743728] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.065 [2024-10-07 11:29:09.743755] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.065 [2024-10-07 11:29:09.743771] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.065 [2024-10-07 11:29:09.743785] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.065 [2024-10-07 11:29:09.743805] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.065 [2024-10-07 11:29:09.743855] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.065 [2024-10-07 11:29:09.743879] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.065 [2024-10-07 11:29:09.743896] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.065 [2024-10-07 11:29:09.743919] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.065 [2024-10-07 11:29:09.743940] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.065 [2024-10-07 11:29:09.743954] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.065 [2024-10-07 11:29:09.743968] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.065 [2024-10-07 11:29:09.743990] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.065 [2024-10-07 11:29:09.754330] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.065 [2024-10-07 11:29:09.754590] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.065 [2024-10-07 11:29:09.754685] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.065 [2024-10-07 11:29:09.754719] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.065 [2024-10-07 11:29:09.754736] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.065 [2024-10-07 11:29:09.754998] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.065 [2024-10-07 11:29:09.755037] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.065 [2024-10-07 11:29:09.755056] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.065 [2024-10-07 11:29:09.755075] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.065 [2024-10-07 11:29:09.755136] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.065 [2024-10-07 11:29:09.755160] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.065 [2024-10-07 11:29:09.755174] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.065 [2024-10-07 11:29:09.755187] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.065 [2024-10-07 11:29:09.755360] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.065 [2024-10-07 11:29:09.755389] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.065 [2024-10-07 11:29:09.755404] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.065 [2024-10-07 11:29:09.755433] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.065 [2024-10-07 11:29:09.755492] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.065 [2024-10-07 11:29:09.768052] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.065 [2024-10-07 11:29:09.768328] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.065 [2024-10-07 11:29:09.768437] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.065 [2024-10-07 11:29:09.768467] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.065 [2024-10-07 11:29:09.768485] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.065 [2024-10-07 11:29:09.768645] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.065 [2024-10-07 11:29:09.768672] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.065 [2024-10-07 11:29:09.768688] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.066 [2024-10-07 11:29:09.768707] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.066 [2024-10-07 11:29:09.768810] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.066 [2024-10-07 11:29:09.768831] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.066 [2024-10-07 11:29:09.768846] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.066 [2024-10-07 11:29:09.768860] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.066 [2024-10-07 11:29:09.770939] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.066 [2024-10-07 11:29:09.770977] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.066 [2024-10-07 11:29:09.771011] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.066 [2024-10-07 11:29:09.771024] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.066 [2024-10-07 11:29:09.771682] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.066 [2024-10-07 11:29:09.778499] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.066 [2024-10-07 11:29:09.778545] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.066 [2024-10-07 11:29:09.778643] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.066 [2024-10-07 11:29:09.778670] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.066 [2024-10-07 11:29:09.778687] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.066 [2024-10-07 11:29:09.778747] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.066 [2024-10-07 11:29:09.778769] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.066 [2024-10-07 11:29:09.778784] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.066 [2024-10-07 11:29:09.778805] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.066 [2024-10-07 11:29:09.778824] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.066 [2024-10-07 11:29:09.778843] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.066 [2024-10-07 11:29:09.778856] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.066 [2024-10-07 11:29:09.778869] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.066 [2024-10-07 11:29:09.778884] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.066 [2024-10-07 11:29:09.778897] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.066 [2024-10-07 11:29:09.778909] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.066 [2024-10-07 11:29:09.778930] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.066 [2024-10-07 11:29:09.778943] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.066 [2024-10-07 11:29:09.788618] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.066 [2024-10-07 11:29:09.788694] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.066 [2024-10-07 11:29:09.788766] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.066 [2024-10-07 11:29:09.788792] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.066 [2024-10-07 11:29:09.788808] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.066 [2024-10-07 11:29:09.788975] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.066 [2024-10-07 11:29:09.789014] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.066 [2024-10-07 11:29:09.789031] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.066 [2024-10-07 11:29:09.789065] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.066 [2024-10-07 11:29:09.789315] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.066 [2024-10-07 11:29:09.789353] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.066 [2024-10-07 11:29:09.789370] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.066 [2024-10-07 11:29:09.789399] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.066 [2024-10-07 11:29:09.789485] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.066 [2024-10-07 11:29:09.789507] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.066 [2024-10-07 11:29:09.789521] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.066 [2024-10-07 11:29:09.789534] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.066 [2024-10-07 11:29:09.789573] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.066 [2024-10-07 11:29:09.798936] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.066 [2024-10-07 11:29:09.798983] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.066 [2024-10-07 11:29:09.799411] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.066 [2024-10-07 11:29:09.799492] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.066 [2024-10-07 11:29:09.799512] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.066 [2024-10-07 11:29:09.799562] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.066 [2024-10-07 11:29:09.799586] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.066 [2024-10-07 11:29:09.799600] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.066 [2024-10-07 11:29:09.801389] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.066 [2024-10-07 11:29:09.801487] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.066 [2024-10-07 11:29:09.801921] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.066 [2024-10-07 11:29:09.801998] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.066 [2024-10-07 11:29:09.802017] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.066 [2024-10-07 11:29:09.802035] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.066 [2024-10-07 11:29:09.802049] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.066 [2024-10-07 11:29:09.802062] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.066 [2024-10-07 11:29:09.802408] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.066 [2024-10-07 11:29:09.802457] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.066 [2024-10-07 11:29:09.809258] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.066 [2024-10-07 11:29:09.809302] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.066 [2024-10-07 11:29:09.809493] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.066 [2024-10-07 11:29:09.809522] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.066 [2024-10-07 11:29:09.809538] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.066 [2024-10-07 11:29:09.809582] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.066 [2024-10-07 11:29:09.809604] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.066 [2024-10-07 11:29:09.809634] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.066 [2024-10-07 11:29:09.809872] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.066 [2024-10-07 11:29:09.809900] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.066 [2024-10-07 11:29:09.810055] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.066 [2024-10-07 11:29:09.810080] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.066 [2024-10-07 11:29:09.810095] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.066 [2024-10-07 11:29:09.810111] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.066 [2024-10-07 11:29:09.810125] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.066 [2024-10-07 11:29:09.810139] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.066 [2024-10-07 11:29:09.812933] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.066 [2024-10-07 11:29:09.812969] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.066 [2024-10-07 11:29:09.821400] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.066 [2024-10-07 11:29:09.821461] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.066 [2024-10-07 11:29:09.821562] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.066 [2024-10-07 11:29:09.821589] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.066 [2024-10-07 11:29:09.821621] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.066 [2024-10-07 11:29:09.821664] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.066 [2024-10-07 11:29:09.821687] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.066 [2024-10-07 11:29:09.821701] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.066 [2024-10-07 11:29:09.821738] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.066 [2024-10-07 11:29:09.821760] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.066 [2024-10-07 11:29:09.821779] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.066 [2024-10-07 11:29:09.821793] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.066 [2024-10-07 11:29:09.821806] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.066 [2024-10-07 11:29:09.821821] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.066 [2024-10-07 11:29:09.821834] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.067 [2024-10-07 11:29:09.821852] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.067 [2024-10-07 11:29:09.821874] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.067 [2024-10-07 11:29:09.821887] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.067 [2024-10-07 11:29:09.831538] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.067 [2024-10-07 11:29:09.831634] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.067 [2024-10-07 11:29:09.831721] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.067 [2024-10-07 11:29:09.831749] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.067 [2024-10-07 11:29:09.831765] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.067 [2024-10-07 11:29:09.831833] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.067 [2024-10-07 11:29:09.831855] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.067 [2024-10-07 11:29:09.831870] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.067 [2024-10-07 11:29:09.831887] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.067 [2024-10-07 11:29:09.831910] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.067 [2024-10-07 11:29:09.831926] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.067 [2024-10-07 11:29:09.831938] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.067 [2024-10-07 11:29:09.831951] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.067 [2024-10-07 11:29:09.831972] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.067 [2024-10-07 11:29:09.831985] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.067 [2024-10-07 11:29:09.831998] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.067 [2024-10-07 11:29:09.832010] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.067 [2024-10-07 11:29:09.832029] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.067 [2024-10-07 11:29:09.843563] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.067 [2024-10-07 11:29:09.843611] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.067 [2024-10-07 11:29:09.843734] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.067 [2024-10-07 11:29:09.843762] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.067 [2024-10-07 11:29:09.843778] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.067 [2024-10-07 11:29:09.843837] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.067 [2024-10-07 11:29:09.843859] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.067 [2024-10-07 11:29:09.843873] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.067 [2024-10-07 11:29:09.844380] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.067 [2024-10-07 11:29:09.844432] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.067 [2024-10-07 11:29:09.844594] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.067 [2024-10-07 11:29:09.844628] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.067 [2024-10-07 11:29:09.844644] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.067 [2024-10-07 11:29:09.844675] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.067 [2024-10-07 11:29:09.844690] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.067 [2024-10-07 11:29:09.844703] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.067 [2024-10-07 11:29:09.844799] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.067 [2024-10-07 11:29:09.844817] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.067 [2024-10-07 11:29:09.855597] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.067 [2024-10-07 11:29:09.855644] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.067 [2024-10-07 11:29:09.855743] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.067 [2024-10-07 11:29:09.855770] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.067 [2024-10-07 11:29:09.855786] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.067 [2024-10-07 11:29:09.855845] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.067 [2024-10-07 11:29:09.855866] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.067 [2024-10-07 11:29:09.855880] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.067 [2024-10-07 11:29:09.855903] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.067 [2024-10-07 11:29:09.855921] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.067 [2024-10-07 11:29:09.856357] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.067 [2024-10-07 11:29:09.856383] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.067 [2024-10-07 11:29:09.856396] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.067 [2024-10-07 11:29:09.856412] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.067 [2024-10-07 11:29:09.856425] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.067 [2024-10-07 11:29:09.856437] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.067 [2024-10-07 11:29:09.856650] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.067 [2024-10-07 11:29:09.856673] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.067 [2024-10-07 11:29:09.868821] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.067 [2024-10-07 11:29:09.868868] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.067 [2024-10-07 11:29:09.869121] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.067 [2024-10-07 11:29:09.869152] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.067 [2024-10-07 11:29:09.869168] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.067 [2024-10-07 11:29:09.869212] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.067 [2024-10-07 11:29:09.869234] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.067 [2024-10-07 11:29:09.869248] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.067 [2024-10-07 11:29:09.869575] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.067 [2024-10-07 11:29:09.869605] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.067 [2024-10-07 11:29:09.869753] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.067 [2024-10-07 11:29:09.869783] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.067 [2024-10-07 11:29:09.869798] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.067 [2024-10-07 11:29:09.869814] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.067 [2024-10-07 11:29:09.869827] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.067 [2024-10-07 11:29:09.869839] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.067 [2024-10-07 11:29:09.871001] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.067 [2024-10-07 11:29:09.871035] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.067 [2024-10-07 11:29:09.881566] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.067 [2024-10-07 11:29:09.881612] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.067 [2024-10-07 11:29:09.881748] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.067 [2024-10-07 11:29:09.881776] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.067 [2024-10-07 11:29:09.881792] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.067 [2024-10-07 11:29:09.881837] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.067 [2024-10-07 11:29:09.881859] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.067 [2024-10-07 11:29:09.881873] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.067 [2024-10-07 11:29:09.881896] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.067 [2024-10-07 11:29:09.881914] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.067 [2024-10-07 11:29:09.881933] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.067 [2024-10-07 11:29:09.881947] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.067 [2024-10-07 11:29:09.881959] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.067 [2024-10-07 11:29:09.882005] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.067 [2024-10-07 11:29:09.882019] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.067 [2024-10-07 11:29:09.882033] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.067 [2024-10-07 11:29:09.882205] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.067 [2024-10-07 11:29:09.882230] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.067 [2024-10-07 11:29:09.896241] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.067 [2024-10-07 11:29:09.896289] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.067 [2024-10-07 11:29:09.896643] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.067 [2024-10-07 11:29:09.896686] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.067 [2024-10-07 11:29:09.896706] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.067 [2024-10-07 11:29:09.896754] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.068 [2024-10-07 11:29:09.896776] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.068 [2024-10-07 11:29:09.896792] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.068 [2024-10-07 11:29:09.897269] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.068 [2024-10-07 11:29:09.897308] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.068 [2024-10-07 11:29:09.897560] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.068 [2024-10-07 11:29:09.897591] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.068 [2024-10-07 11:29:09.897606] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.068 [2024-10-07 11:29:09.897624] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.068 [2024-10-07 11:29:09.897639] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.068 [2024-10-07 11:29:09.897651] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.068 [2024-10-07 11:29:09.897856] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.068 [2024-10-07 11:29:09.897880] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.068 [2024-10-07 11:29:09.909601] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.068 [2024-10-07 11:29:09.909650] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.068 [2024-10-07 11:29:09.910004] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.068 [2024-10-07 11:29:09.910048] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.068 [2024-10-07 11:29:09.910067] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.068 [2024-10-07 11:29:09.910116] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.068 [2024-10-07 11:29:09.910138] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.068 [2024-10-07 11:29:09.910154] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.068 [2024-10-07 11:29:09.910454] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.068 [2024-10-07 11:29:09.910486] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.068 [2024-10-07 11:29:09.910542] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.068 [2024-10-07 11:29:09.910563] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.068 [2024-10-07 11:29:09.910577] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.068 [2024-10-07 11:29:09.910594] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.068 [2024-10-07 11:29:09.910623] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.068 [2024-10-07 11:29:09.910637] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.068 [2024-10-07 11:29:09.910661] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.068 [2024-10-07 11:29:09.910675] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.068 [2024-10-07 11:29:09.923355] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.068 [2024-10-07 11:29:09.923403] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.068 [2024-10-07 11:29:09.923864] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.068 [2024-10-07 11:29:09.923904] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.068 [2024-10-07 11:29:09.923923] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.068 [2024-10-07 11:29:09.923969] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.068 [2024-10-07 11:29:09.923990] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.068 [2024-10-07 11:29:09.924005] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.068 [2024-10-07 11:29:09.924262] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.068 [2024-10-07 11:29:09.924292] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.068 [2024-10-07 11:29:09.924509] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.068 [2024-10-07 11:29:09.924543] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.068 [2024-10-07 11:29:09.924560] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.068 [2024-10-07 11:29:09.924577] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.068 [2024-10-07 11:29:09.924591] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.068 [2024-10-07 11:29:09.924604] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.068 [2024-10-07 11:29:09.924656] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.068 [2024-10-07 11:29:09.924677] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.068 [2024-10-07 11:29:09.935938] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.068 [2024-10-07 11:29:09.935983] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.068 [2024-10-07 11:29:09.936080] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.068 [2024-10-07 11:29:09.936107] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.068 [2024-10-07 11:29:09.936123] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.068 [2024-10-07 11:29:09.936166] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.068 [2024-10-07 11:29:09.936188] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.068 [2024-10-07 11:29:09.936202] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.068 [2024-10-07 11:29:09.936234] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.068 [2024-10-07 11:29:09.936273] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.068 [2024-10-07 11:29:09.936294] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.068 [2024-10-07 11:29:09.936308] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.068 [2024-10-07 11:29:09.936321] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.068 [2024-10-07 11:29:09.936336] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.068 [2024-10-07 11:29:09.936350] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.068 [2024-10-07 11:29:09.936362] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.068 [2024-10-07 11:29:09.936395] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.068 [2024-10-07 11:29:09.936411] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.068 [2024-10-07 11:29:09.946695] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.068 [2024-10-07 11:29:09.950079] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.068 [2024-10-07 11:29:09.950178] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.068 [2024-10-07 11:29:09.950208] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.068 [2024-10-07 11:29:09.950225] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.068 [2024-10-07 11:29:09.950809] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.068 [2024-10-07 11:29:09.950850] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.068 [2024-10-07 11:29:09.950868] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.068 [2024-10-07 11:29:09.950886] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.068 [2024-10-07 11:29:09.952023] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.068 [2024-10-07 11:29:09.952060] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.068 [2024-10-07 11:29:09.952092] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.068 [2024-10-07 11:29:09.952106] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.068 [2024-10-07 11:29:09.952705] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.068 [2024-10-07 11:29:09.952740] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.068 [2024-10-07 11:29:09.952757] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.068 [2024-10-07 11:29:09.952771] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.068 [2024-10-07 11:29:09.953139] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.068 [2024-10-07 11:29:09.956788] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.068 [2024-10-07 11:29:09.956915] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.068 [2024-10-07 11:29:09.956943] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.068 [2024-10-07 11:29:09.956973] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.068 [2024-10-07 11:29:09.956997] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.068 [2024-10-07 11:29:09.957017] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.068 [2024-10-07 11:29:09.957031] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.068 [2024-10-07 11:29:09.957044] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.068 [2024-10-07 11:29:09.957066] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.068 [2024-10-07 11:29:09.960333] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.068 [2024-10-07 11:29:09.960580] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.068 [2024-10-07 11:29:09.960624] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.068 [2024-10-07 11:29:09.960643] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.068 [2024-10-07 11:29:09.960763] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.069 [2024-10-07 11:29:09.960934] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.069 [2024-10-07 11:29:09.960956] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.069 [2024-10-07 11:29:09.960970] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.069 [2024-10-07 11:29:09.961066] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.069 [2024-10-07 11:29:09.967237] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.069 [2024-10-07 11:29:09.967352] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.069 [2024-10-07 11:29:09.967381] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.069 [2024-10-07 11:29:09.967396] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.069 [2024-10-07 11:29:09.967419] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.069 [2024-10-07 11:29:09.967456] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.069 [2024-10-07 11:29:09.967470] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.069 [2024-10-07 11:29:09.967483] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.069 [2024-10-07 11:29:09.967504] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.069 [2024-10-07 11:29:09.970840] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.069 [2024-10-07 11:29:09.970951] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.069 [2024-10-07 11:29:09.970979] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.069 [2024-10-07 11:29:09.970995] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.069 [2024-10-07 11:29:09.971018] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.069 [2024-10-07 11:29:09.971038] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.069 [2024-10-07 11:29:09.971067] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.069 [2024-10-07 11:29:09.971081] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.069 [2024-10-07 11:29:09.971103] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.069 [2024-10-07 11:29:09.980513] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.069 [2024-10-07 11:29:09.980872] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.069 [2024-10-07 11:29:09.980913] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.069 [2024-10-07 11:29:09.980932] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.069 [2024-10-07 11:29:09.981194] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.069 [2024-10-07 11:29:09.981299] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.069 [2024-10-07 11:29:09.981323] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.069 [2024-10-07 11:29:09.981336] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.069 [2024-10-07 11:29:09.981360] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.069 [2024-10-07 11:29:09.981378] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.069 [2024-10-07 11:29:09.981472] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.069 [2024-10-07 11:29:09.981500] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.069 [2024-10-07 11:29:09.981516] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.069 [2024-10-07 11:29:09.981539] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.069 [2024-10-07 11:29:09.981560] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.069 [2024-10-07 11:29:09.981574] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.069 [2024-10-07 11:29:09.981587] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.069 [2024-10-07 11:29:09.981609] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.069 [2024-10-07 11:29:09.994404] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.069 [2024-10-07 11:29:09.994931] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.069 [2024-10-07 11:29:09.995022] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.069 [2024-10-07 11:29:09.995049] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.069 [2024-10-07 11:29:09.995065] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.069 [2024-10-07 11:29:09.995324] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.069 [2024-10-07 11:29:09.995354] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.069 [2024-10-07 11:29:09.995370] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.069 [2024-10-07 11:29:09.995388] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.069 [2024-10-07 11:29:09.995591] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.069 [2024-10-07 11:29:09.995632] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.069 [2024-10-07 11:29:09.995647] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.069 [2024-10-07 11:29:09.995660] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.069 [2024-10-07 11:29:09.995852] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.069 [2024-10-07 11:29:09.995875] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.069 [2024-10-07 11:29:09.995888] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.069 [2024-10-07 11:29:09.995901] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.069 [2024-10-07 11:29:09.995956] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.069 [2024-10-07 11:29:10.008538] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.069 [2024-10-07 11:29:10.008589] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.069 [2024-10-07 11:29:10.008672] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.069 [2024-10-07 11:29:10.008708] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.069 [2024-10-07 11:29:10.008725] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.069 [2024-10-07 11:29:10.008771] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.069 [2024-10-07 11:29:10.008793] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.069 [2024-10-07 11:29:10.008809] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.069 [2024-10-07 11:29:10.008832] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.069 [2024-10-07 11:29:10.008852] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.069 [2024-10-07 11:29:10.008872] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.069 [2024-10-07 11:29:10.008886] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.069 [2024-10-07 11:29:10.008900] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.069 [2024-10-07 11:29:10.008916] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.069 [2024-10-07 11:29:10.008931] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.069 [2024-10-07 11:29:10.008944] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.069 [2024-10-07 11:29:10.008966] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.069 [2024-10-07 11:29:10.008980] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.069 [2024-10-07 11:29:10.023162] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.069 [2024-10-07 11:29:10.023212] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.069 [2024-10-07 11:29:10.023645] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.069 [2024-10-07 11:29:10.023688] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.069 [2024-10-07 11:29:10.023723] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.069 [2024-10-07 11:29:10.023782] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.069 [2024-10-07 11:29:10.023806] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.069 [2024-10-07 11:29:10.023822] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.069 [2024-10-07 11:29:10.023962] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.069 [2024-10-07 11:29:10.023991] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.069 [2024-10-07 11:29:10.024131] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.069 [2024-10-07 11:29:10.024155] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.070 [2024-10-07 11:29:10.024169] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.070 [2024-10-07 11:29:10.024187] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.070 [2024-10-07 11:29:10.024201] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.070 [2024-10-07 11:29:10.024214] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.070 [2024-10-07 11:29:10.024273] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.070 [2024-10-07 11:29:10.024293] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.070 [2024-10-07 11:29:10.034886] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.070 [2024-10-07 11:29:10.034937] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.070 [2024-10-07 11:29:10.035457] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.070 [2024-10-07 11:29:10.035499] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.070 [2024-10-07 11:29:10.035518] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.070 [2024-10-07 11:29:10.035567] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.070 [2024-10-07 11:29:10.035590] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.070 [2024-10-07 11:29:10.035606] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.070 [2024-10-07 11:29:10.037351] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.070 [2024-10-07 11:29:10.037424] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.070 [2024-10-07 11:29:10.038208] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.070 [2024-10-07 11:29:10.038247] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.070 [2024-10-07 11:29:10.038264] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.070 [2024-10-07 11:29:10.038282] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.070 [2024-10-07 11:29:10.038296] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.070 [2024-10-07 11:29:10.038309] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.070 [2024-10-07 11:29:10.038453] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.070 [2024-10-07 11:29:10.038477] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.070 [2024-10-07 11:29:10.049090] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.070 [2024-10-07 11:29:10.049138] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.070 [2024-10-07 11:29:10.049451] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.070 [2024-10-07 11:29:10.049492] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.070 [2024-10-07 11:29:10.049512] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.070 [2024-10-07 11:29:10.049562] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.070 [2024-10-07 11:29:10.049585] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.070 [2024-10-07 11:29:10.049609] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.070 [2024-10-07 11:29:10.049743] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.070 [2024-10-07 11:29:10.049771] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.070 [2024-10-07 11:29:10.049870] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.070 [2024-10-07 11:29:10.049888] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.070 [2024-10-07 11:29:10.049903] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.070 [2024-10-07 11:29:10.049921] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.070 [2024-10-07 11:29:10.049935] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.070 [2024-10-07 11:29:10.049948] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.070 [2024-10-07 11:29:10.050572] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.070 [2024-10-07 11:29:10.050606] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.070 [2024-10-07 11:29:10.059326] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.070 [2024-10-07 11:29:10.059374] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.070 [2024-10-07 11:29:10.059469] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.070 [2024-10-07 11:29:10.059499] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.070 [2024-10-07 11:29:10.059516] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.070 [2024-10-07 11:29:10.059563] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.070 [2024-10-07 11:29:10.059585] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.070 [2024-10-07 11:29:10.059600] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.070 [2024-10-07 11:29:10.059624] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.070 [2024-10-07 11:29:10.059644] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.070 [2024-10-07 11:29:10.062143] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.070 [2024-10-07 11:29:10.062199] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.070 [2024-10-07 11:29:10.062217] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.070 [2024-10-07 11:29:10.062235] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.070 [2024-10-07 11:29:10.062250] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.070 [2024-10-07 11:29:10.062263] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.070 [2024-10-07 11:29:10.063023] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.070 [2024-10-07 11:29:10.063057] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.070 [2024-10-07 11:29:10.069454] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.070 [2024-10-07 11:29:10.069553] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.070 [2024-10-07 11:29:10.069633] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.070 [2024-10-07 11:29:10.069661] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.070 [2024-10-07 11:29:10.069678] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.070 [2024-10-07 11:29:10.069743] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.070 [2024-10-07 11:29:10.069767] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.070 [2024-10-07 11:29:10.069782] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.070 [2024-10-07 11:29:10.069800] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.070 [2024-10-07 11:29:10.069825] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.070 [2024-10-07 11:29:10.069841] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.070 [2024-10-07 11:29:10.069855] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.070 [2024-10-07 11:29:10.069868] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.070 [2024-10-07 11:29:10.069892] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.070 [2024-10-07 11:29:10.069906] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.070 [2024-10-07 11:29:10.069919] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.070 [2024-10-07 11:29:10.069933] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.070 [2024-10-07 11:29:10.070387] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.070 [2024-10-07 11:29:10.079570] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.070 [2024-10-07 11:29:10.079675] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.070 [2024-10-07 11:29:10.079706] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.070 [2024-10-07 11:29:10.079723] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.070 [2024-10-07 11:29:10.079759] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.070 [2024-10-07 11:29:10.079808] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.070 [2024-10-07 11:29:10.079837] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.070 [2024-10-07 11:29:10.079854] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.070 [2024-10-07 11:29:10.079868] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.070 [2024-10-07 11:29:10.079889] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.070 [2024-10-07 11:29:10.079943] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.070 [2024-10-07 11:29:10.079968] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.070 [2024-10-07 11:29:10.079983] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.070 [2024-10-07 11:29:10.080006] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.070 [2024-10-07 11:29:10.080027] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.070 [2024-10-07 11:29:10.080042] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.070 [2024-10-07 11:29:10.080055] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.070 [2024-10-07 11:29:10.080076] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.070 [2024-10-07 11:29:10.091843] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.070 [2024-10-07 11:29:10.091892] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.071 [2024-10-07 11:29:10.091994] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.071 [2024-10-07 11:29:10.092023] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.071 [2024-10-07 11:29:10.092040] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.071 [2024-10-07 11:29:10.092089] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.071 [2024-10-07 11:29:10.092112] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.071 [2024-10-07 11:29:10.092127] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.071 [2024-10-07 11:29:10.092299] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.071 [2024-10-07 11:29:10.092328] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.071 [2024-10-07 11:29:10.092564] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.071 [2024-10-07 11:29:10.092591] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.071 [2024-10-07 11:29:10.092606] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.071 [2024-10-07 11:29:10.092623] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.071 [2024-10-07 11:29:10.092637] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.071 [2024-10-07 11:29:10.092651] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.071 [2024-10-07 11:29:10.092713] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.071 [2024-10-07 11:29:10.092735] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.071 [2024-10-07 11:29:10.106107] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.071 [2024-10-07 11:29:10.106155] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.071 [2024-10-07 11:29:10.106239] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.071 [2024-10-07 11:29:10.106267] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.071 [2024-10-07 11:29:10.106284] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.071 [2024-10-07 11:29:10.106344] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.071 [2024-10-07 11:29:10.106365] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.071 [2024-10-07 11:29:10.106392] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.071 [2024-10-07 11:29:10.106415] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.071 [2024-10-07 11:29:10.106447] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.071 [2024-10-07 11:29:10.106472] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.071 [2024-10-07 11:29:10.106487] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.071 [2024-10-07 11:29:10.106501] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.071 [2024-10-07 11:29:10.106517] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.071 [2024-10-07 11:29:10.106531] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.071 [2024-10-07 11:29:10.106544] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.071 [2024-10-07 11:29:10.106566] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.071 [2024-10-07 11:29:10.106580] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.071 [2024-10-07 11:29:10.122043] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.071 [2024-10-07 11:29:10.122095] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.071 [2024-10-07 11:29:10.122257] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.071 [2024-10-07 11:29:10.122287] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.071 [2024-10-07 11:29:10.122319] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.071 [2024-10-07 11:29:10.122366] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.071 [2024-10-07 11:29:10.122388] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.071 [2024-10-07 11:29:10.122403] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.071 [2024-10-07 11:29:10.122441] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.071 [2024-10-07 11:29:10.122464] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.071 [2024-10-07 11:29:10.122484] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.071 [2024-10-07 11:29:10.122498] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.071 [2024-10-07 11:29:10.122527] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.071 [2024-10-07 11:29:10.122545] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.071 [2024-10-07 11:29:10.122559] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.071 [2024-10-07 11:29:10.122572] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.071 [2024-10-07 11:29:10.122595] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.071 [2024-10-07 11:29:10.122626] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.071 [2024-10-07 11:29:10.134811] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.071 [2024-10-07 11:29:10.134861] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.071 [2024-10-07 11:29:10.134990] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.071 [2024-10-07 11:29:10.135020] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.071 [2024-10-07 11:29:10.135040] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.071 [2024-10-07 11:29:10.135086] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.071 [2024-10-07 11:29:10.135109] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.071 [2024-10-07 11:29:10.135124] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.071 [2024-10-07 11:29:10.135161] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.071 [2024-10-07 11:29:10.135184] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.071 [2024-10-07 11:29:10.135205] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.071 [2024-10-07 11:29:10.135219] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.071 [2024-10-07 11:29:10.135233] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.071 [2024-10-07 11:29:10.135250] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.071 [2024-10-07 11:29:10.135269] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.071 [2024-10-07 11:29:10.135282] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.071 [2024-10-07 11:29:10.135305] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.071 [2024-10-07 11:29:10.135319] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.071 [2024-10-07 11:29:10.148756] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.071 [2024-10-07 11:29:10.148802] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.071 [2024-10-07 11:29:10.148897] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.071 [2024-10-07 11:29:10.148924] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.071 [2024-10-07 11:29:10.148940] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.071 [2024-10-07 11:29:10.149001] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.071 [2024-10-07 11:29:10.149023] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.071 [2024-10-07 11:29:10.149071] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.071 [2024-10-07 11:29:10.149099] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.071 [2024-10-07 11:29:10.149118] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.071 [2024-10-07 11:29:10.149138] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.071 [2024-10-07 11:29:10.149153] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.071 [2024-10-07 11:29:10.149167] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.071 [2024-10-07 11:29:10.149183] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.071 [2024-10-07 11:29:10.149197] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.071 [2024-10-07 11:29:10.149211] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.071 [2024-10-07 11:29:10.149234] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.071 [2024-10-07 11:29:10.149247] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.071 [2024-10-07 11:29:10.162570] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.071 [2024-10-07 11:29:10.162617] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.071 [2024-10-07 11:29:10.162966] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.071 [2024-10-07 11:29:10.163007] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.071 [2024-10-07 11:29:10.163025] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.071 [2024-10-07 11:29:10.163071] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.071 [2024-10-07 11:29:10.163093] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.071 [2024-10-07 11:29:10.163108] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.071 [2024-10-07 11:29:10.163346] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.071 [2024-10-07 11:29:10.163392] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.072 [2024-10-07 11:29:10.163464] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.072 [2024-10-07 11:29:10.163487] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.072 [2024-10-07 11:29:10.163502] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.072 [2024-10-07 11:29:10.163518] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.072 [2024-10-07 11:29:10.163532] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.072 [2024-10-07 11:29:10.163545] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.072 [2024-10-07 11:29:10.163568] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.072 [2024-10-07 11:29:10.163581] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.072 [2024-10-07 11:29:10.176026] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.072 [2024-10-07 11:29:10.176088] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.072 [2024-10-07 11:29:10.176830] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.072 [2024-10-07 11:29:10.176870] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.072 [2024-10-07 11:29:10.176906] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.072 [2024-10-07 11:29:10.176952] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.072 [2024-10-07 11:29:10.176973] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.072 [2024-10-07 11:29:10.176988] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.072 [2024-10-07 11:29:10.177208] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.072 [2024-10-07 11:29:10.177237] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.072 [2024-10-07 11:29:10.177286] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.072 [2024-10-07 11:29:10.177306] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.072 [2024-10-07 11:29:10.177320] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.072 [2024-10-07 11:29:10.177336] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.072 [2024-10-07 11:29:10.177349] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.072 [2024-10-07 11:29:10.177362] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.072 [2024-10-07 11:29:10.177644] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.072 [2024-10-07 11:29:10.177669] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.072 [2024-10-07 11:29:10.186722] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.072 [2024-10-07 11:29:10.186772] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.072 [2024-10-07 11:29:10.186964] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.072 [2024-10-07 11:29:10.186994] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.072 [2024-10-07 11:29:10.187012] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.072 [2024-10-07 11:29:10.187058] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.072 [2024-10-07 11:29:10.187081] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.072 [2024-10-07 11:29:10.187097] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.072 [2024-10-07 11:29:10.187353] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.072 [2024-10-07 11:29:10.187385] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.072 [2024-10-07 11:29:10.187532] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.072 [2024-10-07 11:29:10.187557] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.072 [2024-10-07 11:29:10.187571] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.072 [2024-10-07 11:29:10.187609] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.072 [2024-10-07 11:29:10.187625] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.072 [2024-10-07 11:29:10.187639] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.072 [2024-10-07 11:29:10.187761] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.072 [2024-10-07 11:29:10.187782] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.072 [2024-10-07 11:29:10.198167] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.072 [2024-10-07 11:29:10.198216] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.072 [2024-10-07 11:29:10.198365] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.072 [2024-10-07 11:29:10.198397] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.072 [2024-10-07 11:29:10.198429] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.072 [2024-10-07 11:29:10.198481] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.072 [2024-10-07 11:29:10.198504] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.072 [2024-10-07 11:29:10.198520] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.072 [2024-10-07 11:29:10.198986] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.072 [2024-10-07 11:29:10.199028] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.072 [2024-10-07 11:29:10.199216] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.072 [2024-10-07 11:29:10.199247] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.072 [2024-10-07 11:29:10.199262] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.072 [2024-10-07 11:29:10.199280] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.072 [2024-10-07 11:29:10.199294] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.072 [2024-10-07 11:29:10.199307] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.072 [2024-10-07 11:29:10.199432] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.072 [2024-10-07 11:29:10.199455] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.072 [2024-10-07 11:29:10.208278] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.072 [2024-10-07 11:29:10.208341] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.072 [2024-10-07 11:29:10.208427] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.072 [2024-10-07 11:29:10.208456] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.072 [2024-10-07 11:29:10.208473] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.072 [2024-10-07 11:29:10.208534] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.072 [2024-10-07 11:29:10.208558] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.072 [2024-10-07 11:29:10.208573] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.072 [2024-10-07 11:29:10.208607] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.072 [2024-10-07 11:29:10.208791] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.072 [2024-10-07 11:29:10.208820] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.072 [2024-10-07 11:29:10.208835] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.072 [2024-10-07 11:29:10.208848] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.072 [2024-10-07 11:29:10.208992] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.072 [2024-10-07 11:29:10.209016] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.072 [2024-10-07 11:29:10.209030] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.072 [2024-10-07 11:29:10.209044] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.072 [2024-10-07 11:29:10.209144] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.072 [2024-10-07 11:29:10.218372] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.072 [2024-10-07 11:29:10.218551] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.072 [2024-10-07 11:29:10.218598] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.072 [2024-10-07 11:29:10.218615] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.072 [2024-10-07 11:29:10.218656] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.073 [2024-10-07 11:29:10.218685] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.073 [2024-10-07 11:29:10.218712] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.073 [2024-10-07 11:29:10.218728] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.073 [2024-10-07 11:29:10.218742] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.073 [2024-10-07 11:29:10.218763] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.073 [2024-10-07 11:29:10.218814] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.073 [2024-10-07 11:29:10.218837] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.073 [2024-10-07 11:29:10.218853] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.073 [2024-10-07 11:29:10.218876] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.073 [2024-10-07 11:29:10.218897] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.073 [2024-10-07 11:29:10.218911] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.073 [2024-10-07 11:29:10.218925] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.073 [2024-10-07 11:29:10.218947] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.073 [2024-10-07 11:29:10.232274] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.073 [2024-10-07 11:29:10.232857] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.073 [2024-10-07 11:29:10.232970] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.073 [2024-10-07 11:29:10.232999] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.073 [2024-10-07 11:29:10.233015] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.073 [2024-10-07 11:29:10.233995] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.073 [2024-10-07 11:29:10.234036] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.073 [2024-10-07 11:29:10.234055] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.073 [2024-10-07 11:29:10.234074] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.073 [2024-10-07 11:29:10.234503] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.073 [2024-10-07 11:29:10.234549] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.073 [2024-10-07 11:29:10.234566] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.073 [2024-10-07 11:29:10.234579] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.073 [2024-10-07 11:29:10.234788] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.073 [2024-10-07 11:29:10.234813] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.073 [2024-10-07 11:29:10.234826] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.073 [2024-10-07 11:29:10.234839] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.073 [2024-10-07 11:29:10.235030] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.073 [2024-10-07 11:29:10.242375] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.073 [2024-10-07 11:29:10.242521] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.073 [2024-10-07 11:29:10.242550] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.073 [2024-10-07 11:29:10.242567] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.073 [2024-10-07 11:29:10.242590] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.073 [2024-10-07 11:29:10.242610] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.073 [2024-10-07 11:29:10.242624] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.073 [2024-10-07 11:29:10.242637] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.073 [2024-10-07 11:29:10.242658] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.073 [2024-10-07 11:29:10.246899] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.073 [2024-10-07 11:29:10.247386] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.073 [2024-10-07 11:29:10.247437] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.073 [2024-10-07 11:29:10.247458] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.073 [2024-10-07 11:29:10.248027] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.073 [2024-10-07 11:29:10.248496] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.073 [2024-10-07 11:29:10.248531] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.073 [2024-10-07 11:29:10.248549] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.073 [2024-10-07 11:29:10.248774] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.073 [2024-10-07 11:29:10.252488] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.073 [2024-10-07 11:29:10.252588] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.073 [2024-10-07 11:29:10.252617] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.073 [2024-10-07 11:29:10.252633] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.073 [2024-10-07 11:29:10.252656] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.073 [2024-10-07 11:29:10.252677] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.073 [2024-10-07 11:29:10.252691] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.073 [2024-10-07 11:29:10.252704] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.073 [2024-10-07 11:29:10.252726] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.073 [2024-10-07 11:29:10.260756] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.073 [2024-10-07 11:29:10.261624] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.073 [2024-10-07 11:29:10.261667] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.073 [2024-10-07 11:29:10.261687] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.073 [2024-10-07 11:29:10.262076] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.073 [2024-10-07 11:29:10.262308] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.073 [2024-10-07 11:29:10.262343] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.073 [2024-10-07 11:29:10.262359] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.073 [2024-10-07 11:29:10.262597] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.073 [2024-10-07 11:29:10.262684] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.073 [2024-10-07 11:29:10.262796] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.073 [2024-10-07 11:29:10.262830] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.073 [2024-10-07 11:29:10.262847] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.073 [2024-10-07 11:29:10.262871] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.073 [2024-10-07 11:29:10.263044] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.073 [2024-10-07 11:29:10.263067] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.074 [2024-10-07 11:29:10.263081] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.074 [2024-10-07 11:29:10.263154] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.074 [2024-10-07 11:29:10.274252] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.074 [2024-10-07 11:29:10.274637] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.074 [2024-10-07 11:29:10.274729] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.074 [2024-10-07 11:29:10.274757] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.074 [2024-10-07 11:29:10.274774] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.074 [2024-10-07 11:29:10.275036] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.074 [2024-10-07 11:29:10.275074] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.074 [2024-10-07 11:29:10.275091] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.074 [2024-10-07 11:29:10.275109] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.074 [2024-10-07 11:29:10.275747] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.074 [2024-10-07 11:29:10.275786] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.074 [2024-10-07 11:29:10.275817] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.074 [2024-10-07 11:29:10.275831] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.074 [2024-10-07 11:29:10.276206] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.074 [2024-10-07 11:29:10.276231] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.074 [2024-10-07 11:29:10.276244] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.074 [2024-10-07 11:29:10.276257] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.074 [2024-10-07 11:29:10.276321] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.074 [2024-10-07 11:29:10.285682] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.074 [2024-10-07 11:29:10.285729] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.074 [2024-10-07 11:29:10.285891] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.074 [2024-10-07 11:29:10.285919] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.074 [2024-10-07 11:29:10.285936] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.074 [2024-10-07 11:29:10.286012] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.074 [2024-10-07 11:29:10.286037] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.074 [2024-10-07 11:29:10.286052] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.074 [2024-10-07 11:29:10.286170] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.074 [2024-10-07 11:29:10.286196] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.074 [2024-10-07 11:29:10.286994] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.074 [2024-10-07 11:29:10.287030] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.074 [2024-10-07 11:29:10.287060] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.074 [2024-10-07 11:29:10.287077] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.074 [2024-10-07 11:29:10.287091] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.074 [2024-10-07 11:29:10.287103] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.074 [2024-10-07 11:29:10.289734] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.074 [2024-10-07 11:29:10.289770] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.074 [2024-10-07 11:29:10.295803] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.074 [2024-10-07 11:29:10.295862] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.074 [2024-10-07 11:29:10.295936] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.074 [2024-10-07 11:29:10.295963] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.074 [2024-10-07 11:29:10.295979] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.074 [2024-10-07 11:29:10.296656] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.074 [2024-10-07 11:29:10.296695] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.074 [2024-10-07 11:29:10.296713] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.074 [2024-10-07 11:29:10.296731] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.074 [2024-10-07 11:29:10.298303] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.074 [2024-10-07 11:29:10.298374] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.074 [2024-10-07 11:29:10.298390] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.074 [2024-10-07 11:29:10.298402] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.074 [2024-10-07 11:29:10.298617] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.074 [2024-10-07 11:29:10.298642] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.074 [2024-10-07 11:29:10.298656] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.074 [2024-10-07 11:29:10.298668] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.074 [2024-10-07 11:29:10.298717] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.074 [2024-10-07 11:29:10.305891] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.074 [2024-10-07 11:29:10.306013] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.074 [2024-10-07 11:29:10.306044] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.074 [2024-10-07 11:29:10.306060] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.074 [2024-10-07 11:29:10.306097] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.074 [2024-10-07 11:29:10.306126] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.074 [2024-10-07 11:29:10.306173] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.074 [2024-10-07 11:29:10.306190] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.074 [2024-10-07 11:29:10.306204] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.074 [2024-10-07 11:29:10.306226] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.074 [2024-10-07 11:29:10.306279] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.074 [2024-10-07 11:29:10.306304] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.074 [2024-10-07 11:29:10.306320] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.074 [2024-10-07 11:29:10.306343] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.074 [2024-10-07 11:29:10.306364] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.074 [2024-10-07 11:29:10.306378] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.074 [2024-10-07 11:29:10.306392] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.074 [2024-10-07 11:29:10.306427] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.074 [2024-10-07 11:29:10.318767] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.074 [2024-10-07 11:29:10.318814] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.074 [2024-10-07 11:29:10.319674] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.074 [2024-10-07 11:29:10.319732] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.074 [2024-10-07 11:29:10.319752] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.074 [2024-10-07 11:29:10.319815] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.074 [2024-10-07 11:29:10.319837] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.074 [2024-10-07 11:29:10.319852] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.074 [2024-10-07 11:29:10.320214] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.074 [2024-10-07 11:29:10.320272] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.074 [2024-10-07 11:29:10.320519] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.074 [2024-10-07 11:29:10.320555] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.074 [2024-10-07 11:29:10.320571] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.074 [2024-10-07 11:29:10.320589] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.074 [2024-10-07 11:29:10.320603] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.074 [2024-10-07 11:29:10.320617] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.074 [2024-10-07 11:29:10.320831] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.074 [2024-10-07 11:29:10.320855] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.074 [2024-10-07 11:29:10.331883] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.074 [2024-10-07 11:29:10.331949] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.075 [2024-10-07 11:29:10.332310] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.075 [2024-10-07 11:29:10.332352] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.075 [2024-10-07 11:29:10.332370] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.075 [2024-10-07 11:29:10.332448] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.075 [2024-10-07 11:29:10.332474] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.075 [2024-10-07 11:29:10.332490] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.075 [2024-10-07 11:29:10.332703] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.075 [2024-10-07 11:29:10.332732] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.075 [2024-10-07 11:29:10.333328] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.075 [2024-10-07 11:29:10.333362] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.075 [2024-10-07 11:29:10.333395] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.075 [2024-10-07 11:29:10.333416] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.075 [2024-10-07 11:29:10.333467] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.075 [2024-10-07 11:29:10.333482] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.075 [2024-10-07 11:29:10.333741] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.075 [2024-10-07 11:29:10.333766] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.075 [2024-10-07 11:29:10.344026] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.075 [2024-10-07 11:29:10.344075] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.075 [2024-10-07 11:29:10.344160] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.075 [2024-10-07 11:29:10.344189] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.075 [2024-10-07 11:29:10.344206] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.075 [2024-10-07 11:29:10.344254] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.075 [2024-10-07 11:29:10.344277] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.075 [2024-10-07 11:29:10.344293] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.075 [2024-10-07 11:29:10.344316] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.075 [2024-10-07 11:29:10.344336] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.075 [2024-10-07 11:29:10.344355] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.075 [2024-10-07 11:29:10.344370] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.075 [2024-10-07 11:29:10.344384] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.075 [2024-10-07 11:29:10.344433] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.075 [2024-10-07 11:29:10.344453] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.075 [2024-10-07 11:29:10.344466] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.075 [2024-10-07 11:29:10.344490] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.075 [2024-10-07 11:29:10.344504] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.075 [2024-10-07 11:29:10.354407] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.075 [2024-10-07 11:29:10.354495] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.075 [2024-10-07 11:29:10.354581] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.075 [2024-10-07 11:29:10.354610] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.075 [2024-10-07 11:29:10.354627] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.075 [2024-10-07 11:29:10.354674] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.075 [2024-10-07 11:29:10.354697] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.075 [2024-10-07 11:29:10.354712] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.075 [2024-10-07 11:29:10.354735] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.075 [2024-10-07 11:29:10.354755] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.075 [2024-10-07 11:29:10.354775] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.075 [2024-10-07 11:29:10.354789] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.075 [2024-10-07 11:29:10.354818] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.075 [2024-10-07 11:29:10.354833] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.075 [2024-10-07 11:29:10.354847] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.075 [2024-10-07 11:29:10.354860] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.075 [2024-10-07 11:29:10.354881] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.075 [2024-10-07 11:29:10.354895] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.075 [2024-10-07 11:29:10.367663] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.075 [2024-10-07 11:29:10.367709] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.075 [2024-10-07 11:29:10.367806] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.075 [2024-10-07 11:29:10.367834] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.075 [2024-10-07 11:29:10.367851] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.075 [2024-10-07 11:29:10.367895] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.075 [2024-10-07 11:29:10.367917] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.075 [2024-10-07 11:29:10.367932] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.075 [2024-10-07 11:29:10.367973] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.075 [2024-10-07 11:29:10.367993] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.075 [2024-10-07 11:29:10.368012] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.075 [2024-10-07 11:29:10.368026] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.075 [2024-10-07 11:29:10.368040] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.075 [2024-10-07 11:29:10.368055] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.075 [2024-10-07 11:29:10.368069] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.075 [2024-10-07 11:29:10.368082] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.075 [2024-10-07 11:29:10.368104] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.075 [2024-10-07 11:29:10.368118] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.075 [2024-10-07 11:29:10.377952] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.075 [2024-10-07 11:29:10.378027] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.075 [2024-10-07 11:29:10.378193] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.075 [2024-10-07 11:29:10.378222] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.075 [2024-10-07 11:29:10.378239] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.075 [2024-10-07 11:29:10.378285] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.075 [2024-10-07 11:29:10.378323] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.075 [2024-10-07 11:29:10.378339] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.075 [2024-10-07 11:29:10.378462] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.075 [2024-10-07 11:29:10.378490] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.075 [2024-10-07 11:29:10.380952] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.075 [2024-10-07 11:29:10.380990] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.075 [2024-10-07 11:29:10.381022] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.075 [2024-10-07 11:29:10.381039] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.075 [2024-10-07 11:29:10.381054] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.075 [2024-10-07 11:29:10.381067] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.075 [2024-10-07 11:29:10.383482] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.075 [2024-10-07 11:29:10.383518] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.075 [2024-10-07 11:29:10.388088] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.075 [2024-10-07 11:29:10.388164] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.075 [2024-10-07 11:29:10.388254] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.075 [2024-10-07 11:29:10.388282] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.075 [2024-10-07 11:29:10.388298] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.075 [2024-10-07 11:29:10.388350] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.075 [2024-10-07 11:29:10.388373] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.075 [2024-10-07 11:29:10.388388] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.075 [2024-10-07 11:29:10.388406] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.075 [2024-10-07 11:29:10.388459] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.076 [2024-10-07 11:29:10.388480] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.076 [2024-10-07 11:29:10.388494] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.076 [2024-10-07 11:29:10.388507] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.076 [2024-10-07 11:29:10.388529] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.076 [2024-10-07 11:29:10.388544] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.076 [2024-10-07 11:29:10.388557] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.076 [2024-10-07 11:29:10.388570] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.076 [2024-10-07 11:29:10.388591] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.076 [2024-10-07 11:29:10.398182] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.076 [2024-10-07 11:29:10.398288] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.076 [2024-10-07 11:29:10.398317] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.076 [2024-10-07 11:29:10.398334] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.076 [2024-10-07 11:29:10.398400] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.076 [2024-10-07 11:29:10.398428] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.076 [2024-10-07 11:29:10.398469] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.076 [2024-10-07 11:29:10.398487] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.076 [2024-10-07 11:29:10.398500] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.076 [2024-10-07 11:29:10.398522] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.076 [2024-10-07 11:29:10.398576] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.076 [2024-10-07 11:29:10.398600] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.076 [2024-10-07 11:29:10.398616] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.076 [2024-10-07 11:29:10.398638] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.076 [2024-10-07 11:29:10.398675] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.076 [2024-10-07 11:29:10.398691] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.076 [2024-10-07 11:29:10.398720] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.076 [2024-10-07 11:29:10.398741] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.076 8993.55 IOPS, 35.13 MiB/s [2024-10-07T11:29:15.787Z] [2024-10-07 11:29:10.412244] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.076 [2024-10-07 11:29:10.412291] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.076 [2024-10-07 11:29:10.412515] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.076 [2024-10-07 11:29:10.412547] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.076 [2024-10-07 11:29:10.412564] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.076 [2024-10-07 11:29:10.412610] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.076 [2024-10-07 11:29:10.412633] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.076 [2024-10-07 11:29:10.412649] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.076 [2024-10-07 11:29:10.412850] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.076 [2024-10-07 11:29:10.412879] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.076 [2024-10-07 11:29:10.412996] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.076 [2024-10-07 11:29:10.413019] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.076 [2024-10-07 11:29:10.413034] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.076 [2024-10-07 11:29:10.413066] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.076 [2024-10-07 11:29:10.413081] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.076 [2024-10-07 11:29:10.413094] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.076 [2024-10-07 11:29:10.413203] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.076 [2024-10-07 11:29:10.413225] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.076 [2024-10-07 11:29:10.422464] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.076 [2024-10-07 11:29:10.422521] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.076 [2024-10-07 11:29:10.422619] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.076 [2024-10-07 11:29:10.422647] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.076 [2024-10-07 11:29:10.422663] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.076 [2024-10-07 11:29:10.422708] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.076 [2024-10-07 11:29:10.422730] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.076 [2024-10-07 11:29:10.422745] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.076 [2024-10-07 11:29:10.422785] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.076 [2024-10-07 11:29:10.422805] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.076 [2024-10-07 11:29:10.422825] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.076 [2024-10-07 11:29:10.422840] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.076 [2024-10-07 11:29:10.422853] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.076 [2024-10-07 11:29:10.422869] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.076 [2024-10-07 11:29:10.422883] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.076 [2024-10-07 11:29:10.422896] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.076 [2024-10-07 11:29:10.423128] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.076 [2024-10-07 11:29:10.423153] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.076 [2024-10-07 11:29:10.433340] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.076 [2024-10-07 11:29:10.433391] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.076 [2024-10-07 11:29:10.433596] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.076 [2024-10-07 11:29:10.433628] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.076 [2024-10-07 11:29:10.433647] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.076 [2024-10-07 11:29:10.433692] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.076 [2024-10-07 11:29:10.433714] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.076 [2024-10-07 11:29:10.433729] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.076 [2024-10-07 11:29:10.434122] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.076 [2024-10-07 11:29:10.434162] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.076 [2024-10-07 11:29:10.434342] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.076 [2024-10-07 11:29:10.434391] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.076 [2024-10-07 11:29:10.434408] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.076 [2024-10-07 11:29:10.434440] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.076 [2024-10-07 11:29:10.434455] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.076 [2024-10-07 11:29:10.434468] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.076 [2024-10-07 11:29:10.434698] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.076 [2024-10-07 11:29:10.434724] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.076 [2024-10-07 11:29:10.443682] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.076 [2024-10-07 11:29:10.443728] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.076 [2024-10-07 11:29:10.443901] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.076 [2024-10-07 11:29:10.443955] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.076 [2024-10-07 11:29:10.443974] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.076 [2024-10-07 11:29:10.444038] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.076 [2024-10-07 11:29:10.444061] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.076 [2024-10-07 11:29:10.444076] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.076 [2024-10-07 11:29:10.444512] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.076 [2024-10-07 11:29:10.444554] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.076 [2024-10-07 11:29:10.444705] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.076 [2024-10-07 11:29:10.444737] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.076 [2024-10-07 11:29:10.444754] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.076 [2024-10-07 11:29:10.444771] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.076 [2024-10-07 11:29:10.444787] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.076 [2024-10-07 11:29:10.444800] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.076 [2024-10-07 11:29:10.444943] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.077 [2024-10-07 11:29:10.444963] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.077 [2024-10-07 11:29:10.454295] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.077 [2024-10-07 11:29:10.454371] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.077 [2024-10-07 11:29:10.454495] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.077 [2024-10-07 11:29:10.454523] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.077 [2024-10-07 11:29:10.454539] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.077 [2024-10-07 11:29:10.454583] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.077 [2024-10-07 11:29:10.454605] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.077 [2024-10-07 11:29:10.454619] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.077 [2024-10-07 11:29:10.454642] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.077 [2024-10-07 11:29:10.454660] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.077 [2024-10-07 11:29:10.454679] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.077 [2024-10-07 11:29:10.454692] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.077 [2024-10-07 11:29:10.454705] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.077 [2024-10-07 11:29:10.454720] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.077 [2024-10-07 11:29:10.454733] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.077 [2024-10-07 11:29:10.454760] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.077 [2024-10-07 11:29:10.454784] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.077 [2024-10-07 11:29:10.454797] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.077 [2024-10-07 11:29:10.465904] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.077 [2024-10-07 11:29:10.465950] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.077 [2024-10-07 11:29:10.466284] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.077 [2024-10-07 11:29:10.466356] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.077 [2024-10-07 11:29:10.466375] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.077 [2024-10-07 11:29:10.466433] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.077 [2024-10-07 11:29:10.466458] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.077 [2024-10-07 11:29:10.466473] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.077 [2024-10-07 11:29:10.466539] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.077 [2024-10-07 11:29:10.466566] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.077 [2024-10-07 11:29:10.466586] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.077 [2024-10-07 11:29:10.466600] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.077 [2024-10-07 11:29:10.466612] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.077 [2024-10-07 11:29:10.466628] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.077 [2024-10-07 11:29:10.466641] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.077 [2024-10-07 11:29:10.466654] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.077 [2024-10-07 11:29:10.466675] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.077 [2024-10-07 11:29:10.466689] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.077 [2024-10-07 11:29:10.479476] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.077 [2024-10-07 11:29:10.479521] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.077 [2024-10-07 11:29:10.479616] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.077 [2024-10-07 11:29:10.479643] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.077 [2024-10-07 11:29:10.479659] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.077 [2024-10-07 11:29:10.479702] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.077 [2024-10-07 11:29:10.479723] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.077 [2024-10-07 11:29:10.479738] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.077 [2024-10-07 11:29:10.479760] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.077 [2024-10-07 11:29:10.479801] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.077 [2024-10-07 11:29:10.479821] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.077 [2024-10-07 11:29:10.479835] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.077 [2024-10-07 11:29:10.479848] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.077 [2024-10-07 11:29:10.479863] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.077 [2024-10-07 11:29:10.479877] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.077 [2024-10-07 11:29:10.479889] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.077 [2024-10-07 11:29:10.479911] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.077 [2024-10-07 11:29:10.479925] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.077 [2024-10-07 11:29:10.493472] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.077 [2024-10-07 11:29:10.493518] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.077 [2024-10-07 11:29:10.493617] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.077 [2024-10-07 11:29:10.493646] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.077 [2024-10-07 11:29:10.493663] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.077 [2024-10-07 11:29:10.493708] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.077 [2024-10-07 11:29:10.493729] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.077 [2024-10-07 11:29:10.493744] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.077 [2024-10-07 11:29:10.493766] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.077 [2024-10-07 11:29:10.493785] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.077 [2024-10-07 11:29:10.493805] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.077 [2024-10-07 11:29:10.493819] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.077 [2024-10-07 11:29:10.493832] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.077 [2024-10-07 11:29:10.493847] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.077 [2024-10-07 11:29:10.493861] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.077 [2024-10-07 11:29:10.493874] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.077 [2024-10-07 11:29:10.493896] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.077 [2024-10-07 11:29:10.493910] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.077 [2024-10-07 11:29:10.505017] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.077 [2024-10-07 11:29:10.505062] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.077 [2024-10-07 11:29:10.505327] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.077 [2024-10-07 11:29:10.505368] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.077 [2024-10-07 11:29:10.505401] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.077 [2024-10-07 11:29:10.505466] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.077 [2024-10-07 11:29:10.505490] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.077 [2024-10-07 11:29:10.505505] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.077 [2024-10-07 11:29:10.505560] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.077 [2024-10-07 11:29:10.505585] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.077 [2024-10-07 11:29:10.505617] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.077 [2024-10-07 11:29:10.505634] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.077 [2024-10-07 11:29:10.505647] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.077 [2024-10-07 11:29:10.505662] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.077 [2024-10-07 11:29:10.505676] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.077 [2024-10-07 11:29:10.505689] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.077 [2024-10-07 11:29:10.505710] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.077 [2024-10-07 11:29:10.505723] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.077 [2024-10-07 11:29:10.516091] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.077 [2024-10-07 11:29:10.516137] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.077 [2024-10-07 11:29:10.516328] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.077 [2024-10-07 11:29:10.516358] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.077 [2024-10-07 11:29:10.516374] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.077 [2024-10-07 11:29:10.516418] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.077 [2024-10-07 11:29:10.516473] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.078 [2024-10-07 11:29:10.516489] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.078 [2024-10-07 11:29:10.516608] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.078 [2024-10-07 11:29:10.516635] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.078 [2024-10-07 11:29:10.516741] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.078 [2024-10-07 11:29:10.516761] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.078 [2024-10-07 11:29:10.516790] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.078 [2024-10-07 11:29:10.516806] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.078 [2024-10-07 11:29:10.516819] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.078 [2024-10-07 11:29:10.516831] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.078 [2024-10-07 11:29:10.516941] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.078 [2024-10-07 11:29:10.516960] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.078 [2024-10-07 11:29:10.526548] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.078 [2024-10-07 11:29:10.526596] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.078 [2024-10-07 11:29:10.526766] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.078 [2024-10-07 11:29:10.526797] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.078 [2024-10-07 11:29:10.526814] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.078 [2024-10-07 11:29:10.526866] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.078 [2024-10-07 11:29:10.526889] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.078 [2024-10-07 11:29:10.526904] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.078 [2024-10-07 11:29:10.527010] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.078 [2024-10-07 11:29:10.527035] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.078 [2024-10-07 11:29:10.530190] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.078 [2024-10-07 11:29:10.530231] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.078 [2024-10-07 11:29:10.530248] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.078 [2024-10-07 11:29:10.530266] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.078 [2024-10-07 11:29:10.530280] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.078 [2024-10-07 11:29:10.530293] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.078 [2024-10-07 11:29:10.530523] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.078 [2024-10-07 11:29:10.530550] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.078 [2024-10-07 11:29:10.536656] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.078 [2024-10-07 11:29:10.536718] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.078 [2024-10-07 11:29:10.536796] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.078 [2024-10-07 11:29:10.536824] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.078 [2024-10-07 11:29:10.536840] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.078 [2024-10-07 11:29:10.536903] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.078 [2024-10-07 11:29:10.536927] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.078 [2024-10-07 11:29:10.536944] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.078 [2024-10-07 11:29:10.536962] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.078 [2024-10-07 11:29:10.536985] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.078 [2024-10-07 11:29:10.537021] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.078 [2024-10-07 11:29:10.537036] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.078 [2024-10-07 11:29:10.537050] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.078 [2024-10-07 11:29:10.537074] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.078 [2024-10-07 11:29:10.537089] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.078 [2024-10-07 11:29:10.537102] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.078 [2024-10-07 11:29:10.537116] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.078 [2024-10-07 11:29:10.537136] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.078 [2024-10-07 11:29:10.548102] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.078 [2024-10-07 11:29:10.548149] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.078 [2024-10-07 11:29:10.548245] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.078 [2024-10-07 11:29:10.548273] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.078 [2024-10-07 11:29:10.548289] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.078 [2024-10-07 11:29:10.548332] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.078 [2024-10-07 11:29:10.548353] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.078 [2024-10-07 11:29:10.548368] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.078 [2024-10-07 11:29:10.548390] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.078 [2024-10-07 11:29:10.548408] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.078 [2024-10-07 11:29:10.548440] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.078 [2024-10-07 11:29:10.548457] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.078 [2024-10-07 11:29:10.548470] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.078 [2024-10-07 11:29:10.548485] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.078 [2024-10-07 11:29:10.548498] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.078 [2024-10-07 11:29:10.548510] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.078 [2024-10-07 11:29:10.548531] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.078 [2024-10-07 11:29:10.548545] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.078 [2024-10-07 11:29:10.561867] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.078 [2024-10-07 11:29:10.561914] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.078 [2024-10-07 11:29:10.563222] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.078 [2024-10-07 11:29:10.563279] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.078 [2024-10-07 11:29:10.563298] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.078 [2024-10-07 11:29:10.563363] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.078 [2024-10-07 11:29:10.563387] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.078 [2024-10-07 11:29:10.563402] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.078 [2024-10-07 11:29:10.564113] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.078 [2024-10-07 11:29:10.564154] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.078 [2024-10-07 11:29:10.564387] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.078 [2024-10-07 11:29:10.564470] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.078 [2024-10-07 11:29:10.564489] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.078 [2024-10-07 11:29:10.564507] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.078 [2024-10-07 11:29:10.564521] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.078 [2024-10-07 11:29:10.564534] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.078 [2024-10-07 11:29:10.564733] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.078 [2024-10-07 11:29:10.564758] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.078 [2024-10-07 11:29:10.575706] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.078 [2024-10-07 11:29:10.575751] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.078 [2024-10-07 11:29:10.575921] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.078 [2024-10-07 11:29:10.575950] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.079 [2024-10-07 11:29:10.575966] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.079 [2024-10-07 11:29:10.576009] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.079 [2024-10-07 11:29:10.576031] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.079 [2024-10-07 11:29:10.576046] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.079 [2024-10-07 11:29:10.576363] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.079 [2024-10-07 11:29:10.576397] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.079 [2024-10-07 11:29:10.576480] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.079 [2024-10-07 11:29:10.576501] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.079 [2024-10-07 11:29:10.576515] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.079 [2024-10-07 11:29:10.576531] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.079 [2024-10-07 11:29:10.576544] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.079 [2024-10-07 11:29:10.576557] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.079 [2024-10-07 11:29:10.576578] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.079 [2024-10-07 11:29:10.576610] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.079 [2024-10-07 11:29:10.586065] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.079 [2024-10-07 11:29:10.586113] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.079 [2024-10-07 11:29:10.586276] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.079 [2024-10-07 11:29:10.586335] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.079 [2024-10-07 11:29:10.586351] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.079 [2024-10-07 11:29:10.586395] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.079 [2024-10-07 11:29:10.586416] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.079 [2024-10-07 11:29:10.586443] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.079 [2024-10-07 11:29:10.586674] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.079 [2024-10-07 11:29:10.586704] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.079 [2024-10-07 11:29:10.588289] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.079 [2024-10-07 11:29:10.588324] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.079 [2024-10-07 11:29:10.588356] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.079 [2024-10-07 11:29:10.588372] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.079 [2024-10-07 11:29:10.588386] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.079 [2024-10-07 11:29:10.588398] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.079 [2024-10-07 11:29:10.589035] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.079 [2024-10-07 11:29:10.589068] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.079 [2024-10-07 11:29:10.596172] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.079 [2024-10-07 11:29:10.596249] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.079 [2024-10-07 11:29:10.596322] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.079 [2024-10-07 11:29:10.596348] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.079 [2024-10-07 11:29:10.596365] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.079 [2024-10-07 11:29:10.596416] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.079 [2024-10-07 11:29:10.596470] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.079 [2024-10-07 11:29:10.596487] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.079 [2024-10-07 11:29:10.596506] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.079 [2024-10-07 11:29:10.596530] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.079 [2024-10-07 11:29:10.596547] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.079 [2024-10-07 11:29:10.596578] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.079 [2024-10-07 11:29:10.596594] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.079 [2024-10-07 11:29:10.596618] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.079 [2024-10-07 11:29:10.596633] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.079 [2024-10-07 11:29:10.596646] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.079 [2024-10-07 11:29:10.596659] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.079 [2024-10-07 11:29:10.599393] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.079 [2024-10-07 11:29:10.606815] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.079 [2024-10-07 11:29:10.606862] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.079 [2024-10-07 11:29:10.606943] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.079 [2024-10-07 11:29:10.606971] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.079 [2024-10-07 11:29:10.606987] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.079 [2024-10-07 11:29:10.607032] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.079 [2024-10-07 11:29:10.607071] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.079 [2024-10-07 11:29:10.607087] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.079 [2024-10-07 11:29:10.607111] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.079 [2024-10-07 11:29:10.607131] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.079 [2024-10-07 11:29:10.607150] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.079 [2024-10-07 11:29:10.607165] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.079 [2024-10-07 11:29:10.607178] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.079 [2024-10-07 11:29:10.607194] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.079 [2024-10-07 11:29:10.607208] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.079 [2024-10-07 11:29:10.607221] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.079 [2024-10-07 11:29:10.607244] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.079 [2024-10-07 11:29:10.607257] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.079 [2024-10-07 11:29:10.616921] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.079 [2024-10-07 11:29:10.616996] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.079 [2024-10-07 11:29:10.617071] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.079 [2024-10-07 11:29:10.617098] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.079 [2024-10-07 11:29:10.617114] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.079 [2024-10-07 11:29:10.617164] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.079 [2024-10-07 11:29:10.617200] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.079 [2024-10-07 11:29:10.617217] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.079 [2024-10-07 11:29:10.617235] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.079 [2024-10-07 11:29:10.617257] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.079 [2024-10-07 11:29:10.617273] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.079 [2024-10-07 11:29:10.617286] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.079 [2024-10-07 11:29:10.617298] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.079 [2024-10-07 11:29:10.617320] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.079 [2024-10-07 11:29:10.617334] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.079 [2024-10-07 11:29:10.617346] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.079 [2024-10-07 11:29:10.617358] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.079 [2024-10-07 11:29:10.617389] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.079 [2024-10-07 11:29:10.628856] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.079 [2024-10-07 11:29:10.628901] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.079 [2024-10-07 11:29:10.629022] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.079 [2024-10-07 11:29:10.629067] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.079 [2024-10-07 11:29:10.629084] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.079 [2024-10-07 11:29:10.629130] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.079 [2024-10-07 11:29:10.629152] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.079 [2024-10-07 11:29:10.629167] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.079 [2024-10-07 11:29:10.629190] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.079 [2024-10-07 11:29:10.629209] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.079 [2024-10-07 11:29:10.629228] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.080 [2024-10-07 11:29:10.629242] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.080 [2024-10-07 11:29:10.629256] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.080 [2024-10-07 11:29:10.629271] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.080 [2024-10-07 11:29:10.629285] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.080 [2024-10-07 11:29:10.629298] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.080 [2024-10-07 11:29:10.629320] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.080 [2024-10-07 11:29:10.629334] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.080 [2024-10-07 11:29:10.643727] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.080 [2024-10-07 11:29:10.643776] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.080 [2024-10-07 11:29:10.643926] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.080 [2024-10-07 11:29:10.643954] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.080 [2024-10-07 11:29:10.643970] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.080 [2024-10-07 11:29:10.644015] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.080 [2024-10-07 11:29:10.644037] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.080 [2024-10-07 11:29:10.644052] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.080 [2024-10-07 11:29:10.644529] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.080 [2024-10-07 11:29:10.644560] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.080 [2024-10-07 11:29:10.644650] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.080 [2024-10-07 11:29:10.644671] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.080 [2024-10-07 11:29:10.644685] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.080 [2024-10-07 11:29:10.644701] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.080 [2024-10-07 11:29:10.644715] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.080 [2024-10-07 11:29:10.644728] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.080 [2024-10-07 11:29:10.644901] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.080 [2024-10-07 11:29:10.644925] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.080 [2024-10-07 11:29:10.655585] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.080 [2024-10-07 11:29:10.655631] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.080 [2024-10-07 11:29:10.655729] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.080 [2024-10-07 11:29:10.655762] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.080 [2024-10-07 11:29:10.655779] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.080 [2024-10-07 11:29:10.655839] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.080 [2024-10-07 11:29:10.655861] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.080 [2024-10-07 11:29:10.655875] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.080 [2024-10-07 11:29:10.655898] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.080 [2024-10-07 11:29:10.655916] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.080 [2024-10-07 11:29:10.655935] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.080 [2024-10-07 11:29:10.655948] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.080 [2024-10-07 11:29:10.655978] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.080 [2024-10-07 11:29:10.655996] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.080 [2024-10-07 11:29:10.656009] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.080 [2024-10-07 11:29:10.656022] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.080 [2024-10-07 11:29:10.656043] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.080 [2024-10-07 11:29:10.656057] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.080 [2024-10-07 11:29:10.669483] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.080 [2024-10-07 11:29:10.669529] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.080 [2024-10-07 11:29:10.670612] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.080 [2024-10-07 11:29:10.670654] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.080 [2024-10-07 11:29:10.670688] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.080 [2024-10-07 11:29:10.670735] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.080 [2024-10-07 11:29:10.670757] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.080 [2024-10-07 11:29:10.670772] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.080 [2024-10-07 11:29:10.671149] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.080 [2024-10-07 11:29:10.671180] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.080 [2024-10-07 11:29:10.671461] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.080 [2024-10-07 11:29:10.671495] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.080 [2024-10-07 11:29:10.671512] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.080 [2024-10-07 11:29:10.671529] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.080 [2024-10-07 11:29:10.671543] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.080 [2024-10-07 11:29:10.671556] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.080 [2024-10-07 11:29:10.671614] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.080 [2024-10-07 11:29:10.671634] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.080 [2024-10-07 11:29:10.679806] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.080 [2024-10-07 11:29:10.679868] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.080 [2024-10-07 11:29:10.680056] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.080 [2024-10-07 11:29:10.680086] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.080 [2024-10-07 11:29:10.680104] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.080 [2024-10-07 11:29:10.680148] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.080 [2024-10-07 11:29:10.680170] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.080 [2024-10-07 11:29:10.680201] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.080 [2024-10-07 11:29:10.680311] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.080 [2024-10-07 11:29:10.680336] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.080 [2024-10-07 11:29:10.680459] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.080 [2024-10-07 11:29:10.680480] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.080 [2024-10-07 11:29:10.680494] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.080 [2024-10-07 11:29:10.680510] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.080 [2024-10-07 11:29:10.680524] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.080 [2024-10-07 11:29:10.680537] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.080 [2024-10-07 11:29:10.680889] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.080 [2024-10-07 11:29:10.680913] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.080 [2024-10-07 11:29:10.689943] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.080 [2024-10-07 11:29:10.690046] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.080 [2024-10-07 11:29:10.690120] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.080 [2024-10-07 11:29:10.690147] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.080 [2024-10-07 11:29:10.690164] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.080 [2024-10-07 11:29:10.690216] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.080 [2024-10-07 11:29:10.690238] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.080 [2024-10-07 11:29:10.690258] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.080 [2024-10-07 11:29:10.690276] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.080 [2024-10-07 11:29:10.690313] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.080 [2024-10-07 11:29:10.690329] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.080 [2024-10-07 11:29:10.690342] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.080 [2024-10-07 11:29:10.690354] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.080 [2024-10-07 11:29:10.690376] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.080 [2024-10-07 11:29:10.690390] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.080 [2024-10-07 11:29:10.690403] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.080 [2024-10-07 11:29:10.690415] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.080 [2024-10-07 11:29:10.690434] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.080 [2024-10-07 11:29:10.701832] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.081 [2024-10-07 11:29:10.701894] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.081 [2024-10-07 11:29:10.702064] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.081 [2024-10-07 11:29:10.702095] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.081 [2024-10-07 11:29:10.702112] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.081 [2024-10-07 11:29:10.702158] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.081 [2024-10-07 11:29:10.702181] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.081 [2024-10-07 11:29:10.702196] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.081 [2024-10-07 11:29:10.702219] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.081 [2024-10-07 11:29:10.702238] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.081 [2024-10-07 11:29:10.702258] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.081 [2024-10-07 11:29:10.702273] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.081 [2024-10-07 11:29:10.702286] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.081 [2024-10-07 11:29:10.702318] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.081 [2024-10-07 11:29:10.702346] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.081 [2024-10-07 11:29:10.702358] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.081 [2024-10-07 11:29:10.702394] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.081 [2024-10-07 11:29:10.702408] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.081 [2024-10-07 11:29:10.711988] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.081 [2024-10-07 11:29:10.712035] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.081 [2024-10-07 11:29:10.712132] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.081 [2024-10-07 11:29:10.712159] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.081 [2024-10-07 11:29:10.712175] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.081 [2024-10-07 11:29:10.712220] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.081 [2024-10-07 11:29:10.712242] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.081 [2024-10-07 11:29:10.712257] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.081 [2024-10-07 11:29:10.712279] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.081 [2024-10-07 11:29:10.712297] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.081 [2024-10-07 11:29:10.712317] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.081 [2024-10-07 11:29:10.712331] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.081 [2024-10-07 11:29:10.712344] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.081 [2024-10-07 11:29:10.712359] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.081 [2024-10-07 11:29:10.712420] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.081 [2024-10-07 11:29:10.712434] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.081 [2024-10-07 11:29:10.712473] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.081 [2024-10-07 11:29:10.712491] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.081 [2024-10-07 11:29:10.724453] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.081 [2024-10-07 11:29:10.724498] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.081 [2024-10-07 11:29:10.724799] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.081 [2024-10-07 11:29:10.724839] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.081 [2024-10-07 11:29:10.724857] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.081 [2024-10-07 11:29:10.724903] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.081 [2024-10-07 11:29:10.724925] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.081 [2024-10-07 11:29:10.724940] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.081 [2024-10-07 11:29:10.724990] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.081 [2024-10-07 11:29:10.725014] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.081 [2024-10-07 11:29:10.725035] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.081 [2024-10-07 11:29:10.725049] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.081 [2024-10-07 11:29:10.725062] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.081 [2024-10-07 11:29:10.725078] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.081 [2024-10-07 11:29:10.725092] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.081 [2024-10-07 11:29:10.725104] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.081 [2024-10-07 11:29:10.725125] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.081 [2024-10-07 11:29:10.725139] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.081 [2024-10-07 11:29:10.738447] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.081 [2024-10-07 11:29:10.738525] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.081 [2024-10-07 11:29:10.738626] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.081 [2024-10-07 11:29:10.738654] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.081 [2024-10-07 11:29:10.738671] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.081 [2024-10-07 11:29:10.738730] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.081 [2024-10-07 11:29:10.738752] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.081 [2024-10-07 11:29:10.738766] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.081 [2024-10-07 11:29:10.738806] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.081 [2024-10-07 11:29:10.738826] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.081 [2024-10-07 11:29:10.738857] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.081 [2024-10-07 11:29:10.738873] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.081 [2024-10-07 11:29:10.738886] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.081 [2024-10-07 11:29:10.738902] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.081 [2024-10-07 11:29:10.738916] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.081 [2024-10-07 11:29:10.738928] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.081 [2024-10-07 11:29:10.738949] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.081 [2024-10-07 11:29:10.738963] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.081 [2024-10-07 11:29:10.750976] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.081 [2024-10-07 11:29:10.751040] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.081 [2024-10-07 11:29:10.751524] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.081 [2024-10-07 11:29:10.751566] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.081 [2024-10-07 11:29:10.751585] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.081 [2024-10-07 11:29:10.751634] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.081 [2024-10-07 11:29:10.751657] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.081 [2024-10-07 11:29:10.751673] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.081 [2024-10-07 11:29:10.751759] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.081 [2024-10-07 11:29:10.751785] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.081 [2024-10-07 11:29:10.751837] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.081 [2024-10-07 11:29:10.751851] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.081 [2024-10-07 11:29:10.751873] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.081 [2024-10-07 11:29:10.751890] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.081 [2024-10-07 11:29:10.751904] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.081 [2024-10-07 11:29:10.751916] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.081 [2024-10-07 11:29:10.751938] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.081 [2024-10-07 11:29:10.751952] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.081 [2024-10-07 11:29:10.761189] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.081 [2024-10-07 11:29:10.761234] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.081 [2024-10-07 11:29:10.761329] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.081 [2024-10-07 11:29:10.761386] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.081 [2024-10-07 11:29:10.761405] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.081 [2024-10-07 11:29:10.761466] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.081 [2024-10-07 11:29:10.761491] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.081 [2024-10-07 11:29:10.761507] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.082 [2024-10-07 11:29:10.761531] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.082 [2024-10-07 11:29:10.761551] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.082 [2024-10-07 11:29:10.761810] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.082 [2024-10-07 11:29:10.761835] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.082 [2024-10-07 11:29:10.761849] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.082 [2024-10-07 11:29:10.761864] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.082 [2024-10-07 11:29:10.761878] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.082 [2024-10-07 11:29:10.761890] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.082 [2024-10-07 11:29:10.762033] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.082 [2024-10-07 11:29:10.762056] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.082 [2024-10-07 11:29:10.771310] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.082 [2024-10-07 11:29:10.771374] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.082 [2024-10-07 11:29:10.771461] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.082 [2024-10-07 11:29:10.771490] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.082 [2024-10-07 11:29:10.771512] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.082 [2024-10-07 11:29:10.771566] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.082 [2024-10-07 11:29:10.771589] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.082 [2024-10-07 11:29:10.771605] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.082 [2024-10-07 11:29:10.771623] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.082 [2024-10-07 11:29:10.771647] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.082 [2024-10-07 11:29:10.771664] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.082 [2024-10-07 11:29:10.771677] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.082 [2024-10-07 11:29:10.771691] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.082 [2024-10-07 11:29:10.771945] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.082 [2024-10-07 11:29:10.771971] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.082 [2024-10-07 11:29:10.772004] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.082 [2024-10-07 11:29:10.772018] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.082 [2024-10-07 11:29:10.772186] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.082 [2024-10-07 11:29:10.783212] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.082 [2024-10-07 11:29:10.783261] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.082 [2024-10-07 11:29:10.783567] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.082 [2024-10-07 11:29:10.783608] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.082 [2024-10-07 11:29:10.783628] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.082 [2024-10-07 11:29:10.783676] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.082 [2024-10-07 11:29:10.783699] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.082 [2024-10-07 11:29:10.783715] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.082 [2024-10-07 11:29:10.783769] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.082 [2024-10-07 11:29:10.783795] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.082 [2024-10-07 11:29:10.783816] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.082 [2024-10-07 11:29:10.783831] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.082 [2024-10-07 11:29:10.783845] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.082 [2024-10-07 11:29:10.783861] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.082 [2024-10-07 11:29:10.783876] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.082 [2024-10-07 11:29:10.783889] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.082 [2024-10-07 11:29:10.784061] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.082 [2024-10-07 11:29:10.784102] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.082 [2024-10-07 11:29:10.796689] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.082 [2024-10-07 11:29:10.796740] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.082 [2024-10-07 11:29:10.797535] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.082 [2024-10-07 11:29:10.797577] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.082 [2024-10-07 11:29:10.797597] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.082 [2024-10-07 11:29:10.797646] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.082 [2024-10-07 11:29:10.797669] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.082 [2024-10-07 11:29:10.797685] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.082 [2024-10-07 11:29:10.798104] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.082 [2024-10-07 11:29:10.798163] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.082 [2024-10-07 11:29:10.798236] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.082 [2024-10-07 11:29:10.798262] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.082 [2024-10-07 11:29:10.798278] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.082 [2024-10-07 11:29:10.798295] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.082 [2024-10-07 11:29:10.798309] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.082 [2024-10-07 11:29:10.798323] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.082 [2024-10-07 11:29:10.798513] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.082 [2024-10-07 11:29:10.798545] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.082 [2024-10-07 11:29:10.807408] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.082 [2024-10-07 11:29:10.807485] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.082 [2024-10-07 11:29:10.810644] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.082 [2024-10-07 11:29:10.810697] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.082 [2024-10-07 11:29:10.810716] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.082 [2024-10-07 11:29:10.810766] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.082 [2024-10-07 11:29:10.810789] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.082 [2024-10-07 11:29:10.810820] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.082 [2024-10-07 11:29:10.811254] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.082 [2024-10-07 11:29:10.811295] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.082 [2024-10-07 11:29:10.811489] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.082 [2024-10-07 11:29:10.811522] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.082 [2024-10-07 11:29:10.811539] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.082 [2024-10-07 11:29:10.811556] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.082 [2024-10-07 11:29:10.811571] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.082 [2024-10-07 11:29:10.811584] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.082 [2024-10-07 11:29:10.811696] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.082 [2024-10-07 11:29:10.811717] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.082 [2024-10-07 11:29:10.819982] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.082 [2024-10-07 11:29:10.820029] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.082 [2024-10-07 11:29:10.820129] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.082 [2024-10-07 11:29:10.820157] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.082 [2024-10-07 11:29:10.820192] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.082 [2024-10-07 11:29:10.820242] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.082 [2024-10-07 11:29:10.820265] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.083 [2024-10-07 11:29:10.820280] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.083 [2024-10-07 11:29:10.820304] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.083 [2024-10-07 11:29:10.820324] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.083 [2024-10-07 11:29:10.820344] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.083 [2024-10-07 11:29:10.820359] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.083 [2024-10-07 11:29:10.820373] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.083 [2024-10-07 11:29:10.820389] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.083 [2024-10-07 11:29:10.820403] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.083 [2024-10-07 11:29:10.820416] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.083 [2024-10-07 11:29:10.820711] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.083 [2024-10-07 11:29:10.820737] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.083 [2024-10-07 11:29:10.830935] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.083 [2024-10-07 11:29:10.831149] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.083 [2024-10-07 11:29:10.831229] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.083 [2024-10-07 11:29:10.831264] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.083 [2024-10-07 11:29:10.831282] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.083 [2024-10-07 11:29:10.831472] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.083 [2024-10-07 11:29:10.831529] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.083 [2024-10-07 11:29:10.831547] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.083 [2024-10-07 11:29:10.831566] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.083 [2024-10-07 11:29:10.831709] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.083 [2024-10-07 11:29:10.831737] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.083 [2024-10-07 11:29:10.831752] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.083 [2024-10-07 11:29:10.831766] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.083 [2024-10-07 11:29:10.831905] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.083 [2024-10-07 11:29:10.831927] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.083 [2024-10-07 11:29:10.831941] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.083 [2024-10-07 11:29:10.831970] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.083 [2024-10-07 11:29:10.834586] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.083 [2024-10-07 11:29:10.843173] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.083 [2024-10-07 11:29:10.843363] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.083 [2024-10-07 11:29:10.843474] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.083 [2024-10-07 11:29:10.843504] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.083 [2024-10-07 11:29:10.843520] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.083 [2024-10-07 11:29:10.843575] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.083 [2024-10-07 11:29:10.843599] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.083 [2024-10-07 11:29:10.843615] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.083 [2024-10-07 11:29:10.843633] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.083 [2024-10-07 11:29:10.843672] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.083 [2024-10-07 11:29:10.843693] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.083 [2024-10-07 11:29:10.843707] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.083 [2024-10-07 11:29:10.843721] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.083 [2024-10-07 11:29:10.843744] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.083 [2024-10-07 11:29:10.843759] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.083 [2024-10-07 11:29:10.843772] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.083 [2024-10-07 11:29:10.843785] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.083 [2024-10-07 11:29:10.843820] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.083 [2024-10-07 11:29:10.854263] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.083 [2024-10-07 11:29:10.854312] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.083 [2024-10-07 11:29:10.855434] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.083 [2024-10-07 11:29:10.855492] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.083 [2024-10-07 11:29:10.855512] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.083 [2024-10-07 11:29:10.855562] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.083 [2024-10-07 11:29:10.855585] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.083 [2024-10-07 11:29:10.855601] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.083 [2024-10-07 11:29:10.857065] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.083 [2024-10-07 11:29:10.857107] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.083 [2024-10-07 11:29:10.857419] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.083 [2024-10-07 11:29:10.857463] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.083 [2024-10-07 11:29:10.857478] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.083 [2024-10-07 11:29:10.857496] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.083 [2024-10-07 11:29:10.857510] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.083 [2024-10-07 11:29:10.857523] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.083 [2024-10-07 11:29:10.857661] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.083 [2024-10-07 11:29:10.857685] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.083 [2024-10-07 11:29:10.864409] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.083 [2024-10-07 11:29:10.864502] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.083 [2024-10-07 11:29:10.864588] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.083 [2024-10-07 11:29:10.864617] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.083 [2024-10-07 11:29:10.864634] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.083 [2024-10-07 11:29:10.864680] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.083 [2024-10-07 11:29:10.864702] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.083 [2024-10-07 11:29:10.864717] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.083 [2024-10-07 11:29:10.864741] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.083 [2024-10-07 11:29:10.864760] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.083 [2024-10-07 11:29:10.864780] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.083 [2024-10-07 11:29:10.864794] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.083 [2024-10-07 11:29:10.864808] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.083 [2024-10-07 11:29:10.864824] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.083 [2024-10-07 11:29:10.864838] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.083 [2024-10-07 11:29:10.864854] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.083 [2024-10-07 11:29:10.864877] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.083 [2024-10-07 11:29:10.864891] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.083 [2024-10-07 11:29:10.875038] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.083 [2024-10-07 11:29:10.875086] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.083 [2024-10-07 11:29:10.875184] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.083 [2024-10-07 11:29:10.875212] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.083 [2024-10-07 11:29:10.875229] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.083 [2024-10-07 11:29:10.875293] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.083 [2024-10-07 11:29:10.875317] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.083 [2024-10-07 11:29:10.875333] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.083 [2024-10-07 11:29:10.875357] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.083 [2024-10-07 11:29:10.875377] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.083 [2024-10-07 11:29:10.875396] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.083 [2024-10-07 11:29:10.875411] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.083 [2024-10-07 11:29:10.875438] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.083 [2024-10-07 11:29:10.875458] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.083 [2024-10-07 11:29:10.875472] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.084 [2024-10-07 11:29:10.875485] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.084 [2024-10-07 11:29:10.875523] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.084 [2024-10-07 11:29:10.875540] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.084 [2024-10-07 11:29:10.888061] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.084 [2024-10-07 11:29:10.888110] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.084 [2024-10-07 11:29:10.888267] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.084 [2024-10-07 11:29:10.888297] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.084 [2024-10-07 11:29:10.888315] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.084 [2024-10-07 11:29:10.888362] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.084 [2024-10-07 11:29:10.888385] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.084 [2024-10-07 11:29:10.888400] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.084 [2024-10-07 11:29:10.888439] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.084 [2024-10-07 11:29:10.888461] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.084 [2024-10-07 11:29:10.888481] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.084 [2024-10-07 11:29:10.888495] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.084 [2024-10-07 11:29:10.888509] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.084 [2024-10-07 11:29:10.888525] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.084 [2024-10-07 11:29:10.888539] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.084 [2024-10-07 11:29:10.888553] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.084 [2024-10-07 11:29:10.888576] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.084 [2024-10-07 11:29:10.888605] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.084 [2024-10-07 11:29:10.901053] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.084 [2024-10-07 11:29:10.901101] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.084 [2024-10-07 11:29:10.901252] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.084 [2024-10-07 11:29:10.901281] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.084 [2024-10-07 11:29:10.901297] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.084 [2024-10-07 11:29:10.901342] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.084 [2024-10-07 11:29:10.901364] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.084 [2024-10-07 11:29:10.901395] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.084 [2024-10-07 11:29:10.901419] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.084 [2024-10-07 11:29:10.901453] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.084 [2024-10-07 11:29:10.901478] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.084 [2024-10-07 11:29:10.901493] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.084 [2024-10-07 11:29:10.901506] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.084 [2024-10-07 11:29:10.901523] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.084 [2024-10-07 11:29:10.901538] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.084 [2024-10-07 11:29:10.901551] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.084 [2024-10-07 11:29:10.901574] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.084 [2024-10-07 11:29:10.901588] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.084 [2024-10-07 11:29:10.911563] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.084 [2024-10-07 11:29:10.911610] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.084 [2024-10-07 11:29:10.912754] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.084 [2024-10-07 11:29:10.912811] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.084 [2024-10-07 11:29:10.912846] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.084 [2024-10-07 11:29:10.912894] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.084 [2024-10-07 11:29:10.912917] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.084 [2024-10-07 11:29:10.912933] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.084 [2024-10-07 11:29:10.913122] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.084 [2024-10-07 11:29:10.913151] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.084 [2024-10-07 11:29:10.913248] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.084 [2024-10-07 11:29:10.913301] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.084 [2024-10-07 11:29:10.913317] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.084 [2024-10-07 11:29:10.913334] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.084 [2024-10-07 11:29:10.913349] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.084 [2024-10-07 11:29:10.913362] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.084 [2024-10-07 11:29:10.913541] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.084 [2024-10-07 11:29:10.913567] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.084 [2024-10-07 11:29:10.924214] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.084 [2024-10-07 11:29:10.924262] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.084 [2024-10-07 11:29:10.924501] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.084 [2024-10-07 11:29:10.924533] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.084 [2024-10-07 11:29:10.924550] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.084 [2024-10-07 11:29:10.924598] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.084 [2024-10-07 11:29:10.924620] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.084 [2024-10-07 11:29:10.924636] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.084 [2024-10-07 11:29:10.924747] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.084 [2024-10-07 11:29:10.924772] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.084 [2024-10-07 11:29:10.925117] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.084 [2024-10-07 11:29:10.925151] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.084 [2024-10-07 11:29:10.925167] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.084 [2024-10-07 11:29:10.925185] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.084 [2024-10-07 11:29:10.925199] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.084 [2024-10-07 11:29:10.925212] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.084 [2024-10-07 11:29:10.927013] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.084 [2024-10-07 11:29:10.927050] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.084 [2024-10-07 11:29:10.937015] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.084 [2024-10-07 11:29:10.937061] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.084 [2024-10-07 11:29:10.937190] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.084 [2024-10-07 11:29:10.937219] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.084 [2024-10-07 11:29:10.937236] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.084 [2024-10-07 11:29:10.937280] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.084 [2024-10-07 11:29:10.937318] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.084 [2024-10-07 11:29:10.937335] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.084 [2024-10-07 11:29:10.937359] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.084 [2024-10-07 11:29:10.937378] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.084 [2024-10-07 11:29:10.937397] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.084 [2024-10-07 11:29:10.937412] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.084 [2024-10-07 11:29:10.937439] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.084 [2024-10-07 11:29:10.937458] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.084 [2024-10-07 11:29:10.937472] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.084 [2024-10-07 11:29:10.937485] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.084 [2024-10-07 11:29:10.937664] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.084 [2024-10-07 11:29:10.937689] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.084 [2024-10-07 11:29:10.949668] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.084 [2024-10-07 11:29:10.949719] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.084 [2024-10-07 11:29:10.950175] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.084 [2024-10-07 11:29:10.950218] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.084 [2024-10-07 11:29:10.950238] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.085 [2024-10-07 11:29:10.950286] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.085 [2024-10-07 11:29:10.950308] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.085 [2024-10-07 11:29:10.950324] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.085 [2024-10-07 11:29:10.950407] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.085 [2024-10-07 11:29:10.950452] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.085 [2024-10-07 11:29:10.950474] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.085 [2024-10-07 11:29:10.950489] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.085 [2024-10-07 11:29:10.950503] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.085 [2024-10-07 11:29:10.950519] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.085 [2024-10-07 11:29:10.950534] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.085 [2024-10-07 11:29:10.950547] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.085 [2024-10-07 11:29:10.950570] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.085 [2024-10-07 11:29:10.950585] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.085 [2024-10-07 11:29:10.963197] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.085 [2024-10-07 11:29:10.963246] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.085 [2024-10-07 11:29:10.963613] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.085 [2024-10-07 11:29:10.963654] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.085 [2024-10-07 11:29:10.963673] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.085 [2024-10-07 11:29:10.963720] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.085 [2024-10-07 11:29:10.963742] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.085 [2024-10-07 11:29:10.963758] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.085 [2024-10-07 11:29:10.964012] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.085 [2024-10-07 11:29:10.964042] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.085 [2024-10-07 11:29:10.964096] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.085 [2024-10-07 11:29:10.964116] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.085 [2024-10-07 11:29:10.964131] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.085 [2024-10-07 11:29:10.964147] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.085 [2024-10-07 11:29:10.964161] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.085 [2024-10-07 11:29:10.964174] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.085 [2024-10-07 11:29:10.964340] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.085 [2024-10-07 11:29:10.964361] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.085 [2024-10-07 11:29:10.977407] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.085 [2024-10-07 11:29:10.977466] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.085 [2024-10-07 11:29:10.977564] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.085 [2024-10-07 11:29:10.977592] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.085 [2024-10-07 11:29:10.977609] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.085 [2024-10-07 11:29:10.977653] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.085 [2024-10-07 11:29:10.977675] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.085 [2024-10-07 11:29:10.977690] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.085 [2024-10-07 11:29:10.977713] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.085 [2024-10-07 11:29:10.977733] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.085 [2024-10-07 11:29:10.977753] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.085 [2024-10-07 11:29:10.977767] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.085 [2024-10-07 11:29:10.977798] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.085 [2024-10-07 11:29:10.977815] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.085 [2024-10-07 11:29:10.977829] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.085 [2024-10-07 11:29:10.977842] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.085 [2024-10-07 11:29:10.977865] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.085 [2024-10-07 11:29:10.977878] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.085 [2024-10-07 11:29:10.992331] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.085 [2024-10-07 11:29:10.992379] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.085 [2024-10-07 11:29:10.992504] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.085 [2024-10-07 11:29:10.992534] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.085 [2024-10-07 11:29:10.992551] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.085 [2024-10-07 11:29:10.992597] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.085 [2024-10-07 11:29:10.992620] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.085 [2024-10-07 11:29:10.992635] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.085 [2024-10-07 11:29:10.992659] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.085 [2024-10-07 11:29:10.992679] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.085 [2024-10-07 11:29:10.992698] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.085 [2024-10-07 11:29:10.992713] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.085 [2024-10-07 11:29:10.992727] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.085 [2024-10-07 11:29:10.992743] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.085 [2024-10-07 11:29:10.992757] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.085 [2024-10-07 11:29:10.992770] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.085 [2024-10-07 11:29:10.992792] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.085 [2024-10-07 11:29:10.992821] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.085 [2024-10-07 11:29:11.003506] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.085 [2024-10-07 11:29:11.003552] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.085 [2024-10-07 11:29:11.005316] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.085 [2024-10-07 11:29:11.005374] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.085 [2024-10-07 11:29:11.005393] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.085 [2024-10-07 11:29:11.005453] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.085 [2024-10-07 11:29:11.005478] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.085 [2024-10-07 11:29:11.005512] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.085 [2024-10-07 11:29:11.007048] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.085 [2024-10-07 11:29:11.007091] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.085 [2024-10-07 11:29:11.007303] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.085 [2024-10-07 11:29:11.007329] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.085 [2024-10-07 11:29:11.007342] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.085 [2024-10-07 11:29:11.007359] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.085 [2024-10-07 11:29:11.007372] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.085 [2024-10-07 11:29:11.007385] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.085 [2024-10-07 11:29:11.007531] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.085 [2024-10-07 11:29:11.007554] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.085 [2024-10-07 11:29:11.014074] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.085 [2024-10-07 11:29:11.014120] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.085 [2024-10-07 11:29:11.016299] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.085 [2024-10-07 11:29:11.016355] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.085 [2024-10-07 11:29:11.016374] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.085 [2024-10-07 11:29:11.016421] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.085 [2024-10-07 11:29:11.016473] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.085 [2024-10-07 11:29:11.016489] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.085 [2024-10-07 11:29:11.017786] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.085 [2024-10-07 11:29:11.017828] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.085 [2024-10-07 11:29:11.018161] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.085 [2024-10-07 11:29:11.018193] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.085 [2024-10-07 11:29:11.018209] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.086 [2024-10-07 11:29:11.018226] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.086 [2024-10-07 11:29:11.018241] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.086 [2024-10-07 11:29:11.018253] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.086 [2024-10-07 11:29:11.018317] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.086 [2024-10-07 11:29:11.018337] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.086 [2024-10-07 11:29:11.024195] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.086 [2024-10-07 11:29:11.024283] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.086 [2024-10-07 11:29:11.024355] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.086 [2024-10-07 11:29:11.024382] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.086 [2024-10-07 11:29:11.024398] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.086 [2024-10-07 11:29:11.024478] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.086 [2024-10-07 11:29:11.024503] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.086 [2024-10-07 11:29:11.024519] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.086 [2024-10-07 11:29:11.024536] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.086 [2024-10-07 11:29:11.024560] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.086 [2024-10-07 11:29:11.024577] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.086 [2024-10-07 11:29:11.024590] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.086 [2024-10-07 11:29:11.024603] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.086 [2024-10-07 11:29:11.027323] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.086 [2024-10-07 11:29:11.027361] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.086 [2024-10-07 11:29:11.027393] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.086 [2024-10-07 11:29:11.027407] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.086 [2024-10-07 11:29:11.028524] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.086 [2024-10-07 11:29:11.034312] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.086 [2024-10-07 11:29:11.034446] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.086 [2024-10-07 11:29:11.034475] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.086 [2024-10-07 11:29:11.034491] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.086 [2024-10-07 11:29:11.034527] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.086 [2024-10-07 11:29:11.034554] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.086 [2024-10-07 11:29:11.034580] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.086 [2024-10-07 11:29:11.034595] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.086 [2024-10-07 11:29:11.034608] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.086 [2024-10-07 11:29:11.034628] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.086 [2024-10-07 11:29:11.034677] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.086 [2024-10-07 11:29:11.034700] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.086 [2024-10-07 11:29:11.034715] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.086 [2024-10-07 11:29:11.034736] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.086 [2024-10-07 11:29:11.034774] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.086 [2024-10-07 11:29:11.034789] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.086 [2024-10-07 11:29:11.034802] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.086 [2024-10-07 11:29:11.034823] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.086 [2024-10-07 11:29:11.044397] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.086 [2024-10-07 11:29:11.044542] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.086 [2024-10-07 11:29:11.044572] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.086 [2024-10-07 11:29:11.044589] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.086 [2024-10-07 11:29:11.044612] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.086 [2024-10-07 11:29:11.044645] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.086 [2024-10-07 11:29:11.044663] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.086 [2024-10-07 11:29:11.044676] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.086 [2024-10-07 11:29:11.044699] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.086 [2024-10-07 11:29:11.044734] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.086 [2024-10-07 11:29:11.044795] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.086 [2024-10-07 11:29:11.044821] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.086 [2024-10-07 11:29:11.044837] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.086 [2024-10-07 11:29:11.044875] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.086 [2024-10-07 11:29:11.044896] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.086 [2024-10-07 11:29:11.044910] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.086 [2024-10-07 11:29:11.044923] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.086 [2024-10-07 11:29:11.044943] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.086 [2024-10-07 11:29:11.054518] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.086 [2024-10-07 11:29:11.054623] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.086 [2024-10-07 11:29:11.054653] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.086 [2024-10-07 11:29:11.054670] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.086 [2024-10-07 11:29:11.054695] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.086 [2024-10-07 11:29:11.054720] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.086 [2024-10-07 11:29:11.054735] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.086 [2024-10-07 11:29:11.054748] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.086 [2024-10-07 11:29:11.054790] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.086 [2024-10-07 11:29:11.054827] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.086 [2024-10-07 11:29:11.057266] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.086 [2024-10-07 11:29:11.057311] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.086 [2024-10-07 11:29:11.057330] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.086 [2024-10-07 11:29:11.057791] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.086 [2024-10-07 11:29:11.058851] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.086 [2024-10-07 11:29:11.058890] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.086 [2024-10-07 11:29:11.058907] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.086 [2024-10-07 11:29:11.060446] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.086 [2024-10-07 11:29:11.064727] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.086 [2024-10-07 11:29:11.064859] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.086 [2024-10-07 11:29:11.064888] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.086 [2024-10-07 11:29:11.064904] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.086 [2024-10-07 11:29:11.064930] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.086 [2024-10-07 11:29:11.064962] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.086 [2024-10-07 11:29:11.064978] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.086 [2024-10-07 11:29:11.064992] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.086 [2024-10-07 11:29:11.065014] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.086 [2024-10-07 11:29:11.065032] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.086 [2024-10-07 11:29:11.065090] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.087 [2024-10-07 11:29:11.065115] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.087 [2024-10-07 11:29:11.065130] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.087 [2024-10-07 11:29:11.065151] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.087 [2024-10-07 11:29:11.065172] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.087 [2024-10-07 11:29:11.065185] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.087 [2024-10-07 11:29:11.065198] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.087 [2024-10-07 11:29:11.065218] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.087 [2024-10-07 11:29:11.076342] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.087 [2024-10-07 11:29:11.076405] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.087 [2024-10-07 11:29:11.076555] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.087 [2024-10-07 11:29:11.076585] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.087 [2024-10-07 11:29:11.076602] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.087 [2024-10-07 11:29:11.076648] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.087 [2024-10-07 11:29:11.076672] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.087 [2024-10-07 11:29:11.076687] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.087 [2024-10-07 11:29:11.076711] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.087 [2024-10-07 11:29:11.076731] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.087 [2024-10-07 11:29:11.076751] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.087 [2024-10-07 11:29:11.076765] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.087 [2024-10-07 11:29:11.076779] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.087 [2024-10-07 11:29:11.076795] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.087 [2024-10-07 11:29:11.076824] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.087 [2024-10-07 11:29:11.076852] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.087 [2024-10-07 11:29:11.076873] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.087 [2024-10-07 11:29:11.076886] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.087 [2024-10-07 11:29:11.086530] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.087 [2024-10-07 11:29:11.086607] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.087 [2024-10-07 11:29:11.086683] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.087 [2024-10-07 11:29:11.086710] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.087 [2024-10-07 11:29:11.086742] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.087 [2024-10-07 11:29:11.086808] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.087 [2024-10-07 11:29:11.086830] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.087 [2024-10-07 11:29:11.086845] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.087 [2024-10-07 11:29:11.086862] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.087 [2024-10-07 11:29:11.086885] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.087 [2024-10-07 11:29:11.086902] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.087 [2024-10-07 11:29:11.086915] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.087 [2024-10-07 11:29:11.086928] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.087 [2024-10-07 11:29:11.086948] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.087 [2024-10-07 11:29:11.086962] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.087 [2024-10-07 11:29:11.086989] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.087 [2024-10-07 11:29:11.087003] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.087 [2024-10-07 11:29:11.087024] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.087 [2024-10-07 11:29:11.096888] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.087 [2024-10-07 11:29:11.096934] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.087 [2024-10-07 11:29:11.097045] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.087 [2024-10-07 11:29:11.097072] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.087 [2024-10-07 11:29:11.097088] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.087 [2024-10-07 11:29:11.097131] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.087 [2024-10-07 11:29:11.097153] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.087 [2024-10-07 11:29:11.097168] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.087 [2024-10-07 11:29:11.097190] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.087 [2024-10-07 11:29:11.097209] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.087 [2024-10-07 11:29:11.097227] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.087 [2024-10-07 11:29:11.097240] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.087 [2024-10-07 11:29:11.097253] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.087 [2024-10-07 11:29:11.097268] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.087 [2024-10-07 11:29:11.097281] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.087 [2024-10-07 11:29:11.097294] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.087 [2024-10-07 11:29:11.097315] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.087 [2024-10-07 11:29:11.097328] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.087 [2024-10-07 11:29:11.107595] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.087 [2024-10-07 11:29:11.107640] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.087 [2024-10-07 11:29:11.107734] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.087 [2024-10-07 11:29:11.107761] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.087 [2024-10-07 11:29:11.107777] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.087 [2024-10-07 11:29:11.107820] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.087 [2024-10-07 11:29:11.107842] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.087 [2024-10-07 11:29:11.107856] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.087 [2024-10-07 11:29:11.107879] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.087 [2024-10-07 11:29:11.107915] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.087 [2024-10-07 11:29:11.107936] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.087 [2024-10-07 11:29:11.107949] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.087 [2024-10-07 11:29:11.107962] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.087 [2024-10-07 11:29:11.107978] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.087 [2024-10-07 11:29:11.107991] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.087 [2024-10-07 11:29:11.108003] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.087 [2024-10-07 11:29:11.108024] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.087 [2024-10-07 11:29:11.108038] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.087 [2024-10-07 11:29:11.119548] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.087 [2024-10-07 11:29:11.119594] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.087 [2024-10-07 11:29:11.119689] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.087 [2024-10-07 11:29:11.119717] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.087 [2024-10-07 11:29:11.119733] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.087 [2024-10-07 11:29:11.119776] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.087 [2024-10-07 11:29:11.119797] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.087 [2024-10-07 11:29:11.119812] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.087 [2024-10-07 11:29:11.119834] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.087 [2024-10-07 11:29:11.119853] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.087 [2024-10-07 11:29:11.119872] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.087 [2024-10-07 11:29:11.119885] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.087 [2024-10-07 11:29:11.119898] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.087 [2024-10-07 11:29:11.119913] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.087 [2024-10-07 11:29:11.119926] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.087 [2024-10-07 11:29:11.119938] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.087 [2024-10-07 11:29:11.119975] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.087 [2024-10-07 11:29:11.119992] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.087 [2024-10-07 11:29:11.132390] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.088 [2024-10-07 11:29:11.132463] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.088 [2024-10-07 11:29:11.132561] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.088 [2024-10-07 11:29:11.132589] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.088 [2024-10-07 11:29:11.132620] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.088 [2024-10-07 11:29:11.132670] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.088 [2024-10-07 11:29:11.132693] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.088 [2024-10-07 11:29:11.132708] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.088 [2024-10-07 11:29:11.132730] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.088 [2024-10-07 11:29:11.132750] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.088 [2024-10-07 11:29:11.132769] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.088 [2024-10-07 11:29:11.132783] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.088 [2024-10-07 11:29:11.132796] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.088 [2024-10-07 11:29:11.132812] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.088 [2024-10-07 11:29:11.132825] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.088 [2024-10-07 11:29:11.132854] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.088 [2024-10-07 11:29:11.132875] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.088 [2024-10-07 11:29:11.132889] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.088 [2024-10-07 11:29:11.143936] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.088 [2024-10-07 11:29:11.143983] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.088 [2024-10-07 11:29:11.144162] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.088 [2024-10-07 11:29:11.144191] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.088 [2024-10-07 11:29:11.144207] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.088 [2024-10-07 11:29:11.144252] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.088 [2024-10-07 11:29:11.144274] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.088 [2024-10-07 11:29:11.144289] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.088 [2024-10-07 11:29:11.144453] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.088 [2024-10-07 11:29:11.144483] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.088 [2024-10-07 11:29:11.144593] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.088 [2024-10-07 11:29:11.144615] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.088 [2024-10-07 11:29:11.144629] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.088 [2024-10-07 11:29:11.144646] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.088 [2024-10-07 11:29:11.144660] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.088 [2024-10-07 11:29:11.144689] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.088 [2024-10-07 11:29:11.144801] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.088 [2024-10-07 11:29:11.144819] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.088 [2024-10-07 11:29:11.157917] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.088 [2024-10-07 11:29:11.158006] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.088 [2024-10-07 11:29:11.158107] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.088 [2024-10-07 11:29:11.158136] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.088 [2024-10-07 11:29:11.158153] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.088 [2024-10-07 11:29:11.158199] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.088 [2024-10-07 11:29:11.158222] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.088 [2024-10-07 11:29:11.158238] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.088 [2024-10-07 11:29:11.158276] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.088 [2024-10-07 11:29:11.158300] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.088 [2024-10-07 11:29:11.158320] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.088 [2024-10-07 11:29:11.158335] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.088 [2024-10-07 11:29:11.158348] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.088 [2024-10-07 11:29:11.158364] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.088 [2024-10-07 11:29:11.158378] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.088 [2024-10-07 11:29:11.158391] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.088 [2024-10-07 11:29:11.158414] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.088 [2024-10-07 11:29:11.158443] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.088 [2024-10-07 11:29:11.169772] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.088 [2024-10-07 11:29:11.169818] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.088 [2024-10-07 11:29:11.170017] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.088 [2024-10-07 11:29:11.170047] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.088 [2024-10-07 11:29:11.170064] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.088 [2024-10-07 11:29:11.170112] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.088 [2024-10-07 11:29:11.170134] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.088 [2024-10-07 11:29:11.170149] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.088 [2024-10-07 11:29:11.170262] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.088 [2024-10-07 11:29:11.170288] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.088 [2024-10-07 11:29:11.170707] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.088 [2024-10-07 11:29:11.170747] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.088 [2024-10-07 11:29:11.170764] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.088 [2024-10-07 11:29:11.170781] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.088 [2024-10-07 11:29:11.170810] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.088 [2024-10-07 11:29:11.170822] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.088 [2024-10-07 11:29:11.172762] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.088 [2024-10-07 11:29:11.172797] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.088 [2024-10-07 11:29:11.179895] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.088 [2024-10-07 11:29:11.180001] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.088 [2024-10-07 11:29:11.180073] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.088 [2024-10-07 11:29:11.180100] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.088 [2024-10-07 11:29:11.180117] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.088 [2024-10-07 11:29:11.182402] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.088 [2024-10-07 11:29:11.182458] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.088 [2024-10-07 11:29:11.182478] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.088 [2024-10-07 11:29:11.182497] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.088 [2024-10-07 11:29:11.183180] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.088 [2024-10-07 11:29:11.183219] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.088 [2024-10-07 11:29:11.183236] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.088 [2024-10-07 11:29:11.183249] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.088 [2024-10-07 11:29:11.183347] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.088 [2024-10-07 11:29:11.183369] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.088 [2024-10-07 11:29:11.183383] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.088 [2024-10-07 11:29:11.183396] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.088 [2024-10-07 11:29:11.183449] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.088 [2024-10-07 11:29:11.190019] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.088 [2024-10-07 11:29:11.190138] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.088 [2024-10-07 11:29:11.190167] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.088 [2024-10-07 11:29:11.190184] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.088 [2024-10-07 11:29:11.190221] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.088 [2024-10-07 11:29:11.190265] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.088 [2024-10-07 11:29:11.190295] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.088 [2024-10-07 11:29:11.190326] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.089 [2024-10-07 11:29:11.190339] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.089 [2024-10-07 11:29:11.190360] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.089 [2024-10-07 11:29:11.190444] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.089 [2024-10-07 11:29:11.190481] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.089 [2024-10-07 11:29:11.190500] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.089 [2024-10-07 11:29:11.190523] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.089 [2024-10-07 11:29:11.190544] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.089 [2024-10-07 11:29:11.190558] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.089 [2024-10-07 11:29:11.190571] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.089 [2024-10-07 11:29:11.190592] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.089 [2024-10-07 11:29:11.202838] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.089 [2024-10-07 11:29:11.202885] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.089 [2024-10-07 11:29:11.203014] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.089 [2024-10-07 11:29:11.203042] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.089 [2024-10-07 11:29:11.203058] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.089 [2024-10-07 11:29:11.203102] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.089 [2024-10-07 11:29:11.203124] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.089 [2024-10-07 11:29:11.203139] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.089 [2024-10-07 11:29:11.203388] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.089 [2024-10-07 11:29:11.203417] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.089 [2024-10-07 11:29:11.203552] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.089 [2024-10-07 11:29:11.203576] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.089 [2024-10-07 11:29:11.203591] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.089 [2024-10-07 11:29:11.203607] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.089 [2024-10-07 11:29:11.203621] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.089 [2024-10-07 11:29:11.203635] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.089 [2024-10-07 11:29:11.203685] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.089 [2024-10-07 11:29:11.203735] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.089 [2024-10-07 11:29:11.216620] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.089 [2024-10-07 11:29:11.216669] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.089 [2024-10-07 11:29:11.216753] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.089 [2024-10-07 11:29:11.216781] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.089 [2024-10-07 11:29:11.216798] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.089 [2024-10-07 11:29:11.216858] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.089 [2024-10-07 11:29:11.216880] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.089 [2024-10-07 11:29:11.216895] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.089 [2024-10-07 11:29:11.216918] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.089 [2024-10-07 11:29:11.216937] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.089 [2024-10-07 11:29:11.216957] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.089 [2024-10-07 11:29:11.216970] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.089 [2024-10-07 11:29:11.216984] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.089 [2024-10-07 11:29:11.217000] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.089 [2024-10-07 11:29:11.217013] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.089 [2024-10-07 11:29:11.217025] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.089 [2024-10-07 11:29:11.217047] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.089 [2024-10-07 11:29:11.217077] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.089 [2024-10-07 11:29:11.230801] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.089 [2024-10-07 11:29:11.230851] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.089 [2024-10-07 11:29:11.230935] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.089 [2024-10-07 11:29:11.230964] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.089 [2024-10-07 11:29:11.230996] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.089 [2024-10-07 11:29:11.231040] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.089 [2024-10-07 11:29:11.231079] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.089 [2024-10-07 11:29:11.231094] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.089 [2024-10-07 11:29:11.231118] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.089 [2024-10-07 11:29:11.231137] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.089 [2024-10-07 11:29:11.231157] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.089 [2024-10-07 11:29:11.231189] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.089 [2024-10-07 11:29:11.231205] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.089 [2024-10-07 11:29:11.231222] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.089 [2024-10-07 11:29:11.231236] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.089 [2024-10-07 11:29:11.231249] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.089 [2024-10-07 11:29:11.231272] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.089 [2024-10-07 11:29:11.231286] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.089 [2024-10-07 11:29:11.241169] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.089 [2024-10-07 11:29:11.241219] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.089 [2024-10-07 11:29:11.241394] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.089 [2024-10-07 11:29:11.241442] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.089 [2024-10-07 11:29:11.241461] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.089 [2024-10-07 11:29:11.241511] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.089 [2024-10-07 11:29:11.241534] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.089 [2024-10-07 11:29:11.241549] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.089 [2024-10-07 11:29:11.241655] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.089 [2024-10-07 11:29:11.241679] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.089 [2024-10-07 11:29:11.241786] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.089 [2024-10-07 11:29:11.241807] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.089 [2024-10-07 11:29:11.241821] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.089 [2024-10-07 11:29:11.241837] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.089 [2024-10-07 11:29:11.241852] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.089 [2024-10-07 11:29:11.241865] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.089 [2024-10-07 11:29:11.242570] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.089 [2024-10-07 11:29:11.242607] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.089 [2024-10-07 11:29:11.251278] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.089 [2024-10-07 11:29:11.251355] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.089 [2024-10-07 11:29:11.251470] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.089 [2024-10-07 11:29:11.251499] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.089 [2024-10-07 11:29:11.251514] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.089 [2024-10-07 11:29:11.251733] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.089 [2024-10-07 11:29:11.251776] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.089 [2024-10-07 11:29:11.251793] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.089 [2024-10-07 11:29:11.251811] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.089 [2024-10-07 11:29:11.251945] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.089 [2024-10-07 11:29:11.251971] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.089 [2024-10-07 11:29:11.251985] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.089 [2024-10-07 11:29:11.251998] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.089 [2024-10-07 11:29:11.252092] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.089 [2024-10-07 11:29:11.252110] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.089 [2024-10-07 11:29:11.252123] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.090 [2024-10-07 11:29:11.252136] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.090 [2024-10-07 11:29:11.252309] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.090 [2024-10-07 11:29:11.261562] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.090 [2024-10-07 11:29:11.261607] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.090 [2024-10-07 11:29:11.261704] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.090 [2024-10-07 11:29:11.261731] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.090 [2024-10-07 11:29:11.261747] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.090 [2024-10-07 11:29:11.261791] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.090 [2024-10-07 11:29:11.261812] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.090 [2024-10-07 11:29:11.261827] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.090 [2024-10-07 11:29:11.261849] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.090 [2024-10-07 11:29:11.261867] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.090 [2024-10-07 11:29:11.261886] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.090 [2024-10-07 11:29:11.261900] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.090 [2024-10-07 11:29:11.261913] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.090 [2024-10-07 11:29:11.261928] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.090 [2024-10-07 11:29:11.261941] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.090 [2024-10-07 11:29:11.261953] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.090 [2024-10-07 11:29:11.262003] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.090 [2024-10-07 11:29:11.262019] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.090 [2024-10-07 11:29:11.275101] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.090 [2024-10-07 11:29:11.275150] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.090 [2024-10-07 11:29:11.275251] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.090 [2024-10-07 11:29:11.275279] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.090 [2024-10-07 11:29:11.275296] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.090 [2024-10-07 11:29:11.275343] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.090 [2024-10-07 11:29:11.275366] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.090 [2024-10-07 11:29:11.275381] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.090 [2024-10-07 11:29:11.275887] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.090 [2024-10-07 11:29:11.275929] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.090 [2024-10-07 11:29:11.276157] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.090 [2024-10-07 11:29:11.276192] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.090 [2024-10-07 11:29:11.276209] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.090 [2024-10-07 11:29:11.276226] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.090 [2024-10-07 11:29:11.276241] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.090 [2024-10-07 11:29:11.276254] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.090 [2024-10-07 11:29:11.276742] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.090 [2024-10-07 11:29:11.276777] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.090 [2024-10-07 11:29:11.289158] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.090 [2024-10-07 11:29:11.289205] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.090 [2024-10-07 11:29:11.289303] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.090 [2024-10-07 11:29:11.289331] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.090 [2024-10-07 11:29:11.289347] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.090 [2024-10-07 11:29:11.289392] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.090 [2024-10-07 11:29:11.289414] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.090 [2024-10-07 11:29:11.289445] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.090 [2024-10-07 11:29:11.289470] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.090 [2024-10-07 11:29:11.289489] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.090 [2024-10-07 11:29:11.289509] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.090 [2024-10-07 11:29:11.289523] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.090 [2024-10-07 11:29:11.289555] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.090 [2024-10-07 11:29:11.289572] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.090 [2024-10-07 11:29:11.289586] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.090 [2024-10-07 11:29:11.289599] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.090 [2024-10-07 11:29:11.289621] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.090 [2024-10-07 11:29:11.289635] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.090 [2024-10-07 11:29:11.301809] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.090 [2024-10-07 11:29:11.301859] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.090 [2024-10-07 11:29:11.302000] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.090 [2024-10-07 11:29:11.302031] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.090 [2024-10-07 11:29:11.302048] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.090 [2024-10-07 11:29:11.302094] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.090 [2024-10-07 11:29:11.302117] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.090 [2024-10-07 11:29:11.302133] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.090 [2024-10-07 11:29:11.302157] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.090 [2024-10-07 11:29:11.302177] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.090 [2024-10-07 11:29:11.302212] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.090 [2024-10-07 11:29:11.302229] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.090 [2024-10-07 11:29:11.302244] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.090 [2024-10-07 11:29:11.302260] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.090 [2024-10-07 11:29:11.302274] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.090 [2024-10-07 11:29:11.302287] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.090 [2024-10-07 11:29:11.302310] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.090 [2024-10-07 11:29:11.302324] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.090 [2024-10-07 11:29:11.315799] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.090 [2024-10-07 11:29:11.315845] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.090 [2024-10-07 11:29:11.315939] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.090 [2024-10-07 11:29:11.315966] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.090 [2024-10-07 11:29:11.315982] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.090 [2024-10-07 11:29:11.316026] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.090 [2024-10-07 11:29:11.316047] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.090 [2024-10-07 11:29:11.316078] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.090 [2024-10-07 11:29:11.316102] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.090 [2024-10-07 11:29:11.316121] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.090 [2024-10-07 11:29:11.316140] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.090 [2024-10-07 11:29:11.316153] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.090 [2024-10-07 11:29:11.316166] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.090 [2024-10-07 11:29:11.316181] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.091 [2024-10-07 11:29:11.316195] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.091 [2024-10-07 11:29:11.316207] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.091 [2024-10-07 11:29:11.317142] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.091 [2024-10-07 11:29:11.317193] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.091 [2024-10-07 11:29:11.327188] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.091 [2024-10-07 11:29:11.327235] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.091 [2024-10-07 11:29:11.328580] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.091 [2024-10-07 11:29:11.328623] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.091 [2024-10-07 11:29:11.328642] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.091 [2024-10-07 11:29:11.328691] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.091 [2024-10-07 11:29:11.328714] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.091 [2024-10-07 11:29:11.328730] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.091 [2024-10-07 11:29:11.330458] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.091 [2024-10-07 11:29:11.330536] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.091 [2024-10-07 11:29:11.330793] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.091 [2024-10-07 11:29:11.330821] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.091 [2024-10-07 11:29:11.330835] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.091 [2024-10-07 11:29:11.330854] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.091 [2024-10-07 11:29:11.330868] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.091 [2024-10-07 11:29:11.330881] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.091 [2024-10-07 11:29:11.331104] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.091 [2024-10-07 11:29:11.331129] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.091 [2024-10-07 11:29:11.339023] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.091 [2024-10-07 11:29:11.339084] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.091 [2024-10-07 11:29:11.339184] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.091 [2024-10-07 11:29:11.339213] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.091 [2024-10-07 11:29:11.339229] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.091 [2024-10-07 11:29:11.339274] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.091 [2024-10-07 11:29:11.339296] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.091 [2024-10-07 11:29:11.339310] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.091 [2024-10-07 11:29:11.339333] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.091 [2024-10-07 11:29:11.339351] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.091 [2024-10-07 11:29:11.339371] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.091 [2024-10-07 11:29:11.339384] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.091 [2024-10-07 11:29:11.339397] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.091 [2024-10-07 11:29:11.339412] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.091 [2024-10-07 11:29:11.339438] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.091 [2024-10-07 11:29:11.339453] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.091 [2024-10-07 11:29:11.339476] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.091 [2024-10-07 11:29:11.339490] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.091 [2024-10-07 11:29:11.349158] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.091 [2024-10-07 11:29:11.349234] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.091 [2024-10-07 11:29:11.349307] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.091 [2024-10-07 11:29:11.349334] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.091 [2024-10-07 11:29:11.349350] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.091 [2024-10-07 11:29:11.349399] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.091 [2024-10-07 11:29:11.349421] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.091 [2024-10-07 11:29:11.349453] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.091 [2024-10-07 11:29:11.349471] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.091 [2024-10-07 11:29:11.349509] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.091 [2024-10-07 11:29:11.349529] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.091 [2024-10-07 11:29:11.349542] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.091 [2024-10-07 11:29:11.349555] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.091 [2024-10-07 11:29:11.349591] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.091 [2024-10-07 11:29:11.349607] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.091 [2024-10-07 11:29:11.349620] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.091 [2024-10-07 11:29:11.349632] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.091 [2024-10-07 11:29:11.349652] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.091 [2024-10-07 11:29:11.362014] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.091 [2024-10-07 11:29:11.362063] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.091 [2024-10-07 11:29:11.362555] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.091 [2024-10-07 11:29:11.362596] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.091 [2024-10-07 11:29:11.362615] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.091 [2024-10-07 11:29:11.362664] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.091 [2024-10-07 11:29:11.362686] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.091 [2024-10-07 11:29:11.362702] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.091 [2024-10-07 11:29:11.362925] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.091 [2024-10-07 11:29:11.362955] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.091 [2024-10-07 11:29:11.363005] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.091 [2024-10-07 11:29:11.363025] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.091 [2024-10-07 11:29:11.363039] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.091 [2024-10-07 11:29:11.363054] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.091 [2024-10-07 11:29:11.363068] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.091 [2024-10-07 11:29:11.363080] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.091 [2024-10-07 11:29:11.363102] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.091 [2024-10-07 11:29:11.363116] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.091 [2024-10-07 11:29:11.376398] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.091 [2024-10-07 11:29:11.376460] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.091 [2024-10-07 11:29:11.377436] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.091 [2024-10-07 11:29:11.377481] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.091 [2024-10-07 11:29:11.377500] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.091 [2024-10-07 11:29:11.377551] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.091 [2024-10-07 11:29:11.377574] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.091 [2024-10-07 11:29:11.377590] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.091 [2024-10-07 11:29:11.377736] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.091 [2024-10-07 11:29:11.377765] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.091 [2024-10-07 11:29:11.377786] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.091 [2024-10-07 11:29:11.377801] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.091 [2024-10-07 11:29:11.377815] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.091 [2024-10-07 11:29:11.377832] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.091 [2024-10-07 11:29:11.377862] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.091 [2024-10-07 11:29:11.377875] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.091 [2024-10-07 11:29:11.377897] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.091 [2024-10-07 11:29:11.377911] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.091 [2024-10-07 11:29:11.386992] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.091 [2024-10-07 11:29:11.387042] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.091 [2024-10-07 11:29:11.387126] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.091 [2024-10-07 11:29:11.387156] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.092 [2024-10-07 11:29:11.387174] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.092 [2024-10-07 11:29:11.387249] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.092 [2024-10-07 11:29:11.387274] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.092 [2024-10-07 11:29:11.387290] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.092 [2024-10-07 11:29:11.387315] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.092 [2024-10-07 11:29:11.387334] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.092 [2024-10-07 11:29:11.387354] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.092 [2024-10-07 11:29:11.387369] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.092 [2024-10-07 11:29:11.387382] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.092 [2024-10-07 11:29:11.387398] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.092 [2024-10-07 11:29:11.387429] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.092 [2024-10-07 11:29:11.387445] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.092 [2024-10-07 11:29:11.387469] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.092 [2024-10-07 11:29:11.387484] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.092 [2024-10-07 11:29:11.399367] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.092 [2024-10-07 11:29:11.399443] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.092 [2024-10-07 11:29:11.400011] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.092 [2024-10-07 11:29:11.400053] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.092 [2024-10-07 11:29:11.400072] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.092 [2024-10-07 11:29:11.400119] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.092 [2024-10-07 11:29:11.400142] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.092 [2024-10-07 11:29:11.400174] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.092 [2024-10-07 11:29:11.402405] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.092 [2024-10-07 11:29:11.402464] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.092 [2024-10-07 11:29:11.402730] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.092 [2024-10-07 11:29:11.402769] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.092 [2024-10-07 11:29:11.402786] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.092 [2024-10-07 11:29:11.402804] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.092 [2024-10-07 11:29:11.402819] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.092 [2024-10-07 11:29:11.402834] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.092 [2024-10-07 11:29:11.403040] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.092 [2024-10-07 11:29:11.403067] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.092 9024.83 IOPS, 35.25 MiB/s [2024-10-07T11:29:15.803Z] [2024-10-07 11:29:11.411531] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.092 [2024-10-07 11:29:11.411580] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.092 [2024-10-07 11:29:11.411891] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.092 [2024-10-07 11:29:11.411931] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.092 [2024-10-07 11:29:11.411950] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.092 [2024-10-07 11:29:11.411996] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.092 [2024-10-07 11:29:11.412018] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.092 [2024-10-07 11:29:11.412033] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.092 [2024-10-07 11:29:11.412084] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.092 [2024-10-07 11:29:11.412108] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.092 [2024-10-07 11:29:11.412128] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.092 [2024-10-07 11:29:11.412142] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.092 [2024-10-07 11:29:11.412155] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.092 [2024-10-07 11:29:11.412170] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.092 [2024-10-07 11:29:11.412199] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.092 [2024-10-07 11:29:11.412213] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.092 [2024-10-07 11:29:11.412236] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.092 [2024-10-07 11:29:11.412250] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.092 [2024-10-07 11:29:11.423404] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.092 [2024-10-07 11:29:11.423468] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.092 [2024-10-07 11:29:11.423555] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.092 [2024-10-07 11:29:11.423584] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.092 [2024-10-07 11:29:11.423601] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.092 [2024-10-07 11:29:11.423649] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.092 [2024-10-07 11:29:11.423687] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.092 [2024-10-07 11:29:11.423702] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.092 [2024-10-07 11:29:11.423725] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.092 [2024-10-07 11:29:11.423743] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.092 [2024-10-07 11:29:11.423763] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.092 [2024-10-07 11:29:11.423776] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.092 [2024-10-07 11:29:11.423789] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.092 [2024-10-07 11:29:11.423805] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.092 [2024-10-07 11:29:11.423818] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.092 [2024-10-07 11:29:11.423830] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.092 [2024-10-07 11:29:11.423851] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.092 [2024-10-07 11:29:11.423865] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.092 [2024-10-07 11:29:11.435265] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.092 [2024-10-07 11:29:11.435315] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.092 [2024-10-07 11:29:11.435400] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.092 [2024-10-07 11:29:11.435444] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.092 [2024-10-07 11:29:11.435462] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.092 [2024-10-07 11:29:11.435511] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.092 [2024-10-07 11:29:11.435534] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.092 [2024-10-07 11:29:11.435550] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.092 [2024-10-07 11:29:11.435573] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.092 [2024-10-07 11:29:11.435609] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.092 [2024-10-07 11:29:11.435631] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.092 [2024-10-07 11:29:11.435646] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.092 [2024-10-07 11:29:11.435660] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.092 [2024-10-07 11:29:11.435677] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.092 [2024-10-07 11:29:11.435691] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.092 [2024-10-07 11:29:11.435704] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.092 [2024-10-07 11:29:11.435865] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.092 [2024-10-07 11:29:11.435892] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.092 [2024-10-07 11:29:11.449335] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.092 [2024-10-07 11:29:11.449387] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.092 [2024-10-07 11:29:11.449684] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.092 [2024-10-07 11:29:11.449734] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.092 [2024-10-07 11:29:11.449754] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.092 [2024-10-07 11:29:11.449806] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.092 [2024-10-07 11:29:11.449830] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.092 [2024-10-07 11:29:11.449845] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.092 [2024-10-07 11:29:11.450082] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.092 [2024-10-07 11:29:11.450115] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.092 [2024-10-07 11:29:11.450178] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.093 [2024-10-07 11:29:11.450200] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.093 [2024-10-07 11:29:11.450215] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.093 [2024-10-07 11:29:11.450232] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.093 [2024-10-07 11:29:11.450246] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.093 [2024-10-07 11:29:11.450259] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.093 [2024-10-07 11:29:11.450283] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.093 [2024-10-07 11:29:11.450300] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.093 [2024-10-07 11:29:11.462563] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.093 [2024-10-07 11:29:11.462608] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.093 [2024-10-07 11:29:11.462705] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.093 [2024-10-07 11:29:11.462746] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.093 [2024-10-07 11:29:11.462764] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.093 [2024-10-07 11:29:11.462811] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.093 [2024-10-07 11:29:11.462833] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.093 [2024-10-07 11:29:11.462848] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.093 [2024-10-07 11:29:11.462871] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.093 [2024-10-07 11:29:11.462890] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.093 [2024-10-07 11:29:11.462908] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.093 [2024-10-07 11:29:11.462922] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.093 [2024-10-07 11:29:11.462934] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.093 [2024-10-07 11:29:11.462950] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.093 [2024-10-07 11:29:11.462963] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.093 [2024-10-07 11:29:11.462975] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.093 [2024-10-07 11:29:11.462997] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.093 [2024-10-07 11:29:11.463010] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.093 [2024-10-07 11:29:11.477241] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.093 [2024-10-07 11:29:11.477292] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.093 [2024-10-07 11:29:11.477390] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.093 [2024-10-07 11:29:11.477418] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.093 [2024-10-07 11:29:11.477449] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.093 [2024-10-07 11:29:11.477497] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.093 [2024-10-07 11:29:11.477519] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.093 [2024-10-07 11:29:11.477533] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.093 [2024-10-07 11:29:11.477556] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.093 [2024-10-07 11:29:11.477575] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.093 [2024-10-07 11:29:11.477593] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.093 [2024-10-07 11:29:11.477607] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.093 [2024-10-07 11:29:11.477620] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.093 [2024-10-07 11:29:11.477635] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.093 [2024-10-07 11:29:11.477648] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.093 [2024-10-07 11:29:11.477676] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.093 [2024-10-07 11:29:11.477700] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.093 [2024-10-07 11:29:11.477714] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.093 [2024-10-07 11:29:11.489312] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.093 [2024-10-07 11:29:11.489362] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.093 [2024-10-07 11:29:11.489460] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.093 [2024-10-07 11:29:11.489491] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.093 [2024-10-07 11:29:11.489508] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.093 [2024-10-07 11:29:11.489556] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.093 [2024-10-07 11:29:11.489579] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.093 [2024-10-07 11:29:11.489600] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.093 [2024-10-07 11:29:11.489623] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.093 [2024-10-07 11:29:11.489643] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.093 [2024-10-07 11:29:11.489663] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.093 [2024-10-07 11:29:11.489677] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.093 [2024-10-07 11:29:11.489691] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.093 [2024-10-07 11:29:11.489707] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.093 [2024-10-07 11:29:11.489721] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.093 [2024-10-07 11:29:11.489734] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.093 [2024-10-07 11:29:11.489757] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.093 [2024-10-07 11:29:11.489772] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.093 [2024-10-07 11:29:11.500946] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.093 [2024-10-07 11:29:11.500993] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.093 [2024-10-07 11:29:11.501282] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.093 [2024-10-07 11:29:11.501315] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.093 [2024-10-07 11:29:11.501332] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.093 [2024-10-07 11:29:11.501394] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.093 [2024-10-07 11:29:11.501416] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.093 [2024-10-07 11:29:11.501431] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.093 [2024-10-07 11:29:11.501641] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.093 [2024-10-07 11:29:11.501672] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.093 [2024-10-07 11:29:11.501895] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.093 [2024-10-07 11:29:11.501929] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.093 [2024-10-07 11:29:11.501945] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.093 [2024-10-07 11:29:11.501970] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.093 [2024-10-07 11:29:11.502003] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.093 [2024-10-07 11:29:11.502016] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.093 [2024-10-07 11:29:11.502076] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.093 [2024-10-07 11:29:11.502097] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.093 [2024-10-07 11:29:11.515159] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.093 [2024-10-07 11:29:11.515207] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.093 [2024-10-07 11:29:11.515547] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.093 [2024-10-07 11:29:11.515581] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.093 [2024-10-07 11:29:11.515599] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.093 [2024-10-07 11:29:11.515646] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.093 [2024-10-07 11:29:11.515670] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.093 [2024-10-07 11:29:11.515685] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.093 [2024-10-07 11:29:11.515765] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.093 [2024-10-07 11:29:11.515789] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.093 [2024-10-07 11:29:11.515808] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.093 [2024-10-07 11:29:11.515823] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.093 [2024-10-07 11:29:11.515835] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.093 [2024-10-07 11:29:11.515851] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.093 [2024-10-07 11:29:11.515865] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.093 [2024-10-07 11:29:11.515877] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.093 [2024-10-07 11:29:11.515899] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.093 [2024-10-07 11:29:11.515913] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.093 [2024-10-07 11:29:11.525830] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.094 [2024-10-07 11:29:11.525881] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.094 [2024-10-07 11:29:11.526016] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.094 [2024-10-07 11:29:11.526051] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.094 [2024-10-07 11:29:11.526101] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.094 [2024-10-07 11:29:11.526164] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.094 [2024-10-07 11:29:11.526189] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.094 [2024-10-07 11:29:11.526205] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.094 [2024-10-07 11:29:11.526231] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.094 [2024-10-07 11:29:11.526251] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.094 [2024-10-07 11:29:11.526272] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.094 [2024-10-07 11:29:11.526286] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.094 [2024-10-07 11:29:11.526300] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.094 [2024-10-07 11:29:11.526317] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.094 [2024-10-07 11:29:11.526332] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.094 [2024-10-07 11:29:11.526345] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.094 [2024-10-07 11:29:11.526368] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.094 [2024-10-07 11:29:11.526382] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.094 [2024-10-07 11:29:11.538134] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.094 [2024-10-07 11:29:11.538186] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.094 [2024-10-07 11:29:11.538326] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.094 [2024-10-07 11:29:11.538358] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.094 [2024-10-07 11:29:11.538376] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.094 [2024-10-07 11:29:11.538437] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.094 [2024-10-07 11:29:11.538463] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.094 [2024-10-07 11:29:11.538478] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.094 [2024-10-07 11:29:11.538522] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.094 [2024-10-07 11:29:11.538547] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.094 [2024-10-07 11:29:11.538568] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.094 [2024-10-07 11:29:11.538583] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.094 [2024-10-07 11:29:11.538597] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.094 [2024-10-07 11:29:11.538613] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.094 [2024-10-07 11:29:11.538627] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.094 [2024-10-07 11:29:11.538640] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.094 [2024-10-07 11:29:11.538681] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.094 [2024-10-07 11:29:11.538698] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.094 [2024-10-07 11:29:11.548506] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.094 [2024-10-07 11:29:11.548569] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.094 [2024-10-07 11:29:11.549231] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.094 [2024-10-07 11:29:11.549273] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.094 [2024-10-07 11:29:11.549308] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.094 [2024-10-07 11:29:11.549356] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.094 [2024-10-07 11:29:11.549378] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.094 [2024-10-07 11:29:11.549394] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.094 [2024-10-07 11:29:11.549553] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.094 [2024-10-07 11:29:11.549598] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.094 [2024-10-07 11:29:11.550418] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.094 [2024-10-07 11:29:11.550479] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.094 [2024-10-07 11:29:11.550515] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.094 [2024-10-07 11:29:11.550532] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.094 [2024-10-07 11:29:11.550547] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.094 [2024-10-07 11:29:11.550560] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.094 [2024-10-07 11:29:11.553509] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.094 [2024-10-07 11:29:11.553549] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.094 [2024-10-07 11:29:11.558652] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.094 [2024-10-07 11:29:11.558716] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.094 [2024-10-07 11:29:11.558793] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.094 [2024-10-07 11:29:11.558821] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.094 [2024-10-07 11:29:11.558838] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.094 [2024-10-07 11:29:11.558891] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.094 [2024-10-07 11:29:11.558915] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.094 [2024-10-07 11:29:11.558931] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.094 [2024-10-07 11:29:11.558949] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.094 [2024-10-07 11:29:11.558973] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.094 [2024-10-07 11:29:11.558996] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.094 [2024-10-07 11:29:11.559028] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.094 [2024-10-07 11:29:11.559043] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.094 [2024-10-07 11:29:11.559067] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.094 [2024-10-07 11:29:11.559082] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.094 [2024-10-07 11:29:11.559096] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.094 [2024-10-07 11:29:11.559110] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.094 [2024-10-07 11:29:11.559142] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.094 [2024-10-07 11:29:11.572095] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.094 [2024-10-07 11:29:11.572143] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.094 [2024-10-07 11:29:11.572473] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.094 [2024-10-07 11:29:11.572506] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.094 [2024-10-07 11:29:11.572523] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.094 [2024-10-07 11:29:11.572568] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.094 [2024-10-07 11:29:11.572590] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.094 [2024-10-07 11:29:11.572605] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.094 [2024-10-07 11:29:11.572656] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.094 [2024-10-07 11:29:11.572681] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.094 [2024-10-07 11:29:11.572701] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.094 [2024-10-07 11:29:11.572715] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.094 [2024-10-07 11:29:11.572728] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.094 [2024-10-07 11:29:11.572744] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.094 [2024-10-07 11:29:11.572757] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.094 [2024-10-07 11:29:11.572770] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.094 [2024-10-07 11:29:11.572792] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.094 [2024-10-07 11:29:11.572805] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.094 [2024-10-07 11:29:11.584149] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.094 [2024-10-07 11:29:11.584197] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.094 [2024-10-07 11:29:11.584406] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.094 [2024-10-07 11:29:11.584436] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.094 [2024-10-07 11:29:11.584470] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.094 [2024-10-07 11:29:11.584539] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.094 [2024-10-07 11:29:11.584564] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.094 [2024-10-07 11:29:11.584580] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.094 [2024-10-07 11:29:11.584693] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.095 [2024-10-07 11:29:11.584734] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.095 [2024-10-07 11:29:11.584824] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.095 [2024-10-07 11:29:11.584842] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.095 [2024-10-07 11:29:11.584856] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.095 [2024-10-07 11:29:11.584871] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.095 [2024-10-07 11:29:11.584885] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.095 [2024-10-07 11:29:11.584897] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.095 [2024-10-07 11:29:11.586180] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.095 [2024-10-07 11:29:11.586218] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.095 [2024-10-07 11:29:11.594838] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.095 [2024-10-07 11:29:11.594888] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.095 [2024-10-07 11:29:11.595675] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.095 [2024-10-07 11:29:11.595719] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.095 [2024-10-07 11:29:11.595739] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.095 [2024-10-07 11:29:11.595789] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.095 [2024-10-07 11:29:11.595812] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.095 [2024-10-07 11:29:11.595827] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.095 [2024-10-07 11:29:11.596018] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.095 [2024-10-07 11:29:11.596049] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.095 [2024-10-07 11:29:11.599984] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.095 [2024-10-07 11:29:11.600028] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.095 [2024-10-07 11:29:11.600048] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.095 [2024-10-07 11:29:11.600076] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.095 [2024-10-07 11:29:11.600095] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.095 [2024-10-07 11:29:11.600109] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.095 [2024-10-07 11:29:11.600310] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.095 [2024-10-07 11:29:11.600351] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.095 [2024-10-07 11:29:11.605307] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.095 [2024-10-07 11:29:11.605356] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.095 [2024-10-07 11:29:11.605534] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.095 [2024-10-07 11:29:11.605566] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.095 [2024-10-07 11:29:11.605583] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.095 [2024-10-07 11:29:11.605630] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.095 [2024-10-07 11:29:11.605653] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.095 [2024-10-07 11:29:11.605668] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.095 [2024-10-07 11:29:11.605780] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.095 [2024-10-07 11:29:11.605808] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.095 [2024-10-07 11:29:11.605889] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.095 [2024-10-07 11:29:11.605908] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.095 [2024-10-07 11:29:11.605922] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.095 [2024-10-07 11:29:11.605939] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.095 [2024-10-07 11:29:11.605953] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.095 [2024-10-07 11:29:11.605981] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.095 [2024-10-07 11:29:11.608621] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.095 [2024-10-07 11:29:11.608658] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.095 [2024-10-07 11:29:11.615418] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.095 [2024-10-07 11:29:11.615509] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.095 [2024-10-07 11:29:11.615595] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.095 [2024-10-07 11:29:11.615623] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.095 [2024-10-07 11:29:11.615640] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.095 [2024-10-07 11:29:11.615695] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.095 [2024-10-07 11:29:11.615718] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.095 [2024-10-07 11:29:11.615734] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.095 [2024-10-07 11:29:11.615752] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.095 [2024-10-07 11:29:11.615776] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.095 [2024-10-07 11:29:11.615793] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.095 [2024-10-07 11:29:11.615806] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.095 [2024-10-07 11:29:11.615838] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.095 [2024-10-07 11:29:11.615864] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.095 [2024-10-07 11:29:11.615880] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.095 [2024-10-07 11:29:11.615893] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.095 [2024-10-07 11:29:11.615907] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.095 [2024-10-07 11:29:11.615927] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.095 [2024-10-07 11:29:11.628132] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.095 [2024-10-07 11:29:11.628182] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.095 [2024-10-07 11:29:11.628283] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.095 [2024-10-07 11:29:11.628312] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.095 [2024-10-07 11:29:11.628329] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.095 [2024-10-07 11:29:11.628376] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.095 [2024-10-07 11:29:11.628398] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.095 [2024-10-07 11:29:11.628414] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.095 [2024-10-07 11:29:11.628452] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.096 [2024-10-07 11:29:11.628474] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.096 [2024-10-07 11:29:11.628494] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.096 [2024-10-07 11:29:11.628509] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.096 [2024-10-07 11:29:11.628522] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.096 [2024-10-07 11:29:11.628539] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.096 [2024-10-07 11:29:11.628553] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.096 [2024-10-07 11:29:11.628566] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.096 [2024-10-07 11:29:11.628589] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.096 [2024-10-07 11:29:11.628603] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.096 [2024-10-07 11:29:11.642204] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.096 [2024-10-07 11:29:11.642254] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.096 [2024-10-07 11:29:11.642591] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.096 [2024-10-07 11:29:11.642634] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.096 [2024-10-07 11:29:11.642653] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.096 [2024-10-07 11:29:11.642703] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.096 [2024-10-07 11:29:11.642726] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.096 [2024-10-07 11:29:11.642756] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.096 [2024-10-07 11:29:11.642812] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.096 [2024-10-07 11:29:11.642838] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.096 [2024-10-07 11:29:11.642859] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.096 [2024-10-07 11:29:11.642874] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.096 [2024-10-07 11:29:11.642888] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.096 [2024-10-07 11:29:11.642905] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.096 [2024-10-07 11:29:11.642919] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.096 [2024-10-07 11:29:11.642932] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.096 [2024-10-07 11:29:11.642956] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.096 [2024-10-07 11:29:11.642970] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.096 [2024-10-07 11:29:11.655621] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.096 [2024-10-07 11:29:11.655671] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.096 [2024-10-07 11:29:11.655756] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.096 [2024-10-07 11:29:11.655785] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.096 [2024-10-07 11:29:11.655802] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.096 [2024-10-07 11:29:11.655864] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.096 [2024-10-07 11:29:11.655886] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.096 [2024-10-07 11:29:11.655901] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.096 [2024-10-07 11:29:11.655924] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.096 [2024-10-07 11:29:11.655943] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.096 [2024-10-07 11:29:11.655962] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.096 [2024-10-07 11:29:11.655976] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.096 [2024-10-07 11:29:11.655989] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.096 [2024-10-07 11:29:11.656005] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.096 [2024-10-07 11:29:11.656019] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.096 [2024-10-07 11:29:11.656031] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.096 [2024-10-07 11:29:11.656062] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.096 [2024-10-07 11:29:11.656076] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.096 [2024-10-07 11:29:11.669619] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.096 [2024-10-07 11:29:11.669683] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.096 [2024-10-07 11:29:11.670010] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.096 [2024-10-07 11:29:11.670055] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.096 [2024-10-07 11:29:11.670074] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.096 [2024-10-07 11:29:11.670125] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.096 [2024-10-07 11:29:11.670148] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.096 [2024-10-07 11:29:11.670164] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.096 [2024-10-07 11:29:11.670297] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.096 [2024-10-07 11:29:11.670342] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.096 [2024-10-07 11:29:11.670461] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.096 [2024-10-07 11:29:11.670483] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.096 [2024-10-07 11:29:11.670498] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.096 [2024-10-07 11:29:11.670515] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.096 [2024-10-07 11:29:11.670529] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.096 [2024-10-07 11:29:11.670543] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.096 [2024-10-07 11:29:11.671004] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.096 [2024-10-07 11:29:11.671038] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.096 [2024-10-07 11:29:11.680637] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.096 [2024-10-07 11:29:11.680690] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.096 [2024-10-07 11:29:11.680891] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.096 [2024-10-07 11:29:11.680923] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.096 [2024-10-07 11:29:11.680941] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.096 [2024-10-07 11:29:11.680987] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.096 [2024-10-07 11:29:11.681011] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.096 [2024-10-07 11:29:11.681027] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.096 [2024-10-07 11:29:11.681139] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.096 [2024-10-07 11:29:11.681165] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.096 [2024-10-07 11:29:11.681262] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.096 [2024-10-07 11:29:11.681281] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.096 [2024-10-07 11:29:11.681296] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.096 [2024-10-07 11:29:11.681331] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.096 [2024-10-07 11:29:11.681348] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.096 [2024-10-07 11:29:11.681361] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.096 [2024-10-07 11:29:11.682584] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.096 [2024-10-07 11:29:11.682624] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.096 [2024-10-07 11:29:11.692858] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.096 [2024-10-07 11:29:11.695057] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.096 [2024-10-07 11:29:11.695160] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.096 [2024-10-07 11:29:11.695190] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.096 [2024-10-07 11:29:11.695207] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.096 [2024-10-07 11:29:11.695522] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.096 [2024-10-07 11:29:11.695577] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.096 [2024-10-07 11:29:11.695600] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.096 [2024-10-07 11:29:11.695630] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.096 [2024-10-07 11:29:11.695701] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.096 [2024-10-07 11:29:11.695726] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.096 [2024-10-07 11:29:11.695741] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.096 [2024-10-07 11:29:11.695755] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.096 [2024-10-07 11:29:11.695780] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.096 [2024-10-07 11:29:11.695796] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.096 [2024-10-07 11:29:11.695809] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.096 [2024-10-07 11:29:11.695822] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.097 [2024-10-07 11:29:11.696044] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.097 [2024-10-07 11:29:11.704680] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.097 [2024-10-07 11:29:11.704858] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.097 [2024-10-07 11:29:11.704889] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.097 [2024-10-07 11:29:11.704906] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.097 [2024-10-07 11:29:11.704929] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.097 [2024-10-07 11:29:11.704950] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.097 [2024-10-07 11:29:11.704964] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.097 [2024-10-07 11:29:11.704993] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.097 [2024-10-07 11:29:11.705034] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.097 [2024-10-07 11:29:11.705133] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.097 [2024-10-07 11:29:11.705205] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.097 [2024-10-07 11:29:11.705231] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.097 [2024-10-07 11:29:11.705248] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.097 [2024-10-07 11:29:11.705271] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.097 [2024-10-07 11:29:11.705292] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.097 [2024-10-07 11:29:11.705306] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.097 [2024-10-07 11:29:11.705320] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.097 [2024-10-07 11:29:11.705341] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.097 [2024-10-07 11:29:11.715529] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.097 [2024-10-07 11:29:11.715675] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.097 [2024-10-07 11:29:11.715759] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.097 [2024-10-07 11:29:11.715787] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.097 [2024-10-07 11:29:11.715804] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.097 [2024-10-07 11:29:11.715857] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.097 [2024-10-07 11:29:11.715880] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.097 [2024-10-07 11:29:11.715896] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.097 [2024-10-07 11:29:11.715914] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.097 [2024-10-07 11:29:11.715938] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.097 [2024-10-07 11:29:11.715955] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.097 [2024-10-07 11:29:11.715969] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.097 [2024-10-07 11:29:11.715983] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.097 [2024-10-07 11:29:11.716006] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.097 [2024-10-07 11:29:11.716021] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.097 [2024-10-07 11:29:11.716034] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.097 [2024-10-07 11:29:11.716047] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.097 [2024-10-07 11:29:11.716069] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.097 [2024-10-07 11:29:11.725606] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.097 [2024-10-07 11:29:11.725724] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.097 [2024-10-07 11:29:11.725770] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.097 [2024-10-07 11:29:11.725789] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.097 [2024-10-07 11:29:11.725813] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.097 [2024-10-07 11:29:11.725848] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.097 [2024-10-07 11:29:11.725865] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.097 [2024-10-07 11:29:11.725878] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.097 [2024-10-07 11:29:11.725902] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.097 [2024-10-07 11:29:11.725920] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.097 [2024-10-07 11:29:11.726011] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.097 [2024-10-07 11:29:11.726048] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.097 [2024-10-07 11:29:11.726064] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.097 [2024-10-07 11:29:11.726086] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.097 [2024-10-07 11:29:11.726108] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.097 [2024-10-07 11:29:11.726124] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.097 [2024-10-07 11:29:11.726137] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.097 [2024-10-07 11:29:11.726167] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.097 [2024-10-07 11:29:11.736279] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.097 [2024-10-07 11:29:11.736390] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.097 [2024-10-07 11:29:11.736483] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.097 [2024-10-07 11:29:11.736513] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.097 [2024-10-07 11:29:11.736530] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.097 [2024-10-07 11:29:11.736584] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.097 [2024-10-07 11:29:11.736608] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.097 [2024-10-07 11:29:11.736624] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.097 [2024-10-07 11:29:11.736642] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.097 [2024-10-07 11:29:11.736666] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.097 [2024-10-07 11:29:11.736683] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.097 [2024-10-07 11:29:11.736696] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.097 [2024-10-07 11:29:11.736710] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.097 [2024-10-07 11:29:11.736733] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.097 [2024-10-07 11:29:11.736763] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.097 [2024-10-07 11:29:11.736778] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.097 [2024-10-07 11:29:11.736791] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.097 [2024-10-07 11:29:11.736812] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.097 [2024-10-07 11:29:11.748903] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.097 [2024-10-07 11:29:11.748968] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.097 [2024-10-07 11:29:11.749268] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.097 [2024-10-07 11:29:11.749311] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.097 [2024-10-07 11:29:11.749330] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.097 [2024-10-07 11:29:11.749379] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.097 [2024-10-07 11:29:11.749402] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.097 [2024-10-07 11:29:11.749432] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.097 [2024-10-07 11:29:11.749502] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.097 [2024-10-07 11:29:11.749530] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.097 [2024-10-07 11:29:11.749566] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.097 [2024-10-07 11:29:11.749584] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.097 [2024-10-07 11:29:11.749598] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.097 [2024-10-07 11:29:11.749615] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.097 [2024-10-07 11:29:11.749630] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.097 [2024-10-07 11:29:11.749643] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.097 [2024-10-07 11:29:11.749666] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.097 [2024-10-07 11:29:11.749680] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.097 [2024-10-07 11:29:11.760204] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.097 [2024-10-07 11:29:11.760252] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.097 [2024-10-07 11:29:11.760464] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.097 [2024-10-07 11:29:11.760494] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.097 [2024-10-07 11:29:11.760511] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.097 [2024-10-07 11:29:11.760557] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.097 [2024-10-07 11:29:11.760595] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.098 [2024-10-07 11:29:11.760611] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.098 [2024-10-07 11:29:11.760716] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.098 [2024-10-07 11:29:11.760773] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.098 [2024-10-07 11:29:11.760889] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.098 [2024-10-07 11:29:11.760909] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.098 [2024-10-07 11:29:11.760923] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.098 [2024-10-07 11:29:11.760940] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.098 [2024-10-07 11:29:11.760954] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.098 [2024-10-07 11:29:11.760967] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.098 [2024-10-07 11:29:11.761067] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.098 [2024-10-07 11:29:11.761085] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.098 [2024-10-07 11:29:11.770345] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.098 [2024-10-07 11:29:11.770419] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.098 [2024-10-07 11:29:11.770517] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.098 [2024-10-07 11:29:11.770561] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.098 [2024-10-07 11:29:11.770578] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.098 [2024-10-07 11:29:11.770777] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.098 [2024-10-07 11:29:11.770808] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.098 [2024-10-07 11:29:11.770825] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.098 [2024-10-07 11:29:11.770843] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.098 [2024-10-07 11:29:11.770983] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.098 [2024-10-07 11:29:11.771018] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.098 [2024-10-07 11:29:11.771040] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.098 [2024-10-07 11:29:11.771058] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.098 [2024-10-07 11:29:11.771162] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.098 [2024-10-07 11:29:11.771181] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.098 [2024-10-07 11:29:11.771195] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.098 [2024-10-07 11:29:11.771209] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.098 [2024-10-07 11:29:11.771334] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.098 [2024-10-07 11:29:11.780452] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.098 [2024-10-07 11:29:11.780569] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.098 [2024-10-07 11:29:11.780601] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.098 [2024-10-07 11:29:11.780633] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.098 [2024-10-07 11:29:11.780673] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.098 [2024-10-07 11:29:11.781893] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.098 [2024-10-07 11:29:11.781946] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.098 [2024-10-07 11:29:11.781975] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.098 [2024-10-07 11:29:11.781991] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.098 [2024-10-07 11:29:11.782283] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.098 [2024-10-07 11:29:11.782356] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.098 [2024-10-07 11:29:11.782382] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.098 [2024-10-07 11:29:11.782399] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.098 [2024-10-07 11:29:11.782462] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.098 [2024-10-07 11:29:11.782491] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.098 [2024-10-07 11:29:11.782508] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.098 [2024-10-07 11:29:11.782521] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.098 [2024-10-07 11:29:11.782544] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.098 [2024-10-07 11:29:11.793326] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.098 [2024-10-07 11:29:11.793466] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.098 [2024-10-07 11:29:11.793548] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.098 [2024-10-07 11:29:11.793575] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.098 [2024-10-07 11:29:11.793592] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.098 [2024-10-07 11:29:11.793880] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.098 [2024-10-07 11:29:11.793921] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.098 [2024-10-07 11:29:11.793940] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.098 [2024-10-07 11:29:11.793959] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.098 [2024-10-07 11:29:11.794121] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.098 [2024-10-07 11:29:11.794147] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.098 [2024-10-07 11:29:11.794162] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.098 [2024-10-07 11:29:11.794176] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.098 [2024-10-07 11:29:11.794277] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.098 [2024-10-07 11:29:11.794296] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.098 [2024-10-07 11:29:11.794327] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.098 [2024-10-07 11:29:11.794342] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.098 [2024-10-07 11:29:11.794478] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.098 [2024-10-07 11:29:11.806195] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.098 [2024-10-07 11:29:11.806247] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.098 [2024-10-07 11:29:11.808634] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.098 [2024-10-07 11:29:11.808678] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.098 [2024-10-07 11:29:11.808697] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.098 [2024-10-07 11:29:11.808746] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.098 [2024-10-07 11:29:11.808770] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.098 [2024-10-07 11:29:11.808785] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.098 [2024-10-07 11:29:11.809063] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.098 [2024-10-07 11:29:11.809095] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.098 [2024-10-07 11:29:11.809144] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.098 [2024-10-07 11:29:11.809165] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.098 [2024-10-07 11:29:11.809179] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.098 [2024-10-07 11:29:11.809196] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.098 [2024-10-07 11:29:11.809211] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.098 [2024-10-07 11:29:11.809224] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.098 [2024-10-07 11:29:11.809373] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.098 [2024-10-07 11:29:11.809398] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.098 [2024-10-07 11:29:11.816311] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.098 [2024-10-07 11:29:11.816374] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.098 [2024-10-07 11:29:11.816470] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.098 [2024-10-07 11:29:11.816500] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.098 [2024-10-07 11:29:11.816524] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.098 [2024-10-07 11:29:11.816591] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.098 [2024-10-07 11:29:11.816622] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.098 [2024-10-07 11:29:11.816648] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.098 [2024-10-07 11:29:11.816666] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.098 [2024-10-07 11:29:11.816690] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.098 [2024-10-07 11:29:11.816727] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.098 [2024-10-07 11:29:11.816742] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.098 [2024-10-07 11:29:11.816756] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.098 [2024-10-07 11:29:11.816780] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.099 [2024-10-07 11:29:11.816795] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.099 [2024-10-07 11:29:11.816808] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.099 [2024-10-07 11:29:11.816823] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.099 [2024-10-07 11:29:11.816843] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.099 [2024-10-07 11:29:11.830116] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.099 [2024-10-07 11:29:11.830166] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.099 [2024-10-07 11:29:11.830252] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.099 [2024-10-07 11:29:11.830280] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.099 [2024-10-07 11:29:11.830297] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.099 [2024-10-07 11:29:11.830344] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.099 [2024-10-07 11:29:11.830366] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.099 [2024-10-07 11:29:11.830397] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.099 [2024-10-07 11:29:11.830436] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.099 [2024-10-07 11:29:11.830474] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.099 [2024-10-07 11:29:11.830496] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.099 [2024-10-07 11:29:11.830511] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.099 [2024-10-07 11:29:11.830524] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.099 [2024-10-07 11:29:11.830541] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.099 [2024-10-07 11:29:11.830555] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.099 [2024-10-07 11:29:11.830568] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.099 [2024-10-07 11:29:11.830591] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.099 [2024-10-07 11:29:11.830605] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.099 [2024-10-07 11:29:11.841640] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.099 [2024-10-07 11:29:11.841692] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.099 [2024-10-07 11:29:11.841890] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.099 [2024-10-07 11:29:11.841922] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.099 [2024-10-07 11:29:11.841956] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.099 [2024-10-07 11:29:11.842021] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.099 [2024-10-07 11:29:11.842045] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.099 [2024-10-07 11:29:11.842061] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.099 [2024-10-07 11:29:11.842203] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.099 [2024-10-07 11:29:11.842233] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.099 [2024-10-07 11:29:11.842369] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.099 [2024-10-07 11:29:11.842393] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.099 [2024-10-07 11:29:11.842408] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.099 [2024-10-07 11:29:11.842442] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.099 [2024-10-07 11:29:11.842457] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.099 [2024-10-07 11:29:11.842471] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.099 [2024-10-07 11:29:11.842890] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.099 [2024-10-07 11:29:11.842924] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.099 [2024-10-07 11:29:11.851755] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.099 [2024-10-07 11:29:11.851819] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.099 [2024-10-07 11:29:11.851895] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.099 [2024-10-07 11:29:11.851923] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.099 [2024-10-07 11:29:11.851940] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.099 [2024-10-07 11:29:11.851994] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.099 [2024-10-07 11:29:11.852017] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.099 [2024-10-07 11:29:11.852033] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.099 [2024-10-07 11:29:11.852051] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.099 [2024-10-07 11:29:11.852075] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.099 [2024-10-07 11:29:11.852092] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.099 [2024-10-07 11:29:11.852106] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.099 [2024-10-07 11:29:11.852119] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.099 [2024-10-07 11:29:11.852142] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.099 [2024-10-07 11:29:11.852156] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.099 [2024-10-07 11:29:11.852169] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.099 [2024-10-07 11:29:11.852203] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.099 [2024-10-07 11:29:11.852226] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.099 [2024-10-07 11:29:11.861851] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.099 [2024-10-07 11:29:11.862010] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.099 [2024-10-07 11:29:11.862042] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.099 [2024-10-07 11:29:11.862061] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.099 [2024-10-07 11:29:11.862086] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.099 [2024-10-07 11:29:11.862117] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.099 [2024-10-07 11:29:11.862179] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.099 [2024-10-07 11:29:11.862204] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.099 [2024-10-07 11:29:11.862219] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.099 [2024-10-07 11:29:11.862234] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.099 [2024-10-07 11:29:11.862247] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.099 [2024-10-07 11:29:11.862261] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.099 [2024-10-07 11:29:11.862283] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.099 [2024-10-07 11:29:11.862301] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.099 [2024-10-07 11:29:11.862337] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.099 [2024-10-07 11:29:11.862350] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.099 [2024-10-07 11:29:11.862363] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.099 [2024-10-07 11:29:11.862383] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.099 [2024-10-07 11:29:11.872288] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.099 [2024-10-07 11:29:11.872483] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.099 [2024-10-07 11:29:11.872574] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.099 [2024-10-07 11:29:11.872603] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.099 [2024-10-07 11:29:11.872620] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.099 [2024-10-07 11:29:11.872788] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.099 [2024-10-07 11:29:11.872816] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.099 [2024-10-07 11:29:11.872833] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.099 [2024-10-07 11:29:11.872851] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.099 [2024-10-07 11:29:11.872980] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.099 [2024-10-07 11:29:11.873006] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.099 [2024-10-07 11:29:11.873038] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.100 [2024-10-07 11:29:11.873053] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.100 [2024-10-07 11:29:11.873193] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.100 [2024-10-07 11:29:11.873226] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.100 [2024-10-07 11:29:11.873245] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.100 [2024-10-07 11:29:11.873259] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.100 [2024-10-07 11:29:11.873373] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.100 [2024-10-07 11:29:11.882766] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.100 [2024-10-07 11:29:11.882835] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.100 [2024-10-07 11:29:11.882914] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.100 [2024-10-07 11:29:11.882942] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.100 [2024-10-07 11:29:11.882959] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.100 [2024-10-07 11:29:11.883012] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.100 [2024-10-07 11:29:11.883036] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.100 [2024-10-07 11:29:11.883052] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.100 [2024-10-07 11:29:11.883070] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.100 [2024-10-07 11:29:11.883124] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.100 [2024-10-07 11:29:11.883140] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.100 [2024-10-07 11:29:11.883153] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.100 [2024-10-07 11:29:11.883165] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.100 [2024-10-07 11:29:11.883186] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.100 [2024-10-07 11:29:11.883200] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.100 [2024-10-07 11:29:11.883213] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.100 [2024-10-07 11:29:11.883225] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.100 [2024-10-07 11:29:11.883244] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.100 [2024-10-07 11:29:11.893871] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.100 [2024-10-07 11:29:11.893918] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.100 [2024-10-07 11:29:11.894182] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.100 [2024-10-07 11:29:11.894214] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.100 [2024-10-07 11:29:11.894232] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.100 [2024-10-07 11:29:11.894298] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.100 [2024-10-07 11:29:11.894338] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.100 [2024-10-07 11:29:11.894353] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.100 [2024-10-07 11:29:11.894473] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.100 [2024-10-07 11:29:11.894500] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.100 [2024-10-07 11:29:11.894613] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.100 [2024-10-07 11:29:11.894632] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.100 [2024-10-07 11:29:11.894646] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.100 [2024-10-07 11:29:11.894662] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.100 [2024-10-07 11:29:11.894675] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.100 [2024-10-07 11:29:11.894707] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.100 [2024-10-07 11:29:11.894830] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.100 [2024-10-07 11:29:11.894851] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.100 [2024-10-07 11:29:11.904327] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.100 [2024-10-07 11:29:11.904377] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.100 [2024-10-07 11:29:11.904556] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.100 [2024-10-07 11:29:11.904587] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.100 [2024-10-07 11:29:11.904603] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.100 [2024-10-07 11:29:11.904650] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.100 [2024-10-07 11:29:11.904672] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.100 [2024-10-07 11:29:11.904688] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.100 [2024-10-07 11:29:11.904803] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.100 [2024-10-07 11:29:11.904826] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.100 [2024-10-07 11:29:11.904934] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.100 [2024-10-07 11:29:11.904951] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.100 [2024-10-07 11:29:11.904964] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.100 [2024-10-07 11:29:11.904980] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.100 [2024-10-07 11:29:11.904993] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.100 [2024-10-07 11:29:11.905006] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.100 [2024-10-07 11:29:11.905038] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.100 [2024-10-07 11:29:11.905068] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.100 [2024-10-07 11:29:11.914436] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.100 [2024-10-07 11:29:11.914562] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.100 [2024-10-07 11:29:11.914591] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.100 [2024-10-07 11:29:11.914608] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.100 [2024-10-07 11:29:11.916182] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.100 [2024-10-07 11:29:11.916252] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.100 [2024-10-07 11:29:11.916963] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.100 [2024-10-07 11:29:11.917002] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.100 [2024-10-07 11:29:11.917036] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.100 [2024-10-07 11:29:11.917051] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.100 [2024-10-07 11:29:11.917063] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.100 [2024-10-07 11:29:11.917076] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.100 [2024-10-07 11:29:11.917334] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.100 [2024-10-07 11:29:11.917377] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.100 [2024-10-07 11:29:11.917512] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.100 [2024-10-07 11:29:11.917536] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.100 [2024-10-07 11:29:11.917551] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.100 [2024-10-07 11:29:11.917714] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.100 [2024-10-07 11:29:11.925604] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.100 [2024-10-07 11:29:11.927348] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.100 [2024-10-07 11:29:11.927393] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.100 [2024-10-07 11:29:11.927437] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.100 [2024-10-07 11:29:11.928061] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.100 [2024-10-07 11:29:11.928327] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.100 [2024-10-07 11:29:11.928376] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.100 [2024-10-07 11:29:11.928395] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.100 [2024-10-07 11:29:11.928421] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.100 [2024-10-07 11:29:11.928499] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.100 [2024-10-07 11:29:11.928575] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.100 [2024-10-07 11:29:11.928602] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.100 [2024-10-07 11:29:11.928636] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.100 [2024-10-07 11:29:11.928662] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.100 [2024-10-07 11:29:11.928685] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.100 [2024-10-07 11:29:11.928699] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.100 [2024-10-07 11:29:11.928713] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.100 [2024-10-07 11:29:11.928736] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.100 [2024-10-07 11:29:11.938388] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.100 [2024-10-07 11:29:11.938906] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.100 [2024-10-07 11:29:11.938949] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.101 [2024-10-07 11:29:11.938968] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.101 [2024-10-07 11:29:11.939020] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.101 [2024-10-07 11:29:11.939054] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.101 [2024-10-07 11:29:11.939115] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.101 [2024-10-07 11:29:11.939139] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.101 [2024-10-07 11:29:11.939154] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.101 [2024-10-07 11:29:11.939168] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.101 [2024-10-07 11:29:11.939180] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.101 [2024-10-07 11:29:11.939193] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.101 [2024-10-07 11:29:11.939215] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.101 [2024-10-07 11:29:11.939232] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.101 [2024-10-07 11:29:11.939253] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.101 [2024-10-07 11:29:11.939266] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.101 [2024-10-07 11:29:11.939279] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.101 [2024-10-07 11:29:11.939298] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.101 [2024-10-07 11:29:11.951965] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.101 [2024-10-07 11:29:11.952030] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.101 [2024-10-07 11:29:11.952130] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.101 [2024-10-07 11:29:11.952160] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.101 [2024-10-07 11:29:11.952177] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.101 [2024-10-07 11:29:11.952224] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.101 [2024-10-07 11:29:11.952264] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.101 [2024-10-07 11:29:11.952282] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.101 [2024-10-07 11:29:11.952307] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.101 [2024-10-07 11:29:11.952327] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.101 [2024-10-07 11:29:11.952347] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.101 [2024-10-07 11:29:11.952361] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.101 [2024-10-07 11:29:11.952374] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.101 [2024-10-07 11:29:11.952391] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.101 [2024-10-07 11:29:11.952405] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.101 [2024-10-07 11:29:11.952437] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.101 [2024-10-07 11:29:11.952462] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.101 [2024-10-07 11:29:11.952477] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.101 [2024-10-07 11:29:11.965940] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.101 [2024-10-07 11:29:11.966001] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.101 [2024-10-07 11:29:11.966087] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.101 [2024-10-07 11:29:11.966124] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.101 [2024-10-07 11:29:11.966141] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.101 [2024-10-07 11:29:11.966187] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.101 [2024-10-07 11:29:11.966209] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.101 [2024-10-07 11:29:11.966225] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.101 [2024-10-07 11:29:11.966249] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.101 [2024-10-07 11:29:11.966268] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.101 [2024-10-07 11:29:11.966288] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.101 [2024-10-07 11:29:11.966302] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.101 [2024-10-07 11:29:11.966316] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.101 [2024-10-07 11:29:11.966332] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.101 [2024-10-07 11:29:11.966347] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.101 [2024-10-07 11:29:11.966360] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.101 [2024-10-07 11:29:11.966383] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.101 [2024-10-07 11:29:11.966396] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.101 [2024-10-07 11:29:11.979446] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.101 [2024-10-07 11:29:11.979516] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.101 [2024-10-07 11:29:11.979604] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.101 [2024-10-07 11:29:11.979633] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.101 [2024-10-07 11:29:11.979651] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.101 [2024-10-07 11:29:11.979697] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.101 [2024-10-07 11:29:11.979720] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.101 [2024-10-07 11:29:11.979736] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.101 [2024-10-07 11:29:11.979760] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.101 [2024-10-07 11:29:11.979779] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.101 [2024-10-07 11:29:11.979799] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.101 [2024-10-07 11:29:11.979814] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.101 [2024-10-07 11:29:11.979827] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.101 [2024-10-07 11:29:11.979843] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.101 [2024-10-07 11:29:11.979858] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.101 [2024-10-07 11:29:11.979871] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.101 [2024-10-07 11:29:11.979894] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.101 [2024-10-07 11:29:11.979908] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.101 [2024-10-07 11:29:11.991266] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.101 [2024-10-07 11:29:11.991317] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.101 [2024-10-07 11:29:11.991514] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.101 [2024-10-07 11:29:11.991546] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.101 [2024-10-07 11:29:11.991564] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.101 [2024-10-07 11:29:11.991611] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.101 [2024-10-07 11:29:11.991634] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.101 [2024-10-07 11:29:11.991650] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.101 [2024-10-07 11:29:11.991893] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.101 [2024-10-07 11:29:11.991922] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.101 [2024-10-07 11:29:11.991970] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.101 [2024-10-07 11:29:11.992007] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.101 [2024-10-07 11:29:11.992022] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.101 [2024-10-07 11:29:11.992054] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.101 [2024-10-07 11:29:11.992071] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.101 [2024-10-07 11:29:11.992084] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.101 [2024-10-07 11:29:11.992108] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.101 [2024-10-07 11:29:11.992123] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.101 [2024-10-07 11:29:12.004879] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.101 [2024-10-07 11:29:12.004928] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.101 [2024-10-07 11:29:12.005239] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.101 [2024-10-07 11:29:12.005279] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.101 [2024-10-07 11:29:12.005297] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.101 [2024-10-07 11:29:12.005345] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.101 [2024-10-07 11:29:12.005376] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.101 [2024-10-07 11:29:12.005394] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.101 [2024-10-07 11:29:12.005533] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.101 [2024-10-07 11:29:12.005563] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.102 [2024-10-07 11:29:12.005763] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.102 [2024-10-07 11:29:12.005788] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.102 [2024-10-07 11:29:12.005806] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.102 [2024-10-07 11:29:12.005823] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.102 [2024-10-07 11:29:12.005838] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.102 [2024-10-07 11:29:12.005851] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.102 [2024-10-07 11:29:12.005904] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.102 [2024-10-07 11:29:12.005924] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.102 [2024-10-07 11:29:12.016073] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.102 [2024-10-07 11:29:12.016121] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.102 [2024-10-07 11:29:12.016323] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.102 [2024-10-07 11:29:12.016353] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.102 [2024-10-07 11:29:12.016370] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.102 [2024-10-07 11:29:12.016416] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.102 [2024-10-07 11:29:12.016470] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.102 [2024-10-07 11:29:12.016504] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.102 [2024-10-07 11:29:12.016655] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.102 [2024-10-07 11:29:12.016684] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.102 [2024-10-07 11:29:12.016818] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.102 [2024-10-07 11:29:12.016843] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.102 [2024-10-07 11:29:12.016857] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.102 [2024-10-07 11:29:12.016874] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.102 [2024-10-07 11:29:12.016889] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.102 [2024-10-07 11:29:12.016903] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.102 [2024-10-07 11:29:12.017026] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.102 [2024-10-07 11:29:12.017047] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.102 [2024-10-07 11:29:12.026375] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.102 [2024-10-07 11:29:12.026436] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.102 [2024-10-07 11:29:12.026524] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.102 [2024-10-07 11:29:12.026553] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.102 [2024-10-07 11:29:12.026571] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.102 [2024-10-07 11:29:12.026618] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.102 [2024-10-07 11:29:12.026640] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.102 [2024-10-07 11:29:12.026656] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.102 [2024-10-07 11:29:12.026679] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.102 [2024-10-07 11:29:12.026699] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.102 [2024-10-07 11:29:12.026719] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.102 [2024-10-07 11:29:12.026734] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.102 [2024-10-07 11:29:12.026747] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.102 [2024-10-07 11:29:12.026763] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.102 [2024-10-07 11:29:12.026778] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.102 [2024-10-07 11:29:12.026790] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.102 [2024-10-07 11:29:12.026813] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.102 [2024-10-07 11:29:12.026828] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.102 [2024-10-07 11:29:12.036974] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.102 [2024-10-07 11:29:12.037022] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.102 [2024-10-07 11:29:12.037934] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.102 [2024-10-07 11:29:12.037999] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.102 [2024-10-07 11:29:12.038021] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.102 [2024-10-07 11:29:12.038071] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.102 [2024-10-07 11:29:12.038094] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.102 [2024-10-07 11:29:12.038110] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.102 [2024-10-07 11:29:12.040235] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.102 [2024-10-07 11:29:12.040281] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.102 [2024-10-07 11:29:12.040810] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.102 [2024-10-07 11:29:12.040847] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.102 [2024-10-07 11:29:12.040864] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.102 [2024-10-07 11:29:12.040882] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.102 [2024-10-07 11:29:12.040897] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.102 [2024-10-07 11:29:12.040910] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.102 [2024-10-07 11:29:12.041207] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.102 [2024-10-07 11:29:12.041233] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.102 [2024-10-07 11:29:12.047356] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.102 [2024-10-07 11:29:12.047448] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.102 [2024-10-07 11:29:12.047635] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.102 [2024-10-07 11:29:12.047665] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.102 [2024-10-07 11:29:12.047682] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.102 [2024-10-07 11:29:12.047729] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.102 [2024-10-07 11:29:12.047751] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.102 [2024-10-07 11:29:12.047766] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.102 [2024-10-07 11:29:12.049167] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.102 [2024-10-07 11:29:12.049206] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.102 [2024-10-07 11:29:12.051763] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.102 [2024-10-07 11:29:12.051817] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.102 [2024-10-07 11:29:12.051837] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.102 [2024-10-07 11:29:12.051855] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.102 [2024-10-07 11:29:12.051885] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.102 [2024-10-07 11:29:12.051900] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.102 [2024-10-07 11:29:12.053096] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.102 [2024-10-07 11:29:12.053148] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.102 [2024-10-07 11:29:12.057524] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.102 [2024-10-07 11:29:12.057601] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.102 [2024-10-07 11:29:12.057676] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.102 [2024-10-07 11:29:12.057704] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.102 [2024-10-07 11:29:12.057720] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.102 [2024-10-07 11:29:12.057772] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.102 [2024-10-07 11:29:12.057795] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.102 [2024-10-07 11:29:12.057810] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.102 [2024-10-07 11:29:12.057828] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.102 [2024-10-07 11:29:12.059632] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.102 [2024-10-07 11:29:12.059675] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.102 [2024-10-07 11:29:12.059692] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.102 [2024-10-07 11:29:12.059706] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.102 [2024-10-07 11:29:12.060369] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.102 [2024-10-07 11:29:12.060405] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.102 [2024-10-07 11:29:12.060456] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.103 [2024-10-07 11:29:12.060471] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.103 [2024-10-07 11:29:12.060775] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.103 [2024-10-07 11:29:12.070028] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.103 [2024-10-07 11:29:12.070084] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.103 [2024-10-07 11:29:12.070198] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.103 [2024-10-07 11:29:12.070228] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.103 [2024-10-07 11:29:12.070245] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.103 [2024-10-07 11:29:12.070292] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.103 [2024-10-07 11:29:12.070315] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.103 [2024-10-07 11:29:12.070346] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.103 [2024-10-07 11:29:12.070387] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.103 [2024-10-07 11:29:12.070408] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.103 [2024-10-07 11:29:12.070444] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.103 [2024-10-07 11:29:12.070462] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.103 [2024-10-07 11:29:12.070476] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.103 [2024-10-07 11:29:12.070492] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.103 [2024-10-07 11:29:12.070506] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.103 [2024-10-07 11:29:12.070519] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.103 [2024-10-07 11:29:12.070542] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.103 [2024-10-07 11:29:12.070555] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.103 [2024-10-07 11:29:12.080630] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.103 [2024-10-07 11:29:12.080680] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.103 [2024-10-07 11:29:12.080765] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.103 [2024-10-07 11:29:12.080795] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.103 [2024-10-07 11:29:12.080812] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.103 [2024-10-07 11:29:12.080860] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.103 [2024-10-07 11:29:12.080883] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.103 [2024-10-07 11:29:12.080899] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.103 [2024-10-07 11:29:12.080922] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.103 [2024-10-07 11:29:12.080942] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.103 [2024-10-07 11:29:12.080961] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.103 [2024-10-07 11:29:12.080976] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.103 [2024-10-07 11:29:12.081005] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.103 [2024-10-07 11:29:12.081020] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.103 [2024-10-07 11:29:12.081034] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.103 [2024-10-07 11:29:12.081047] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.103 [2024-10-07 11:29:12.081069] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.103 [2024-10-07 11:29:12.081082] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.103 [2024-10-07 11:29:12.092948] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.103 [2024-10-07 11:29:12.093000] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.103 [2024-10-07 11:29:12.093116] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.103 [2024-10-07 11:29:12.093165] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.103 [2024-10-07 11:29:12.093185] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.103 [2024-10-07 11:29:12.093235] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.103 [2024-10-07 11:29:12.093258] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.103 [2024-10-07 11:29:12.093274] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.103 [2024-10-07 11:29:12.093299] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.103 [2024-10-07 11:29:12.093319] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.103 [2024-10-07 11:29:12.093339] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.103 [2024-10-07 11:29:12.093354] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.103 [2024-10-07 11:29:12.093367] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.103 [2024-10-07 11:29:12.093385] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.103 [2024-10-07 11:29:12.093429] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.103 [2024-10-07 11:29:12.093449] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.103 [2024-10-07 11:29:12.093475] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.103 [2024-10-07 11:29:12.093490] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.103 [2024-10-07 11:29:12.106049] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.103 [2024-10-07 11:29:12.106102] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.103 [2024-10-07 11:29:12.106405] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.103 [2024-10-07 11:29:12.106472] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.103 [2024-10-07 11:29:12.106493] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.103 [2024-10-07 11:29:12.106547] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.103 [2024-10-07 11:29:12.106570] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.103 [2024-10-07 11:29:12.106586] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.103 [2024-10-07 11:29:12.106656] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.103 [2024-10-07 11:29:12.106685] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.103 [2024-10-07 11:29:12.106717] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.103 [2024-10-07 11:29:12.106731] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.103 [2024-10-07 11:29:12.106745] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.103 [2024-10-07 11:29:12.106762] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.103 [2024-10-07 11:29:12.106776] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.103 [2024-10-07 11:29:12.106806] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.103 [2024-10-07 11:29:12.106832] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.103 [2024-10-07 11:29:12.106846] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.103 [2024-10-07 11:29:12.118851] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.103 [2024-10-07 11:29:12.118900] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.103 [2024-10-07 11:29:12.119534] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.103 [2024-10-07 11:29:12.119577] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.103 [2024-10-07 11:29:12.119597] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.103 [2024-10-07 11:29:12.119645] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.103 [2024-10-07 11:29:12.119668] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.103 [2024-10-07 11:29:12.119684] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.103 [2024-10-07 11:29:12.119927] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.103 [2024-10-07 11:29:12.119971] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.103 [2024-10-07 11:29:12.120026] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.103 [2024-10-07 11:29:12.120047] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.103 [2024-10-07 11:29:12.120062] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.103 [2024-10-07 11:29:12.120080] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.104 [2024-10-07 11:29:12.120095] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.104 [2024-10-07 11:29:12.120108] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.104 [2024-10-07 11:29:12.120132] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.104 [2024-10-07 11:29:12.120146] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.104 [2024-10-07 11:29:12.130359] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.104 [2024-10-07 11:29:12.130431] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.104 [2024-10-07 11:29:12.130551] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.104 [2024-10-07 11:29:12.130581] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.104 [2024-10-07 11:29:12.130598] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.104 [2024-10-07 11:29:12.130646] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.104 [2024-10-07 11:29:12.130668] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.104 [2024-10-07 11:29:12.130684] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.104 [2024-10-07 11:29:12.131752] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.104 [2024-10-07 11:29:12.131807] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.104 [2024-10-07 11:29:12.132024] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.104 [2024-10-07 11:29:12.132066] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.104 [2024-10-07 11:29:12.132081] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.104 [2024-10-07 11:29:12.132098] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.104 [2024-10-07 11:29:12.132112] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.104 [2024-10-07 11:29:12.132125] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.104 [2024-10-07 11:29:12.132242] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.104 [2024-10-07 11:29:12.132263] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.104 [2024-10-07 11:29:12.143715] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.104 [2024-10-07 11:29:12.143765] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.104 [2024-10-07 11:29:12.143998] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.104 [2024-10-07 11:29:12.144038] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.104 [2024-10-07 11:29:12.144063] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.104 [2024-10-07 11:29:12.144125] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.104 [2024-10-07 11:29:12.144149] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.104 [2024-10-07 11:29:12.144165] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.104 [2024-10-07 11:29:12.144269] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.104 [2024-10-07 11:29:12.144292] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.104 [2024-10-07 11:29:12.144405] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.104 [2024-10-07 11:29:12.144445] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.104 [2024-10-07 11:29:12.144460] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.104 [2024-10-07 11:29:12.144477] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.104 [2024-10-07 11:29:12.144492] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.104 [2024-10-07 11:29:12.144505] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.104 [2024-10-07 11:29:12.144545] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.104 [2024-10-07 11:29:12.144562] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.104 [2024-10-07 11:29:12.154109] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.104 [2024-10-07 11:29:12.154159] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.104 [2024-10-07 11:29:12.154361] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.104 [2024-10-07 11:29:12.154394] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.104 [2024-10-07 11:29:12.154443] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.104 [2024-10-07 11:29:12.154498] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.104 [2024-10-07 11:29:12.154522] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.104 [2024-10-07 11:29:12.154538] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.104 [2024-10-07 11:29:12.154653] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.104 [2024-10-07 11:29:12.154678] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.104 [2024-10-07 11:29:12.154915] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.104 [2024-10-07 11:29:12.154947] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.104 [2024-10-07 11:29:12.154963] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.104 [2024-10-07 11:29:12.154980] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.104 [2024-10-07 11:29:12.154995] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.104 [2024-10-07 11:29:12.155008] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.104 [2024-10-07 11:29:12.155143] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.104 [2024-10-07 11:29:12.155166] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.104 [2024-10-07 11:29:12.164288] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.104 [2024-10-07 11:29:12.164338] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.104 [2024-10-07 11:29:12.164445] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.104 [2024-10-07 11:29:12.164479] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.104 [2024-10-07 11:29:12.164497] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.104 [2024-10-07 11:29:12.164548] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.104 [2024-10-07 11:29:12.164571] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.104 [2024-10-07 11:29:12.164587] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.104 [2024-10-07 11:29:12.164611] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.104 [2024-10-07 11:29:12.164631] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.104 [2024-10-07 11:29:12.164668] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.104 [2024-10-07 11:29:12.164686] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.104 [2024-10-07 11:29:12.164700] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.104 [2024-10-07 11:29:12.164716] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.104 [2024-10-07 11:29:12.164731] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.104 [2024-10-07 11:29:12.164744] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.104 [2024-10-07 11:29:12.164782] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.104 [2024-10-07 11:29:12.164799] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.104 [2024-10-07 11:29:12.174402] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.104 [2024-10-07 11:29:12.174483] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.104 [2024-10-07 11:29:12.174559] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.104 [2024-10-07 11:29:12.174588] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.104 [2024-10-07 11:29:12.174604] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.104 [2024-10-07 11:29:12.174657] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.104 [2024-10-07 11:29:12.174681] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.104 [2024-10-07 11:29:12.174696] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.104 [2024-10-07 11:29:12.174714] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.104 [2024-10-07 11:29:12.174738] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.104 [2024-10-07 11:29:12.174755] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.104 [2024-10-07 11:29:12.174768] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.104 [2024-10-07 11:29:12.174782] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.104 [2024-10-07 11:29:12.174805] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.104 [2024-10-07 11:29:12.174820] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.104 [2024-10-07 11:29:12.174832] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.104 [2024-10-07 11:29:12.174845] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.104 [2024-10-07 11:29:12.177099] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.104 [2024-10-07 11:29:12.184497] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.104 [2024-10-07 11:29:12.184625] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.104 [2024-10-07 11:29:12.184655] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.104 [2024-10-07 11:29:12.184672] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.105 [2024-10-07 11:29:12.184710] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.105 [2024-10-07 11:29:12.184740] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.105 [2024-10-07 11:29:12.184767] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.105 [2024-10-07 11:29:12.184782] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.105 [2024-10-07 11:29:12.184796] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.105 [2024-10-07 11:29:12.184817] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.105 [2024-10-07 11:29:12.184868] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.105 [2024-10-07 11:29:12.184909] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.105 [2024-10-07 11:29:12.184927] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.105 [2024-10-07 11:29:12.184951] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.105 [2024-10-07 11:29:12.184973] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.105 [2024-10-07 11:29:12.184987] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.105 [2024-10-07 11:29:12.185001] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.105 [2024-10-07 11:29:12.185023] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.105 [2024-10-07 11:29:12.199020] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.105 [2024-10-07 11:29:12.199072] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.105 [2024-10-07 11:29:12.199175] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.105 [2024-10-07 11:29:12.199220] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.105 [2024-10-07 11:29:12.199237] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.105 [2024-10-07 11:29:12.199282] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.105 [2024-10-07 11:29:12.199303] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.105 [2024-10-07 11:29:12.199318] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.105 [2024-10-07 11:29:12.199341] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.105 [2024-10-07 11:29:12.199360] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.105 [2024-10-07 11:29:12.199379] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.105 [2024-10-07 11:29:12.199393] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.105 [2024-10-07 11:29:12.199406] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.105 [2024-10-07 11:29:12.199422] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.105 [2024-10-07 11:29:12.199435] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.105 [2024-10-07 11:29:12.199465] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.105 [2024-10-07 11:29:12.199490] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.105 [2024-10-07 11:29:12.199504] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.105 [2024-10-07 11:29:12.210517] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.105 [2024-10-07 11:29:12.210567] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.105 [2024-10-07 11:29:12.210751] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.105 [2024-10-07 11:29:12.210782] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.105 [2024-10-07 11:29:12.210799] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.105 [2024-10-07 11:29:12.210866] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.105 [2024-10-07 11:29:12.210891] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.105 [2024-10-07 11:29:12.210906] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.105 [2024-10-07 11:29:12.211049] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.105 [2024-10-07 11:29:12.211075] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.105 [2024-10-07 11:29:12.211272] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.105 [2024-10-07 11:29:12.211296] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.105 [2024-10-07 11:29:12.211310] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.105 [2024-10-07 11:29:12.211327] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.105 [2024-10-07 11:29:12.211342] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.105 [2024-10-07 11:29:12.211354] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.105 [2024-10-07 11:29:12.213870] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.105 [2024-10-07 11:29:12.213908] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.105 [2024-10-07 11:29:12.220629] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.105 [2024-10-07 11:29:12.220708] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.105 [2024-10-07 11:29:12.220797] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.105 [2024-10-07 11:29:12.220824] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.105 [2024-10-07 11:29:12.220840] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.105 [2024-10-07 11:29:12.220892] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.105 [2024-10-07 11:29:12.220914] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.105 [2024-10-07 11:29:12.220929] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.105 [2024-10-07 11:29:12.220947] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.105 [2024-10-07 11:29:12.220970] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.105 [2024-10-07 11:29:12.220987] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.105 [2024-10-07 11:29:12.221000] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.105 [2024-10-07 11:29:12.221013] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.105 [2024-10-07 11:29:12.221035] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.105 [2024-10-07 11:29:12.221049] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.105 [2024-10-07 11:29:12.221062] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.105 [2024-10-07 11:29:12.221075] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.105 [2024-10-07 11:29:12.221111] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.105 [2024-10-07 11:29:12.230723] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.105 [2024-10-07 11:29:12.230857] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.105 [2024-10-07 11:29:12.230886] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.105 [2024-10-07 11:29:12.230903] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.105 [2024-10-07 11:29:12.230938] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.105 [2024-10-07 11:29:12.230965] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.105 [2024-10-07 11:29:12.230991] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.105 [2024-10-07 11:29:12.231006] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.105 [2024-10-07 11:29:12.231019] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.105 [2024-10-07 11:29:12.231220] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.105 [2024-10-07 11:29:12.231284] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.105 [2024-10-07 11:29:12.231310] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.105 [2024-10-07 11:29:12.231326] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.105 [2024-10-07 11:29:12.231721] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.105 [2024-10-07 11:29:12.231783] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.105 [2024-10-07 11:29:12.231804] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.105 [2024-10-07 11:29:12.231819] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.105 [2024-10-07 11:29:12.231843] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.105 [2024-10-07 11:29:12.242094] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.105 [2024-10-07 11:29:12.242554] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.105 [2024-10-07 11:29:12.242650] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.105 [2024-10-07 11:29:12.242679] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.105 [2024-10-07 11:29:12.242696] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.105 [2024-10-07 11:29:12.242957] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.105 [2024-10-07 11:29:12.242996] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.105 [2024-10-07 11:29:12.243014] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.105 [2024-10-07 11:29:12.243033] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.105 [2024-10-07 11:29:12.243229] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.105 [2024-10-07 11:29:12.243257] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.106 [2024-10-07 11:29:12.243288] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.106 [2024-10-07 11:29:12.243304] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.106 [2024-10-07 11:29:12.243364] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.106 [2024-10-07 11:29:12.243385] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.106 [2024-10-07 11:29:12.243398] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.106 [2024-10-07 11:29:12.243425] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.106 [2024-10-07 11:29:12.243597] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.106 [2024-10-07 11:29:12.256045] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.106 [2024-10-07 11:29:12.256096] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.106 [2024-10-07 11:29:12.256550] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.106 [2024-10-07 11:29:12.256592] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.106 [2024-10-07 11:29:12.256611] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.106 [2024-10-07 11:29:12.256661] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.106 [2024-10-07 11:29:12.256684] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.106 [2024-10-07 11:29:12.256700] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.106 [2024-10-07 11:29:12.256915] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.106 [2024-10-07 11:29:12.256946] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.106 [2024-10-07 11:29:12.257153] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.106 [2024-10-07 11:29:12.257180] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.106 [2024-10-07 11:29:12.257194] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.106 [2024-10-07 11:29:12.257211] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.106 [2024-10-07 11:29:12.257225] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.106 [2024-10-07 11:29:12.257239] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.106 [2024-10-07 11:29:12.257296] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.106 [2024-10-07 11:29:12.257316] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.106 [2024-10-07 11:29:12.269240] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.106 [2024-10-07 11:29:12.269300] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.106 [2024-10-07 11:29:12.270102] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.106 [2024-10-07 11:29:12.270147] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.106 [2024-10-07 11:29:12.270166] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.106 [2024-10-07 11:29:12.270215] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.106 [2024-10-07 11:29:12.270256] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.106 [2024-10-07 11:29:12.270274] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.106 [2024-10-07 11:29:12.270667] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.106 [2024-10-07 11:29:12.270708] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.106 [2024-10-07 11:29:12.270922] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.106 [2024-10-07 11:29:12.270955] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.106 [2024-10-07 11:29:12.270972] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.106 [2024-10-07 11:29:12.270989] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.106 [2024-10-07 11:29:12.271005] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.106 [2024-10-07 11:29:12.271018] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.106 [2024-10-07 11:29:12.271217] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.106 [2024-10-07 11:29:12.271241] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.106 [2024-10-07 11:29:12.283195] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.106 [2024-10-07 11:29:12.283245] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.106 [2024-10-07 11:29:12.284080] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.106 [2024-10-07 11:29:12.284123] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.106 [2024-10-07 11:29:12.284143] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.106 [2024-10-07 11:29:12.284192] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.106 [2024-10-07 11:29:12.284215] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.106 [2024-10-07 11:29:12.284231] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.106 [2024-10-07 11:29:12.284622] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.106 [2024-10-07 11:29:12.284653] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.106 [2024-10-07 11:29:12.284875] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.106 [2024-10-07 11:29:12.284909] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.106 [2024-10-07 11:29:12.284925] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.106 [2024-10-07 11:29:12.284942] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.106 [2024-10-07 11:29:12.284956] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.106 [2024-10-07 11:29:12.284969] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.106 [2024-10-07 11:29:12.285183] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.106 [2024-10-07 11:29:12.285207] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.106 [2024-10-07 11:29:12.297426] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.106 [2024-10-07 11:29:12.297469] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.106 [2024-10-07 11:29:12.298345] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.106 [2024-10-07 11:29:12.298394] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.106 [2024-10-07 11:29:12.298428] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.106 [2024-10-07 11:29:12.298482] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.106 [2024-10-07 11:29:12.298506] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.106 [2024-10-07 11:29:12.298521] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.106 [2024-10-07 11:29:12.299027] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.106 [2024-10-07 11:29:12.299070] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.106 [2024-10-07 11:29:12.299316] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.106 [2024-10-07 11:29:12.299351] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.106 [2024-10-07 11:29:12.299367] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.106 [2024-10-07 11:29:12.299384] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.106 [2024-10-07 11:29:12.299400] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.106 [2024-10-07 11:29:12.299429] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.106 [2024-10-07 11:29:12.299635] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.106 [2024-10-07 11:29:12.299660] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.106 [2024-10-07 11:29:12.311519] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.106 [2024-10-07 11:29:12.311568] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.106 [2024-10-07 11:29:12.312373] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.106 [2024-10-07 11:29:12.312428] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.106 [2024-10-07 11:29:12.312449] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.106 [2024-10-07 11:29:12.312500] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.106 [2024-10-07 11:29:12.312523] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.106 [2024-10-07 11:29:12.312539] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.106 [2024-10-07 11:29:12.312926] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.106 [2024-10-07 11:29:12.312966] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.106 [2024-10-07 11:29:12.313179] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.106 [2024-10-07 11:29:12.313213] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.106 [2024-10-07 11:29:12.313245] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.106 [2024-10-07 11:29:12.313266] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.106 [2024-10-07 11:29:12.313280] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.106 [2024-10-07 11:29:12.313293] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.106 [2024-10-07 11:29:12.313511] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.106 [2024-10-07 11:29:12.313538] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.106 [2024-10-07 11:29:12.325364] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.107 [2024-10-07 11:29:12.325439] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.107 [2024-10-07 11:29:12.326239] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.107 [2024-10-07 11:29:12.326290] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.107 [2024-10-07 11:29:12.326309] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.107 [2024-10-07 11:29:12.326358] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.107 [2024-10-07 11:29:12.326381] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.107 [2024-10-07 11:29:12.326397] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.107 [2024-10-07 11:29:12.326784] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.107 [2024-10-07 11:29:12.326833] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.107 [2024-10-07 11:29:12.327046] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.107 [2024-10-07 11:29:12.327080] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.107 [2024-10-07 11:29:12.327097] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.107 [2024-10-07 11:29:12.327114] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.107 [2024-10-07 11:29:12.327129] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.107 [2024-10-07 11:29:12.327143] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.107 [2024-10-07 11:29:12.327342] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.107 [2024-10-07 11:29:12.327367] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.107 [2024-10-07 11:29:12.339587] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.107 [2024-10-07 11:29:12.339638] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.107 [2024-10-07 11:29:12.340460] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.107 [2024-10-07 11:29:12.340516] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.107 [2024-10-07 11:29:12.340535] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.107 [2024-10-07 11:29:12.340586] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.107 [2024-10-07 11:29:12.340610] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.107 [2024-10-07 11:29:12.340641] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.107 [2024-10-07 11:29:12.341047] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.107 [2024-10-07 11:29:12.341082] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.107 [2024-10-07 11:29:12.341293] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.107 [2024-10-07 11:29:12.341327] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.107 [2024-10-07 11:29:12.341343] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.107 [2024-10-07 11:29:12.341360] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.107 [2024-10-07 11:29:12.341390] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.107 [2024-10-07 11:29:12.341420] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.107 [2024-10-07 11:29:12.341657] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.107 [2024-10-07 11:29:12.341684] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.107 [2024-10-07 11:29:12.353717] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.107 [2024-10-07 11:29:12.353766] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.107 [2024-10-07 11:29:12.354641] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.107 [2024-10-07 11:29:12.354698] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.107 [2024-10-07 11:29:12.354717] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.107 [2024-10-07 11:29:12.354766] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.107 [2024-10-07 11:29:12.354821] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.107 [2024-10-07 11:29:12.354836] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.107 [2024-10-07 11:29:12.355252] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.107 [2024-10-07 11:29:12.355310] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.107 [2024-10-07 11:29:12.355538] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.107 [2024-10-07 11:29:12.355573] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.107 [2024-10-07 11:29:12.355589] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.107 [2024-10-07 11:29:12.355607] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.107 [2024-10-07 11:29:12.355621] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.107 [2024-10-07 11:29:12.355635] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.107 [2024-10-07 11:29:12.355860] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.107 [2024-10-07 11:29:12.355883] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.107 [2024-10-07 11:29:12.367699] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.107 [2024-10-07 11:29:12.367749] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.107 [2024-10-07 11:29:12.368596] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.107 [2024-10-07 11:29:12.368640] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.107 [2024-10-07 11:29:12.368660] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.107 [2024-10-07 11:29:12.368710] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.107 [2024-10-07 11:29:12.368733] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.107 [2024-10-07 11:29:12.368748] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.107 [2024-10-07 11:29:12.369122] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.107 [2024-10-07 11:29:12.369164] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.107 [2024-10-07 11:29:12.369376] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.107 [2024-10-07 11:29:12.369422] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.107 [2024-10-07 11:29:12.369442] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.107 [2024-10-07 11:29:12.369460] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.107 [2024-10-07 11:29:12.369475] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.107 [2024-10-07 11:29:12.369488] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.107 [2024-10-07 11:29:12.369690] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.107 [2024-10-07 11:29:12.369714] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.107 [2024-10-07 11:29:12.381170] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.107 [2024-10-07 11:29:12.381229] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.107 [2024-10-07 11:29:12.382038] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.107 [2024-10-07 11:29:12.382083] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.107 [2024-10-07 11:29:12.382102] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.107 [2024-10-07 11:29:12.382152] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.107 [2024-10-07 11:29:12.382175] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.107 [2024-10-07 11:29:12.382191] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.107 [2024-10-07 11:29:12.382595] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.107 [2024-10-07 11:29:12.382627] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.107 [2024-10-07 11:29:12.382836] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.107 [2024-10-07 11:29:12.382872] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.107 [2024-10-07 11:29:12.382889] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.107 [2024-10-07 11:29:12.382912] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.107 [2024-10-07 11:29:12.382945] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.107 [2024-10-07 11:29:12.382961] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.107 [2024-10-07 11:29:12.383178] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.107 [2024-10-07 11:29:12.383202] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.107 [2024-10-07 11:29:12.394511] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.107 [2024-10-07 11:29:12.394557] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.107 [2024-10-07 11:29:12.395313] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.107 [2024-10-07 11:29:12.395368] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.107 [2024-10-07 11:29:12.395386] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.107 [2024-10-07 11:29:12.395460] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.107 [2024-10-07 11:29:12.395486] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.107 [2024-10-07 11:29:12.395501] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.107 [2024-10-07 11:29:12.395876] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.108 [2024-10-07 11:29:12.395906] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.108 [2024-10-07 11:29:12.396100] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.108 [2024-10-07 11:29:12.396133] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.108 [2024-10-07 11:29:12.396149] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.108 [2024-10-07 11:29:12.396165] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.108 [2024-10-07 11:29:12.396180] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.108 [2024-10-07 11:29:12.396192] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.108 [2024-10-07 11:29:12.396379] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.108 [2024-10-07 11:29:12.396402] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.108 9035.08 IOPS, 35.29 MiB/s [2024-10-07T11:29:15.819Z] [2024-10-07 11:29:12.410069] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.108 [2024-10-07 11:29:12.410113] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.108 [2024-10-07 11:29:12.410212] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.108 [2024-10-07 11:29:12.410240] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.108 [2024-10-07 11:29:12.410256] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.108 [2024-10-07 11:29:12.410316] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.108 [2024-10-07 11:29:12.410337] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.108 [2024-10-07 11:29:12.410351] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.108 [2024-10-07 11:29:12.410389] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.108 [2024-10-07 11:29:12.410407] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.108 [2024-10-07 11:29:12.410426] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.108 [2024-10-07 11:29:12.410461] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.108 [2024-10-07 11:29:12.410483] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.108 [2024-10-07 11:29:12.410501] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.108 [2024-10-07 11:29:12.410515] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.108 [2024-10-07 11:29:12.410527] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.108 [2024-10-07 11:29:12.410550] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.108 [2024-10-07 11:29:12.410563] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.108 [2024-10-07 11:29:12.422714] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.108 [2024-10-07 11:29:12.422761] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.108 [2024-10-07 11:29:12.422956] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.108 [2024-10-07 11:29:12.422985] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.108 [2024-10-07 11:29:12.423001] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.108 [2024-10-07 11:29:12.423045] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.108 [2024-10-07 11:29:12.423066] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.108 [2024-10-07 11:29:12.423082] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.108 [2024-10-07 11:29:12.423708] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.108 [2024-10-07 11:29:12.423749] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.108 [2024-10-07 11:29:12.425033] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.108 [2024-10-07 11:29:12.425074] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.108 [2024-10-07 11:29:12.425106] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.108 [2024-10-07 11:29:12.425123] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.108 [2024-10-07 11:29:12.425137] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.108 [2024-10-07 11:29:12.425150] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.108 [2024-10-07 11:29:12.425436] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.108 [2024-10-07 11:29:12.425475] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.108 [2024-10-07 11:29:12.435006] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.108 [2024-10-07 11:29:12.435055] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.108 [2024-10-07 11:29:12.435199] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.108 [2024-10-07 11:29:12.435230] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.108 [2024-10-07 11:29:12.435247] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.108 [2024-10-07 11:29:12.435293] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.108 [2024-10-07 11:29:12.435316] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.108 [2024-10-07 11:29:12.435331] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.108 [2024-10-07 11:29:12.435371] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.108 [2024-10-07 11:29:12.435395] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.108 [2024-10-07 11:29:12.435431] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.108 [2024-10-07 11:29:12.435450] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.108 [2024-10-07 11:29:12.435464] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.108 [2024-10-07 11:29:12.435481] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.108 [2024-10-07 11:29:12.435495] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.108 [2024-10-07 11:29:12.435508] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.108 [2024-10-07 11:29:12.435531] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.108 [2024-10-07 11:29:12.435545] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.108 [2024-10-07 11:29:12.446385] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.108 [2024-10-07 11:29:12.446449] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.108 [2024-10-07 11:29:12.448395] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.108 [2024-10-07 11:29:12.448451] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.108 [2024-10-07 11:29:12.448471] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.108 [2024-10-07 11:29:12.448522] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.108 [2024-10-07 11:29:12.448545] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.108 [2024-10-07 11:29:12.448570] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.108 [2024-10-07 11:29:12.449134] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.108 [2024-10-07 11:29:12.449176] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.108 [2024-10-07 11:29:12.449837] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.108 [2024-10-07 11:29:12.449872] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.108 [2024-10-07 11:29:12.449889] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.108 [2024-10-07 11:29:12.449906] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.108 [2024-10-07 11:29:12.449936] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.108 [2024-10-07 11:29:12.449951] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.108 [2024-10-07 11:29:12.450201] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.108 [2024-10-07 11:29:12.450227] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.108 [2024-10-07 11:29:12.458220] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.109 [2024-10-07 11:29:12.458270] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.109 [2024-10-07 11:29:12.458355] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.109 [2024-10-07 11:29:12.458384] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.109 [2024-10-07 11:29:12.458401] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.109 [2024-10-07 11:29:12.458465] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.109 [2024-10-07 11:29:12.458489] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.109 [2024-10-07 11:29:12.458505] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.109 [2024-10-07 11:29:12.463009] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.109 [2024-10-07 11:29:12.463056] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.109 [2024-10-07 11:29:12.463820] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.109 [2024-10-07 11:29:12.463856] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.109 [2024-10-07 11:29:12.463874] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.109 [2024-10-07 11:29:12.463891] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.109 [2024-10-07 11:29:12.463905] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.109 [2024-10-07 11:29:12.463918] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.109 [2024-10-07 11:29:12.464342] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.109 [2024-10-07 11:29:12.464377] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.109 [2024-10-07 11:29:12.468332] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.109 [2024-10-07 11:29:12.468390] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.109 [2024-10-07 11:29:12.468478] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.109 [2024-10-07 11:29:12.468506] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.109 [2024-10-07 11:29:12.468522] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.109 [2024-10-07 11:29:12.468575] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.109 [2024-10-07 11:29:12.468599] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.109 [2024-10-07 11:29:12.468615] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.109 [2024-10-07 11:29:12.468633] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.109 [2024-10-07 11:29:12.468673] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.109 [2024-10-07 11:29:12.468691] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.109 [2024-10-07 11:29:12.468705] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.109 [2024-10-07 11:29:12.468718] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.109 [2024-10-07 11:29:12.468740] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.109 [2024-10-07 11:29:12.468755] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.109 [2024-10-07 11:29:12.468768] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.109 [2024-10-07 11:29:12.468782] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.109 [2024-10-07 11:29:12.468803] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.109 [2024-10-07 11:29:12.478405] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.109 [2024-10-07 11:29:12.478562] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.109 [2024-10-07 11:29:12.478592] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.109 [2024-10-07 11:29:12.478609] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.109 [2024-10-07 11:29:12.478645] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.109 [2024-10-07 11:29:12.478673] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.109 [2024-10-07 11:29:12.478699] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.109 [2024-10-07 11:29:12.478715] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.109 [2024-10-07 11:29:12.478728] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.109 [2024-10-07 11:29:12.478748] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.109 [2024-10-07 11:29:12.478798] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.109 [2024-10-07 11:29:12.478838] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.109 [2024-10-07 11:29:12.478869] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.109 [2024-10-07 11:29:12.478891] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.109 [2024-10-07 11:29:12.478911] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.109 [2024-10-07 11:29:12.478925] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.109 [2024-10-07 11:29:12.478938] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.109 [2024-10-07 11:29:12.478959] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.109 [2024-10-07 11:29:12.489461] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.109 [2024-10-07 11:29:12.489507] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.109 [2024-10-07 11:29:12.489629] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.109 [2024-10-07 11:29:12.489658] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.109 [2024-10-07 11:29:12.489688] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.109 [2024-10-07 11:29:12.489736] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.109 [2024-10-07 11:29:12.489758] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.109 [2024-10-07 11:29:12.489773] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.109 [2024-10-07 11:29:12.489939] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.109 [2024-10-07 11:29:12.489976] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.109 [2024-10-07 11:29:12.490065] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.109 [2024-10-07 11:29:12.490088] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.109 [2024-10-07 11:29:12.490102] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.109 [2024-10-07 11:29:12.490118] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.109 [2024-10-07 11:29:12.490132] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.109 [2024-10-07 11:29:12.490145] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.109 [2024-10-07 11:29:12.490168] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.109 [2024-10-07 11:29:12.490182] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.109 [2024-10-07 11:29:12.501163] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.109 [2024-10-07 11:29:12.501208] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.109 [2024-10-07 11:29:12.502694] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.109 [2024-10-07 11:29:12.502738] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.109 [2024-10-07 11:29:12.502773] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.109 [2024-10-07 11:29:12.502837] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.109 [2024-10-07 11:29:12.502860] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.109 [2024-10-07 11:29:12.502875] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.109 [2024-10-07 11:29:12.503632] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.109 [2024-10-07 11:29:12.503671] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.109 [2024-10-07 11:29:12.504045] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.109 [2024-10-07 11:29:12.504078] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.109 [2024-10-07 11:29:12.504094] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.109 [2024-10-07 11:29:12.504110] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.109 [2024-10-07 11:29:12.504124] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.109 [2024-10-07 11:29:12.504155] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.109 [2024-10-07 11:29:12.504360] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.109 [2024-10-07 11:29:12.504384] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.109 [2024-10-07 11:29:12.514220] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.109 [2024-10-07 11:29:12.514267] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.109 [2024-10-07 11:29:12.514613] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.109 [2024-10-07 11:29:12.514654] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.109 [2024-10-07 11:29:12.514673] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.109 [2024-10-07 11:29:12.514720] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.109 [2024-10-07 11:29:12.514742] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.109 [2024-10-07 11:29:12.514757] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.110 [2024-10-07 11:29:12.514889] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.110 [2024-10-07 11:29:12.514916] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.110 [2024-10-07 11:29:12.515063] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.110 [2024-10-07 11:29:12.515086] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.110 [2024-10-07 11:29:12.515100] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.110 [2024-10-07 11:29:12.515115] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.110 [2024-10-07 11:29:12.515129] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.110 [2024-10-07 11:29:12.515141] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.110 [2024-10-07 11:29:12.515186] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.110 [2024-10-07 11:29:12.515206] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.110 [2024-10-07 11:29:12.527081] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.110 [2024-10-07 11:29:12.527125] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.110 [2024-10-07 11:29:12.527220] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.110 [2024-10-07 11:29:12.527247] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.110 [2024-10-07 11:29:12.527263] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.110 [2024-10-07 11:29:12.527307] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.110 [2024-10-07 11:29:12.527328] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.110 [2024-10-07 11:29:12.527343] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.110 [2024-10-07 11:29:12.527365] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.110 [2024-10-07 11:29:12.527383] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.110 [2024-10-07 11:29:12.527419] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.110 [2024-10-07 11:29:12.527451] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.110 [2024-10-07 11:29:12.527467] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.110 [2024-10-07 11:29:12.527483] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.110 [2024-10-07 11:29:12.527497] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.110 [2024-10-07 11:29:12.527509] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.110 [2024-10-07 11:29:12.527530] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.110 [2024-10-07 11:29:12.527544] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.110 [2024-10-07 11:29:12.539275] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.110 [2024-10-07 11:29:12.539321] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.110 [2024-10-07 11:29:12.539494] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.110 [2024-10-07 11:29:12.539523] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.110 [2024-10-07 11:29:12.539540] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.110 [2024-10-07 11:29:12.539584] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.110 [2024-10-07 11:29:12.539606] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.110 [2024-10-07 11:29:12.539620] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.110 [2024-10-07 11:29:12.539643] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.110 [2024-10-07 11:29:12.539661] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.110 [2024-10-07 11:29:12.539680] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.110 [2024-10-07 11:29:12.539693] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.110 [2024-10-07 11:29:12.539706] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.110 [2024-10-07 11:29:12.539721] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.110 [2024-10-07 11:29:12.539734] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.110 [2024-10-07 11:29:12.539747] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.110 [2024-10-07 11:29:12.539768] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.110 [2024-10-07 11:29:12.539782] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.110 [2024-10-07 11:29:12.549413] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.110 [2024-10-07 11:29:12.549486] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.110 [2024-10-07 11:29:12.549571] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.110 [2024-10-07 11:29:12.549599] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.110 [2024-10-07 11:29:12.549616] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.110 [2024-10-07 11:29:12.549691] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.110 [2024-10-07 11:29:12.549716] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.110 [2024-10-07 11:29:12.549732] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.110 [2024-10-07 11:29:12.549750] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.110 [2024-10-07 11:29:12.549774] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.110 [2024-10-07 11:29:12.549790] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.110 [2024-10-07 11:29:12.549804] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.110 [2024-10-07 11:29:12.549818] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.110 [2024-10-07 11:29:12.549841] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.110 [2024-10-07 11:29:12.549855] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.110 [2024-10-07 11:29:12.549868] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.110 [2024-10-07 11:29:12.549881] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.110 [2024-10-07 11:29:12.549901] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.110 [2024-10-07 11:29:12.561437] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.110 [2024-10-07 11:29:12.561502] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.110 [2024-10-07 11:29:12.561602] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.110 [2024-10-07 11:29:12.561637] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.110 [2024-10-07 11:29:12.561654] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.110 [2024-10-07 11:29:12.561700] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.110 [2024-10-07 11:29:12.561723] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.110 [2024-10-07 11:29:12.561738] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.110 [2024-10-07 11:29:12.561762] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.110 [2024-10-07 11:29:12.561782] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.110 [2024-10-07 11:29:12.561801] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.110 [2024-10-07 11:29:12.561816] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.110 [2024-10-07 11:29:12.561830] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.110 [2024-10-07 11:29:12.561845] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.110 [2024-10-07 11:29:12.561859] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.110 [2024-10-07 11:29:12.561872] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.110 [2024-10-07 11:29:12.561895] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.110 [2024-10-07 11:29:12.561923] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.110 [2024-10-07 11:29:12.573382] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.110 [2024-10-07 11:29:12.573457] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.110 [2024-10-07 11:29:12.573658] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.110 [2024-10-07 11:29:12.573687] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.110 [2024-10-07 11:29:12.573703] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.110 [2024-10-07 11:29:12.573747] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.110 [2024-10-07 11:29:12.573769] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.110 [2024-10-07 11:29:12.573783] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.110 [2024-10-07 11:29:12.573879] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.110 [2024-10-07 11:29:12.573902] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.110 [2024-10-07 11:29:12.574030] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.110 [2024-10-07 11:29:12.574052] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.110 [2024-10-07 11:29:12.574067] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.110 [2024-10-07 11:29:12.574083] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.110 [2024-10-07 11:29:12.574097] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.110 [2024-10-07 11:29:12.574110] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.111 [2024-10-07 11:29:12.577886] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.111 [2024-10-07 11:29:12.577922] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.111 [2024-10-07 11:29:12.583520] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.111 [2024-10-07 11:29:12.583594] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.111 [2024-10-07 11:29:12.583665] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.111 [2024-10-07 11:29:12.583692] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.111 [2024-10-07 11:29:12.583708] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.111 [2024-10-07 11:29:12.585522] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.111 [2024-10-07 11:29:12.585578] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.111 [2024-10-07 11:29:12.585596] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.111 [2024-10-07 11:29:12.585614] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.111 [2024-10-07 11:29:12.585804] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.111 [2024-10-07 11:29:12.585834] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.111 [2024-10-07 11:29:12.585870] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.111 [2024-10-07 11:29:12.585884] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.111 [2024-10-07 11:29:12.585937] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.111 [2024-10-07 11:29:12.585957] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.111 [2024-10-07 11:29:12.585999] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.111 [2024-10-07 11:29:12.586013] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.111 [2024-10-07 11:29:12.586053] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.111 [2024-10-07 11:29:12.593612] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.111 [2024-10-07 11:29:12.593726] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.111 [2024-10-07 11:29:12.593756] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.111 [2024-10-07 11:29:12.593774] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.111 [2024-10-07 11:29:12.593811] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.111 [2024-10-07 11:29:12.593840] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.111 [2024-10-07 11:29:12.593879] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.111 [2024-10-07 11:29:12.593909] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.111 [2024-10-07 11:29:12.593923] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.111 [2024-10-07 11:29:12.593943] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.111 [2024-10-07 11:29:12.594021] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.111 [2024-10-07 11:29:12.594046] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.111 [2024-10-07 11:29:12.594062] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.111 [2024-10-07 11:29:12.594093] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.111 [2024-10-07 11:29:12.594114] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.111 [2024-10-07 11:29:12.594129] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.111 [2024-10-07 11:29:12.594142] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.111 [2024-10-07 11:29:12.594164] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.111 [2024-10-07 11:29:12.606251] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.111 [2024-10-07 11:29:12.606299] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.111 [2024-10-07 11:29:12.606384] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.111 [2024-10-07 11:29:12.606425] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.111 [2024-10-07 11:29:12.606445] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.111 [2024-10-07 11:29:12.606494] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.111 [2024-10-07 11:29:12.606533] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.111 [2024-10-07 11:29:12.606551] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.111 [2024-10-07 11:29:12.606575] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.111 [2024-10-07 11:29:12.606595] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.111 [2024-10-07 11:29:12.606615] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.111 [2024-10-07 11:29:12.606629] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.111 [2024-10-07 11:29:12.606643] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.111 [2024-10-07 11:29:12.606660] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.111 [2024-10-07 11:29:12.606674] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.111 [2024-10-07 11:29:12.606687] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.111 [2024-10-07 11:29:12.606726] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.111 [2024-10-07 11:29:12.606739] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.111 [2024-10-07 11:29:12.621259] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.111 [2024-10-07 11:29:12.621309] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.111 [2024-10-07 11:29:12.621954] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.111 [2024-10-07 11:29:12.622036] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.111 [2024-10-07 11:29:12.622071] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.111 [2024-10-07 11:29:12.622119] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.111 [2024-10-07 11:29:12.622141] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.111 [2024-10-07 11:29:12.622156] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.111 [2024-10-07 11:29:12.622392] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.111 [2024-10-07 11:29:12.622421] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.111 [2024-10-07 11:29:12.622482] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.111 [2024-10-07 11:29:12.622504] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.111 [2024-10-07 11:29:12.622519] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.111 [2024-10-07 11:29:12.622535] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.111 [2024-10-07 11:29:12.622548] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.111 [2024-10-07 11:29:12.622560] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.111 [2024-10-07 11:29:12.622678] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.111 [2024-10-07 11:29:12.622700] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.111 [2024-10-07 11:29:12.631701] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.111 [2024-10-07 11:29:12.631747] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.111 [2024-10-07 11:29:12.631843] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.111 [2024-10-07 11:29:12.631886] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.111 [2024-10-07 11:29:12.631901] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.111 [2024-10-07 11:29:12.631945] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.111 [2024-10-07 11:29:12.631966] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.111 [2024-10-07 11:29:12.631981] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.111 [2024-10-07 11:29:12.632003] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.111 [2024-10-07 11:29:12.632021] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.111 [2024-10-07 11:29:12.632039] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.111 [2024-10-07 11:29:12.632053] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.111 [2024-10-07 11:29:12.632066] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.111 [2024-10-07 11:29:12.632081] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.111 [2024-10-07 11:29:12.632094] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.111 [2024-10-07 11:29:12.632106] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.111 [2024-10-07 11:29:12.632127] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.111 [2024-10-07 11:29:12.632140] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.111 [2024-10-07 11:29:12.642195] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.111 [2024-10-07 11:29:12.642243] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.111 [2024-10-07 11:29:12.642532] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.111 [2024-10-07 11:29:12.642570] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.111 [2024-10-07 11:29:12.642588] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.111 [2024-10-07 11:29:12.642634] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.112 [2024-10-07 11:29:12.642657] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.112 [2024-10-07 11:29:12.642673] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.112 [2024-10-07 11:29:12.642728] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.112 [2024-10-07 11:29:12.642768] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.112 [2024-10-07 11:29:12.642788] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.112 [2024-10-07 11:29:12.642802] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.112 [2024-10-07 11:29:12.642833] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.112 [2024-10-07 11:29:12.642850] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.112 [2024-10-07 11:29:12.642864] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.112 [2024-10-07 11:29:12.642877] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.112 [2024-10-07 11:29:12.642900] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.112 [2024-10-07 11:29:12.642913] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.112 [2024-10-07 11:29:12.652755] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.112 [2024-10-07 11:29:12.652819] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.112 [2024-10-07 11:29:12.652990] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.112 [2024-10-07 11:29:12.653019] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.112 [2024-10-07 11:29:12.653034] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.112 [2024-10-07 11:29:12.653079] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.112 [2024-10-07 11:29:12.653101] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.112 [2024-10-07 11:29:12.653115] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.112 [2024-10-07 11:29:12.654783] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.112 [2024-10-07 11:29:12.654828] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.112 [2024-10-07 11:29:12.656821] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.112 [2024-10-07 11:29:12.656873] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.112 [2024-10-07 11:29:12.656889] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.112 [2024-10-07 11:29:12.656906] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.112 [2024-10-07 11:29:12.656920] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.112 [2024-10-07 11:29:12.656933] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.112 [2024-10-07 11:29:12.657293] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.112 [2024-10-07 11:29:12.657319] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.112 [2024-10-07 11:29:12.662914] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.112 [2024-10-07 11:29:12.662956] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.112 [2024-10-07 11:29:12.663058] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.112 [2024-10-07 11:29:12.663086] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.112 [2024-10-07 11:29:12.663102] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.112 [2024-10-07 11:29:12.663148] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.112 [2024-10-07 11:29:12.663170] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.112 [2024-10-07 11:29:12.663201] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.112 [2024-10-07 11:29:12.663225] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.112 [2024-10-07 11:29:12.663244] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.112 [2024-10-07 11:29:12.663262] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.112 [2024-10-07 11:29:12.663276] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.112 [2024-10-07 11:29:12.663289] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.112 [2024-10-07 11:29:12.663304] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.112 [2024-10-07 11:29:12.663318] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.112 [2024-10-07 11:29:12.663330] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.112 [2024-10-07 11:29:12.663351] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.112 [2024-10-07 11:29:12.663364] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.112 [2024-10-07 11:29:12.673028] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.112 [2024-10-07 11:29:12.673105] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.112 [2024-10-07 11:29:12.673176] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.112 [2024-10-07 11:29:12.673203] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.112 [2024-10-07 11:29:12.673218] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.112 [2024-10-07 11:29:12.673269] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.112 [2024-10-07 11:29:12.673291] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.112 [2024-10-07 11:29:12.673306] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.112 [2024-10-07 11:29:12.673323] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.112 [2024-10-07 11:29:12.673345] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.112 [2024-10-07 11:29:12.673361] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.112 [2024-10-07 11:29:12.673374] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.112 [2024-10-07 11:29:12.673387] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.112 [2024-10-07 11:29:12.673408] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.112 [2024-10-07 11:29:12.673438] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.112 [2024-10-07 11:29:12.673482] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.112 [2024-10-07 11:29:12.673496] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.112 [2024-10-07 11:29:12.673518] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.112 [2024-10-07 11:29:12.686255] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.112 [2024-10-07 11:29:12.686347] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.112 [2024-10-07 11:29:12.686727] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.112 [2024-10-07 11:29:12.686770] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.112 [2024-10-07 11:29:12.686819] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.112 [2024-10-07 11:29:12.686869] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.112 [2024-10-07 11:29:12.686891] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.112 [2024-10-07 11:29:12.686906] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.112 [2024-10-07 11:29:12.687094] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.112 [2024-10-07 11:29:12.687124] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.112 [2024-10-07 11:29:12.687176] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.112 [2024-10-07 11:29:12.687196] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.112 [2024-10-07 11:29:12.687209] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.112 [2024-10-07 11:29:12.687225] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.112 [2024-10-07 11:29:12.687239] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.112 [2024-10-07 11:29:12.687251] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.112 [2024-10-07 11:29:12.687273] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.112 [2024-10-07 11:29:12.687287] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.112 [2024-10-07 11:29:12.697758] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.112 [2024-10-07 11:29:12.697803] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.112 [2024-10-07 11:29:12.697898] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.112 [2024-10-07 11:29:12.697926] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.113 [2024-10-07 11:29:12.697942] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.113 [2024-10-07 11:29:12.698015] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.113 [2024-10-07 11:29:12.698039] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.113 [2024-10-07 11:29:12.698055] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.113 [2024-10-07 11:29:12.698079] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.113 [2024-10-07 11:29:12.698099] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.113 [2024-10-07 11:29:12.698119] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.113 [2024-10-07 11:29:12.698133] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.113 [2024-10-07 11:29:12.698147] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.113 [2024-10-07 11:29:12.698178] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.113 [2024-10-07 11:29:12.698194] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.113 [2024-10-07 11:29:12.698208] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.113 [2024-10-07 11:29:12.698231] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.113 [2024-10-07 11:29:12.698245] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.113 [2024-10-07 11:29:12.710409] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.113 [2024-10-07 11:29:12.710467] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.113 [2024-10-07 11:29:12.710567] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.113 [2024-10-07 11:29:12.710595] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.113 [2024-10-07 11:29:12.710611] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.113 [2024-10-07 11:29:12.710655] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.113 [2024-10-07 11:29:12.710678] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.113 [2024-10-07 11:29:12.710693] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.113 [2024-10-07 11:29:12.710730] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.113 [2024-10-07 11:29:12.710753] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.113 [2024-10-07 11:29:12.710773] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.113 [2024-10-07 11:29:12.710787] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.113 [2024-10-07 11:29:12.710800] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.113 [2024-10-07 11:29:12.710815] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.113 [2024-10-07 11:29:12.710845] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.113 [2024-10-07 11:29:12.710857] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.113 [2024-10-07 11:29:12.710879] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.113 [2024-10-07 11:29:12.710892] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.113 [2024-10-07 11:29:12.720544] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.113 [2024-10-07 11:29:12.720622] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.113 [2024-10-07 11:29:12.720695] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.113 [2024-10-07 11:29:12.720721] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.113 [2024-10-07 11:29:12.720738] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.113 [2024-10-07 11:29:12.721355] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.113 [2024-10-07 11:29:12.721408] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.113 [2024-10-07 11:29:12.721469] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.113 [2024-10-07 11:29:12.721505] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.113 [2024-10-07 11:29:12.721603] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.113 [2024-10-07 11:29:12.721627] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.113 [2024-10-07 11:29:12.721640] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.113 [2024-10-07 11:29:12.721653] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.113 [2024-10-07 11:29:12.721676] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.113 [2024-10-07 11:29:12.721691] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.113 [2024-10-07 11:29:12.721703] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.113 [2024-10-07 11:29:12.721716] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.113 [2024-10-07 11:29:12.721736] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.113 [2024-10-07 11:29:12.731223] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.113 [2024-10-07 11:29:12.731270] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.113 [2024-10-07 11:29:12.731571] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.113 [2024-10-07 11:29:12.731612] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.113 [2024-10-07 11:29:12.731630] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.113 [2024-10-07 11:29:12.731677] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.113 [2024-10-07 11:29:12.731698] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.113 [2024-10-07 11:29:12.731713] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.113 [2024-10-07 11:29:12.731762] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.113 [2024-10-07 11:29:12.731786] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.113 [2024-10-07 11:29:12.731805] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.113 [2024-10-07 11:29:12.731820] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.113 [2024-10-07 11:29:12.731833] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.113 [2024-10-07 11:29:12.731848] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.113 [2024-10-07 11:29:12.731861] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.113 [2024-10-07 11:29:12.731873] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.113 [2024-10-07 11:29:12.731895] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.113 [2024-10-07 11:29:12.731908] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.113 [2024-10-07 11:29:12.741597] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.113 [2024-10-07 11:29:12.741643] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.113 [2024-10-07 11:29:12.741776] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.113 [2024-10-07 11:29:12.741805] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.113 [2024-10-07 11:29:12.741822] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.113 [2024-10-07 11:29:12.741880] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.113 [2024-10-07 11:29:12.741902] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.113 [2024-10-07 11:29:12.741917] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.113 [2024-10-07 11:29:12.741940] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.113 [2024-10-07 11:29:12.741959] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.113 [2024-10-07 11:29:12.742005] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.113 [2024-10-07 11:29:12.742020] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.113 [2024-10-07 11:29:12.742034] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.113 [2024-10-07 11:29:12.742050] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.113 [2024-10-07 11:29:12.742064] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.113 [2024-10-07 11:29:12.742091] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.113 [2024-10-07 11:29:12.742113] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.113 [2024-10-07 11:29:12.742127] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.113 [2024-10-07 11:29:12.754141] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.113 [2024-10-07 11:29:12.754191] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.113 [2024-10-07 11:29:12.754605] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.113 [2024-10-07 11:29:12.754645] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.113 [2024-10-07 11:29:12.754664] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.113 [2024-10-07 11:29:12.754709] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.113 [2024-10-07 11:29:12.754731] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.113 [2024-10-07 11:29:12.754745] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.113 [2024-10-07 11:29:12.754935] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.113 [2024-10-07 11:29:12.754964] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.113 [2024-10-07 11:29:12.755016] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.114 [2024-10-07 11:29:12.755036] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.114 [2024-10-07 11:29:12.755050] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.114 [2024-10-07 11:29:12.755065] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.114 [2024-10-07 11:29:12.755095] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.114 [2024-10-07 11:29:12.755109] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.114 [2024-10-07 11:29:12.755133] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.114 [2024-10-07 11:29:12.755146] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.114 [2024-10-07 11:29:12.766816] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.114 [2024-10-07 11:29:12.766862] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.114 [2024-10-07 11:29:12.767167] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.114 [2024-10-07 11:29:12.767207] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.114 [2024-10-07 11:29:12.767225] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.114 [2024-10-07 11:29:12.767271] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.114 [2024-10-07 11:29:12.767292] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.114 [2024-10-07 11:29:12.767307] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.114 [2024-10-07 11:29:12.767357] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.114 [2024-10-07 11:29:12.767381] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.114 [2024-10-07 11:29:12.767400] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.114 [2024-10-07 11:29:12.767428] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.114 [2024-10-07 11:29:12.767443] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.114 [2024-10-07 11:29:12.767459] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.114 [2024-10-07 11:29:12.767472] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.114 [2024-10-07 11:29:12.767485] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.114 [2024-10-07 11:29:12.767507] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.114 [2024-10-07 11:29:12.767520] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.114 [2024-10-07 11:29:12.777705] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.114 [2024-10-07 11:29:12.777752] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.114 [2024-10-07 11:29:12.777956] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.114 [2024-10-07 11:29:12.778119] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.114 [2024-10-07 11:29:12.778138] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.114 [2024-10-07 11:29:12.778187] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.114 [2024-10-07 11:29:12.778209] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.114 [2024-10-07 11:29:12.778224] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.114 [2024-10-07 11:29:12.778346] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.114 [2024-10-07 11:29:12.778387] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.114 [2024-10-07 11:29:12.778506] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.114 [2024-10-07 11:29:12.778529] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.114 [2024-10-07 11:29:12.778542] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.114 [2024-10-07 11:29:12.778558] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.114 [2024-10-07 11:29:12.778571] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.114 [2024-10-07 11:29:12.778584] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.114 [2024-10-07 11:29:12.778678] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.114 [2024-10-07 11:29:12.778695] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.114 [2024-10-07 11:29:12.787943] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.114 [2024-10-07 11:29:12.787988] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.114 [2024-10-07 11:29:12.788081] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.114 [2024-10-07 11:29:12.788108] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.114 [2024-10-07 11:29:12.788124] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.114 [2024-10-07 11:29:12.788168] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.114 [2024-10-07 11:29:12.788189] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.114 [2024-10-07 11:29:12.788204] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.114 [2024-10-07 11:29:12.790670] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.114 [2024-10-07 11:29:12.790713] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.114 [2024-10-07 11:29:12.791004] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.114 [2024-10-07 11:29:12.791032] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.114 [2024-10-07 11:29:12.791046] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.114 [2024-10-07 11:29:12.791062] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.114 [2024-10-07 11:29:12.791076] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.114 [2024-10-07 11:29:12.791088] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.114 [2024-10-07 11:29:12.791204] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.114 [2024-10-07 11:29:12.791225] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.114 [2024-10-07 11:29:12.798401] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.114 [2024-10-07 11:29:12.798472] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.114 [2024-10-07 11:29:12.798553] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.114 [2024-10-07 11:29:12.798580] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.114 [2024-10-07 11:29:12.798610] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.114 [2024-10-07 11:29:12.798659] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.114 [2024-10-07 11:29:12.798682] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.114 [2024-10-07 11:29:12.798697] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.114 [2024-10-07 11:29:12.798720] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.114 [2024-10-07 11:29:12.798738] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.115 [2024-10-07 11:29:12.798756] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.115 [2024-10-07 11:29:12.798771] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.115 [2024-10-07 11:29:12.798783] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.115 [2024-10-07 11:29:12.798798] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.115 [2024-10-07 11:29:12.798811] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.115 [2024-10-07 11:29:12.798823] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.115 [2024-10-07 11:29:12.798845] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.115 [2024-10-07 11:29:12.798858] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.115 [2024-10-07 11:29:12.808532] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.115 [2024-10-07 11:29:12.808608] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.115 [2024-10-07 11:29:12.808685] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.115 [2024-10-07 11:29:12.808712] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.115 [2024-10-07 11:29:12.808729] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.115 [2024-10-07 11:29:12.808779] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.115 [2024-10-07 11:29:12.808802] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.115 [2024-10-07 11:29:12.808817] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.115 [2024-10-07 11:29:12.808834] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.115 [2024-10-07 11:29:12.808857] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.115 [2024-10-07 11:29:12.808873] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.115 [2024-10-07 11:29:12.808886] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.115 [2024-10-07 11:29:12.808899] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.115 [2024-10-07 11:29:12.808921] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.115 [2024-10-07 11:29:12.808934] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.115 [2024-10-07 11:29:12.808947] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.115 [2024-10-07 11:29:12.808977] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.115 [2024-10-07 11:29:12.808999] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.115 [2024-10-07 11:29:12.821440] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.115 [2024-10-07 11:29:12.821515] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.115 [2024-10-07 11:29:12.821913] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.115 [2024-10-07 11:29:12.821954] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.115 [2024-10-07 11:29:12.822000] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.115 [2024-10-07 11:29:12.822051] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.115 [2024-10-07 11:29:12.822073] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.115 [2024-10-07 11:29:12.822088] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.115 [2024-10-07 11:29:12.822229] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.115 [2024-10-07 11:29:12.822258] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.115 [2024-10-07 11:29:12.822355] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.115 [2024-10-07 11:29:12.822388] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.115 [2024-10-07 11:29:12.822401] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.115 [2024-10-07 11:29:12.822417] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.115 [2024-10-07 11:29:12.822430] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.115 [2024-10-07 11:29:12.822475] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.115 [2024-10-07 11:29:12.822513] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.115 [2024-10-07 11:29:12.822531] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.115 [2024-10-07 11:29:12.835807] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.115 [2024-10-07 11:29:12.835855] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.115 [2024-10-07 11:29:12.836026] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.115 [2024-10-07 11:29:12.836072] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.115 [2024-10-07 11:29:12.836090] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.115 [2024-10-07 11:29:12.836136] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.115 [2024-10-07 11:29:12.836159] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.115 [2024-10-07 11:29:12.836175] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.115 [2024-10-07 11:29:12.836198] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.115 [2024-10-07 11:29:12.836218] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.115 [2024-10-07 11:29:12.836255] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.115 [2024-10-07 11:29:12.836270] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.115 [2024-10-07 11:29:12.836284] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.115 [2024-10-07 11:29:12.836300] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.115 [2024-10-07 11:29:12.836315] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.115 [2024-10-07 11:29:12.836328] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.115 [2024-10-07 11:29:12.836350] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.115 [2024-10-07 11:29:12.836364] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.115 [2024-10-07 11:29:12.848788] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.115 [2024-10-07 11:29:12.848837] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.115 [2024-10-07 11:29:12.848919] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.115 [2024-10-07 11:29:12.848948] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.115 [2024-10-07 11:29:12.848965] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.115 [2024-10-07 11:29:12.849011] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.115 [2024-10-07 11:29:12.849033] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.115 [2024-10-07 11:29:12.849049] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.115 [2024-10-07 11:29:12.849635] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.115 [2024-10-07 11:29:12.849676] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.115 [2024-10-07 11:29:12.849763] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.115 [2024-10-07 11:29:12.849784] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.115 [2024-10-07 11:29:12.849799] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.115 [2024-10-07 11:29:12.849815] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.115 [2024-10-07 11:29:12.849830] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.115 [2024-10-07 11:29:12.849843] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.115 [2024-10-07 11:29:12.849866] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.115 [2024-10-07 11:29:12.849880] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.115 [2024-10-07 11:29:12.859375] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.115 [2024-10-07 11:29:12.859478] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.115 [2024-10-07 11:29:12.859633] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.115 [2024-10-07 11:29:12.859662] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.115 [2024-10-07 11:29:12.859678] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.115 [2024-10-07 11:29:12.859738] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.115 [2024-10-07 11:29:12.859761] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.115 [2024-10-07 11:29:12.859776] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.115 [2024-10-07 11:29:12.859874] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.115 [2024-10-07 11:29:12.859897] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.115 [2024-10-07 11:29:12.859987] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.115 [2024-10-07 11:29:12.860005] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.115 [2024-10-07 11:29:12.860018] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.115 [2024-10-07 11:29:12.860034] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.116 [2024-10-07 11:29:12.860047] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.116 [2024-10-07 11:29:12.860076] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.116 [2024-10-07 11:29:12.860455] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.116 [2024-10-07 11:29:12.860493] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.116 [2024-10-07 11:29:12.870271] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.116 [2024-10-07 11:29:12.870363] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.116 [2024-10-07 11:29:12.870567] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.116 [2024-10-07 11:29:12.870597] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.116 [2024-10-07 11:29:12.870613] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.116 [2024-10-07 11:29:12.870657] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.116 [2024-10-07 11:29:12.870679] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.116 [2024-10-07 11:29:12.870693] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.116 [2024-10-07 11:29:12.870801] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.116 [2024-10-07 11:29:12.870825] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.116 [2024-10-07 11:29:12.870924] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.116 [2024-10-07 11:29:12.870944] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.116 [2024-10-07 11:29:12.870957] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.116 [2024-10-07 11:29:12.870973] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.116 [2024-10-07 11:29:12.870986] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.116 [2024-10-07 11:29:12.870999] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.116 [2024-10-07 11:29:12.871110] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.116 [2024-10-07 11:29:12.871129] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.116 [2024-10-07 11:29:12.880447] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.116 [2024-10-07 11:29:12.880505] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.116 [2024-10-07 11:29:12.880603] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.116 [2024-10-07 11:29:12.880631] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.116 [2024-10-07 11:29:12.880647] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.116 [2024-10-07 11:29:12.880692] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.116 [2024-10-07 11:29:12.880715] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.116 [2024-10-07 11:29:12.880730] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.116 [2024-10-07 11:29:12.880752] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.116 [2024-10-07 11:29:12.880771] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.116 [2024-10-07 11:29:12.880791] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.116 [2024-10-07 11:29:12.880805] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.116 [2024-10-07 11:29:12.880834] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.116 [2024-10-07 11:29:12.880849] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.116 [2024-10-07 11:29:12.880861] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.116 [2024-10-07 11:29:12.880874] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.116 [2024-10-07 11:29:12.880895] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.116 [2024-10-07 11:29:12.880908] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.116 [2024-10-07 11:29:12.892246] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.116 [2024-10-07 11:29:12.892294] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.116 [2024-10-07 11:29:12.892446] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.116 [2024-10-07 11:29:12.892476] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.116 [2024-10-07 11:29:12.892492] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.116 [2024-10-07 11:29:12.892537] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.116 [2024-10-07 11:29:12.892559] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.116 [2024-10-07 11:29:12.892573] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.116 [2024-10-07 11:29:12.892596] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.116 [2024-10-07 11:29:12.892614] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.116 [2024-10-07 11:29:12.892634] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.116 [2024-10-07 11:29:12.892665] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.116 [2024-10-07 11:29:12.892679] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.116 [2024-10-07 11:29:12.892695] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.116 [2024-10-07 11:29:12.892709] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.116 [2024-10-07 11:29:12.892721] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.116 [2024-10-07 11:29:12.892743] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.116 [2024-10-07 11:29:12.892756] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.116 [2024-10-07 11:29:12.905940] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.116 [2024-10-07 11:29:12.906014] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.116 [2024-10-07 11:29:12.906116] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.116 [2024-10-07 11:29:12.906145] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.116 [2024-10-07 11:29:12.906161] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.116 [2024-10-07 11:29:12.906206] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.116 [2024-10-07 11:29:12.906229] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.116 [2024-10-07 11:29:12.906244] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.116 [2024-10-07 11:29:12.907669] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.116 [2024-10-07 11:29:12.907711] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.116 [2024-10-07 11:29:12.908296] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.116 [2024-10-07 11:29:12.908331] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.116 [2024-10-07 11:29:12.908346] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.116 [2024-10-07 11:29:12.908363] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.116 [2024-10-07 11:29:12.908376] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.116 [2024-10-07 11:29:12.908389] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.116 [2024-10-07 11:29:12.908792] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.116 [2024-10-07 11:29:12.908818] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.116 [2024-10-07 11:29:12.916599] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.116 [2024-10-07 11:29:12.916644] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.116 [2024-10-07 11:29:12.916836] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.116 [2024-10-07 11:29:12.916879] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.116 [2024-10-07 11:29:12.916896] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.116 [2024-10-07 11:29:12.916941] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.116 [2024-10-07 11:29:12.916971] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.116 [2024-10-07 11:29:12.916994] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.116 [2024-10-07 11:29:12.917105] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.117 [2024-10-07 11:29:12.917129] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.117 [2024-10-07 11:29:12.918489] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.117 [2024-10-07 11:29:12.918525] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.117 [2024-10-07 11:29:12.918558] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.117 [2024-10-07 11:29:12.918575] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.117 [2024-10-07 11:29:12.918588] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.117 [2024-10-07 11:29:12.918601] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.117 [2024-10-07 11:29:12.921399] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.117 [2024-10-07 11:29:12.921459] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.117 [2024-10-07 11:29:12.927507] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.117 [2024-10-07 11:29:12.927554] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.117 [2024-10-07 11:29:12.927734] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.117 [2024-10-07 11:29:12.927764] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.117 [2024-10-07 11:29:12.927780] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.117 [2024-10-07 11:29:12.927824] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.117 [2024-10-07 11:29:12.927845] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.117 [2024-10-07 11:29:12.927860] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.117 [2024-10-07 11:29:12.927956] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.117 [2024-10-07 11:29:12.927978] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.117 [2024-10-07 11:29:12.928068] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.117 [2024-10-07 11:29:12.928086] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.117 [2024-10-07 11:29:12.928099] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.117 [2024-10-07 11:29:12.928114] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.117 [2024-10-07 11:29:12.928127] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.117 [2024-10-07 11:29:12.928139] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.117 [2024-10-07 11:29:12.928201] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.117 [2024-10-07 11:29:12.928218] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.117 [2024-10-07 11:29:12.937630] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.117 [2024-10-07 11:29:12.937707] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.117 [2024-10-07 11:29:12.937780] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.117 [2024-10-07 11:29:12.937807] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.117 [2024-10-07 11:29:12.937838] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.117 [2024-10-07 11:29:12.938557] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.117 [2024-10-07 11:29:12.938595] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.117 [2024-10-07 11:29:12.938629] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.117 [2024-10-07 11:29:12.938646] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.117 [2024-10-07 11:29:12.938823] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.117 [2024-10-07 11:29:12.938848] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.117 [2024-10-07 11:29:12.938862] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.117 [2024-10-07 11:29:12.938875] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.117 [2024-10-07 11:29:12.938971] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.117 [2024-10-07 11:29:12.938989] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.117 [2024-10-07 11:29:12.939002] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.117 [2024-10-07 11:29:12.939014] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.117 [2024-10-07 11:29:12.939085] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.117 [2024-10-07 11:29:12.948409] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.117 [2024-10-07 11:29:12.948530] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.117 [2024-10-07 11:29:12.948610] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.117 [2024-10-07 11:29:12.948637] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.117 [2024-10-07 11:29:12.948653] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.117 [2024-10-07 11:29:12.948947] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.117 [2024-10-07 11:29:12.948979] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.117 [2024-10-07 11:29:12.948996] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.117 [2024-10-07 11:29:12.949015] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.117 [2024-10-07 11:29:12.949069] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.117 [2024-10-07 11:29:12.949092] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.117 [2024-10-07 11:29:12.949106] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.117 [2024-10-07 11:29:12.949135] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.117 [2024-10-07 11:29:12.949177] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.117 [2024-10-07 11:29:12.949195] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.117 [2024-10-07 11:29:12.949209] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.117 [2024-10-07 11:29:12.949222] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.117 [2024-10-07 11:29:12.949243] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.117 [2024-10-07 11:29:12.961624] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.117 [2024-10-07 11:29:12.961672] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.117 [2024-10-07 11:29:12.962089] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.117 [2024-10-07 11:29:12.962145] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.117 [2024-10-07 11:29:12.962164] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.117 [2024-10-07 11:29:12.962213] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.117 [2024-10-07 11:29:12.962236] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.117 [2024-10-07 11:29:12.962251] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.117 [2024-10-07 11:29:12.962441] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.117 [2024-10-07 11:29:12.962501] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.117 [2024-10-07 11:29:12.962606] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.117 [2024-10-07 11:29:12.962628] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.117 [2024-10-07 11:29:12.962641] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.117 [2024-10-07 11:29:12.962657] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.117 [2024-10-07 11:29:12.962671] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.117 [2024-10-07 11:29:12.962684] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.117 [2024-10-07 11:29:12.962788] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.117 [2024-10-07 11:29:12.962807] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.117 [2024-10-07 11:29:12.972025] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.117 [2024-10-07 11:29:12.972081] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.117 [2024-10-07 11:29:12.972177] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.117 [2024-10-07 11:29:12.972204] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.117 [2024-10-07 11:29:12.972220] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.117 [2024-10-07 11:29:12.972267] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.117 [2024-10-07 11:29:12.972288] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.117 [2024-10-07 11:29:12.972318] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.117 [2024-10-07 11:29:12.972342] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.117 [2024-10-07 11:29:12.972361] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.117 [2024-10-07 11:29:12.972380] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.117 [2024-10-07 11:29:12.972394] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.117 [2024-10-07 11:29:12.972407] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.117 [2024-10-07 11:29:12.972422] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.117 [2024-10-07 11:29:12.972451] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.117 [2024-10-07 11:29:12.972464] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.118 [2024-10-07 11:29:12.972487] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.118 [2024-10-07 11:29:12.972500] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.118 [2024-10-07 11:29:12.982155] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.118 [2024-10-07 11:29:12.982232] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.118 [2024-10-07 11:29:12.982322] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.118 [2024-10-07 11:29:12.982349] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.118 [2024-10-07 11:29:12.982365] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.118 [2024-10-07 11:29:12.982415] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.118 [2024-10-07 11:29:12.982437] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.118 [2024-10-07 11:29:12.982469] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.118 [2024-10-07 11:29:12.982487] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.118 [2024-10-07 11:29:12.982510] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.118 [2024-10-07 11:29:12.982527] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.118 [2024-10-07 11:29:12.982539] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.118 [2024-10-07 11:29:12.982552] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.118 [2024-10-07 11:29:12.982574] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.118 [2024-10-07 11:29:12.982588] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.118 [2024-10-07 11:29:12.982602] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.118 [2024-10-07 11:29:12.982614] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.118 [2024-10-07 11:29:12.982633] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.118 [2024-10-07 11:29:12.993664] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.118 [2024-10-07 11:29:12.993728] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.118 [2024-10-07 11:29:12.993913] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.118 [2024-10-07 11:29:12.993945] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.118 [2024-10-07 11:29:12.993962] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.118 [2024-10-07 11:29:12.994023] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.118 [2024-10-07 11:29:12.994047] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.118 [2024-10-07 11:29:12.994062] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.118 [2024-10-07 11:29:12.994199] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.118 [2024-10-07 11:29:12.994228] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.118 [2024-10-07 11:29:12.994336] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.118 [2024-10-07 11:29:12.994357] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.118 [2024-10-07 11:29:12.994371] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.118 [2024-10-07 11:29:12.994388] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.118 [2024-10-07 11:29:12.994402] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.118 [2024-10-07 11:29:12.994433] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.118 [2024-10-07 11:29:12.994538] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.118 [2024-10-07 11:29:12.994556] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.118 [2024-10-07 11:29:13.004560] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.118 [2024-10-07 11:29:13.004604] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.118 [2024-10-07 11:29:13.004700] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.118 [2024-10-07 11:29:13.004728] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.118 [2024-10-07 11:29:13.004744] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.118 [2024-10-07 11:29:13.004787] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.118 [2024-10-07 11:29:13.004809] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.118 [2024-10-07 11:29:13.004823] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.118 [2024-10-07 11:29:13.007331] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.118 [2024-10-07 11:29:13.007375] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.118 [2024-10-07 11:29:13.007674] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.118 [2024-10-07 11:29:13.007710] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.118 [2024-10-07 11:29:13.007727] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.118 [2024-10-07 11:29:13.007757] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.118 [2024-10-07 11:29:13.007773] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.118 [2024-10-07 11:29:13.007786] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.118 [2024-10-07 11:29:13.007904] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.118 [2024-10-07 11:29:13.007926] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.118 [2024-10-07 11:29:13.015783] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.118 [2024-10-07 11:29:13.019384] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.118 [2024-10-07 11:29:13.019994] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.118 [2024-10-07 11:29:13.020039] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.118 [2024-10-07 11:29:13.020059] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.118 [2024-10-07 11:29:13.020110] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.118 [2024-10-07 11:29:13.020134] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.118 [2024-10-07 11:29:13.020150] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.118 [2024-10-07 11:29:13.020355] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.118 [2024-10-07 11:29:13.020396] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.118 [2024-10-07 11:29:13.020543] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.118 [2024-10-07 11:29:13.020568] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.118 [2024-10-07 11:29:13.020589] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.118 [2024-10-07 11:29:13.020619] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.118 [2024-10-07 11:29:13.020643] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.118 [2024-10-07 11:29:13.020657] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.118 [2024-10-07 11:29:13.020826] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.118 [2024-10-07 11:29:13.020849] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.118 [2024-10-07 11:29:13.029507] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.118 [2024-10-07 11:29:13.029619] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.118 [2024-10-07 11:29:13.029727] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.118 [2024-10-07 11:29:13.029755] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.118 [2024-10-07 11:29:13.029787] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.118 [2024-10-07 11:29:13.029841] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.118 [2024-10-07 11:29:13.029864] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.118 [2024-10-07 11:29:13.029880] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.118 [2024-10-07 11:29:13.029918] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.118 [2024-10-07 11:29:13.029943] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.118 [2024-10-07 11:29:13.029960] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.118 [2024-10-07 11:29:13.029987] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.118 [2024-10-07 11:29:13.030002] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.118 [2024-10-07 11:29:13.030026] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.118 [2024-10-07 11:29:13.030040] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.118 [2024-10-07 11:29:13.030053] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.118 [2024-10-07 11:29:13.030066] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.118 [2024-10-07 11:29:13.030086] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.118 [2024-10-07 11:29:13.042217] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.118 [2024-10-07 11:29:13.042267] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.118 [2024-10-07 11:29:13.042950] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.118 [2024-10-07 11:29:13.043006] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.118 [2024-10-07 11:29:13.043040] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.118 [2024-10-07 11:29:13.043087] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.119 [2024-10-07 11:29:13.043109] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.119 [2024-10-07 11:29:13.043123] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.119 [2024-10-07 11:29:13.043211] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.119 [2024-10-07 11:29:13.043235] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.119 [2024-10-07 11:29:13.043254] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.119 [2024-10-07 11:29:13.043268] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.119 [2024-10-07 11:29:13.043282] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.119 [2024-10-07 11:29:13.043298] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.119 [2024-10-07 11:29:13.043311] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.119 [2024-10-07 11:29:13.043324] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.119 [2024-10-07 11:29:13.043345] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.119 [2024-10-07 11:29:13.043358] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.119 [2024-10-07 11:29:13.052326] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.119 [2024-10-07 11:29:13.052419] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.119 [2024-10-07 11:29:13.052544] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.119 [2024-10-07 11:29:13.052574] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.119 [2024-10-07 11:29:13.052591] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.119 [2024-10-07 11:29:13.052644] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.119 [2024-10-07 11:29:13.052668] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.119 [2024-10-07 11:29:13.052684] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.119 [2024-10-07 11:29:13.052701] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.119 [2024-10-07 11:29:13.052725] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.119 [2024-10-07 11:29:13.052742] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.119 [2024-10-07 11:29:13.052755] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.119 [2024-10-07 11:29:13.052769] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.119 [2024-10-07 11:29:13.052792] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.119 [2024-10-07 11:29:13.052821] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.119 [2024-10-07 11:29:13.052849] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.119 [2024-10-07 11:29:13.052861] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.119 [2024-10-07 11:29:13.052880] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.119 [2024-10-07 11:29:13.065076] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.119 [2024-10-07 11:29:13.065174] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.119 [2024-10-07 11:29:13.065648] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.119 [2024-10-07 11:29:13.065691] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.119 [2024-10-07 11:29:13.065710] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.119 [2024-10-07 11:29:13.065760] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.119 [2024-10-07 11:29:13.065783] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.119 [2024-10-07 11:29:13.065798] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.119 [2024-10-07 11:29:13.065882] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.119 [2024-10-07 11:29:13.065911] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.119 [2024-10-07 11:29:13.065931] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.119 [2024-10-07 11:29:13.065946] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.119 [2024-10-07 11:29:13.065960] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.119 [2024-10-07 11:29:13.065990] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.119 [2024-10-07 11:29:13.066022] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.119 [2024-10-07 11:29:13.066037] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.119 [2024-10-07 11:29:13.066062] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.119 [2024-10-07 11:29:13.066077] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.119 [2024-10-07 11:29:13.075861] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.119 [2024-10-07 11:29:13.075908] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.119 [2024-10-07 11:29:13.076078] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.119 [2024-10-07 11:29:13.076106] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.119 [2024-10-07 11:29:13.076123] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.119 [2024-10-07 11:29:13.076168] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.119 [2024-10-07 11:29:13.076189] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.119 [2024-10-07 11:29:13.076204] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.119 [2024-10-07 11:29:13.076254] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.119 [2024-10-07 11:29:13.076277] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.119 [2024-10-07 11:29:13.076297] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.119 [2024-10-07 11:29:13.076311] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.119 [2024-10-07 11:29:13.076324] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.119 [2024-10-07 11:29:13.076340] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.119 [2024-10-07 11:29:13.076353] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.119 [2024-10-07 11:29:13.076365] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.119 [2024-10-07 11:29:13.076758] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.119 [2024-10-07 11:29:13.076784] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.119 [2024-10-07 11:29:13.087501] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.119 [2024-10-07 11:29:13.087547] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.119 [2024-10-07 11:29:13.089695] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.119 [2024-10-07 11:29:13.089753] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.119 [2024-10-07 11:29:13.089772] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.119 [2024-10-07 11:29:13.089820] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.119 [2024-10-07 11:29:13.089842] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.119 [2024-10-07 11:29:13.089857] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.119 [2024-10-07 11:29:13.090205] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.119 [2024-10-07 11:29:13.090253] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.119 [2024-10-07 11:29:13.090499] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.119 [2024-10-07 11:29:13.090536] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.119 [2024-10-07 11:29:13.090552] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.119 [2024-10-07 11:29:13.090568] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.119 [2024-10-07 11:29:13.090583] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.119 [2024-10-07 11:29:13.090595] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.119 [2024-10-07 11:29:13.090716] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.119 [2024-10-07 11:29:13.090738] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.119 [2024-10-07 11:29:13.097621] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.119 [2024-10-07 11:29:13.097695] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.119 [2024-10-07 11:29:13.097777] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.119 [2024-10-07 11:29:13.097803] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.119 [2024-10-07 11:29:13.097819] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.119 [2024-10-07 11:29:13.097870] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.119 [2024-10-07 11:29:13.097892] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.119 [2024-10-07 11:29:13.097907] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.119 [2024-10-07 11:29:13.097925] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.119 [2024-10-07 11:29:13.097947] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.119 [2024-10-07 11:29:13.097974] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.119 [2024-10-07 11:29:13.098006] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.119 [2024-10-07 11:29:13.098020] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.119 [2024-10-07 11:29:13.098043] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.120 [2024-10-07 11:29:13.098057] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.120 [2024-10-07 11:29:13.098070] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.120 [2024-10-07 11:29:13.098083] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.120 [2024-10-07 11:29:13.098103] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.120 [2024-10-07 11:29:13.109326] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.120 [2024-10-07 11:29:13.109374] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.120 [2024-10-07 11:29:13.109488] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.120 [2024-10-07 11:29:13.109549] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.120 [2024-10-07 11:29:13.109567] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.120 [2024-10-07 11:29:13.109615] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.120 [2024-10-07 11:29:13.109638] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.120 [2024-10-07 11:29:13.109652] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.120 [2024-10-07 11:29:13.109675] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.120 [2024-10-07 11:29:13.109710] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.120 [2024-10-07 11:29:13.109729] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.120 [2024-10-07 11:29:13.109742] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.120 [2024-10-07 11:29:13.109755] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.120 [2024-10-07 11:29:13.109769] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.120 [2024-10-07 11:29:13.109782] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.120 [2024-10-07 11:29:13.109795] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.120 [2024-10-07 11:29:13.109817] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.120 [2024-10-07 11:29:13.109829] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.120 [2024-10-07 11:29:13.119459] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.120 [2024-10-07 11:29:13.119536] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.120 [2024-10-07 11:29:13.119608] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.120 [2024-10-07 11:29:13.119635] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.120 [2024-10-07 11:29:13.119651] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.120 [2024-10-07 11:29:13.119717] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.120 [2024-10-07 11:29:13.119739] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.120 [2024-10-07 11:29:13.119753] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.120 [2024-10-07 11:29:13.119770] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.120 [2024-10-07 11:29:13.122626] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.120 [2024-10-07 11:29:13.122667] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.120 [2024-10-07 11:29:13.122701] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.120 [2024-10-07 11:29:13.122714] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.120 [2024-10-07 11:29:13.125689] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.120 [2024-10-07 11:29:13.125727] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.120 [2024-10-07 11:29:13.125774] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.120 [2024-10-07 11:29:13.125803] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.120 [2024-10-07 11:29:13.126494] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.120 [2024-10-07 11:29:13.129550] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.120 [2024-10-07 11:29:13.129671] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.120 [2024-10-07 11:29:13.129699] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.120 [2024-10-07 11:29:13.129715] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.120 [2024-10-07 11:29:13.129750] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.120 [2024-10-07 11:29:13.129777] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.120 [2024-10-07 11:29:13.129803] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.120 [2024-10-07 11:29:13.129817] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.120 [2024-10-07 11:29:13.129830] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.120 [2024-10-07 11:29:13.129850] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.120 [2024-10-07 11:29:13.129898] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.120 [2024-10-07 11:29:13.129921] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.120 [2024-10-07 11:29:13.129936] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.120 [2024-10-07 11:29:13.129957] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.120 [2024-10-07 11:29:13.130006] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.120 [2024-10-07 11:29:13.130021] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.120 [2024-10-07 11:29:13.130034] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.120 [2024-10-07 11:29:13.130055] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.120 [2024-10-07 11:29:13.139739] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.120 [2024-10-07 11:29:13.139853] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.120 [2024-10-07 11:29:13.139881] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.120 [2024-10-07 11:29:13.139898] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.120 [2024-10-07 11:29:13.139932] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.120 [2024-10-07 11:29:13.139959] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.120 [2024-10-07 11:29:13.139985] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.120 [2024-10-07 11:29:13.140000] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.120 [2024-10-07 11:29:13.140013] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.120 [2024-10-07 11:29:13.140033] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.120 [2024-10-07 11:29:13.140116] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.120 [2024-10-07 11:29:13.140141] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.120 [2024-10-07 11:29:13.140156] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.120 [2024-10-07 11:29:13.140179] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.120 [2024-10-07 11:29:13.140199] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.120 [2024-10-07 11:29:13.140213] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.120 [2024-10-07 11:29:13.140225] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.120 [2024-10-07 11:29:13.140246] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.120 [2024-10-07 11:29:13.151749] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.120 [2024-10-07 11:29:13.151795] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.120 [2024-10-07 11:29:13.151890] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.120 [2024-10-07 11:29:13.151918] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.120 [2024-10-07 11:29:13.151935] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.120 [2024-10-07 11:29:13.151980] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.120 [2024-10-07 11:29:13.152001] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.120 [2024-10-07 11:29:13.152016] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.120 [2024-10-07 11:29:13.152038] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.120 [2024-10-07 11:29:13.152056] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.120 [2024-10-07 11:29:13.152075] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.120 [2024-10-07 11:29:13.152088] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.120 [2024-10-07 11:29:13.152101] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.120 [2024-10-07 11:29:13.152116] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.120 [2024-10-07 11:29:13.152129] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.120 [2024-10-07 11:29:13.152141] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.120 [2024-10-07 11:29:13.152162] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.120 [2024-10-07 11:29:13.152175] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.120 [2024-10-07 11:29:13.163387] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.120 [2024-10-07 11:29:13.163443] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.120 [2024-10-07 11:29:13.165373] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.120 [2024-10-07 11:29:13.165443] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.121 [2024-10-07 11:29:13.165482] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.121 [2024-10-07 11:29:13.165534] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.121 [2024-10-07 11:29:13.165557] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.121 [2024-10-07 11:29:13.165572] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.121 [2024-10-07 11:29:13.166240] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.121 [2024-10-07 11:29:13.166282] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.121 [2024-10-07 11:29:13.166558] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.121 [2024-10-07 11:29:13.166588] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.121 [2024-10-07 11:29:13.166603] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.121 [2024-10-07 11:29:13.166619] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.121 [2024-10-07 11:29:13.166633] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.121 [2024-10-07 11:29:13.166646] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.121 [2024-10-07 11:29:13.166698] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.121 [2024-10-07 11:29:13.166717] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.121 [2024-10-07 11:29:13.174060] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.121 [2024-10-07 11:29:13.174105] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.121 [2024-10-07 11:29:13.174202] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.121 [2024-10-07 11:29:13.174229] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.121 [2024-10-07 11:29:13.174246] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.121 [2024-10-07 11:29:13.174290] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.121 [2024-10-07 11:29:13.174326] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.121 [2024-10-07 11:29:13.174341] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.121 [2024-10-07 11:29:13.174362] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.121 [2024-10-07 11:29:13.174381] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.121 [2024-10-07 11:29:13.174399] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.121 [2024-10-07 11:29:13.174412] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.121 [2024-10-07 11:29:13.174425] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.121 [2024-10-07 11:29:13.174453] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.121 [2024-10-07 11:29:13.174470] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.121 [2024-10-07 11:29:13.174483] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.121 [2024-10-07 11:29:13.174519] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.121 [2024-10-07 11:29:13.174534] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.121 [2024-10-07 11:29:13.184194] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.121 [2024-10-07 11:29:13.184241] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.121 [2024-10-07 11:29:13.184352] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.121 [2024-10-07 11:29:13.184381] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.121 [2024-10-07 11:29:13.184398] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.121 [2024-10-07 11:29:13.184458] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.121 [2024-10-07 11:29:13.184483] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.121 [2024-10-07 11:29:13.184499] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.121 [2024-10-07 11:29:13.184523] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.121 [2024-10-07 11:29:13.184543] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.121 [2024-10-07 11:29:13.184563] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.121 [2024-10-07 11:29:13.184577] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.121 [2024-10-07 11:29:13.184591] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.121 [2024-10-07 11:29:13.184607] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.121 [2024-10-07 11:29:13.184620] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.121 [2024-10-07 11:29:13.184633] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.121 [2024-10-07 11:29:13.184656] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.121 [2024-10-07 11:29:13.184669] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.121 [2024-10-07 11:29:13.195708] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.121 [2024-10-07 11:29:13.195754] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.121 [2024-10-07 11:29:13.196643] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.121 [2024-10-07 11:29:13.196698] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.121 [2024-10-07 11:29:13.196716] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.121 [2024-10-07 11:29:13.196762] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.121 [2024-10-07 11:29:13.196783] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.121 [2024-10-07 11:29:13.196798] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.121 [2024-10-07 11:29:13.198513] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.121 [2024-10-07 11:29:13.198555] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.121 [2024-10-07 11:29:13.198634] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.121 [2024-10-07 11:29:13.198672] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.121 [2024-10-07 11:29:13.198687] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.121 [2024-10-07 11:29:13.198704] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.121 [2024-10-07 11:29:13.198718] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.121 [2024-10-07 11:29:13.198730] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.121 [2024-10-07 11:29:13.198753] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.121 [2024-10-07 11:29:13.198766] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.121 [2024-10-07 11:29:13.205859] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.121 [2024-10-07 11:29:13.205934] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.121 [2024-10-07 11:29:13.206032] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.121 [2024-10-07 11:29:13.206060] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.121 [2024-10-07 11:29:13.206077] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.121 [2024-10-07 11:29:13.208854] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.121 [2024-10-07 11:29:13.208897] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.121 [2024-10-07 11:29:13.208916] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.121 [2024-10-07 11:29:13.208936] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.121 [2024-10-07 11:29:13.209678] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.121 [2024-10-07 11:29:13.209717] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.121 [2024-10-07 11:29:13.209734] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.121 [2024-10-07 11:29:13.209748] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.121 [2024-10-07 11:29:13.210012] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.121 [2024-10-07 11:29:13.210039] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.121 [2024-10-07 11:29:13.210053] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.121 [2024-10-07 11:29:13.210066] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.121 [2024-10-07 11:29:13.210186] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.121 [2024-10-07 11:29:13.215950] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.122 [2024-10-07 11:29:13.216056] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.122 [2024-10-07 11:29:13.216086] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.122 [2024-10-07 11:29:13.216103] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.122 [2024-10-07 11:29:13.216140] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.122 [2024-10-07 11:29:13.216184] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.122 [2024-10-07 11:29:13.216213] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.122 [2024-10-07 11:29:13.216229] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.122 [2024-10-07 11:29:13.216242] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.122 [2024-10-07 11:29:13.216263] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.122 [2024-10-07 11:29:13.216317] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.122 [2024-10-07 11:29:13.216342] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.122 [2024-10-07 11:29:13.216357] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.122 [2024-10-07 11:29:13.216380] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.122 [2024-10-07 11:29:13.216401] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.122 [2024-10-07 11:29:13.216462] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.122 [2024-10-07 11:29:13.216477] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.122 [2024-10-07 11:29:13.216500] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.122 [2024-10-07 11:29:13.228489] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.122 [2024-10-07 11:29:13.228539] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.122 [2024-10-07 11:29:13.228830] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.122 [2024-10-07 11:29:13.228886] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.122 [2024-10-07 11:29:13.228905] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.122 [2024-10-07 11:29:13.228952] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.122 [2024-10-07 11:29:13.228973] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.122 [2024-10-07 11:29:13.228988] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.122 [2024-10-07 11:29:13.229183] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.122 [2024-10-07 11:29:13.229212] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.122 [2024-10-07 11:29:13.229284] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.122 [2024-10-07 11:29:13.229306] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.122 [2024-10-07 11:29:13.229320] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.122 [2024-10-07 11:29:13.229336] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.122 [2024-10-07 11:29:13.229350] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.122 [2024-10-07 11:29:13.229362] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.122 [2024-10-07 11:29:13.229385] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.122 [2024-10-07 11:29:13.229399] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.122 [2024-10-07 11:29:13.240578] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.122 [2024-10-07 11:29:13.240644] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.122 [2024-10-07 11:29:13.240869] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.122 [2024-10-07 11:29:13.240899] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.122 [2024-10-07 11:29:13.240916] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.122 [2024-10-07 11:29:13.240962] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.122 [2024-10-07 11:29:13.240983] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.122 [2024-10-07 11:29:13.240998] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.122 [2024-10-07 11:29:13.241110] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.122 [2024-10-07 11:29:13.241135] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.122 [2024-10-07 11:29:13.241229] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.122 [2024-10-07 11:29:13.241247] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.122 [2024-10-07 11:29:13.241260] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.122 [2024-10-07 11:29:13.241276] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.122 [2024-10-07 11:29:13.241290] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.122 [2024-10-07 11:29:13.241302] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.122 [2024-10-07 11:29:13.241417] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.122 [2024-10-07 11:29:13.241470] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.122 [2024-10-07 11:29:13.252513] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.122 [2024-10-07 11:29:13.252560] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.122 [2024-10-07 11:29:13.252886] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.122 [2024-10-07 11:29:13.252927] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.122 [2024-10-07 11:29:13.252947] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.122 [2024-10-07 11:29:13.252994] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.122 [2024-10-07 11:29:13.253016] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.122 [2024-10-07 11:29:13.253031] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.122 [2024-10-07 11:29:13.253195] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.122 [2024-10-07 11:29:13.253233] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.122 [2024-10-07 11:29:13.253363] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.122 [2024-10-07 11:29:13.253393] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.122 [2024-10-07 11:29:13.253453] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.122 [2024-10-07 11:29:13.253473] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.122 [2024-10-07 11:29:13.253487] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.122 [2024-10-07 11:29:13.253500] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.122 [2024-10-07 11:29:13.253613] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.122 [2024-10-07 11:29:13.253633] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.122 [2024-10-07 11:29:13.262620] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.122 [2024-10-07 11:29:13.262682] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.122 [2024-10-07 11:29:13.262772] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.122 [2024-10-07 11:29:13.262799] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.122 [2024-10-07 11:29:13.262815] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.122 [2024-10-07 11:29:13.263118] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.122 [2024-10-07 11:29:13.263158] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.122 [2024-10-07 11:29:13.263176] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.122 [2024-10-07 11:29:13.263194] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.122 [2024-10-07 11:29:13.263346] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.122 [2024-10-07 11:29:13.263376] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.122 [2024-10-07 11:29:13.263392] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.122 [2024-10-07 11:29:13.263405] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.122 [2024-10-07 11:29:13.263520] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.122 [2024-10-07 11:29:13.263538] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.122 [2024-10-07 11:29:13.263551] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.122 [2024-10-07 11:29:13.263565] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.122 [2024-10-07 11:29:13.263659] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.122 [2024-10-07 11:29:13.272698] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.122 [2024-10-07 11:29:13.272801] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.122 [2024-10-07 11:29:13.272831] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.122 [2024-10-07 11:29:13.272849] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.122 [2024-10-07 11:29:13.272886] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.122 [2024-10-07 11:29:13.272915] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.122 [2024-10-07 11:29:13.272959] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.122 [2024-10-07 11:29:13.272976] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.122 [2024-10-07 11:29:13.272990] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.123 [2024-10-07 11:29:13.273012] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.123 [2024-10-07 11:29:13.273065] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.123 [2024-10-07 11:29:13.273090] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.123 [2024-10-07 11:29:13.273105] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.123 [2024-10-07 11:29:13.273128] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.123 [2024-10-07 11:29:13.273149] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.123 [2024-10-07 11:29:13.273163] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.123 [2024-10-07 11:29:13.273176] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.123 [2024-10-07 11:29:13.273197] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.123 [2024-10-07 11:29:13.286491] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.123 [2024-10-07 11:29:13.286540] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.123 [2024-10-07 11:29:13.286654] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.123 [2024-10-07 11:29:13.286685] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.123 [2024-10-07 11:29:13.286702] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.123 [2024-10-07 11:29:13.286749] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.123 [2024-10-07 11:29:13.286778] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.123 [2024-10-07 11:29:13.286794] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.123 [2024-10-07 11:29:13.286818] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.123 [2024-10-07 11:29:13.286837] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.123 [2024-10-07 11:29:13.286858] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.123 [2024-10-07 11:29:13.286872] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.123 [2024-10-07 11:29:13.286886] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.123 [2024-10-07 11:29:13.286902] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.123 [2024-10-07 11:29:13.286916] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.123 [2024-10-07 11:29:13.286928] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.123 [2024-10-07 11:29:13.286951] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.123 [2024-10-07 11:29:13.286965] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.123 [2024-10-07 11:29:13.299105] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.123 [2024-10-07 11:29:13.299168] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.123 [2024-10-07 11:29:13.299345] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.123 [2024-10-07 11:29:13.299376] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.123 [2024-10-07 11:29:13.299393] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.123 [2024-10-07 11:29:13.299457] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.123 [2024-10-07 11:29:13.299482] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.123 [2024-10-07 11:29:13.299498] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.123 [2024-10-07 11:29:13.299522] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.123 [2024-10-07 11:29:13.299543] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.123 [2024-10-07 11:29:13.299562] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.123 [2024-10-07 11:29:13.299584] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.123 [2024-10-07 11:29:13.299598] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.123 [2024-10-07 11:29:13.299615] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.123 [2024-10-07 11:29:13.299629] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.123 [2024-10-07 11:29:13.299642] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.123 [2024-10-07 11:29:13.299665] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.123 [2024-10-07 11:29:13.299678] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.123 [2024-10-07 11:29:13.312346] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.123 [2024-10-07 11:29:13.312396] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.123 [2024-10-07 11:29:13.313604] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.123 [2024-10-07 11:29:13.313644] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.123 [2024-10-07 11:29:13.313679] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.123 [2024-10-07 11:29:13.313726] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.123 [2024-10-07 11:29:13.313749] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.123 [2024-10-07 11:29:13.313763] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.123 [2024-10-07 11:29:13.315350] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.123 [2024-10-07 11:29:13.315393] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.123 [2024-10-07 11:29:13.315738] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.123 [2024-10-07 11:29:13.315772] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.123 [2024-10-07 11:29:13.315788] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.123 [2024-10-07 11:29:13.315820] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.123 [2024-10-07 11:29:13.315836] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.123 [2024-10-07 11:29:13.315849] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.123 [2024-10-07 11:29:13.315919] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.123 [2024-10-07 11:29:13.315939] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.123 [2024-10-07 11:29:13.324226] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.123 [2024-10-07 11:29:13.324272] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.123 [2024-10-07 11:29:13.324386] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.123 [2024-10-07 11:29:13.324414] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.123 [2024-10-07 11:29:13.324444] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.123 [2024-10-07 11:29:13.324494] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.123 [2024-10-07 11:29:13.324516] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.123 [2024-10-07 11:29:13.324531] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.123 [2024-10-07 11:29:13.324554] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.123 [2024-10-07 11:29:13.324573] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.123 [2024-10-07 11:29:13.324592] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.123 [2024-10-07 11:29:13.324608] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.123 [2024-10-07 11:29:13.324621] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.123 [2024-10-07 11:29:13.324637] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.123 [2024-10-07 11:29:13.324650] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.123 [2024-10-07 11:29:13.324663] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.123 [2024-10-07 11:29:13.324685] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.123 [2024-10-07 11:29:13.324698] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.123 [2024-10-07 11:29:13.334346] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.123 [2024-10-07 11:29:13.334422] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.123 [2024-10-07 11:29:13.334512] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.123 [2024-10-07 11:29:13.334539] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.123 [2024-10-07 11:29:13.334555] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.123 [2024-10-07 11:29:13.334607] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.123 [2024-10-07 11:29:13.334628] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.123 [2024-10-07 11:29:13.334643] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.123 [2024-10-07 11:29:13.334678] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.123 [2024-10-07 11:29:13.334703] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.123 [2024-10-07 11:29:13.334719] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.123 [2024-10-07 11:29:13.334732] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.123 [2024-10-07 11:29:13.334745] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.123 [2024-10-07 11:29:13.334768] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.123 [2024-10-07 11:29:13.334782] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.123 [2024-10-07 11:29:13.334794] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.123 [2024-10-07 11:29:13.334806] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.124 [2024-10-07 11:29:13.334826] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.124 [2024-10-07 11:29:13.347352] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.124 [2024-10-07 11:29:13.347403] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.124 [2024-10-07 11:29:13.347841] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.124 [2024-10-07 11:29:13.347882] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.124 [2024-10-07 11:29:13.347901] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.124 [2024-10-07 11:29:13.347951] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.124 [2024-10-07 11:29:13.347974] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.124 [2024-10-07 11:29:13.347989] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.124 [2024-10-07 11:29:13.348140] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.124 [2024-10-07 11:29:13.348168] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.124 [2024-10-07 11:29:13.348272] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.124 [2024-10-07 11:29:13.348292] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.124 [2024-10-07 11:29:13.348306] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.124 [2024-10-07 11:29:13.348322] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.124 [2024-10-07 11:29:13.348335] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.124 [2024-10-07 11:29:13.348348] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.124 [2024-10-07 11:29:13.348459] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.124 [2024-10-07 11:29:13.348480] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.124 [2024-10-07 11:29:13.359482] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.124 [2024-10-07 11:29:13.359532] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.124 [2024-10-07 11:29:13.361778] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.124 [2024-10-07 11:29:13.361837] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.124 [2024-10-07 11:29:13.361856] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.124 [2024-10-07 11:29:13.361903] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.124 [2024-10-07 11:29:13.361925] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.124 [2024-10-07 11:29:13.361940] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.124 [2024-10-07 11:29:13.362081] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.124 [2024-10-07 11:29:13.362110] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.124 [2024-10-07 11:29:13.362394] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.124 [2024-10-07 11:29:13.362421] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.124 [2024-10-07 11:29:13.362435] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.124 [2024-10-07 11:29:13.362468] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.124 [2024-10-07 11:29:13.362483] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.124 [2024-10-07 11:29:13.362495] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.124 [2024-10-07 11:29:13.362672] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.124 [2024-10-07 11:29:13.362695] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.124 [2024-10-07 11:29:13.369611] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.124 [2024-10-07 11:29:13.369688] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.124 [2024-10-07 11:29:13.369768] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.124 [2024-10-07 11:29:13.369795] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.124 [2024-10-07 11:29:13.369810] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.124 [2024-10-07 11:29:13.369861] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.124 [2024-10-07 11:29:13.369884] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.124 [2024-10-07 11:29:13.369898] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.124 [2024-10-07 11:29:13.369915] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.124 [2024-10-07 11:29:13.369938] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.124 [2024-10-07 11:29:13.369955] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.124 [2024-10-07 11:29:13.369981] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.124 [2024-10-07 11:29:13.369995] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.124 [2024-10-07 11:29:13.370017] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.124 [2024-10-07 11:29:13.370047] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.124 [2024-10-07 11:29:13.370062] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.124 [2024-10-07 11:29:13.370075] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.124 [2024-10-07 11:29:13.370096] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.124 [2024-10-07 11:29:13.380137] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.124 [2024-10-07 11:29:13.380184] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.124 [2024-10-07 11:29:13.380281] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.124 [2024-10-07 11:29:13.380308] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.124 [2024-10-07 11:29:13.380324] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.124 [2024-10-07 11:29:13.380369] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.124 [2024-10-07 11:29:13.380390] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.124 [2024-10-07 11:29:13.380405] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.124 [2024-10-07 11:29:13.380441] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.124 [2024-10-07 11:29:13.380463] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.124 [2024-10-07 11:29:13.380482] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.124 [2024-10-07 11:29:13.380496] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.124 [2024-10-07 11:29:13.380510] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.124 [2024-10-07 11:29:13.380525] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.124 [2024-10-07 11:29:13.380538] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.124 [2024-10-07 11:29:13.380551] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.124 [2024-10-07 11:29:13.380572] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.124 [2024-10-07 11:29:13.380586] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.124 [2024-10-07 11:29:13.391249] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.124 [2024-10-07 11:29:13.391296] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.124 [2024-10-07 11:29:13.391394] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.124 [2024-10-07 11:29:13.391422] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.124 [2024-10-07 11:29:13.391454] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.124 [2024-10-07 11:29:13.391502] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.124 [2024-10-07 11:29:13.391524] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.124 [2024-10-07 11:29:13.391540] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.124 [2024-10-07 11:29:13.391563] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.124 [2024-10-07 11:29:13.391598] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.124 [2024-10-07 11:29:13.391618] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.124 [2024-10-07 11:29:13.391633] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.124 [2024-10-07 11:29:13.391646] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.124 [2024-10-07 11:29:13.391662] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.124 [2024-10-07 11:29:13.391675] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.124 [2024-10-07 11:29:13.391688] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.124 [2024-10-07 11:29:13.391710] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.124 [2024-10-07 11:29:13.391723] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.124 [2024-10-07 11:29:13.401371] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.124 [2024-10-07 11:29:13.401459] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.124 [2024-10-07 11:29:13.401534] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.124 [2024-10-07 11:29:13.401561] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.124 [2024-10-07 11:29:13.401577] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.124 [2024-10-07 11:29:13.402011] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.124 [2024-10-07 11:29:13.402053] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.125 [2024-10-07 11:29:13.402072] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.125 [2024-10-07 11:29:13.402091] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.125 [2024-10-07 11:29:13.402159] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.125 [2024-10-07 11:29:13.402182] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.125 [2024-10-07 11:29:13.402196] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.125 [2024-10-07 11:29:13.402210] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.125 [2024-10-07 11:29:13.403231] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.125 [2024-10-07 11:29:13.403265] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.125 [2024-10-07 11:29:13.403297] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.125 [2024-10-07 11:29:13.403311] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.125 [2024-10-07 11:29:13.403735] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.125 9064.71 IOPS, 35.41 MiB/s [2024-10-07T11:29:15.836Z] [2024-10-07 11:29:13.411800] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.125 [2024-10-07 11:29:13.411847] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.125 [2024-10-07 11:29:13.411944] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.125 [2024-10-07 11:29:13.411985] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.125 [2024-10-07 11:29:13.412003] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.125 [2024-10-07 11:29:13.412050] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.125 [2024-10-07 11:29:13.412072] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.125 [2024-10-07 11:29:13.412087] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.125 [2024-10-07 11:29:13.414569] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.125 [2024-10-07 11:29:13.414612] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.125 [2024-10-07 11:29:13.415428] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.125 [2024-10-07 11:29:13.415475] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.125 [2024-10-07 11:29:13.415508] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.125 [2024-10-07 11:29:13.415524] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.125 [2024-10-07 11:29:13.415538] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.125 [2024-10-07 11:29:13.415551] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.125 [2024-10-07 11:29:13.415654] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.125 [2024-10-07 11:29:13.415675] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.125 [2024-10-07 11:29:13.425466] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.125 [2024-10-07 11:29:13.428358] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.125 [2024-10-07 11:29:13.428478] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.125 [2024-10-07 11:29:13.428507] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.125 [2024-10-07 11:29:13.428524] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.125 [2024-10-07 11:29:13.429338] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.125 [2024-10-07 11:29:13.429393] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.125 [2024-10-07 11:29:13.429411] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.125 [2024-10-07 11:29:13.429441] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.125 [2024-10-07 11:29:13.430004] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.125 [2024-10-07 11:29:13.430057] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.125 [2024-10-07 11:29:13.430074] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.125 [2024-10-07 11:29:13.430088] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.125 [2024-10-07 11:29:13.430318] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.125 [2024-10-07 11:29:13.430352] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.125 [2024-10-07 11:29:13.430384] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.125 [2024-10-07 11:29:13.430399] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.125 [2024-10-07 11:29:13.430894] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.125 [2024-10-07 11:29:13.436018] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.125 [2024-10-07 11:29:13.436148] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.125 [2024-10-07 11:29:13.436177] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.125 [2024-10-07 11:29:13.436193] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.125 [2024-10-07 11:29:13.436215] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.125 [2024-10-07 11:29:13.436236] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.125 [2024-10-07 11:29:13.436249] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.125 [2024-10-07 11:29:13.436262] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.125 [2024-10-07 11:29:13.436283] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.125 [2024-10-07 11:29:13.443953] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.125 [2024-10-07 11:29:13.444465] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.125 [2024-10-07 11:29:13.444507] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.125 [2024-10-07 11:29:13.444527] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.125 [2024-10-07 11:29:13.444742] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.125 [2024-10-07 11:29:13.444994] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.125 [2024-10-07 11:29:13.445027] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.125 [2024-10-07 11:29:13.445042] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.125 [2024-10-07 11:29:13.445098] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.125 [2024-10-07 11:29:13.446121] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.125 [2024-10-07 11:29:13.446217] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.125 [2024-10-07 11:29:13.446246] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.125 [2024-10-07 11:29:13.446262] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.125 [2024-10-07 11:29:13.446286] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.125 [2024-10-07 11:29:13.446322] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.125 [2024-10-07 11:29:13.446351] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.125 [2024-10-07 11:29:13.446363] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.125 [2024-10-07 11:29:13.446384] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.125 [2024-10-07 11:29:13.457959] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.125 [2024-10-07 11:29:13.458035] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.125 [2024-10-07 11:29:13.458190] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.125 [2024-10-07 11:29:13.458220] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.125 [2024-10-07 11:29:13.458237] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.125 [2024-10-07 11:29:13.458283] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.125 [2024-10-07 11:29:13.458316] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.125 [2024-10-07 11:29:13.458331] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.125 [2024-10-07 11:29:13.458354] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.125 [2024-10-07 11:29:13.458385] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.126 [2024-10-07 11:29:13.458416] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.126 [2024-10-07 11:29:13.458480] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.126 [2024-10-07 11:29:13.458498] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.126 [2024-10-07 11:29:13.458515] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.126 [2024-10-07 11:29:13.458529] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.126 [2024-10-07 11:29:13.458542] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.126 [2024-10-07 11:29:13.458565] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.126 [2024-10-07 11:29:13.458579] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.126 [2024-10-07 11:29:13.469763] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.126 [2024-10-07 11:29:13.469811] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.126 [2024-10-07 11:29:13.469894] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.126 [2024-10-07 11:29:13.469923] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.126 [2024-10-07 11:29:13.469940] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.126 [2024-10-07 11:29:13.469999] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.126 [2024-10-07 11:29:13.470023] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.126 [2024-10-07 11:29:13.470038] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.126 [2024-10-07 11:29:13.470077] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.126 [2024-10-07 11:29:13.470100] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.126 [2024-10-07 11:29:13.470120] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.126 [2024-10-07 11:29:13.470134] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.126 [2024-10-07 11:29:13.470162] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.126 [2024-10-07 11:29:13.470181] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.126 [2024-10-07 11:29:13.470207] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.126 [2024-10-07 11:29:13.470220] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.126 [2024-10-07 11:29:13.470243] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.126 [2024-10-07 11:29:13.470257] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.126 [2024-10-07 11:29:13.484117] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.126 [2024-10-07 11:29:13.484181] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.126 [2024-10-07 11:29:13.484265] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.126 [2024-10-07 11:29:13.484293] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.126 [2024-10-07 11:29:13.484310] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.126 [2024-10-07 11:29:13.484356] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.126 [2024-10-07 11:29:13.484393] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.126 [2024-10-07 11:29:13.484425] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.126 [2024-10-07 11:29:13.484461] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.126 [2024-10-07 11:29:13.484484] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.126 [2024-10-07 11:29:13.484504] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.126 [2024-10-07 11:29:13.484534] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.126 [2024-10-07 11:29:13.484547] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.126 [2024-10-07 11:29:13.484563] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.126 [2024-10-07 11:29:13.484577] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.126 [2024-10-07 11:29:13.484589] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.126 [2024-10-07 11:29:13.485527] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.126 [2024-10-07 11:29:13.485573] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.126 [2024-10-07 11:29:13.495016] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.126 [2024-10-07 11:29:13.495061] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.126 [2024-10-07 11:29:13.496256] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.126 [2024-10-07 11:29:13.496310] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.126 [2024-10-07 11:29:13.496329] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.126 [2024-10-07 11:29:13.496375] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.126 [2024-10-07 11:29:13.496396] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.126 [2024-10-07 11:29:13.496436] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.126 [2024-10-07 11:29:13.498153] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.126 [2024-10-07 11:29:13.498207] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.126 [2024-10-07 11:29:13.498627] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.126 [2024-10-07 11:29:13.498663] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.126 [2024-10-07 11:29:13.498680] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.126 [2024-10-07 11:29:13.498697] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.126 [2024-10-07 11:29:13.498711] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.126 [2024-10-07 11:29:13.498724] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.126 [2024-10-07 11:29:13.498933] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.126 [2024-10-07 11:29:13.498957] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.126 [2024-10-07 11:29:13.506239] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.126 [2024-10-07 11:29:13.506287] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.126 [2024-10-07 11:29:13.506571] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.126 [2024-10-07 11:29:13.506603] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.126 [2024-10-07 11:29:13.506620] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.126 [2024-10-07 11:29:13.506667] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.126 [2024-10-07 11:29:13.506690] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.126 [2024-10-07 11:29:13.506705] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.126 [2024-10-07 11:29:13.506839] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.126 [2024-10-07 11:29:13.506863] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.126 [2024-10-07 11:29:13.506956] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.126 [2024-10-07 11:29:13.506985] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.126 [2024-10-07 11:29:13.506999] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.126 [2024-10-07 11:29:13.507015] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.126 [2024-10-07 11:29:13.507028] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.126 [2024-10-07 11:29:13.507041] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.126 [2024-10-07 11:29:13.507138] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.126 [2024-10-07 11:29:13.507172] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.126 [2024-10-07 11:29:13.517129] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.126 [2024-10-07 11:29:13.518369] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.126 [2024-10-07 11:29:13.518525] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.126 [2024-10-07 11:29:13.518555] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.126 [2024-10-07 11:29:13.518572] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.126 [2024-10-07 11:29:13.519172] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.126 [2024-10-07 11:29:13.519210] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.126 [2024-10-07 11:29:13.519244] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.126 [2024-10-07 11:29:13.519262] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.126 [2024-10-07 11:29:13.519342] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.126 [2024-10-07 11:29:13.519365] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.126 [2024-10-07 11:29:13.519379] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.126 [2024-10-07 11:29:13.519392] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.126 [2024-10-07 11:29:13.519415] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.126 [2024-10-07 11:29:13.519444] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.126 [2024-10-07 11:29:13.519474] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.126 [2024-10-07 11:29:13.519487] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.126 [2024-10-07 11:29:13.519507] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.127 [2024-10-07 11:29:13.528874] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.127 [2024-10-07 11:29:13.528919] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.127 [2024-10-07 11:29:13.529014] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.127 [2024-10-07 11:29:13.529041] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.127 [2024-10-07 11:29:13.529074] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.127 [2024-10-07 11:29:13.529118] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.127 [2024-10-07 11:29:13.529140] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.127 [2024-10-07 11:29:13.529156] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.127 [2024-10-07 11:29:13.529178] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.127 [2024-10-07 11:29:13.529197] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.127 [2024-10-07 11:29:13.529216] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.127 [2024-10-07 11:29:13.529230] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.127 [2024-10-07 11:29:13.529246] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.127 [2024-10-07 11:29:13.529262] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.127 [2024-10-07 11:29:13.529291] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.127 [2024-10-07 11:29:13.529305] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.127 [2024-10-07 11:29:13.529516] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.127 [2024-10-07 11:29:13.529542] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.127 [2024-10-07 11:29:13.542515] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.127 [2024-10-07 11:29:13.542560] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.127 [2024-10-07 11:29:13.542869] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.127 [2024-10-07 11:29:13.542909] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.127 [2024-10-07 11:29:13.542927] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.127 [2024-10-07 11:29:13.542973] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.127 [2024-10-07 11:29:13.542994] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.127 [2024-10-07 11:29:13.543009] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.127 [2024-10-07 11:29:13.543468] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.127 [2024-10-07 11:29:13.543508] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.127 [2024-10-07 11:29:13.543717] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.127 [2024-10-07 11:29:13.543750] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.127 [2024-10-07 11:29:13.543765] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.127 [2024-10-07 11:29:13.543781] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.127 [2024-10-07 11:29:13.543795] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.127 [2024-10-07 11:29:13.543807] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.127 [2024-10-07 11:29:13.543858] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.127 [2024-10-07 11:29:13.543877] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.127 [2024-10-07 11:29:13.553934] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.127 [2024-10-07 11:29:13.554006] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.127 [2024-10-07 11:29:13.554107] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.127 [2024-10-07 11:29:13.554137] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.127 [2024-10-07 11:29:13.554154] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.127 [2024-10-07 11:29:13.554199] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.127 [2024-10-07 11:29:13.554221] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.127 [2024-10-07 11:29:13.554236] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.127 [2024-10-07 11:29:13.554274] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.127 [2024-10-07 11:29:13.554294] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.127 [2024-10-07 11:29:13.554328] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.127 [2024-10-07 11:29:13.554341] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.127 [2024-10-07 11:29:13.554354] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.127 [2024-10-07 11:29:13.554369] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.127 [2024-10-07 11:29:13.554382] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.127 [2024-10-07 11:29:13.554394] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.127 [2024-10-07 11:29:13.554415] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.127 [2024-10-07 11:29:13.554428] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.127 [2024-10-07 11:29:13.568835] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.127 [2024-10-07 11:29:13.568883] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.127 [2024-10-07 11:29:13.569300] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.127 [2024-10-07 11:29:13.569341] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.127 [2024-10-07 11:29:13.569360] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.127 [2024-10-07 11:29:13.569407] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.127 [2024-10-07 11:29:13.569459] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.127 [2024-10-07 11:29:13.569474] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.127 [2024-10-07 11:29:13.569741] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.127 [2024-10-07 11:29:13.569777] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.127 [2024-10-07 11:29:13.569846] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.127 [2024-10-07 11:29:13.569866] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.127 [2024-10-07 11:29:13.569879] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.127 [2024-10-07 11:29:13.569895] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.127 [2024-10-07 11:29:13.569909] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.127 [2024-10-07 11:29:13.569921] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.127 [2024-10-07 11:29:13.569943] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.127 [2024-10-07 11:29:13.569956] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.127 [2024-10-07 11:29:13.581616] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.127 [2024-10-07 11:29:13.581663] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.127 [2024-10-07 11:29:13.581762] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.127 [2024-10-07 11:29:13.581834] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.127 [2024-10-07 11:29:13.581852] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.127 [2024-10-07 11:29:13.581899] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.127 [2024-10-07 11:29:13.581921] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.127 [2024-10-07 11:29:13.581936] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.127 [2024-10-07 11:29:13.581959] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.127 [2024-10-07 11:29:13.582008] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.127 [2024-10-07 11:29:13.582028] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.127 [2024-10-07 11:29:13.582042] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.127 [2024-10-07 11:29:13.582055] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.127 [2024-10-07 11:29:13.582071] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.127 [2024-10-07 11:29:13.582084] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.127 [2024-10-07 11:29:13.582097] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.127 [2024-10-07 11:29:13.582119] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.127 [2024-10-07 11:29:13.582132] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.127 [2024-10-07 11:29:13.594977] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.127 [2024-10-07 11:29:13.595023] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.127 [2024-10-07 11:29:13.595119] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.127 [2024-10-07 11:29:13.595146] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.127 [2024-10-07 11:29:13.595162] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.127 [2024-10-07 11:29:13.595206] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.127 [2024-10-07 11:29:13.595227] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.127 [2024-10-07 11:29:13.595242] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.128 [2024-10-07 11:29:13.595710] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.128 [2024-10-07 11:29:13.595748] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.128 [2024-10-07 11:29:13.595965] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.128 [2024-10-07 11:29:13.595998] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.128 [2024-10-07 11:29:13.596013] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.128 [2024-10-07 11:29:13.596029] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.128 [2024-10-07 11:29:13.596042] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.128 [2024-10-07 11:29:13.596070] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.128 [2024-10-07 11:29:13.596304] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.128 [2024-10-07 11:29:13.596329] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.128 [2024-10-07 11:29:13.608876] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.128 [2024-10-07 11:29:13.608924] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.128 [2024-10-07 11:29:13.609007] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.128 [2024-10-07 11:29:13.609034] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.128 [2024-10-07 11:29:13.609051] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.128 [2024-10-07 11:29:13.609096] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.128 [2024-10-07 11:29:13.609118] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.128 [2024-10-07 11:29:13.609133] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.128 [2024-10-07 11:29:13.609156] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.128 [2024-10-07 11:29:13.609175] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.128 [2024-10-07 11:29:13.609195] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.128 [2024-10-07 11:29:13.609209] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.128 [2024-10-07 11:29:13.609223] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.128 [2024-10-07 11:29:13.609238] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.128 [2024-10-07 11:29:13.609252] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.128 [2024-10-07 11:29:13.609265] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.128 [2024-10-07 11:29:13.609288] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.128 [2024-10-07 11:29:13.609302] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.128 [2024-10-07 11:29:13.619442] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.128 [2024-10-07 11:29:13.619488] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.128 [2024-10-07 11:29:13.619584] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.128 [2024-10-07 11:29:13.619611] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.128 [2024-10-07 11:29:13.619627] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.128 [2024-10-07 11:29:13.619671] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.128 [2024-10-07 11:29:13.619692] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.128 [2024-10-07 11:29:13.619707] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.128 [2024-10-07 11:29:13.622415] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.128 [2024-10-07 11:29:13.622501] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.128 [2024-10-07 11:29:13.622929] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.128 [2024-10-07 11:29:13.622965] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.128 [2024-10-07 11:29:13.622981] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.128 [2024-10-07 11:29:13.622998] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.128 [2024-10-07 11:29:13.623011] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.128 [2024-10-07 11:29:13.623023] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.128 [2024-10-07 11:29:13.623189] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.128 [2024-10-07 11:29:13.623211] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.128 [2024-10-07 11:29:13.629562] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.128 [2024-10-07 11:29:13.629638] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.128 [2024-10-07 11:29:13.629725] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.128 [2024-10-07 11:29:13.629752] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.128 [2024-10-07 11:29:13.629768] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.128 [2024-10-07 11:29:13.629817] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.128 [2024-10-07 11:29:13.629839] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.128 [2024-10-07 11:29:13.629853] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.128 [2024-10-07 11:29:13.629870] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.128 [2024-10-07 11:29:13.629892] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.128 [2024-10-07 11:29:13.629908] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.128 [2024-10-07 11:29:13.629920] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.128 [2024-10-07 11:29:13.629933] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.128 [2024-10-07 11:29:13.629954] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.128 [2024-10-07 11:29:13.629997] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.128 [2024-10-07 11:29:13.630011] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.128 [2024-10-07 11:29:13.630024] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.128 [2024-10-07 11:29:13.630046] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.128 [2024-10-07 11:29:13.639764] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.128 [2024-10-07 11:29:13.639810] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.128 [2024-10-07 11:29:13.639906] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.128 [2024-10-07 11:29:13.639933] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.128 [2024-10-07 11:29:13.639963] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.128 [2024-10-07 11:29:13.640011] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.128 [2024-10-07 11:29:13.640033] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.128 [2024-10-07 11:29:13.640048] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.128 [2024-10-07 11:29:13.640287] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.128 [2024-10-07 11:29:13.640315] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.128 [2024-10-07 11:29:13.640585] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.128 [2024-10-07 11:29:13.640623] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.128 [2024-10-07 11:29:13.640640] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.128 [2024-10-07 11:29:13.640657] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.128 [2024-10-07 11:29:13.640670] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.128 [2024-10-07 11:29:13.640683] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.128 [2024-10-07 11:29:13.640744] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.128 [2024-10-07 11:29:13.640766] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.128 [2024-10-07 11:29:13.652889] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.128 [2024-10-07 11:29:13.652937] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.128 [2024-10-07 11:29:13.653642] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.128 [2024-10-07 11:29:13.653698] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.128 [2024-10-07 11:29:13.653716] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.128 [2024-10-07 11:29:13.653778] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.128 [2024-10-07 11:29:13.653800] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.128 [2024-10-07 11:29:13.653814] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.128 [2024-10-07 11:29:13.654156] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.128 [2024-10-07 11:29:13.654188] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.128 [2024-10-07 11:29:13.654258] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.128 [2024-10-07 11:29:13.654280] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.128 [2024-10-07 11:29:13.654295] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.128 [2024-10-07 11:29:13.654312] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.128 [2024-10-07 11:29:13.654326] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.129 [2024-10-07 11:29:13.654339] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.129 [2024-10-07 11:29:13.654379] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.129 [2024-10-07 11:29:13.654394] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.129 [2024-10-07 11:29:13.666972] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.129 [2024-10-07 11:29:13.667020] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.129 [2024-10-07 11:29:13.667950] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.129 [2024-10-07 11:29:13.667982] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.129 [2024-10-07 11:29:13.667998] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.129 [2024-10-07 11:29:13.668043] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.129 [2024-10-07 11:29:13.668064] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.129 [2024-10-07 11:29:13.668095] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.129 [2024-10-07 11:29:13.668334] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.129 [2024-10-07 11:29:13.668364] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.129 [2024-10-07 11:29:13.668658] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.129 [2024-10-07 11:29:13.668686] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.129 [2024-10-07 11:29:13.668701] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.129 [2024-10-07 11:29:13.668718] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.129 [2024-10-07 11:29:13.668732] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.129 [2024-10-07 11:29:13.668745] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.129 [2024-10-07 11:29:13.668868] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.129 [2024-10-07 11:29:13.668891] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.129 [2024-10-07 11:29:13.679497] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.129 [2024-10-07 11:29:13.679543] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.129 [2024-10-07 11:29:13.679724] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.129 [2024-10-07 11:29:13.679764] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.129 [2024-10-07 11:29:13.679783] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.129 [2024-10-07 11:29:13.679846] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.129 [2024-10-07 11:29:13.679869] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.129 [2024-10-07 11:29:13.679884] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.129 [2024-10-07 11:29:13.680082] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.129 [2024-10-07 11:29:13.680119] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.129 [2024-10-07 11:29:13.680186] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.129 [2024-10-07 11:29:13.680208] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.129 [2024-10-07 11:29:13.680222] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.129 [2024-10-07 11:29:13.680238] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.129 [2024-10-07 11:29:13.680252] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.129 [2024-10-07 11:29:13.680265] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.129 [2024-10-07 11:29:13.680287] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.129 [2024-10-07 11:29:13.680301] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.129 [2024-10-07 11:29:13.697040] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.129 [2024-10-07 11:29:13.697086] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.129 [2024-10-07 11:29:13.697247] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.129 [2024-10-07 11:29:13.697276] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.129 [2024-10-07 11:29:13.697293] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.129 [2024-10-07 11:29:13.697337] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.129 [2024-10-07 11:29:13.697358] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.129 [2024-10-07 11:29:13.697373] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.129 [2024-10-07 11:29:13.697395] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.129 [2024-10-07 11:29:13.697413] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.129 [2024-10-07 11:29:13.697463] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.129 [2024-10-07 11:29:13.697480] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.129 [2024-10-07 11:29:13.697494] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.129 [2024-10-07 11:29:13.697510] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.129 [2024-10-07 11:29:13.697524] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.129 [2024-10-07 11:29:13.697537] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.129 [2024-10-07 11:29:13.697560] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.129 [2024-10-07 11:29:13.697574] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.129 [2024-10-07 11:29:13.711238] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.129 [2024-10-07 11:29:13.711285] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.129 [2024-10-07 11:29:13.711686] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.129 [2024-10-07 11:29:13.711728] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.129 [2024-10-07 11:29:13.711746] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.129 [2024-10-07 11:29:13.711830] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.129 [2024-10-07 11:29:13.711853] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.129 [2024-10-07 11:29:13.711868] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.129 [2024-10-07 11:29:13.712060] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.129 [2024-10-07 11:29:13.712118] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.129 [2024-10-07 11:29:13.712172] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.129 [2024-10-07 11:29:13.712193] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.129 [2024-10-07 11:29:13.712207] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.129 [2024-10-07 11:29:13.712223] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.129 [2024-10-07 11:29:13.712236] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.129 [2024-10-07 11:29:13.712248] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.129 [2024-10-07 11:29:13.712271] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.129 [2024-10-07 11:29:13.712284] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.129 [2024-10-07 11:29:13.723479] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.129 [2024-10-07 11:29:13.723525] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.129 [2024-10-07 11:29:13.723622] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.129 [2024-10-07 11:29:13.723648] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.129 [2024-10-07 11:29:13.723664] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.129 [2024-10-07 11:29:13.723707] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.129 [2024-10-07 11:29:13.723738] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.129 [2024-10-07 11:29:13.723753] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.129 [2024-10-07 11:29:13.723775] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.129 [2024-10-07 11:29:13.723793] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.129 [2024-10-07 11:29:13.723812] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.129 [2024-10-07 11:29:13.723825] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.129 [2024-10-07 11:29:13.723838] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.129 [2024-10-07 11:29:13.723852] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.130 [2024-10-07 11:29:13.723866] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.130 [2024-10-07 11:29:13.723878] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.130 [2024-10-07 11:29:13.723899] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.130 [2024-10-07 11:29:13.723925] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.130 [2024-10-07 11:29:13.735581] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.130 [2024-10-07 11:29:13.735627] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.130 [2024-10-07 11:29:13.736923] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.130 [2024-10-07 11:29:13.736979] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.130 [2024-10-07 11:29:13.736997] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.130 [2024-10-07 11:29:13.737044] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.130 [2024-10-07 11:29:13.737065] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.130 [2024-10-07 11:29:13.737079] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.130 [2024-10-07 11:29:13.737192] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.130 [2024-10-07 11:29:13.737217] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.130 [2024-10-07 11:29:13.737237] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.130 [2024-10-07 11:29:13.737251] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.130 [2024-10-07 11:29:13.737263] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.130 [2024-10-07 11:29:13.737279] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.130 [2024-10-07 11:29:13.737292] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.130 [2024-10-07 11:29:13.737304] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.130 [2024-10-07 11:29:13.737337] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.130 [2024-10-07 11:29:13.737352] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.130 [2024-10-07 11:29:13.749336] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.130 [2024-10-07 11:29:13.749382] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.130 [2024-10-07 11:29:13.749586] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.130 [2024-10-07 11:29:13.749616] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.130 [2024-10-07 11:29:13.749633] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.130 [2024-10-07 11:29:13.749677] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.130 [2024-10-07 11:29:13.749698] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.130 [2024-10-07 11:29:13.749713] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.130 [2024-10-07 11:29:13.749873] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.130 [2024-10-07 11:29:13.749900] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.130 [2024-10-07 11:29:13.749947] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.130 [2024-10-07 11:29:13.750027] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.130 [2024-10-07 11:29:13.750050] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.130 [2024-10-07 11:29:13.750067] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.130 [2024-10-07 11:29:13.750081] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.130 [2024-10-07 11:29:13.750094] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.130 [2024-10-07 11:29:13.750118] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.130 [2024-10-07 11:29:13.750132] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.130 [2024-10-07 11:29:13.762251] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.130 [2024-10-07 11:29:13.762316] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.130 [2024-10-07 11:29:13.762401] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.130 [2024-10-07 11:29:13.762453] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.130 [2024-10-07 11:29:13.762474] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.130 [2024-10-07 11:29:13.762525] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.130 [2024-10-07 11:29:13.762548] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.130 [2024-10-07 11:29:13.762564] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.130 [2024-10-07 11:29:13.763413] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.130 [2024-10-07 11:29:13.763463] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.130 [2024-10-07 11:29:13.764266] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.130 [2024-10-07 11:29:13.764302] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.130 [2024-10-07 11:29:13.764319] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.130 [2024-10-07 11:29:13.764336] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.130 [2024-10-07 11:29:13.764351] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.130 [2024-10-07 11:29:13.764364] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.130 [2024-10-07 11:29:13.764916] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.130 [2024-10-07 11:29:13.764952] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.130 [2024-10-07 11:29:13.775914] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.130 [2024-10-07 11:29:13.775960] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.130 [2024-10-07 11:29:13.776232] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.130 [2024-10-07 11:29:13.776273] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.130 [2024-10-07 11:29:13.776292] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.130 [2024-10-07 11:29:13.776339] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.130 [2024-10-07 11:29:13.776379] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.130 [2024-10-07 11:29:13.776396] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.130 [2024-10-07 11:29:13.776656] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.130 [2024-10-07 11:29:13.776686] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.130 [2024-10-07 11:29:13.776754] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.130 [2024-10-07 11:29:13.776776] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.130 [2024-10-07 11:29:13.776790] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.130 [2024-10-07 11:29:13.776805] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.130 [2024-10-07 11:29:13.776819] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.130 [2024-10-07 11:29:13.776831] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.130 [2024-10-07 11:29:13.776853] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.130 [2024-10-07 11:29:13.776866] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.130 [2024-10-07 11:29:13.786074] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.130 [2024-10-07 11:29:13.786121] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.130 [2024-10-07 11:29:13.786206] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.130 [2024-10-07 11:29:13.786234] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.130 [2024-10-07 11:29:13.786251] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.130 [2024-10-07 11:29:13.786309] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.130 [2024-10-07 11:29:13.786330] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.130 [2024-10-07 11:29:13.786345] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.130 [2024-10-07 11:29:13.786368] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.130 [2024-10-07 11:29:13.786386] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.130 [2024-10-07 11:29:13.788671] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.130 [2024-10-07 11:29:13.788709] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.130 [2024-10-07 11:29:13.788726] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.130 [2024-10-07 11:29:13.788743] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.130 [2024-10-07 11:29:13.788758] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.130 [2024-10-07 11:29:13.788770] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.130 [2024-10-07 11:29:13.789590] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.130 [2024-10-07 11:29:13.789623] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.130 [2024-10-07 11:29:13.796212] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.130 [2024-10-07 11:29:13.796289] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.130 [2024-10-07 11:29:13.796365] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.130 [2024-10-07 11:29:13.796393] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.131 [2024-10-07 11:29:13.796410] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.131 [2024-10-07 11:29:13.796480] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.131 [2024-10-07 11:29:13.796505] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.131 [2024-10-07 11:29:13.796520] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.131 [2024-10-07 11:29:13.796538] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.131 [2024-10-07 11:29:13.796562] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.131 [2024-10-07 11:29:13.796579] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.131 [2024-10-07 11:29:13.796593] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.131 [2024-10-07 11:29:13.796606] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.131 [2024-10-07 11:29:13.796629] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.131 [2024-10-07 11:29:13.796643] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.131 [2024-10-07 11:29:13.796656] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.131 [2024-10-07 11:29:13.796669] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.131 [2024-10-07 11:29:13.796690] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.131 [2024-10-07 11:29:13.806305] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.131 [2024-10-07 11:29:13.806422] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.131 [2024-10-07 11:29:13.806452] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.131 [2024-10-07 11:29:13.806470] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.131 [2024-10-07 11:29:13.806507] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.131 [2024-10-07 11:29:13.806536] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.131 [2024-10-07 11:29:13.806563] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.131 [2024-10-07 11:29:13.806579] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.131 [2024-10-07 11:29:13.806593] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.131 [2024-10-07 11:29:13.806614] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.131 [2024-10-07 11:29:13.806665] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.131 [2024-10-07 11:29:13.806688] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.131 [2024-10-07 11:29:13.806704] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.131 [2024-10-07 11:29:13.806743] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.131 [2024-10-07 11:29:13.806780] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.131 [2024-10-07 11:29:13.806795] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.131 [2024-10-07 11:29:13.806808] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.131 [2024-10-07 11:29:13.806829] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.131 [2024-10-07 11:29:13.816386] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.131 [2024-10-07 11:29:13.816502] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.131 [2024-10-07 11:29:13.816533] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.131 [2024-10-07 11:29:13.816550] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.131 [2024-10-07 11:29:13.816573] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.131 [2024-10-07 11:29:13.816608] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.131 [2024-10-07 11:29:13.816626] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.131 [2024-10-07 11:29:13.816640] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.131 [2024-10-07 11:29:13.816663] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.131 [2024-10-07 11:29:13.816682] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.131 [2024-10-07 11:29:13.816743] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.131 [2024-10-07 11:29:13.816769] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.131 [2024-10-07 11:29:13.816800] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.131 [2024-10-07 11:29:13.816821] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.131 [2024-10-07 11:29:13.816842] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.131 [2024-10-07 11:29:13.816856] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.131 [2024-10-07 11:29:13.816869] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.131 [2024-10-07 11:29:13.816890] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.131 [2024-10-07 11:29:13.828104] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.131 [2024-10-07 11:29:13.828150] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.131 [2024-10-07 11:29:13.828284] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.131 [2024-10-07 11:29:13.828312] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.131 [2024-10-07 11:29:13.828328] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.131 [2024-10-07 11:29:13.828372] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.131 [2024-10-07 11:29:13.828393] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.131 [2024-10-07 11:29:13.828422] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.131 [2024-10-07 11:29:13.828464] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.131 [2024-10-07 11:29:13.828483] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.131 [2024-10-07 11:29:13.828502] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.131 [2024-10-07 11:29:13.828515] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.131 [2024-10-07 11:29:13.828528] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.131 [2024-10-07 11:29:13.828543] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.131 [2024-10-07 11:29:13.828557] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.131 [2024-10-07 11:29:13.828569] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.131 [2024-10-07 11:29:13.828827] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.131 [2024-10-07 11:29:13.828850] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.131 [2024-10-07 11:29:13.838226] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.131 [2024-10-07 11:29:13.838289] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.131 [2024-10-07 11:29:13.838368] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.131 [2024-10-07 11:29:13.838396] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.131 [2024-10-07 11:29:13.838426] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.131 [2024-10-07 11:29:13.838484] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.131 [2024-10-07 11:29:13.838508] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.131 [2024-10-07 11:29:13.838523] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.131 [2024-10-07 11:29:13.838541] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.131 [2024-10-07 11:29:13.838579] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.131 [2024-10-07 11:29:13.838595] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.131 [2024-10-07 11:29:13.838609] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.131 [2024-10-07 11:29:13.838621] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.131 [2024-10-07 11:29:13.838644] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.131 [2024-10-07 11:29:13.838658] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.131 [2024-10-07 11:29:13.838670] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.131 [2024-10-07 11:29:13.838683] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.131 [2024-10-07 11:29:13.838702] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.131 [2024-10-07 11:29:13.850437] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.131 [2024-10-07 11:29:13.850500] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.131 [2024-10-07 11:29:13.850772] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.131 [2024-10-07 11:29:13.850806] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.131 [2024-10-07 11:29:13.850824] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.131 [2024-10-07 11:29:13.850870] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.131 [2024-10-07 11:29:13.850893] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.131 [2024-10-07 11:29:13.850908] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.131 [2024-10-07 11:29:13.850966] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.131 [2024-10-07 11:29:13.850991] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.131 [2024-10-07 11:29:13.851160] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.131 [2024-10-07 11:29:13.851183] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.132 [2024-10-07 11:29:13.851197] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.132 [2024-10-07 11:29:13.851214] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.132 [2024-10-07 11:29:13.851228] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.132 [2024-10-07 11:29:13.851241] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.132 [2024-10-07 11:29:13.851295] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.132 [2024-10-07 11:29:13.851316] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.132 [2024-10-07 11:29:13.864916] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.132 [2024-10-07 11:29:13.864965] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.132 [2024-10-07 11:29:13.865598] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.132 [2024-10-07 11:29:13.865655] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.132 [2024-10-07 11:29:13.865689] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.132 [2024-10-07 11:29:13.865735] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.132 [2024-10-07 11:29:13.865763] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.132 [2024-10-07 11:29:13.865778] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.132 [2024-10-07 11:29:13.866013] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.132 [2024-10-07 11:29:13.866050] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.132 [2024-10-07 11:29:13.866560] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.132 [2024-10-07 11:29:13.866597] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.132 [2024-10-07 11:29:13.866614] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.132 [2024-10-07 11:29:13.866631] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.132 [2024-10-07 11:29:13.866660] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.132 [2024-10-07 11:29:13.866674] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.132 [2024-10-07 11:29:13.866910] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.132 [2024-10-07 11:29:13.866936] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.132 [2024-10-07 11:29:13.878250] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.132 [2024-10-07 11:29:13.878300] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.132 [2024-10-07 11:29:13.878398] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.132 [2024-10-07 11:29:13.878438] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.132 [2024-10-07 11:29:13.878457] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.132 [2024-10-07 11:29:13.878505] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.132 [2024-10-07 11:29:13.878542] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.132 [2024-10-07 11:29:13.878557] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.132 [2024-10-07 11:29:13.878579] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.132 [2024-10-07 11:29:13.878598] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.132 [2024-10-07 11:29:13.878617] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.132 [2024-10-07 11:29:13.878630] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.132 [2024-10-07 11:29:13.878643] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.132 [2024-10-07 11:29:13.878658] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.132 [2024-10-07 11:29:13.878671] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.132 [2024-10-07 11:29:13.878685] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.132 [2024-10-07 11:29:13.878706] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.132 [2024-10-07 11:29:13.878719] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.132 [2024-10-07 11:29:13.888478] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.132 [2024-10-07 11:29:13.888523] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.132 [2024-10-07 11:29:13.888618] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.132 [2024-10-07 11:29:13.888645] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.132 [2024-10-07 11:29:13.888661] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.132 [2024-10-07 11:29:13.888705] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.132 [2024-10-07 11:29:13.888727] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.132 [2024-10-07 11:29:13.888741] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.132 [2024-10-07 11:29:13.891490] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.132 [2024-10-07 11:29:13.891535] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.132 [2024-10-07 11:29:13.893115] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.132 [2024-10-07 11:29:13.893152] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.132 [2024-10-07 11:29:13.893185] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.132 [2024-10-07 11:29:13.893203] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.132 [2024-10-07 11:29:13.893217] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.132 [2024-10-07 11:29:13.893229] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.132 [2024-10-07 11:29:13.893307] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.132 [2024-10-07 11:29:13.893329] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.132 [2024-10-07 11:29:13.899081] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.132 [2024-10-07 11:29:13.899126] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.132 [2024-10-07 11:29:13.899298] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.132 [2024-10-07 11:29:13.899327] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.132 [2024-10-07 11:29:13.899343] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.132 [2024-10-07 11:29:13.899387] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.132 [2024-10-07 11:29:13.899409] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.132 [2024-10-07 11:29:13.899437] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.132 [2024-10-07 11:29:13.899476] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.132 [2024-10-07 11:29:13.899498] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.132 [2024-10-07 11:29:13.899518] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.132 [2024-10-07 11:29:13.899532] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.132 [2024-10-07 11:29:13.899545] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.132 [2024-10-07 11:29:13.899561] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.132 [2024-10-07 11:29:13.899575] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.132 [2024-10-07 11:29:13.899587] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.132 [2024-10-07 11:29:13.899609] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.132 [2024-10-07 11:29:13.899623] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.132 [2024-10-07 11:29:13.909236] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.132 [2024-10-07 11:29:13.909281] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.132 [2024-10-07 11:29:13.909391] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.132 [2024-10-07 11:29:13.909450] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.132 [2024-10-07 11:29:13.909483] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.132 [2024-10-07 11:29:13.909535] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.132 [2024-10-07 11:29:13.909558] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.132 [2024-10-07 11:29:13.909574] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.132 [2024-10-07 11:29:13.909598] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.132 [2024-10-07 11:29:13.909617] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.132 [2024-10-07 11:29:13.909637] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.132 [2024-10-07 11:29:13.909651] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.132 [2024-10-07 11:29:13.909665] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.132 [2024-10-07 11:29:13.909680] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.132 [2024-10-07 11:29:13.909699] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.132 [2024-10-07 11:29:13.909712] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.132 [2024-10-07 11:29:13.909750] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.132 [2024-10-07 11:29:13.909763] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.132 [2024-10-07 11:29:13.921024] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.132 [2024-10-07 11:29:13.921070] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.133 [2024-10-07 11:29:13.921265] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.133 [2024-10-07 11:29:13.921300] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.133 [2024-10-07 11:29:13.921316] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.133 [2024-10-07 11:29:13.921360] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.133 [2024-10-07 11:29:13.921381] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.133 [2024-10-07 11:29:13.921396] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.133 [2024-10-07 11:29:13.921506] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.133 [2024-10-07 11:29:13.921531] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.133 [2024-10-07 11:29:13.921621] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.133 [2024-10-07 11:29:13.921639] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.133 [2024-10-07 11:29:13.921652] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.133 [2024-10-07 11:29:13.921667] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.133 [2024-10-07 11:29:13.921681] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.133 [2024-10-07 11:29:13.921707] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.133 [2024-10-07 11:29:13.922055] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.133 [2024-10-07 11:29:13.922079] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.133 [2024-10-07 11:29:13.933430] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.133 [2024-10-07 11:29:13.933487] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.133 [2024-10-07 11:29:13.933689] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.133 [2024-10-07 11:29:13.933718] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.133 [2024-10-07 11:29:13.933735] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.133 [2024-10-07 11:29:13.933779] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.133 [2024-10-07 11:29:13.933800] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.133 [2024-10-07 11:29:13.933814] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.133 [2024-10-07 11:29:13.933921] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.133 [2024-10-07 11:29:13.933945] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.133 [2024-10-07 11:29:13.934067] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.133 [2024-10-07 11:29:13.934088] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.133 [2024-10-07 11:29:13.934102] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.133 [2024-10-07 11:29:13.934118] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.133 [2024-10-07 11:29:13.934132] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.133 [2024-10-07 11:29:13.934145] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.133 [2024-10-07 11:29:13.935386] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.133 [2024-10-07 11:29:13.935451] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.133 [2024-10-07 11:29:13.947277] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.133 [2024-10-07 11:29:13.947324] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.133 [2024-10-07 11:29:13.947528] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.133 [2024-10-07 11:29:13.947557] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.133 [2024-10-07 11:29:13.947573] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.133 [2024-10-07 11:29:13.947618] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.133 [2024-10-07 11:29:13.947639] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.133 [2024-10-07 11:29:13.947653] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.133 [2024-10-07 11:29:13.949018] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.133 [2024-10-07 11:29:13.949089] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.133 [2024-10-07 11:29:13.950629] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.133 [2024-10-07 11:29:13.950666] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.133 [2024-10-07 11:29:13.950699] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.133 [2024-10-07 11:29:13.950716] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.133 [2024-10-07 11:29:13.950729] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.133 [2024-10-07 11:29:13.950742] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.133 [2024-10-07 11:29:13.951372] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.133 [2024-10-07 11:29:13.951406] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.133 [2024-10-07 11:29:13.957660] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.133 [2024-10-07 11:29:13.957705] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.133 [2024-10-07 11:29:13.957899] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.133 [2024-10-07 11:29:13.957928] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.133 [2024-10-07 11:29:13.957951] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.133 [2024-10-07 11:29:13.958026] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.133 [2024-10-07 11:29:13.958049] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.133 [2024-10-07 11:29:13.958065] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.133 [2024-10-07 11:29:13.958276] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.133 [2024-10-07 11:29:13.958334] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.133 [2024-10-07 11:29:13.958479] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.133 [2024-10-07 11:29:13.958503] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.133 [2024-10-07 11:29:13.958517] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.133 [2024-10-07 11:29:13.958533] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.133 [2024-10-07 11:29:13.958547] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.133 [2024-10-07 11:29:13.958559] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.133 [2024-10-07 11:29:13.958682] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.133 [2024-10-07 11:29:13.958704] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.133 [2024-10-07 11:29:13.967777] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.133 [2024-10-07 11:29:13.967852] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.133 [2024-10-07 11:29:13.967924] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.133 [2024-10-07 11:29:13.967950] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.133 [2024-10-07 11:29:13.967985] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.133 [2024-10-07 11:29:13.968039] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.133 [2024-10-07 11:29:13.968063] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.133 [2024-10-07 11:29:13.968078] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.133 [2024-10-07 11:29:13.968095] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.133 [2024-10-07 11:29:13.968118] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.133 [2024-10-07 11:29:13.968133] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.133 [2024-10-07 11:29:13.968146] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.133 [2024-10-07 11:29:13.968158] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.133 [2024-10-07 11:29:13.968197] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.133 [2024-10-07 11:29:13.968211] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.133 [2024-10-07 11:29:13.968223] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.133 [2024-10-07 11:29:13.968235] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.133 [2024-10-07 11:29:13.968255] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.134 [2024-10-07 11:29:13.981401] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.134 [2024-10-07 11:29:13.981475] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.134 [2024-10-07 11:29:13.981963] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.134 [2024-10-07 11:29:13.982063] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.134 [2024-10-07 11:29:13.982082] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.134 [2024-10-07 11:29:13.982130] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.134 [2024-10-07 11:29:13.982153] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.134 [2024-10-07 11:29:13.982168] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.134 [2024-10-07 11:29:13.982446] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.134 [2024-10-07 11:29:13.982489] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.134 [2024-10-07 11:29:13.982536] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.134 [2024-10-07 11:29:13.982555] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.134 [2024-10-07 11:29:13.982569] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.134 [2024-10-07 11:29:13.982585] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.134 [2024-10-07 11:29:13.982599] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.134 [2024-10-07 11:29:13.982612] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.134 [2024-10-07 11:29:13.982651] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.134 [2024-10-07 11:29:13.982667] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.134 [2024-10-07 11:29:13.995074] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.134 [2024-10-07 11:29:13.995121] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.134 [2024-10-07 11:29:13.995452] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.134 [2024-10-07 11:29:13.995491] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.134 [2024-10-07 11:29:13.995509] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.134 [2024-10-07 11:29:13.995558] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.134 [2024-10-07 11:29:13.995580] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.134 [2024-10-07 11:29:13.995595] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.134 [2024-10-07 11:29:13.995807] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.134 [2024-10-07 11:29:13.995837] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.134 [2024-10-07 11:29:13.996063] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.134 [2024-10-07 11:29:13.996096] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.134 [2024-10-07 11:29:13.996113] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.134 [2024-10-07 11:29:13.996129] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.134 [2024-10-07 11:29:13.996143] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.134 [2024-10-07 11:29:13.996155] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.134 [2024-10-07 11:29:13.996212] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.134 [2024-10-07 11:29:13.996231] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.134 [2024-10-07 11:29:14.007560] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.134 [2024-10-07 11:29:14.007606] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.134 [2024-10-07 11:29:14.007700] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.134 [2024-10-07 11:29:14.007727] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.134 [2024-10-07 11:29:14.007743] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.134 [2024-10-07 11:29:14.007786] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.134 [2024-10-07 11:29:14.007807] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.134 [2024-10-07 11:29:14.007822] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.134 [2024-10-07 11:29:14.007844] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.134 [2024-10-07 11:29:14.007862] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.134 [2024-10-07 11:29:14.007897] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.134 [2024-10-07 11:29:14.007911] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.134 [2024-10-07 11:29:14.007924] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.134 [2024-10-07 11:29:14.007940] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.134 [2024-10-07 11:29:14.007953] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.134 [2024-10-07 11:29:14.007965] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.134 [2024-10-07 11:29:14.008212] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.134 [2024-10-07 11:29:14.008236] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.134 [2024-10-07 11:29:14.020566] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.134 [2024-10-07 11:29:14.020613] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.134 [2024-10-07 11:29:14.020793] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.134 [2024-10-07 11:29:14.020822] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.134 [2024-10-07 11:29:14.020838] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.134 [2024-10-07 11:29:14.020881] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.134 [2024-10-07 11:29:14.020903] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.134 [2024-10-07 11:29:14.020918] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.134 [2024-10-07 11:29:14.021024] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.134 [2024-10-07 11:29:14.021049] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.134 [2024-10-07 11:29:14.021140] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.134 [2024-10-07 11:29:14.021157] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.134 [2024-10-07 11:29:14.021170] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.134 [2024-10-07 11:29:14.021202] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.134 [2024-10-07 11:29:14.021216] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.134 [2024-10-07 11:29:14.021229] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.134 [2024-10-07 11:29:14.022342] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.134 [2024-10-07 11:29:14.022378] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.134 [2024-10-07 11:29:14.030868] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.134 [2024-10-07 11:29:14.030916] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.134 [2024-10-07 11:29:14.030997] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.134 [2024-10-07 11:29:14.031026] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.134 [2024-10-07 11:29:14.031042] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.134 [2024-10-07 11:29:14.031109] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.134 [2024-10-07 11:29:14.031133] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.134 [2024-10-07 11:29:14.031149] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.134 [2024-10-07 11:29:14.031173] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.134 [2024-10-07 11:29:14.031192] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.134 [2024-10-07 11:29:14.031212] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.134 [2024-10-07 11:29:14.031226] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.134 [2024-10-07 11:29:14.031240] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.134 [2024-10-07 11:29:14.031257] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.134 [2024-10-07 11:29:14.031271] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.134 [2024-10-07 11:29:14.031284] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.134 [2024-10-07 11:29:14.031306] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.134 [2024-10-07 11:29:14.031320] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.134 [2024-10-07 11:29:14.043060] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.134 [2024-10-07 11:29:14.043107] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.134 [2024-10-07 11:29:14.043213] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.134 [2024-10-07 11:29:14.043241] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.134 [2024-10-07 11:29:14.043257] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.134 [2024-10-07 11:29:14.043301] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.134 [2024-10-07 11:29:14.043322] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.134 [2024-10-07 11:29:14.043336] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.135 [2024-10-07 11:29:14.043359] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.135 [2024-10-07 11:29:14.043377] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.135 [2024-10-07 11:29:14.043396] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.135 [2024-10-07 11:29:14.043421] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.135 [2024-10-07 11:29:14.043437] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.135 [2024-10-07 11:29:14.043452] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.135 [2024-10-07 11:29:14.043466] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.135 [2024-10-07 11:29:14.043478] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.135 [2024-10-07 11:29:14.043500] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.135 [2024-10-07 11:29:14.043528] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.135 [2024-10-07 11:29:14.053475] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.135 [2024-10-07 11:29:14.053521] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.135 [2024-10-07 11:29:14.053702] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.135 [2024-10-07 11:29:14.053732] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.135 [2024-10-07 11:29:14.053748] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.135 [2024-10-07 11:29:14.053793] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.135 [2024-10-07 11:29:14.053815] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.135 [2024-10-07 11:29:14.053846] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.135 [2024-10-07 11:29:14.055411] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.135 [2024-10-07 11:29:14.055478] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.135 [2024-10-07 11:29:14.056124] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.135 [2024-10-07 11:29:14.056157] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.135 [2024-10-07 11:29:14.056188] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.135 [2024-10-07 11:29:14.056205] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.135 [2024-10-07 11:29:14.056218] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.135 [2024-10-07 11:29:14.056231] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.135 [2024-10-07 11:29:14.056254] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.135 [2024-10-07 11:29:14.056268] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.135 [2024-10-07 11:29:14.063595] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.135 [2024-10-07 11:29:14.063657] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.135 [2024-10-07 11:29:14.063737] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.135 [2024-10-07 11:29:14.063764] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.135 [2024-10-07 11:29:14.063781] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.135 [2024-10-07 11:29:14.063834] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.135 [2024-10-07 11:29:14.063857] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.135 [2024-10-07 11:29:14.063873] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.135 [2024-10-07 11:29:14.063891] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.135 [2024-10-07 11:29:14.063915] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.135 [2024-10-07 11:29:14.063932] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.135 [2024-10-07 11:29:14.063967] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.135 [2024-10-07 11:29:14.063981] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.135 [2024-10-07 11:29:14.065289] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.135 [2024-10-07 11:29:14.065328] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.135 [2024-10-07 11:29:14.065345] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.135 [2024-10-07 11:29:14.065358] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.135 [2024-10-07 11:29:14.066101] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.135 [2024-10-07 11:29:14.074559] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.135 [2024-10-07 11:29:14.074604] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.135 [2024-10-07 11:29:14.075229] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.135 [2024-10-07 11:29:14.075284] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.135 [2024-10-07 11:29:14.075303] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.135 [2024-10-07 11:29:14.075351] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.135 [2024-10-07 11:29:14.075372] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.135 [2024-10-07 11:29:14.075402] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.135 [2024-10-07 11:29:14.075503] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.135 [2024-10-07 11:29:14.075531] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.135 [2024-10-07 11:29:14.075551] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.135 [2024-10-07 11:29:14.075566] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.135 [2024-10-07 11:29:14.075579] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.135 [2024-10-07 11:29:14.075595] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.135 [2024-10-07 11:29:14.075608] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.135 [2024-10-07 11:29:14.075621] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.135 [2024-10-07 11:29:14.075643] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.135 [2024-10-07 11:29:14.075657] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.135 [2024-10-07 11:29:14.086015] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.135 [2024-10-07 11:29:14.086070] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.135 [2024-10-07 11:29:14.086346] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.135 [2024-10-07 11:29:14.086429] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.135 [2024-10-07 11:29:14.086449] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.135 [2024-10-07 11:29:14.086496] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.135 [2024-10-07 11:29:14.086533] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.135 [2024-10-07 11:29:14.086549] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.135 [2024-10-07 11:29:14.086754] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.135 [2024-10-07 11:29:14.086784] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.135 [2024-10-07 11:29:14.086836] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.135 [2024-10-07 11:29:14.086856] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.135 [2024-10-07 11:29:14.086869] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.135 [2024-10-07 11:29:14.086885] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.135 [2024-10-07 11:29:14.086899] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.135 [2024-10-07 11:29:14.086911] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.135 [2024-10-07 11:29:14.087071] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.135 [2024-10-07 11:29:14.087092] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.135 [2024-10-07 11:29:14.096619] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.135 [2024-10-07 11:29:14.096665] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.135 [2024-10-07 11:29:14.096771] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.135 [2024-10-07 11:29:14.096799] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.135 [2024-10-07 11:29:14.096815] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.135 [2024-10-07 11:29:14.096860] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.135 [2024-10-07 11:29:14.096881] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.135 [2024-10-07 11:29:14.096896] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.135 [2024-10-07 11:29:14.099651] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.135 [2024-10-07 11:29:14.099694] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.135 [2024-10-07 11:29:14.100419] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.135 [2024-10-07 11:29:14.100462] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.135 [2024-10-07 11:29:14.100496] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.135 [2024-10-07 11:29:14.100512] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.135 [2024-10-07 11:29:14.100525] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.135 [2024-10-07 11:29:14.100537] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.136 [2024-10-07 11:29:14.100718] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.136 [2024-10-07 11:29:14.100741] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.136 [2024-10-07 11:29:14.106752] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.136 [2024-10-07 11:29:14.106828] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.136 [2024-10-07 11:29:14.106899] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.136 [2024-10-07 11:29:14.106926] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.136 [2024-10-07 11:29:14.106942] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.136 [2024-10-07 11:29:14.106992] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.136 [2024-10-07 11:29:14.107014] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.136 [2024-10-07 11:29:14.107028] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.136 [2024-10-07 11:29:14.107045] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.136 [2024-10-07 11:29:14.107067] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.136 [2024-10-07 11:29:14.107083] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.136 [2024-10-07 11:29:14.107096] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.136 [2024-10-07 11:29:14.107108] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.136 [2024-10-07 11:29:14.107130] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.136 [2024-10-07 11:29:14.107143] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.136 [2024-10-07 11:29:14.107156] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.136 [2024-10-07 11:29:14.107168] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.136 [2024-10-07 11:29:14.107187] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.136 [2024-10-07 11:29:14.118742] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.136 [2024-10-07 11:29:14.118803] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.136 [2024-10-07 11:29:14.118897] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.136 [2024-10-07 11:29:14.118924] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.136 [2024-10-07 11:29:14.118940] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.136 [2024-10-07 11:29:14.118983] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.136 [2024-10-07 11:29:14.119003] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.136 [2024-10-07 11:29:14.119018] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.136 [2024-10-07 11:29:14.119040] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.136 [2024-10-07 11:29:14.119059] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.136 [2024-10-07 11:29:14.119078] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.136 [2024-10-07 11:29:14.119092] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.136 [2024-10-07 11:29:14.119120] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.136 [2024-10-07 11:29:14.119137] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.136 [2024-10-07 11:29:14.119151] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.136 [2024-10-07 11:29:14.119163] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.136 [2024-10-07 11:29:14.119184] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.136 [2024-10-07 11:29:14.119198] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.136 [2024-10-07 11:29:14.132010] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.136 [2024-10-07 11:29:14.132056] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.136 [2024-10-07 11:29:14.132168] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.136 [2024-10-07 11:29:14.132211] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.136 [2024-10-07 11:29:14.132228] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.136 [2024-10-07 11:29:14.132274] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.136 [2024-10-07 11:29:14.132296] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.136 [2024-10-07 11:29:14.132311] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.136 [2024-10-07 11:29:14.132335] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.136 [2024-10-07 11:29:14.132354] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.136 [2024-10-07 11:29:14.132374] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.136 [2024-10-07 11:29:14.132387] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.136 [2024-10-07 11:29:14.132401] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.136 [2024-10-07 11:29:14.132416] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.136 [2024-10-07 11:29:14.132429] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.136 [2024-10-07 11:29:14.132442] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.136 [2024-10-07 11:29:14.132479] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.136 [2024-10-07 11:29:14.132496] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.136 [2024-10-07 11:29:14.145472] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.136 [2024-10-07 11:29:14.145519] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.136 [2024-10-07 11:29:14.145617] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.136 [2024-10-07 11:29:14.145645] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.136 [2024-10-07 11:29:14.145661] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.136 [2024-10-07 11:29:14.145705] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.136 [2024-10-07 11:29:14.145726] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.136 [2024-10-07 11:29:14.145758] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.136 [2024-10-07 11:29:14.145784] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.136 [2024-10-07 11:29:14.145803] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.136 [2024-10-07 11:29:14.145822] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.136 [2024-10-07 11:29:14.145836] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.136 [2024-10-07 11:29:14.145864] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.136 [2024-10-07 11:29:14.145880] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.136 [2024-10-07 11:29:14.145893] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.136 [2024-10-07 11:29:14.145905] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.136 [2024-10-07 11:29:14.145927] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.136 [2024-10-07 11:29:14.145940] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.136 [2024-10-07 11:29:14.157157] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.136 [2024-10-07 11:29:14.157203] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.136 [2024-10-07 11:29:14.157299] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.136 [2024-10-07 11:29:14.157326] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.136 [2024-10-07 11:29:14.157341] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.136 [2024-10-07 11:29:14.157385] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.136 [2024-10-07 11:29:14.157406] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.136 [2024-10-07 11:29:14.157437] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.136 [2024-10-07 11:29:14.157475] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.136 [2024-10-07 11:29:14.157495] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.136 [2024-10-07 11:29:14.157515] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.136 [2024-10-07 11:29:14.157528] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.136 [2024-10-07 11:29:14.157542] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.136 [2024-10-07 11:29:14.157557] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.136 [2024-10-07 11:29:14.157570] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.136 [2024-10-07 11:29:14.157583] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.136 [2024-10-07 11:29:14.157605] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.136 [2024-10-07 11:29:14.157619] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.136 [2024-10-07 11:29:14.168301] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.136 [2024-10-07 11:29:14.168360] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.136 [2024-10-07 11:29:14.168655] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.136 [2024-10-07 11:29:14.168695] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.136 [2024-10-07 11:29:14.168713] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.136 [2024-10-07 11:29:14.168759] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.137 [2024-10-07 11:29:14.168781] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.137 [2024-10-07 11:29:14.168795] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.137 [2024-10-07 11:29:14.168858] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.137 [2024-10-07 11:29:14.168883] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.137 [2024-10-07 11:29:14.168903] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.137 [2024-10-07 11:29:14.168916] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.137 [2024-10-07 11:29:14.168930] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.137 [2024-10-07 11:29:14.168945] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.137 [2024-10-07 11:29:14.168958] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.137 [2024-10-07 11:29:14.168971] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.137 [2024-10-07 11:29:14.168992] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.137 [2024-10-07 11:29:14.169005] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.137 [2024-10-07 11:29:14.179736] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.137 [2024-10-07 11:29:14.179785] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.137 [2024-10-07 11:29:14.180555] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.137 [2024-10-07 11:29:14.180594] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.137 [2024-10-07 11:29:14.180629] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.137 [2024-10-07 11:29:14.180675] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.137 [2024-10-07 11:29:14.180696] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.137 [2024-10-07 11:29:14.180711] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.137 [2024-10-07 11:29:14.181055] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.137 [2024-10-07 11:29:14.181090] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.137 [2024-10-07 11:29:14.181159] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.137 [2024-10-07 11:29:14.181179] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.137 [2024-10-07 11:29:14.181192] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.137 [2024-10-07 11:29:14.181224] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.137 [2024-10-07 11:29:14.181239] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.137 [2024-10-07 11:29:14.181251] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.137 [2024-10-07 11:29:14.181274] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.137 [2024-10-07 11:29:14.181288] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.137 [2024-10-07 11:29:14.193514] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.137 [2024-10-07 11:29:14.193560] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.137 [2024-10-07 11:29:14.194404] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.137 [2024-10-07 11:29:14.194483] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.137 [2024-10-07 11:29:14.194503] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.137 [2024-10-07 11:29:14.194552] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.137 [2024-10-07 11:29:14.194575] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.137 [2024-10-07 11:29:14.194590] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.137 [2024-10-07 11:29:14.195226] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.137 [2024-10-07 11:29:14.195265] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.137 [2024-10-07 11:29:14.195357] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.137 [2024-10-07 11:29:14.195377] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.137 [2024-10-07 11:29:14.195390] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.137 [2024-10-07 11:29:14.195406] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.137 [2024-10-07 11:29:14.195437] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.137 [2024-10-07 11:29:14.195450] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.137 [2024-10-07 11:29:14.195473] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.137 [2024-10-07 11:29:14.195487] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.137 [2024-10-07 11:29:14.204914] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.137 [2024-10-07 11:29:14.204960] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.137 [2024-10-07 11:29:14.205324] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.137 [2024-10-07 11:29:14.205363] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.137 [2024-10-07 11:29:14.205381] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.137 [2024-10-07 11:29:14.205439] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.137 [2024-10-07 11:29:14.205463] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.137 [2024-10-07 11:29:14.205478] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.137 [2024-10-07 11:29:14.205559] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.137 [2024-10-07 11:29:14.205584] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.137 [2024-10-07 11:29:14.205603] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.137 [2024-10-07 11:29:14.205617] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.137 [2024-10-07 11:29:14.205630] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.137 [2024-10-07 11:29:14.205646] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.137 [2024-10-07 11:29:14.205659] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.137 [2024-10-07 11:29:14.205671] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.137 [2024-10-07 11:29:14.205692] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.137 [2024-10-07 11:29:14.205705] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.137 [2024-10-07 11:29:14.218603] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.137 [2024-10-07 11:29:14.218652] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.137 [2024-10-07 11:29:14.219070] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.137 [2024-10-07 11:29:14.219128] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.137 [2024-10-07 11:29:14.219147] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.137 [2024-10-07 11:29:14.219196] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.137 [2024-10-07 11:29:14.219219] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.137 [2024-10-07 11:29:14.219234] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.137 [2024-10-07 11:29:14.219982] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.137 [2024-10-07 11:29:14.220024] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.137 [2024-10-07 11:29:14.220304] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.137 [2024-10-07 11:29:14.220339] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.137 [2024-10-07 11:29:14.220356] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.137 [2024-10-07 11:29:14.220373] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.137 [2024-10-07 11:29:14.220387] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.137 [2024-10-07 11:29:14.220400] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.137 [2024-10-07 11:29:14.220623] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.137 [2024-10-07 11:29:14.220648] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.137 [2024-10-07 11:29:14.232572] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.137 [2024-10-07 11:29:14.232634] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.137 [2024-10-07 11:29:14.233441] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.137 [2024-10-07 11:29:14.233493] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.137 [2024-10-07 11:29:14.233513] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.137 [2024-10-07 11:29:14.233577] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.137 [2024-10-07 11:29:14.233599] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.137 [2024-10-07 11:29:14.233613] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.137 [2024-10-07 11:29:14.234122] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.137 [2024-10-07 11:29:14.234165] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.137 [2024-10-07 11:29:14.234405] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.137 [2024-10-07 11:29:14.234462] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.137 [2024-10-07 11:29:14.234495] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.137 [2024-10-07 11:29:14.234513] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.138 [2024-10-07 11:29:14.234526] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.138 [2024-10-07 11:29:14.234539] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.138 [2024-10-07 11:29:14.234731] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.138 [2024-10-07 11:29:14.234754] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.138 [2024-10-07 11:29:14.245694] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.138 [2024-10-07 11:29:14.245739] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.138 [2024-10-07 11:29:14.246193] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.138 [2024-10-07 11:29:14.246235] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.138 [2024-10-07 11:29:14.246254] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.138 [2024-10-07 11:29:14.246305] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.138 [2024-10-07 11:29:14.246342] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.138 [2024-10-07 11:29:14.246373] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.138 [2024-10-07 11:29:14.247107] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.138 [2024-10-07 11:29:14.247146] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.138 [2024-10-07 11:29:14.247411] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.138 [2024-10-07 11:29:14.247435] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.138 [2024-10-07 11:29:14.247497] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.138 [2024-10-07 11:29:14.247517] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.138 [2024-10-07 11:29:14.247531] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.138 [2024-10-07 11:29:14.247558] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.138 [2024-10-07 11:29:14.247763] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.138 [2024-10-07 11:29:14.247789] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.138 [2024-10-07 11:29:14.259129] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.138 [2024-10-07 11:29:14.259176] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.138 [2024-10-07 11:29:14.260041] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.138 [2024-10-07 11:29:14.260081] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.138 [2024-10-07 11:29:14.260116] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.138 [2024-10-07 11:29:14.260164] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.138 [2024-10-07 11:29:14.260202] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.138 [2024-10-07 11:29:14.260217] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.138 [2024-10-07 11:29:14.260734] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.138 [2024-10-07 11:29:14.260775] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.138 [2024-10-07 11:29:14.261014] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.138 [2024-10-07 11:29:14.261047] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.138 [2024-10-07 11:29:14.261063] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.138 [2024-10-07 11:29:14.261080] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.138 [2024-10-07 11:29:14.261094] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.138 [2024-10-07 11:29:14.261106] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.138 [2024-10-07 11:29:14.261158] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.138 [2024-10-07 11:29:14.261178] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.138 [2024-10-07 11:29:14.272529] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.138 [2024-10-07 11:29:14.272575] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.138 [2024-10-07 11:29:14.273352] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.138 [2024-10-07 11:29:14.273390] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.138 [2024-10-07 11:29:14.273432] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.138 [2024-10-07 11:29:14.273484] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.138 [2024-10-07 11:29:14.273505] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.138 [2024-10-07 11:29:14.273520] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.138 [2024-10-07 11:29:14.273869] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.138 [2024-10-07 11:29:14.273922] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.138 [2024-10-07 11:29:14.274162] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.138 [2024-10-07 11:29:14.274199] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.138 [2024-10-07 11:29:14.274216] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.138 [2024-10-07 11:29:14.274233] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.138 [2024-10-07 11:29:14.274247] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.138 [2024-10-07 11:29:14.274260] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.138 [2024-10-07 11:29:14.274519] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.138 [2024-10-07 11:29:14.274563] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.138 [2024-10-07 11:29:14.286181] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.138 [2024-10-07 11:29:14.286231] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.138 [2024-10-07 11:29:14.286708] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.138 [2024-10-07 11:29:14.286748] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.138 [2024-10-07 11:29:14.286767] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.138 [2024-10-07 11:29:14.286813] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.138 [2024-10-07 11:29:14.286834] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.138 [2024-10-07 11:29:14.286849] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.138 [2024-10-07 11:29:14.287050] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.138 [2024-10-07 11:29:14.287079] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.138 [2024-10-07 11:29:14.287262] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.138 [2024-10-07 11:29:14.287295] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.138 [2024-10-07 11:29:14.287310] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.138 [2024-10-07 11:29:14.287326] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.138 [2024-10-07 11:29:14.287340] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.138 [2024-10-07 11:29:14.287352] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.138 [2024-10-07 11:29:14.287406] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.138 [2024-10-07 11:29:14.287455] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.138 [2024-10-07 11:29:14.299098] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.138 [2024-10-07 11:29:14.299145] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.138 [2024-10-07 11:29:14.299584] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.138 [2024-10-07 11:29:14.299624] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.138 [2024-10-07 11:29:14.299658] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.138 [2024-10-07 11:29:14.299707] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.138 [2024-10-07 11:29:14.299729] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.138 [2024-10-07 11:29:14.299743] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.138 [2024-10-07 11:29:14.299945] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.138 [2024-10-07 11:29:14.299974] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.138 [2024-10-07 11:29:14.300156] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.138 [2024-10-07 11:29:14.300189] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.138 [2024-10-07 11:29:14.300205] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.139 [2024-10-07 11:29:14.300221] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.139 [2024-10-07 11:29:14.300234] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.139 [2024-10-07 11:29:14.300246] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.139 [2024-10-07 11:29:14.300466] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.139 [2024-10-07 11:29:14.300490] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.139 [2024-10-07 11:29:14.312080] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.139 [2024-10-07 11:29:14.312130] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.139 [2024-10-07 11:29:14.312635] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.139 [2024-10-07 11:29:14.312677] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.139 [2024-10-07 11:29:14.312697] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.139 [2024-10-07 11:29:14.312746] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.139 [2024-10-07 11:29:14.312768] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.139 [2024-10-07 11:29:14.312784] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.139 [2024-10-07 11:29:14.312998] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.139 [2024-10-07 11:29:14.313029] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.139 [2024-10-07 11:29:14.313223] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.139 [2024-10-07 11:29:14.313248] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.139 [2024-10-07 11:29:14.313264] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.139 [2024-10-07 11:29:14.313280] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.139 [2024-10-07 11:29:14.313295] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.139 [2024-10-07 11:29:14.313323] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.139 [2024-10-07 11:29:14.313399] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.139 [2024-10-07 11:29:14.313419] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.139 [2024-10-07 11:29:14.326052] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.139 [2024-10-07 11:29:14.326101] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.139 [2024-10-07 11:29:14.326565] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.139 [2024-10-07 11:29:14.326605] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.139 [2024-10-07 11:29:14.326624] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.139 [2024-10-07 11:29:14.326672] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.139 [2024-10-07 11:29:14.326694] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.139 [2024-10-07 11:29:14.326709] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.139 [2024-10-07 11:29:14.326930] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.139 [2024-10-07 11:29:14.326960] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.139 [2024-10-07 11:29:14.327169] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.139 [2024-10-07 11:29:14.327204] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.139 [2024-10-07 11:29:14.327220] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.139 [2024-10-07 11:29:14.327239] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.139 [2024-10-07 11:29:14.327253] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.139 [2024-10-07 11:29:14.327266] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.139 [2024-10-07 11:29:14.327325] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.139 [2024-10-07 11:29:14.327345] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.139 [2024-10-07 11:29:14.339143] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.139 [2024-10-07 11:29:14.339211] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.139 [2024-10-07 11:29:14.339642] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.139 [2024-10-07 11:29:14.339693] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.139 [2024-10-07 11:29:14.339713] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.139 [2024-10-07 11:29:14.339763] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.139 [2024-10-07 11:29:14.339786] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.139 [2024-10-07 11:29:14.339801] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.139 [2024-10-07 11:29:14.340515] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.139 [2024-10-07 11:29:14.340557] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.139 [2024-10-07 11:29:14.340817] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.139 [2024-10-07 11:29:14.340843] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.139 [2024-10-07 11:29:14.340858] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.139 [2024-10-07 11:29:14.340875] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.139 [2024-10-07 11:29:14.340890] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.139 [2024-10-07 11:29:14.340903] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.139 [2024-10-07 11:29:14.341102] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.139 [2024-10-07 11:29:14.341126] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.139 [2024-10-07 11:29:14.352689] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.139 [2024-10-07 11:29:14.352735] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.139 [2024-10-07 11:29:14.353580] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.139 [2024-10-07 11:29:14.353637] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.139 [2024-10-07 11:29:14.353657] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.139 [2024-10-07 11:29:14.353706] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.139 [2024-10-07 11:29:14.353729] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.139 [2024-10-07 11:29:14.353745] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.139 [2024-10-07 11:29:14.354173] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.139 [2024-10-07 11:29:14.354207] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.139 [2024-10-07 11:29:14.354430] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.139 [2024-10-07 11:29:14.354478] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.139 [2024-10-07 11:29:14.354510] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.139 [2024-10-07 11:29:14.354527] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.139 [2024-10-07 11:29:14.354541] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.139 [2024-10-07 11:29:14.354554] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.139 [2024-10-07 11:29:14.354744] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.139 [2024-10-07 11:29:14.354767] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.139 [2024-10-07 11:29:14.365607] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.139 [2024-10-07 11:29:14.365654] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.139 [2024-10-07 11:29:14.366124] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.139 [2024-10-07 11:29:14.366167] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.139 [2024-10-07 11:29:14.366187] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.139 [2024-10-07 11:29:14.366253] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.139 [2024-10-07 11:29:14.366278] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.139 [2024-10-07 11:29:14.366293] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.139 [2024-10-07 11:29:14.367008] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.139 [2024-10-07 11:29:14.367047] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.139 [2024-10-07 11:29:14.367291] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.139 [2024-10-07 11:29:14.367317] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.139 [2024-10-07 11:29:14.367332] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.139 [2024-10-07 11:29:14.367348] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.139 [2024-10-07 11:29:14.367361] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.139 [2024-10-07 11:29:14.367373] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.139 [2024-10-07 11:29:14.367594] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.139 [2024-10-07 11:29:14.367619] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.139 [2024-10-07 11:29:14.378771] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.139 [2024-10-07 11:29:14.378817] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.139 [2024-10-07 11:29:14.379573] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.140 [2024-10-07 11:29:14.379629] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.140 [2024-10-07 11:29:14.379648] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.140 [2024-10-07 11:29:14.379695] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.140 [2024-10-07 11:29:14.379716] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.140 [2024-10-07 11:29:14.379731] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.140 [2024-10-07 11:29:14.380079] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.140 [2024-10-07 11:29:14.380124] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.140 [2024-10-07 11:29:14.380359] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.140 [2024-10-07 11:29:14.380394] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.140 [2024-10-07 11:29:14.380420] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.140 [2024-10-07 11:29:14.380441] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.140 [2024-10-07 11:29:14.380455] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.140 [2024-10-07 11:29:14.380467] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.140 [2024-10-07 11:29:14.380675] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.140 [2024-10-07 11:29:14.380716] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.140 [2024-10-07 11:29:14.392538] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.140 [2024-10-07 11:29:14.392584] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.140 [2024-10-07 11:29:14.393411] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.140 [2024-10-07 11:29:14.393510] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.140 [2024-10-07 11:29:14.393531] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.140 [2024-10-07 11:29:14.393581] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.140 [2024-10-07 11:29:14.393604] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.140 [2024-10-07 11:29:14.393620] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.140 [2024-10-07 11:29:14.394162] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.140 [2024-10-07 11:29:14.394205] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.140 [2024-10-07 11:29:14.394459] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.140 [2024-10-07 11:29:14.394492] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.140 [2024-10-07 11:29:14.394508] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.140 [2024-10-07 11:29:14.394525] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.140 [2024-10-07 11:29:14.394539] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.140 [2024-10-07 11:29:14.394551] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.140 [2024-10-07 11:29:14.394747] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.140 [2024-10-07 11:29:14.394770] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.140 [2024-10-07 11:29:14.402825] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.140 [2024-10-07 11:29:14.402870] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.140 [2024-10-07 11:29:14.402967] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.140 [2024-10-07 11:29:14.402995] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.140 [2024-10-07 11:29:14.403011] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.140 [2024-10-07 11:29:14.403058] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.140 [2024-10-07 11:29:14.403080] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.140 [2024-10-07 11:29:14.403095] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.140 [2024-10-07 11:29:14.403272] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.140 [2024-10-07 11:29:14.403299] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.140 [2024-10-07 11:29:14.403349] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.140 [2024-10-07 11:29:14.403382] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.140 [2024-10-07 11:29:14.403397] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.140 [2024-10-07 11:29:14.403413] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.140 [2024-10-07 11:29:14.403442] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.140 [2024-10-07 11:29:14.403457] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.140 [2024-10-07 11:29:14.403624] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.140 [2024-10-07 11:29:14.403645] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.140 9097.33 IOPS, 35.54 MiB/s 00:18:34.140 Latency(us) 00:18:34.140 [2024-10-07T11:29:15.851Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:34.140 Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:18:34.140 Verification LBA range: start 0x0 length 0x4000 00:18:34.140 NVMe0n1 : 15.01 9096.08 35.53 0.00 0.00 14038.91 711.21 33363.78 00:18:34.140 [2024-10-07T11:29:15.851Z] =================================================================================================================== 00:18:34.140 [2024-10-07T11:29:15.851Z] Total : 9096.08 35.53 0.00 0.00 14038.91 711.21 33363.78 00:18:34.140 [2024-10-07 11:29:14.412925] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.140 [2024-10-07 11:29:14.413084] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.140 [2024-10-07 11:29:14.413114] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.140 [2024-10-07 11:29:14.413131] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.140 [2024-10-07 11:29:14.413149] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.140 [2024-10-07 11:29:14.413176] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.140 [2024-10-07 11:29:14.413233] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.140 [2024-10-07 11:29:14.413257] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.140 [2024-10-07 11:29:14.413273] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.140 [2024-10-07 11:29:14.413287] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.140 [2024-10-07 11:29:14.413300] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.140 [2024-10-07 11:29:14.413313] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.140 [2024-10-07 11:29:14.413330] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.140 [2024-10-07 11:29:14.413346] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.140 [2024-10-07 11:29:14.413364] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.140 [2024-10-07 11:29:14.413393] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.140 [2024-10-07 11:29:14.413406] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.140 [2024-10-07 11:29:14.413420] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.140 [2024-10-07 11:29:14.423020] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.140 [2024-10-07 11:29:14.423109] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.140 [2024-10-07 11:29:14.423136] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.140 [2024-10-07 11:29:14.423152] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.140 [2024-10-07 11:29:14.423172] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.140 [2024-10-07 11:29:14.423190] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.140 [2024-10-07 11:29:14.423204] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.140 [2024-10-07 11:29:14.423217] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.140 [2024-10-07 11:29:14.423241] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.140 [2024-10-07 11:29:14.423260] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.140 [2024-10-07 11:29:14.423320] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.140 [2024-10-07 11:29:14.423344] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.140 [2024-10-07 11:29:14.423360] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.140 [2024-10-07 11:29:14.423378] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.140 [2024-10-07 11:29:14.423396] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.140 [2024-10-07 11:29:14.423422] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.140 [2024-10-07 11:29:14.423438] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.140 [2024-10-07 11:29:14.423455] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.140 [2024-10-07 11:29:14.433075] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.140 [2024-10-07 11:29:14.433176] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.140 [2024-10-07 11:29:14.433203] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.140 [2024-10-07 11:29:14.433219] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.141 [2024-10-07 11:29:14.433238] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.141 [2024-10-07 11:29:14.433257] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.141 [2024-10-07 11:29:14.433271] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.141 [2024-10-07 11:29:14.433284] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.141 [2024-10-07 11:29:14.433299] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.141 [2024-10-07 11:29:14.433323] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.141 [2024-10-07 11:29:14.433382] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.141 [2024-10-07 11:29:14.433406] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.141 [2024-10-07 11:29:14.433437] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.141 [2024-10-07 11:29:14.433484] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.141 [2024-10-07 11:29:14.433504] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.141 [2024-10-07 11:29:14.433518] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.141 [2024-10-07 11:29:14.433531] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.141 [2024-10-07 11:29:14.433547] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.141 [2024-10-07 11:29:14.443130] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.141 [2024-10-07 11:29:14.443230] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.141 [2024-10-07 11:29:14.443257] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.141 [2024-10-07 11:29:14.443273] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.141 [2024-10-07 11:29:14.443293] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.141 [2024-10-07 11:29:14.443311] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.141 [2024-10-07 11:29:14.443324] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.141 [2024-10-07 11:29:14.443337] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.141 [2024-10-07 11:29:14.443356] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.141 [2024-10-07 11:29:14.443381] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.141 [2024-10-07 11:29:14.443454] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.141 [2024-10-07 11:29:14.443481] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.141 [2024-10-07 11:29:14.443497] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.141 [2024-10-07 11:29:14.443516] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.141 [2024-10-07 11:29:14.443537] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.141 [2024-10-07 11:29:14.443550] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.141 [2024-10-07 11:29:14.443563] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.141 [2024-10-07 11:29:14.443579] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.141 [2024-10-07 11:29:14.453183] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.141 [2024-10-07 11:29:14.453266] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.141 [2024-10-07 11:29:14.453293] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.141 [2024-10-07 11:29:14.453309] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.141 [2024-10-07 11:29:14.453328] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.141 [2024-10-07 11:29:14.453346] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.141 [2024-10-07 11:29:14.453360] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.141 [2024-10-07 11:29:14.453386] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.141 [2024-10-07 11:29:14.453403] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.141 [2024-10-07 11:29:14.453446] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.141 [2024-10-07 11:29:14.453523] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.141 [2024-10-07 11:29:14.453549] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.141 [2024-10-07 11:29:14.453565] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.141 [2024-10-07 11:29:14.453583] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.141 [2024-10-07 11:29:14.453601] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.141 [2024-10-07 11:29:14.453615] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.141 [2024-10-07 11:29:14.453628] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.141 [2024-10-07 11:29:14.453644] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.141 [2024-10-07 11:29:14.463234] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.141 [2024-10-07 11:29:14.463331] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.141 [2024-10-07 11:29:14.463357] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.141 [2024-10-07 11:29:14.463373] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.141 [2024-10-07 11:29:14.463391] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.141 [2024-10-07 11:29:14.463408] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.141 [2024-10-07 11:29:14.463438] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.141 [2024-10-07 11:29:14.463465] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.141 [2024-10-07 11:29:14.463483] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.141 [2024-10-07 11:29:14.463516] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.141 [2024-10-07 11:29:14.463579] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.141 [2024-10-07 11:29:14.463603] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.141 [2024-10-07 11:29:14.463619] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.141 [2024-10-07 11:29:14.463638] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.141 [2024-10-07 11:29:14.463655] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.141 [2024-10-07 11:29:14.463669] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.141 [2024-10-07 11:29:14.463682] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.141 [2024-10-07 11:29:14.463698] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.141 [2024-10-07 11:29:14.473286] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.141 [2024-10-07 11:29:14.473397] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.141 [2024-10-07 11:29:14.473435] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.141 [2024-10-07 11:29:14.473455] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.141 [2024-10-07 11:29:14.473475] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.141 [2024-10-07 11:29:14.473493] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.141 [2024-10-07 11:29:14.473507] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.141 [2024-10-07 11:29:14.473519] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.141 [2024-10-07 11:29:14.473538] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.141 [2024-10-07 11:29:14.473572] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.141 [2024-10-07 11:29:14.473633] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.141 [2024-10-07 11:29:14.473659] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.141 [2024-10-07 11:29:14.473675] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.141 [2024-10-07 11:29:14.473693] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.141 [2024-10-07 11:29:14.473710] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.141 [2024-10-07 11:29:14.473723] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.141 [2024-10-07 11:29:14.473736] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.141 [2024-10-07 11:29:14.473752] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.141 Received shutdown signal, test time was about 15.000000 seconds 00:18:34.141 00:18:34.141 Latency(us) 00:18:34.141 [2024-10-07T11:29:15.852Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:34.141 [2024-10-07T11:29:15.852Z] =================================================================================================================== 00:18:34.141 [2024-10-07T11:29:15.852Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:18:34.141 11:29:14 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@65 -- # grep -c 'Resetting controller successful' 00:18:34.141 11:29:14 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@65 -- # count=1 00:18:34.141 11:29:14 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@67 -- # (( count != 3 )) 00:18:34.141 11:29:14 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@68 -- # false 00:18:34.141 11:29:14 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@68 -- # trap - ERR 00:18:34.141 11:29:14 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@68 -- # print_backtrace 00:18:34.141 11:29:14 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@1153 -- # [[ ehxBET =~ e ]] 00:18:34.141 11:29:14 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@1155 -- # args=('--transport=tcp') 00:18:34.141 11:29:14 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@1155 -- # local args 00:18:34.141 11:29:14 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@1157 -- # xtrace_disable 00:18:34.142 11:29:14 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@10 -- # set +x 00:18:34.142 ========== Backtrace start: ========== 00:18:34.142 00:18:34.142 in /home/vagrant/spdk_repo/spdk/test/nvmf/host/failover.sh:68 -> main(["--transport=tcp"]) 00:18:34.142 ... 00:18:34.142 63 cat $testdir/try.txt 00:18:34.142 64 # if this test fails it means we didn't fail over to the second 00:18:34.142 65 count="$(grep -c "Resetting controller successful" < $testdir/try.txt)" 00:18:34.142 66 00:18:34.142 67 if ((count != 3)); then 00:18:34.142 => 68 false 00:18:34.142 69 fi 00:18:34.142 70 00:18:34.142 71 # Part 2 of the test. Start removing ports, starting with the one we are connected to, confirm that the ctrlr remains active until the final trid is removed. 00:18:34.142 72 $rootdir/build/examples/bdevperf -z -r $bdevperf_rpc_sock -q 128 -o 4096 -w verify -t 1 -f &> $testdir/try.txt & 00:18:34.142 73 bdevperf_pid=$! 00:18:34.142 ... 00:18:34.142 00:18:34.142 ========== Backtrace end ========== 00:18:34.142 11:29:14 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@1194 -- # return 0 00:18:34.142 11:29:14 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@1 -- # process_shm --id 0 00:18:34.142 11:29:14 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@808 -- # type=--id 00:18:34.142 11:29:14 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@809 -- # id=0 00:18:34.142 11:29:14 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@810 -- # '[' --id = --pid ']' 00:18:34.142 11:29:14 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@814 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:18:34.142 11:29:14 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@814 -- # shm_files=nvmf_trace.0 00:18:34.142 11:29:14 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@816 -- # [[ -z nvmf_trace.0 ]] 00:18:34.142 11:29:14 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@820 -- # for n in $shm_files 00:18:34.142 11:29:14 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@821 -- # tar -C /dev/shm/ -cvzf /home/vagrant/spdk_repo/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:18:34.142 nvmf_trace.0 00:18:34.142 11:29:15 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@823 -- # return 0 00:18:34.142 11:29:15 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@1 -- # cat /home/vagrant/spdk_repo/spdk/test/nvmf/host/try.txt 00:18:34.142 [2024-10-07 11:28:57.472507] Starting SPDK v25.01-pre git sha1 d16db39ee / DPDK 24.03.0 initialization... 00:18:34.142 [2024-10-07 11:28:57.472692] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --iova-mode=pa --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid89076 ] 00:18:34.142 [2024-10-07 11:28:57.623953] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:34.142 [2024-10-07 11:28:57.770062] reactor.c:1001:reactor_run: *NOTICE*: Reactor started on core 0 00:18:34.142 Running I/O for 15 seconds... 00:18:34.142 8171.00 IOPS, 31.92 MiB/s [2024-10-07T11:29:15.853Z] [2024-10-07 11:29:00.576219] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:77392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.142 [2024-10-07 11:29:00.576270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.142 [2024-10-07 11:29:00.576302] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:77400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.142 [2024-10-07 11:29:00.576321] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.142 [2024-10-07 11:29:00.576338] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:77408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.142 [2024-10-07 11:29:00.576354] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.142 [2024-10-07 11:29:00.576370] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:77416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.142 [2024-10-07 11:29:00.576385] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.142 [2024-10-07 11:29:00.576401] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:77424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.142 [2024-10-07 11:29:00.576451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.142 [2024-10-07 11:29:00.576482] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:77432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.142 [2024-10-07 11:29:00.576527] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.142 [2024-10-07 11:29:00.576559] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:77440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.142 [2024-10-07 11:29:00.576589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.142 [2024-10-07 11:29:00.576619] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:77448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.142 [2024-10-07 11:29:00.576647] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.142 [2024-10-07 11:29:00.576674] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:77456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.142 [2024-10-07 11:29:00.576697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.142 [2024-10-07 11:29:00.576726] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:77464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.142 [2024-10-07 11:29:00.576752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.142 [2024-10-07 11:29:00.576780] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:77472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.142 [2024-10-07 11:29:00.576821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.142 [2024-10-07 11:29:00.576929] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:77480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.142 [2024-10-07 11:29:00.576960] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.142 [2024-10-07 11:29:00.576991] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:77488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.142 [2024-10-07 11:29:00.577017] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.142 [2024-10-07 11:29:00.577035] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:77496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.142 [2024-10-07 11:29:00.577055] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.142 [2024-10-07 11:29:00.577078] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:77504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.142 [2024-10-07 11:29:00.577106] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.142 [2024-10-07 11:29:00.577136] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:77512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.142 [2024-10-07 11:29:00.577172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.142 [2024-10-07 11:29:00.577205] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:77520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.142 [2024-10-07 11:29:00.577241] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.142 [2024-10-07 11:29:00.577263] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:77528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.142 [2024-10-07 11:29:00.577277] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.142 [2024-10-07 11:29:00.577294] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:77536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.142 [2024-10-07 11:29:00.577308] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.142 [2024-10-07 11:29:00.577324] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:77544 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.142 [2024-10-07 11:29:00.577339] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.142 [2024-10-07 11:29:00.577354] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:77552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.142 [2024-10-07 11:29:00.577369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.142 [2024-10-07 11:29:00.577384] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:77560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.142 [2024-10-07 11:29:00.577399] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.142 [2024-10-07 11:29:00.577416] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:77568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.142 [2024-10-07 11:29:00.577443] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.142 [2024-10-07 11:29:00.577484] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:77576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.142 [2024-10-07 11:29:00.577515] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.142 [2024-10-07 11:29:00.577532] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:77584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.142 [2024-10-07 11:29:00.577547] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.142 [2024-10-07 11:29:00.577563] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:77592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.142 [2024-10-07 11:29:00.577577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.142 [2024-10-07 11:29:00.577593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:77600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.142 [2024-10-07 11:29:00.577608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.143 [2024-10-07 11:29:00.577624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:77608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.143 [2024-10-07 11:29:00.577638] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.143 [2024-10-07 11:29:00.577654] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:77616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.143 [2024-10-07 11:29:00.577668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.143 [2024-10-07 11:29:00.577684] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:77624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.143 [2024-10-07 11:29:00.577699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.143 [2024-10-07 11:29:00.577716] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:77632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.143 [2024-10-07 11:29:00.577730] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.143 [2024-10-07 11:29:00.577746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:77640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.143 [2024-10-07 11:29:00.577760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.143 [2024-10-07 11:29:00.577776] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:77648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.143 [2024-10-07 11:29:00.577797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.143 [2024-10-07 11:29:00.577814] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:78016 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:34.143 [2024-10-07 11:29:00.577829] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.143 [2024-10-07 11:29:00.577845] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:78024 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:34.143 [2024-10-07 11:29:00.577860] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.143 [2024-10-07 11:29:00.577876] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:78032 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:34.143 [2024-10-07 11:29:00.577890] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.143 [2024-10-07 11:29:00.577915] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:78040 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:34.143 [2024-10-07 11:29:00.577931] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.143 [2024-10-07 11:29:00.577947] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:78048 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:34.143 [2024-10-07 11:29:00.577976] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.143 [2024-10-07 11:29:00.577993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:78056 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:34.143 [2024-10-07 11:29:00.578008] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.143 [2024-10-07 11:29:00.578025] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:78064 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:34.143 [2024-10-07 11:29:00.578039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.143 [2024-10-07 11:29:00.578055] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:78072 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:34.143 [2024-10-07 11:29:00.578069] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.143 [2024-10-07 11:29:00.578086] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:78080 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:34.143 [2024-10-07 11:29:00.578101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.143 [2024-10-07 11:29:00.578116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:78088 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:34.143 [2024-10-07 11:29:00.578131] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.143 [2024-10-07 11:29:00.578146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:78096 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:34.143 [2024-10-07 11:29:00.578161] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.143 [2024-10-07 11:29:00.578177] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:78104 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:34.143 [2024-10-07 11:29:00.578192] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.143 [2024-10-07 11:29:00.578207] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:78112 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:34.143 [2024-10-07 11:29:00.578222] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.143 [2024-10-07 11:29:00.578238] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:72 nsid:1 lba:78120 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:34.143 [2024-10-07 11:29:00.578252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.143 [2024-10-07 11:29:00.578268] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:78128 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:34.143 [2024-10-07 11:29:00.578282] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.143 [2024-10-07 11:29:00.578298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:109 nsid:1 lba:78136 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:34.143 [2024-10-07 11:29:00.578330] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.143 [2024-10-07 11:29:00.578348] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:78144 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:34.143 [2024-10-07 11:29:00.578363] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.143 [2024-10-07 11:29:00.578378] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:78152 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:34.143 [2024-10-07 11:29:00.578393] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.143 [2024-10-07 11:29:00.578408] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:78160 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:34.143 [2024-10-07 11:29:00.578437] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.143 [2024-10-07 11:29:00.578454] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:78168 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:34.143 [2024-10-07 11:29:00.578469] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.143 [2024-10-07 11:29:00.578485] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:78176 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:34.143 [2024-10-07 11:29:00.578499] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.143 [2024-10-07 11:29:00.578515] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:78184 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:34.143 [2024-10-07 11:29:00.578530] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.143 [2024-10-07 11:29:00.578550] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:78192 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:34.143 [2024-10-07 11:29:00.578565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.143 [2024-10-07 11:29:00.578580] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:78200 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:34.143 [2024-10-07 11:29:00.578595] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.143 [2024-10-07 11:29:00.578611] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:78208 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:34.143 [2024-10-07 11:29:00.578626] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.143 [2024-10-07 11:29:00.578641] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:78216 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:34.143 [2024-10-07 11:29:00.578655] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.143 [2024-10-07 11:29:00.578671] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:78224 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:34.143 [2024-10-07 11:29:00.578685] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.143 [2024-10-07 11:29:00.578701] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:78232 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:34.143 [2024-10-07 11:29:00.578716] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.143 [2024-10-07 11:29:00.578731] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:78240 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:34.143 [2024-10-07 11:29:00.578754] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.143 [2024-10-07 11:29:00.578771] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:78248 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:34.143 [2024-10-07 11:29:00.578800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.143 [2024-10-07 11:29:00.578815] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:78256 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:34.143 [2024-10-07 11:29:00.578829] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.143 [2024-10-07 11:29:00.578845] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:78264 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:34.143 [2024-10-07 11:29:00.578865] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.143 [2024-10-07 11:29:00.578881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:78272 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:34.143 [2024-10-07 11:29:00.578895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.143 [2024-10-07 11:29:00.578910] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:78280 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:34.143 [2024-10-07 11:29:00.578924] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.143 [2024-10-07 11:29:00.578939] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:78288 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:34.143 [2024-10-07 11:29:00.578953] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.143 [2024-10-07 11:29:00.578968] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:78296 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:34.143 [2024-10-07 11:29:00.578982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.143 [2024-10-07 11:29:00.578997] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:78304 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:34.144 [2024-10-07 11:29:00.579011] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.144 [2024-10-07 11:29:00.579026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:78312 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:34.144 [2024-10-07 11:29:00.579041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.144 [2024-10-07 11:29:00.579073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:78320 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:34.144 [2024-10-07 11:29:00.579087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.144 [2024-10-07 11:29:00.579103] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:78328 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:34.144 [2024-10-07 11:29:00.579117] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.144 [2024-10-07 11:29:00.579133] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:78336 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:34.144 [2024-10-07 11:29:00.579147] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.144 [2024-10-07 11:29:00.579170] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:78344 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:34.144 [2024-10-07 11:29:00.579185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.144 [2024-10-07 11:29:00.579201] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:78352 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:34.144 [2024-10-07 11:29:00.579215] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.144 [2024-10-07 11:29:00.579231] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:78360 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:34.144 [2024-10-07 11:29:00.579245] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.144 [2024-10-07 11:29:00.579261] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:78368 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:34.144 [2024-10-07 11:29:00.579275] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.144 [2024-10-07 11:29:00.579290] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:78376 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:34.144 [2024-10-07 11:29:00.579305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.144 [2024-10-07 11:29:00.579320] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:78384 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:34.144 [2024-10-07 11:29:00.579334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.144 [2024-10-07 11:29:00.579350] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:78392 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:34.144 [2024-10-07 11:29:00.579370] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.144 [2024-10-07 11:29:00.579386] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:78400 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:34.144 [2024-10-07 11:29:00.579401] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.144 [2024-10-07 11:29:00.579434] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:78408 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:34.144 [2024-10-07 11:29:00.579496] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.144 [2024-10-07 11:29:00.579526] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:77656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.144 [2024-10-07 11:29:00.579542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.144 [2024-10-07 11:29:00.579558] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:77664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.144 [2024-10-07 11:29:00.579573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.144 [2024-10-07 11:29:00.579588] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:77672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.144 [2024-10-07 11:29:00.579602] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.144 [2024-10-07 11:29:00.579618] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:77680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.144 [2024-10-07 11:29:00.579648] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.144 [2024-10-07 11:29:00.579666] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:77688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.144 [2024-10-07 11:29:00.579680] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.144 [2024-10-07 11:29:00.579696] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:77696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.144 [2024-10-07 11:29:00.579710] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.144 [2024-10-07 11:29:00.579727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:77704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.144 [2024-10-07 11:29:00.579741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.144 [2024-10-07 11:29:00.579756] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:77712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.144 [2024-10-07 11:29:00.579771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.144 [2024-10-07 11:29:00.579786] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:77720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.144 [2024-10-07 11:29:00.579801] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.144 [2024-10-07 11:29:00.579816] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:77728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.144 [2024-10-07 11:29:00.579846] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.144 [2024-10-07 11:29:00.579861] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:77736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.144 [2024-10-07 11:29:00.579875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.144 [2024-10-07 11:29:00.579890] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:77744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.144 [2024-10-07 11:29:00.579904] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.144 [2024-10-07 11:29:00.579919] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:77752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.144 [2024-10-07 11:29:00.579933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.144 [2024-10-07 11:29:00.579949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:77760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.144 [2024-10-07 11:29:00.579969] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.144 [2024-10-07 11:29:00.579985] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:77768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.144 [2024-10-07 11:29:00.579999] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.144 [2024-10-07 11:29:00.580015] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:77776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.144 [2024-10-07 11:29:00.580030] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.144 [2024-10-07 11:29:00.580069] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:77784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.144 [2024-10-07 11:29:00.580085] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.144 [2024-10-07 11:29:00.580101] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:77792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.144 [2024-10-07 11:29:00.580115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.144 [2024-10-07 11:29:00.580131] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:77800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.144 [2024-10-07 11:29:00.580145] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.144 [2024-10-07 11:29:00.580161] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:77808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.144 [2024-10-07 11:29:00.580175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.144 [2024-10-07 11:29:00.580191] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:77816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.144 [2024-10-07 11:29:00.580205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.144 [2024-10-07 11:29:00.580221] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:77824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.144 [2024-10-07 11:29:00.580235] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.144 [2024-10-07 11:29:00.580251] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:77832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.144 [2024-10-07 11:29:00.580265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.144 [2024-10-07 11:29:00.580281] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:77840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.144 [2024-10-07 11:29:00.580295] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.144 [2024-10-07 11:29:00.580312] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:77848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.144 [2024-10-07 11:29:00.580326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.144 [2024-10-07 11:29:00.580342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:77856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.144 [2024-10-07 11:29:00.580356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.144 [2024-10-07 11:29:00.580373] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:77864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.144 [2024-10-07 11:29:00.580387] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.144 [2024-10-07 11:29:00.580404] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:77872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.144 [2024-10-07 11:29:00.580418] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.144 [2024-10-07 11:29:00.580433] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:77880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.145 [2024-10-07 11:29:00.580463] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.145 [2024-10-07 11:29:00.580489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:77888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.145 [2024-10-07 11:29:00.580511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.145 [2024-10-07 11:29:00.580529] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:77896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.145 [2024-10-07 11:29:00.580543] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.145 [2024-10-07 11:29:00.580559] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:77904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.145 [2024-10-07 11:29:00.580573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.145 [2024-10-07 11:29:00.580589] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:77912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.145 [2024-10-07 11:29:00.580604] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.145 [2024-10-07 11:29:00.580619] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:77920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.145 [2024-10-07 11:29:00.580633] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.145 [2024-10-07 11:29:00.580649] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:77928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.145 [2024-10-07 11:29:00.580663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.145 [2024-10-07 11:29:00.580678] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:77936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.145 [2024-10-07 11:29:00.580692] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.145 [2024-10-07 11:29:00.580708] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:77944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.145 [2024-10-07 11:29:00.580722] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.145 [2024-10-07 11:29:00.580738] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:77952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.145 [2024-10-07 11:29:00.580752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.145 [2024-10-07 11:29:00.580768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:77960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.145 [2024-10-07 11:29:00.580796] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.145 [2024-10-07 11:29:00.580812] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:77968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.145 [2024-10-07 11:29:00.580825] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.145 [2024-10-07 11:29:00.580840] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:77976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.145 [2024-10-07 11:29:00.580854] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.145 [2024-10-07 11:29:00.580869] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:77984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.145 [2024-10-07 11:29:00.580890] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.145 [2024-10-07 11:29:00.580906] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:77992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.145 [2024-10-07 11:29:00.580920] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.145 [2024-10-07 11:29:00.580935] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:78000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.145 [2024-10-07 11:29:00.580949] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.145 [2024-10-07 11:29:00.580966] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x69abc0 is same with the state(6) to be set 00:18:34.145 [2024-10-07 11:29:00.580984] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:34.145 [2024-10-07 11:29:00.580995] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:34.145 [2024-10-07 11:29:00.581012] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:78008 len:8 PRP1 0x0 PRP2 0x0 00:18:34.145 [2024-10-07 11:29:00.581026] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.145 [2024-10-07 11:29:00.581121] bdev_nvme.c:1730:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x69abc0 was disconnected and freed. reset controller. 00:18:34.145 [2024-10-07 11:29:00.581253] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:18:34.145 [2024-10-07 11:29:00.581280] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.145 [2024-10-07 11:29:00.581297] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:18:34.145 [2024-10-07 11:29:00.581311] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.145 [2024-10-07 11:29:00.581326] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:18:34.145 [2024-10-07 11:29:00.581340] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.145 [2024-10-07 11:29:00.581355] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:18:34.145 [2024-10-07 11:29:00.581369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.145 [2024-10-07 11:29:00.581382] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.145 [2024-10-07 11:29:00.582701] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.145 [2024-10-07 11:29:00.582743] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.145 [2024-10-07 11:29:00.582867] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.145 [2024-10-07 11:29:00.582899] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.145 [2024-10-07 11:29:00.582916] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.145 [2024-10-07 11:29:00.582940] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.145 [2024-10-07 11:29:00.582964] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.145 [2024-10-07 11:29:00.582992] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.145 [2024-10-07 11:29:00.583010] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.145 [2024-10-07 11:29:00.583036] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.145 [2024-10-07 11:29:00.604707] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.145 [2024-10-07 11:29:00.605941] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.145 [2024-10-07 11:29:00.606026] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.145 [2024-10-07 11:29:00.606055] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.145 [2024-10-07 11:29:00.608121] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.145 [2024-10-07 11:29:00.608808] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.145 [2024-10-07 11:29:00.608862] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.145 [2024-10-07 11:29:00.608898] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.145 [2024-10-07 11:29:00.609081] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.145 [2024-10-07 11:29:00.614815] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.145 [2024-10-07 11:29:00.614939] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.145 [2024-10-07 11:29:00.614971] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.145 [2024-10-07 11:29:00.614988] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.145 [2024-10-07 11:29:00.615011] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.145 [2024-10-07 11:29:00.615033] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.145 [2024-10-07 11:29:00.615047] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.145 [2024-10-07 11:29:00.615061] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.145 [2024-10-07 11:29:00.615083] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.145 [2024-10-07 11:29:00.624891] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.145 [2024-10-07 11:29:00.625018] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.145 [2024-10-07 11:29:00.625050] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.145 [2024-10-07 11:29:00.625066] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.145 [2024-10-07 11:29:00.625090] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.145 [2024-10-07 11:29:00.625112] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.145 [2024-10-07 11:29:00.625126] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.145 [2024-10-07 11:29:00.625139] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.145 [2024-10-07 11:29:00.625161] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.145 [2024-10-07 11:29:00.635912] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.145 [2024-10-07 11:29:00.636188] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.145 [2024-10-07 11:29:00.636232] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.145 [2024-10-07 11:29:00.636252] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.145 [2024-10-07 11:29:00.636304] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.145 [2024-10-07 11:29:00.636332] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.145 [2024-10-07 11:29:00.636347] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.145 [2024-10-07 11:29:00.636360] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.146 [2024-10-07 11:29:00.636384] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.146 [2024-10-07 11:29:00.649031] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.146 [2024-10-07 11:29:00.649404] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.146 [2024-10-07 11:29:00.649459] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.146 [2024-10-07 11:29:00.649481] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.146 [2024-10-07 11:29:00.649616] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.146 [2024-10-07 11:29:00.649760] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.146 [2024-10-07 11:29:00.649793] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.146 [2024-10-07 11:29:00.649809] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.146 [2024-10-07 11:29:00.649862] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.146 [2024-10-07 11:29:00.662216] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.146 [2024-10-07 11:29:00.662661] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.146 [2024-10-07 11:29:00.662707] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.146 [2024-10-07 11:29:00.662727] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.146 [2024-10-07 11:29:00.662861] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.146 [2024-10-07 11:29:00.662934] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.146 [2024-10-07 11:29:00.662958] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.146 [2024-10-07 11:29:00.662972] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.146 [2024-10-07 11:29:00.663019] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.146 [2024-10-07 11:29:00.672304] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.146 [2024-10-07 11:29:00.674972] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.146 [2024-10-07 11:29:00.675038] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.146 [2024-10-07 11:29:00.675059] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.146 [2024-10-07 11:29:00.675980] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.146 [2024-10-07 11:29:00.676368] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.146 [2024-10-07 11:29:00.676407] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.146 [2024-10-07 11:29:00.676453] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.146 [2024-10-07 11:29:00.676605] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.146 [2024-10-07 11:29:00.682390] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.146 [2024-10-07 11:29:00.682531] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.146 [2024-10-07 11:29:00.682563] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.146 [2024-10-07 11:29:00.682581] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.146 [2024-10-07 11:29:00.682606] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.146 [2024-10-07 11:29:00.682629] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.146 [2024-10-07 11:29:00.682645] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.146 [2024-10-07 11:29:00.682659] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.146 [2024-10-07 11:29:00.682682] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.146 [2024-10-07 11:29:00.692504] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.146 [2024-10-07 11:29:00.692631] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.146 [2024-10-07 11:29:00.692662] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.146 [2024-10-07 11:29:00.692679] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.146 [2024-10-07 11:29:00.692704] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.146 [2024-10-07 11:29:00.692726] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.146 [2024-10-07 11:29:00.692740] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.146 [2024-10-07 11:29:00.692753] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.146 [2024-10-07 11:29:00.692776] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.146 [2024-10-07 11:29:00.704005] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.146 [2024-10-07 11:29:00.704132] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.146 [2024-10-07 11:29:00.704163] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.146 [2024-10-07 11:29:00.704181] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.146 [2024-10-07 11:29:00.704205] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.146 [2024-10-07 11:29:00.704227] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.146 [2024-10-07 11:29:00.704241] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.146 [2024-10-07 11:29:00.704272] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.146 [2024-10-07 11:29:00.704298] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.146 [2024-10-07 11:29:00.718734] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.146 [2024-10-07 11:29:00.718850] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.146 [2024-10-07 11:29:00.718882] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.146 [2024-10-07 11:29:00.718899] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.146 [2024-10-07 11:29:00.718924] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.146 [2024-10-07 11:29:00.718946] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.146 [2024-10-07 11:29:00.718961] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.146 [2024-10-07 11:29:00.718975] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.146 [2024-10-07 11:29:00.719014] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.146 [2024-10-07 11:29:00.733484] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.146 [2024-10-07 11:29:00.733634] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.146 [2024-10-07 11:29:00.733666] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.146 [2024-10-07 11:29:00.733684] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.146 [2024-10-07 11:29:00.733709] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.146 [2024-10-07 11:29:00.733732] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.146 [2024-10-07 11:29:00.733747] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.146 [2024-10-07 11:29:00.733761] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.146 [2024-10-07 11:29:00.733785] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.146 [2024-10-07 11:29:00.748152] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.146 [2024-10-07 11:29:00.748282] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.146 [2024-10-07 11:29:00.748313] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.146 [2024-10-07 11:29:00.748330] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.146 [2024-10-07 11:29:00.748354] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.146 [2024-10-07 11:29:00.748376] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.146 [2024-10-07 11:29:00.748392] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.146 [2024-10-07 11:29:00.748405] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.146 [2024-10-07 11:29:00.748442] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.146 [2024-10-07 11:29:00.763393] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.146 [2024-10-07 11:29:00.763637] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.146 [2024-10-07 11:29:00.763671] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.146 [2024-10-07 11:29:00.763689] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.146 [2024-10-07 11:29:00.763714] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.146 [2024-10-07 11:29:00.763736] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.146 [2024-10-07 11:29:00.763750] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.147 [2024-10-07 11:29:00.763764] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.147 [2024-10-07 11:29:00.763788] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.147 [2024-10-07 11:29:00.776261] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.147 [2024-10-07 11:29:00.776390] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.147 [2024-10-07 11:29:00.776422] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.147 [2024-10-07 11:29:00.776454] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.147 [2024-10-07 11:29:00.777005] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.147 [2024-10-07 11:29:00.777148] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.147 [2024-10-07 11:29:00.777171] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.147 [2024-10-07 11:29:00.777185] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.147 [2024-10-07 11:29:00.777209] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.147 [2024-10-07 11:29:00.786573] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.147 [2024-10-07 11:29:00.787540] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.147 [2024-10-07 11:29:00.787598] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.147 [2024-10-07 11:29:00.787618] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.147 [2024-10-07 11:29:00.789313] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.147 [2024-10-07 11:29:00.789683] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.147 [2024-10-07 11:29:00.789722] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.147 [2024-10-07 11:29:00.789739] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.147 [2024-10-07 11:29:00.790240] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.147 [2024-10-07 11:29:00.797166] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.147 [2024-10-07 11:29:00.797291] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.147 [2024-10-07 11:29:00.797322] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.147 [2024-10-07 11:29:00.797339] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.147 [2024-10-07 11:29:00.797363] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.147 [2024-10-07 11:29:00.797416] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.147 [2024-10-07 11:29:00.797462] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.147 [2024-10-07 11:29:00.797483] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.147 [2024-10-07 11:29:00.797509] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.147 [2024-10-07 11:29:00.807261] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.147 [2024-10-07 11:29:00.807386] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.147 [2024-10-07 11:29:00.807417] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.147 [2024-10-07 11:29:00.807451] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.147 [2024-10-07 11:29:00.807476] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.147 [2024-10-07 11:29:00.807498] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.147 [2024-10-07 11:29:00.807512] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.147 [2024-10-07 11:29:00.807525] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.147 [2024-10-07 11:29:00.807548] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.147 [2024-10-07 11:29:00.817358] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.147 [2024-10-07 11:29:00.817509] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.147 [2024-10-07 11:29:00.817543] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.147 [2024-10-07 11:29:00.817560] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.147 [2024-10-07 11:29:00.817585] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.147 [2024-10-07 11:29:00.817607] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.147 [2024-10-07 11:29:00.817621] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.147 [2024-10-07 11:29:00.817634] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.147 [2024-10-07 11:29:00.817657] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.147 [2024-10-07 11:29:00.829238] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.147 [2024-10-07 11:29:00.829379] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.147 [2024-10-07 11:29:00.829432] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.147 [2024-10-07 11:29:00.829475] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.147 [2024-10-07 11:29:00.829503] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.147 [2024-10-07 11:29:00.829540] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.147 [2024-10-07 11:29:00.829558] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.147 [2024-10-07 11:29:00.829571] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.147 [2024-10-07 11:29:00.829610] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.147 [2024-10-07 11:29:00.842081] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.147 [2024-10-07 11:29:00.842207] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.147 [2024-10-07 11:29:00.842238] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.147 [2024-10-07 11:29:00.842255] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.147 [2024-10-07 11:29:00.842279] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.147 [2024-10-07 11:29:00.842300] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.147 [2024-10-07 11:29:00.842314] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.147 [2024-10-07 11:29:00.842329] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.147 [2024-10-07 11:29:00.842352] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.147 [2024-10-07 11:29:00.853215] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.147 [2024-10-07 11:29:00.853480] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.147 [2024-10-07 11:29:00.853517] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.147 [2024-10-07 11:29:00.853535] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.147 [2024-10-07 11:29:00.853668] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.147 [2024-10-07 11:29:00.853781] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.147 [2024-10-07 11:29:00.853802] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.147 [2024-10-07 11:29:00.853816] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.147 [2024-10-07 11:29:00.853921] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.147 [2024-10-07 11:29:00.863318] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.147 [2024-10-07 11:29:00.863458] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.147 [2024-10-07 11:29:00.863490] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.147 [2024-10-07 11:29:00.863506] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.147 [2024-10-07 11:29:00.863531] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.147 [2024-10-07 11:29:00.863552] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.147 [2024-10-07 11:29:00.863566] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.147 [2024-10-07 11:29:00.863580] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.147 [2024-10-07 11:29:00.863602] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.147 [2024-10-07 11:29:00.873559] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.147 [2024-10-07 11:29:00.873682] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.147 [2024-10-07 11:29:00.873713] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.147 [2024-10-07 11:29:00.873747] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.147 [2024-10-07 11:29:00.873773] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.147 [2024-10-07 11:29:00.873797] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.147 [2024-10-07 11:29:00.873811] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.147 [2024-10-07 11:29:00.873824] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.147 [2024-10-07 11:29:00.873846] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.147 [2024-10-07 11:29:00.885890] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.147 [2024-10-07 11:29:00.886303] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.147 [2024-10-07 11:29:00.886350] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.147 [2024-10-07 11:29:00.886370] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.147 [2024-10-07 11:29:00.886443] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.147 [2024-10-07 11:29:00.886476] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.148 [2024-10-07 11:29:00.886497] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.148 [2024-10-07 11:29:00.886511] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.148 [2024-10-07 11:29:00.886536] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.148 [2024-10-07 11:29:00.897692] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.148 [2024-10-07 11:29:00.897947] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.148 [2024-10-07 11:29:00.897997] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.148 [2024-10-07 11:29:00.898016] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.148 [2024-10-07 11:29:00.898153] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.148 [2024-10-07 11:29:00.898272] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.148 [2024-10-07 11:29:00.898313] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.148 [2024-10-07 11:29:00.898330] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.148 [2024-10-07 11:29:00.898462] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.148 [2024-10-07 11:29:00.907826] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.148 [2024-10-07 11:29:00.907939] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.148 [2024-10-07 11:29:00.907971] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.148 [2024-10-07 11:29:00.907990] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.148 [2024-10-07 11:29:00.908424] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.148 [2024-10-07 11:29:00.908611] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.148 [2024-10-07 11:29:00.908666] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.148 [2024-10-07 11:29:00.908684] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.148 [2024-10-07 11:29:00.908830] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.148 [2024-10-07 11:29:00.918177] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.148 [2024-10-07 11:29:00.918293] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.148 [2024-10-07 11:29:00.918326] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.148 [2024-10-07 11:29:00.918344] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.148 [2024-10-07 11:29:00.918368] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.148 [2024-10-07 11:29:00.918391] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.148 [2024-10-07 11:29:00.918406] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.148 [2024-10-07 11:29:00.918437] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.148 [2024-10-07 11:29:00.918463] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.148 [2024-10-07 11:29:00.928261] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.148 [2024-10-07 11:29:00.928390] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.148 [2024-10-07 11:29:00.928448] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.148 [2024-10-07 11:29:00.928469] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.148 [2024-10-07 11:29:00.928493] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.148 [2024-10-07 11:29:00.928515] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.148 [2024-10-07 11:29:00.928529] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.148 [2024-10-07 11:29:00.928558] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.148 [2024-10-07 11:29:00.928580] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.148 [2024-10-07 11:29:00.939407] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.148 [2024-10-07 11:29:00.939718] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.148 [2024-10-07 11:29:00.939762] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.148 [2024-10-07 11:29:00.939781] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.148 [2024-10-07 11:29:00.939823] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.148 [2024-10-07 11:29:00.939848] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.148 [2024-10-07 11:29:00.939863] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.148 [2024-10-07 11:29:00.939876] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.148 [2024-10-07 11:29:00.939898] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.148 [2024-10-07 11:29:00.952450] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.148 [2024-10-07 11:29:00.952690] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.148 [2024-10-07 11:29:00.952735] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.148 [2024-10-07 11:29:00.952770] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.148 [2024-10-07 11:29:00.952894] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.148 [2024-10-07 11:29:00.953640] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.148 [2024-10-07 11:29:00.953679] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.148 [2024-10-07 11:29:00.953712] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.148 [2024-10-07 11:29:00.955706] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.148 [2024-10-07 11:29:00.967318] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.148 [2024-10-07 11:29:00.967457] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.148 [2024-10-07 11:29:00.967490] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.148 [2024-10-07 11:29:00.967507] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.148 [2024-10-07 11:29:00.967531] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.148 [2024-10-07 11:29:00.967553] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.148 [2024-10-07 11:29:00.967568] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.148 [2024-10-07 11:29:00.967581] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.148 [2024-10-07 11:29:00.967603] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.148 [2024-10-07 11:29:00.979170] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.148 [2024-10-07 11:29:00.979295] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.148 [2024-10-07 11:29:00.979326] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.148 [2024-10-07 11:29:00.979343] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.148 [2024-10-07 11:29:00.979366] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.148 [2024-10-07 11:29:00.979387] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.148 [2024-10-07 11:29:00.979401] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.148 [2024-10-07 11:29:00.979414] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.148 [2024-10-07 11:29:00.979451] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.148 [2024-10-07 11:29:00.990768] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.148 [2024-10-07 11:29:00.990896] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.148 [2024-10-07 11:29:00.990927] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.148 [2024-10-07 11:29:00.990944] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.148 [2024-10-07 11:29:00.991522] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.148 [2024-10-07 11:29:00.991665] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.148 [2024-10-07 11:29:00.991689] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.148 [2024-10-07 11:29:00.991703] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.148 [2024-10-07 11:29:00.991727] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.148 [2024-10-07 11:29:01.001253] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.148 [2024-10-07 11:29:01.001394] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.148 [2024-10-07 11:29:01.001443] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.148 [2024-10-07 11:29:01.001477] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.148 [2024-10-07 11:29:01.003567] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.148 [2024-10-07 11:29:01.003891] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.148 [2024-10-07 11:29:01.003928] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.148 [2024-10-07 11:29:01.003944] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.148 [2024-10-07 11:29:01.004401] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.148 [2024-10-07 11:29:01.012631] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.148 [2024-10-07 11:29:01.012857] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.148 [2024-10-07 11:29:01.012897] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.148 [2024-10-07 11:29:01.012915] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.149 [2024-10-07 11:29:01.013042] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.149 [2024-10-07 11:29:01.013146] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.149 [2024-10-07 11:29:01.013175] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.149 [2024-10-07 11:29:01.013191] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.149 [2024-10-07 11:29:01.014392] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.149 [2024-10-07 11:29:01.025053] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.149 [2024-10-07 11:29:01.026202] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.149 [2024-10-07 11:29:01.026265] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.149 [2024-10-07 11:29:01.026285] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.149 [2024-10-07 11:29:01.026488] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.149 [2024-10-07 11:29:01.026607] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.149 [2024-10-07 11:29:01.026629] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.149 [2024-10-07 11:29:01.026662] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.149 [2024-10-07 11:29:01.026783] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.149 [2024-10-07 11:29:01.037593] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.149 [2024-10-07 11:29:01.039802] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.149 [2024-10-07 11:29:01.039863] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.149 [2024-10-07 11:29:01.039883] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.149 [2024-10-07 11:29:01.039984] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.149 [2024-10-07 11:29:01.040014] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.149 [2024-10-07 11:29:01.040028] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.149 [2024-10-07 11:29:01.040042] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.149 [2024-10-07 11:29:01.040065] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.149 [2024-10-07 11:29:01.048044] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.149 [2024-10-07 11:29:01.048170] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.149 [2024-10-07 11:29:01.048202] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.149 [2024-10-07 11:29:01.048219] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.149 [2024-10-07 11:29:01.048242] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.149 [2024-10-07 11:29:01.048264] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.149 [2024-10-07 11:29:01.048278] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.149 [2024-10-07 11:29:01.048290] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.149 [2024-10-07 11:29:01.048312] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.149 [2024-10-07 11:29:01.060820] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.149 [2024-10-07 11:29:01.061015] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.149 [2024-10-07 11:29:01.061048] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.149 [2024-10-07 11:29:01.061066] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.149 [2024-10-07 11:29:01.061090] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.149 [2024-10-07 11:29:01.061112] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.149 [2024-10-07 11:29:01.061127] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.149 [2024-10-07 11:29:01.061141] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.149 [2024-10-07 11:29:01.061164] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.149 [2024-10-07 11:29:01.071040] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.149 [2024-10-07 11:29:01.071195] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.149 [2024-10-07 11:29:01.071229] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.149 [2024-10-07 11:29:01.071248] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.149 [2024-10-07 11:29:01.071273] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.149 [2024-10-07 11:29:01.071296] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.149 [2024-10-07 11:29:01.071310] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.149 [2024-10-07 11:29:01.071324] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.149 [2024-10-07 11:29:01.071348] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.149 [2024-10-07 11:29:01.081161] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.149 [2024-10-07 11:29:01.081307] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.149 [2024-10-07 11:29:01.081341] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.149 [2024-10-07 11:29:01.081359] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.149 [2024-10-07 11:29:01.081383] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.149 [2024-10-07 11:29:01.081406] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.149 [2024-10-07 11:29:01.081461] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.149 [2024-10-07 11:29:01.081489] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.149 [2024-10-07 11:29:01.081517] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.149 [2024-10-07 11:29:01.092338] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.149 [2024-10-07 11:29:01.092567] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.149 [2024-10-07 11:29:01.092602] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.149 [2024-10-07 11:29:01.092620] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.149 [2024-10-07 11:29:01.092645] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.149 [2024-10-07 11:29:01.092668] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.149 [2024-10-07 11:29:01.092683] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.149 [2024-10-07 11:29:01.092697] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.149 [2024-10-07 11:29:01.092736] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.149 [2024-10-07 11:29:01.104243] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.149 [2024-10-07 11:29:01.105053] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.149 [2024-10-07 11:29:01.105099] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.149 [2024-10-07 11:29:01.105120] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.149 [2024-10-07 11:29:01.105526] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.149 [2024-10-07 11:29:01.105641] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.149 [2024-10-07 11:29:01.105667] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.149 [2024-10-07 11:29:01.105682] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.149 [2024-10-07 11:29:01.105709] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.149 [2024-10-07 11:29:01.116538] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.149 [2024-10-07 11:29:01.116896] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.149 [2024-10-07 11:29:01.116942] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.149 [2024-10-07 11:29:01.116962] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.149 [2024-10-07 11:29:01.117021] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.149 [2024-10-07 11:29:01.117051] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.149 [2024-10-07 11:29:01.117066] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.149 [2024-10-07 11:29:01.117080] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.149 [2024-10-07 11:29:01.117105] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.149 [2024-10-07 11:29:01.126894] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.149 [2024-10-07 11:29:01.127108] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.149 [2024-10-07 11:29:01.127141] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.149 [2024-10-07 11:29:01.127159] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.149 [2024-10-07 11:29:01.127284] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.149 [2024-10-07 11:29:01.128578] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.149 [2024-10-07 11:29:01.128616] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.149 [2024-10-07 11:29:01.128634] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.149 [2024-10-07 11:29:01.131107] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.149 [2024-10-07 11:29:01.136993] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.149 [2024-10-07 11:29:01.137126] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.149 [2024-10-07 11:29:01.137158] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.149 [2024-10-07 11:29:01.137175] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.149 [2024-10-07 11:29:01.137199] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.149 [2024-10-07 11:29:01.137222] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.149 [2024-10-07 11:29:01.137236] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.149 [2024-10-07 11:29:01.137250] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.149 [2024-10-07 11:29:01.137289] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.149 [2024-10-07 11:29:01.148209] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.149 [2024-10-07 11:29:01.148371] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.150 [2024-10-07 11:29:01.148404] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.150 [2024-10-07 11:29:01.148421] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.150 [2024-10-07 11:29:01.148463] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.150 [2024-10-07 11:29:01.148487] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.150 [2024-10-07 11:29:01.148501] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.150 [2024-10-07 11:29:01.148514] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.150 [2024-10-07 11:29:01.148538] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.150 [2024-10-07 11:29:01.158346] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.150 [2024-10-07 11:29:01.158489] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.150 [2024-10-07 11:29:01.158521] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.150 [2024-10-07 11:29:01.158538] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.150 [2024-10-07 11:29:01.158562] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.150 [2024-10-07 11:29:01.158585] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.150 [2024-10-07 11:29:01.158599] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.150 [2024-10-07 11:29:01.158612] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.150 [2024-10-07 11:29:01.158635] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.150 [2024-10-07 11:29:01.170595] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.150 [2024-10-07 11:29:01.170845] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.150 [2024-10-07 11:29:01.170890] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.150 [2024-10-07 11:29:01.170910] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.150 [2024-10-07 11:29:01.171026] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.150 [2024-10-07 11:29:01.171134] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.150 [2024-10-07 11:29:01.171159] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.150 [2024-10-07 11:29:01.171175] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.150 [2024-10-07 11:29:01.171277] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.150 [2024-10-07 11:29:01.186790] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.150 [2024-10-07 11:29:01.187503] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.150 [2024-10-07 11:29:01.187564] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.150 [2024-10-07 11:29:01.187619] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.150 [2024-10-07 11:29:01.187993] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.150 [2024-10-07 11:29:01.188083] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.150 [2024-10-07 11:29:01.188106] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.150 [2024-10-07 11:29:01.188120] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.150 [2024-10-07 11:29:01.188145] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.150 [2024-10-07 11:29:01.197142] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.150 [2024-10-07 11:29:01.197274] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.150 [2024-10-07 11:29:01.197306] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.150 [2024-10-07 11:29:01.197324] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.150 [2024-10-07 11:29:01.197349] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.150 [2024-10-07 11:29:01.197384] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.150 [2024-10-07 11:29:01.197402] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.150 [2024-10-07 11:29:01.197420] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.150 [2024-10-07 11:29:01.197474] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.150 [2024-10-07 11:29:01.207352] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.150 [2024-10-07 11:29:01.207495] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.150 [2024-10-07 11:29:01.207529] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.150 [2024-10-07 11:29:01.207547] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.150 [2024-10-07 11:29:01.207572] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.150 [2024-10-07 11:29:01.207594] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.150 [2024-10-07 11:29:01.207608] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.150 [2024-10-07 11:29:01.207621] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.150 [2024-10-07 11:29:01.207644] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.150 [2024-10-07 11:29:01.219809] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.150 [2024-10-07 11:29:01.220106] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.150 [2024-10-07 11:29:01.220152] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.150 [2024-10-07 11:29:01.220173] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.150 [2024-10-07 11:29:01.220235] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.150 [2024-10-07 11:29:01.220279] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.150 [2024-10-07 11:29:01.220328] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.150 [2024-10-07 11:29:01.220344] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.150 [2024-10-07 11:29:01.220370] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.150 [2024-10-07 11:29:01.232022] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.150 [2024-10-07 11:29:01.232290] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.150 [2024-10-07 11:29:01.232336] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.150 [2024-10-07 11:29:01.232357] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.150 [2024-10-07 11:29:01.232521] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.150 [2024-10-07 11:29:01.232643] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.150 [2024-10-07 11:29:01.232666] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.150 [2024-10-07 11:29:01.232681] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.150 [2024-10-07 11:29:01.232787] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.150 [2024-10-07 11:29:01.244649] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.150 [2024-10-07 11:29:01.247062] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.150 [2024-10-07 11:29:01.247127] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.150 [2024-10-07 11:29:01.247148] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.150 [2024-10-07 11:29:01.247252] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.150 [2024-10-07 11:29:01.247566] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.150 [2024-10-07 11:29:01.247604] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.150 [2024-10-07 11:29:01.247622] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.150 [2024-10-07 11:29:01.247791] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.150 [2024-10-07 11:29:01.256067] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.150 [2024-10-07 11:29:01.256384] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.150 [2024-10-07 11:29:01.256459] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.150 [2024-10-07 11:29:01.256492] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.150 [2024-10-07 11:29:01.256553] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.150 [2024-10-07 11:29:01.256587] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.150 [2024-10-07 11:29:01.256602] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.150 [2024-10-07 11:29:01.256615] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.150 [2024-10-07 11:29:01.256639] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.150 [2024-10-07 11:29:01.268128] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.150 [2024-10-07 11:29:01.268639] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.150 [2024-10-07 11:29:01.268717] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.150 [2024-10-07 11:29:01.268738] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.150 [2024-10-07 11:29:01.268808] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.150 [2024-10-07 11:29:01.268838] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.150 [2024-10-07 11:29:01.268854] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.150 [2024-10-07 11:29:01.268883] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.150 [2024-10-07 11:29:01.268907] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.151 [2024-10-07 11:29:01.281319] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.151 [2024-10-07 11:29:01.281544] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.151 [2024-10-07 11:29:01.281585] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.151 [2024-10-07 11:29:01.281605] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.151 [2024-10-07 11:29:01.281631] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.151 [2024-10-07 11:29:01.281654] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.151 [2024-10-07 11:29:01.281668] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.151 [2024-10-07 11:29:01.281682] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.151 [2024-10-07 11:29:01.281724] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.151 [2024-10-07 11:29:01.293032] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.151 [2024-10-07 11:29:01.293184] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.151 [2024-10-07 11:29:01.293219] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.151 [2024-10-07 11:29:01.293237] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.151 [2024-10-07 11:29:01.293432] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.151 [2024-10-07 11:29:01.293500] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.151 [2024-10-07 11:29:01.293530] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.151 [2024-10-07 11:29:01.293545] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.151 [2024-10-07 11:29:01.293571] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.151 [2024-10-07 11:29:01.305897] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.151 [2024-10-07 11:29:01.306200] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.151 [2024-10-07 11:29:01.306246] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.151 [2024-10-07 11:29:01.306267] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.151 [2024-10-07 11:29:01.306492] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.151 [2024-10-07 11:29:01.306617] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.151 [2024-10-07 11:29:01.306649] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.151 [2024-10-07 11:29:01.306665] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.151 [2024-10-07 11:29:01.306797] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.151 [2024-10-07 11:29:01.322160] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.151 [2024-10-07 11:29:01.323012] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.151 [2024-10-07 11:29:01.323071] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.151 [2024-10-07 11:29:01.323091] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.151 [2024-10-07 11:29:01.323196] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.151 [2024-10-07 11:29:01.323226] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.151 [2024-10-07 11:29:01.323240] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.151 [2024-10-07 11:29:01.323253] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.151 [2024-10-07 11:29:01.323277] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.151 [2024-10-07 11:29:01.333571] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.151 [2024-10-07 11:29:01.333816] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.151 [2024-10-07 11:29:01.333849] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.151 [2024-10-07 11:29:01.333866] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.151 [2024-10-07 11:29:01.334026] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.151 [2024-10-07 11:29:01.334146] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.151 [2024-10-07 11:29:01.334185] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.151 [2024-10-07 11:29:01.334202] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.151 [2024-10-07 11:29:01.334331] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.151 [2024-10-07 11:29:01.344097] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.151 [2024-10-07 11:29:01.344213] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.151 [2024-10-07 11:29:01.344246] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.151 [2024-10-07 11:29:01.344264] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.151 [2024-10-07 11:29:01.344289] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.151 [2024-10-07 11:29:01.344312] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.151 [2024-10-07 11:29:01.344326] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.151 [2024-10-07 11:29:01.344361] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.151 [2024-10-07 11:29:01.346963] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.151 [2024-10-07 11:29:01.355810] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.151 [2024-10-07 11:29:01.356006] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.151 [2024-10-07 11:29:01.356039] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.151 [2024-10-07 11:29:01.356057] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.151 [2024-10-07 11:29:01.356082] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.151 [2024-10-07 11:29:01.356105] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.151 [2024-10-07 11:29:01.356119] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.151 [2024-10-07 11:29:01.356132] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.151 [2024-10-07 11:29:01.356155] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.151 [2024-10-07 11:29:01.366593] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.151 [2024-10-07 11:29:01.366856] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.151 [2024-10-07 11:29:01.366901] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.151 [2024-10-07 11:29:01.366920] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.151 [2024-10-07 11:29:01.366973] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.151 [2024-10-07 11:29:01.367015] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.151 [2024-10-07 11:29:01.367034] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.151 [2024-10-07 11:29:01.367049] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.151 [2024-10-07 11:29:01.367072] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.151 [2024-10-07 11:29:01.379774] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.151 [2024-10-07 11:29:01.379969] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.151 [2024-10-07 11:29:01.380012] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.151 [2024-10-07 11:29:01.380031] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.151 [2024-10-07 11:29:01.380189] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.151 [2024-10-07 11:29:01.380262] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.151 [2024-10-07 11:29:01.380285] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.151 [2024-10-07 11:29:01.380299] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.151 [2024-10-07 11:29:01.380323] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.151 [2024-10-07 11:29:01.393613] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.151 [2024-10-07 11:29:01.394478] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.151 [2024-10-07 11:29:01.394528] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.151 [2024-10-07 11:29:01.394549] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.151 [2024-10-07 11:29:01.394938] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.151 [2024-10-07 11:29:01.395032] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.151 [2024-10-07 11:29:01.395060] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.151 [2024-10-07 11:29:01.395076] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.151 [2024-10-07 11:29:01.395254] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.151 8641.50 IOPS, 33.76 MiB/s [2024-10-07T11:29:15.862Z] [2024-10-07 11:29:01.404008] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.151 [2024-10-07 11:29:01.404228] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.151 [2024-10-07 11:29:01.404274] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.151 [2024-10-07 11:29:01.404294] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.151 [2024-10-07 11:29:01.404440] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.151 [2024-10-07 11:29:01.404584] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.151 [2024-10-07 11:29:01.404616] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.151 [2024-10-07 11:29:01.404632] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.151 [2024-10-07 11:29:01.406567] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.151 [2024-10-07 11:29:01.414112] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.151 [2024-10-07 11:29:01.414230] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.151 [2024-10-07 11:29:01.414263] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.151 [2024-10-07 11:29:01.414282] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.151 [2024-10-07 11:29:01.414321] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.151 [2024-10-07 11:29:01.414344] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.152 [2024-10-07 11:29:01.414358] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.152 [2024-10-07 11:29:01.414371] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.152 [2024-10-07 11:29:01.414410] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.152 [2024-10-07 11:29:01.424576] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.152 [2024-10-07 11:29:01.425363] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.152 [2024-10-07 11:29:01.425422] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.152 [2024-10-07 11:29:01.425471] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.152 [2024-10-07 11:29:01.425590] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.152 [2024-10-07 11:29:01.425622] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.152 [2024-10-07 11:29:01.425637] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.152 [2024-10-07 11:29:01.425652] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.152 [2024-10-07 11:29:01.425676] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.152 [2024-10-07 11:29:01.438232] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.152 [2024-10-07 11:29:01.438362] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.152 [2024-10-07 11:29:01.438394] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.152 [2024-10-07 11:29:01.438412] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.152 [2024-10-07 11:29:01.438479] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.152 [2024-10-07 11:29:01.438510] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.152 [2024-10-07 11:29:01.438529] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.152 [2024-10-07 11:29:01.438544] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.152 [2024-10-07 11:29:01.438568] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.152 [2024-10-07 11:29:01.452741] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.152 [2024-10-07 11:29:01.452869] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.152 [2024-10-07 11:29:01.452900] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.152 [2024-10-07 11:29:01.452917] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.152 [2024-10-07 11:29:01.452941] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.152 [2024-10-07 11:29:01.452968] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.152 [2024-10-07 11:29:01.452982] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.152 [2024-10-07 11:29:01.452994] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.152 [2024-10-07 11:29:01.453017] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.152 [2024-10-07 11:29:01.464255] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.152 [2024-10-07 11:29:01.464506] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.152 [2024-10-07 11:29:01.464541] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.152 [2024-10-07 11:29:01.464558] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.152 [2024-10-07 11:29:01.464664] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.152 [2024-10-07 11:29:01.464766] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.152 [2024-10-07 11:29:01.464785] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.152 [2024-10-07 11:29:01.464798] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.152 [2024-10-07 11:29:01.467095] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.152 [2024-10-07 11:29:01.474924] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.152 [2024-10-07 11:29:01.475050] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.152 [2024-10-07 11:29:01.475081] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.152 [2024-10-07 11:29:01.475098] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.152 [2024-10-07 11:29:01.475322] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.152 [2024-10-07 11:29:01.475399] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.152 [2024-10-07 11:29:01.475439] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.152 [2024-10-07 11:29:01.475454] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.152 [2024-10-07 11:29:01.475479] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.152 [2024-10-07 11:29:01.485019] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.152 [2024-10-07 11:29:01.485146] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.152 [2024-10-07 11:29:01.485177] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.152 [2024-10-07 11:29:01.485194] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.152 [2024-10-07 11:29:01.485217] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.152 [2024-10-07 11:29:01.485238] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.152 [2024-10-07 11:29:01.485252] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.152 [2024-10-07 11:29:01.485265] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.152 [2024-10-07 11:29:01.485456] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.152 [2024-10-07 11:29:01.496087] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.152 [2024-10-07 11:29:01.496214] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.152 [2024-10-07 11:29:01.496245] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.152 [2024-10-07 11:29:01.496262] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.152 [2024-10-07 11:29:01.496286] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.152 [2024-10-07 11:29:01.496307] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.152 [2024-10-07 11:29:01.496321] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.152 [2024-10-07 11:29:01.496334] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.152 [2024-10-07 11:29:01.496357] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.152 [2024-10-07 11:29:01.506807] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.152 [2024-10-07 11:29:01.506982] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.152 [2024-10-07 11:29:01.507030] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.152 [2024-10-07 11:29:01.507050] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.152 [2024-10-07 11:29:01.507075] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.152 [2024-10-07 11:29:01.507098] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.152 [2024-10-07 11:29:01.507113] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.152 [2024-10-07 11:29:01.507126] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.152 [2024-10-07 11:29:01.507150] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.152 [2024-10-07 11:29:01.518933] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.152 [2024-10-07 11:29:01.519171] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.152 [2024-10-07 11:29:01.519214] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.152 [2024-10-07 11:29:01.519233] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.152 [2024-10-07 11:29:01.519349] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.152 [2024-10-07 11:29:01.519467] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.152 [2024-10-07 11:29:01.519489] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.152 [2024-10-07 11:29:01.519503] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.152 [2024-10-07 11:29:01.521187] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.152 [2024-10-07 11:29:01.529570] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.152 [2024-10-07 11:29:01.529811] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.152 [2024-10-07 11:29:01.529857] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.152 [2024-10-07 11:29:01.529876] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.152 [2024-10-07 11:29:01.530044] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.152 [2024-10-07 11:29:01.530183] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.152 [2024-10-07 11:29:01.530214] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.152 [2024-10-07 11:29:01.530229] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.152 [2024-10-07 11:29:01.530359] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.152 [2024-10-07 11:29:01.539669] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.152 [2024-10-07 11:29:01.539794] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.152 [2024-10-07 11:29:01.539825] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.152 [2024-10-07 11:29:01.539842] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.152 [2024-10-07 11:29:01.539865] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.152 [2024-10-07 11:29:01.539904] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.152 [2024-10-07 11:29:01.539920] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.152 [2024-10-07 11:29:01.539934] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.152 [2024-10-07 11:29:01.539957] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.152 [2024-10-07 11:29:01.549766] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.152 [2024-10-07 11:29:01.549896] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.152 [2024-10-07 11:29:01.549927] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.152 [2024-10-07 11:29:01.549944] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.152 [2024-10-07 11:29:01.549982] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.152 [2024-10-07 11:29:01.550006] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.152 [2024-10-07 11:29:01.550020] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.152 [2024-10-07 11:29:01.550033] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.152 [2024-10-07 11:29:01.550055] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.152 [2024-10-07 11:29:01.561063] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.152 [2024-10-07 11:29:01.561189] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.152 [2024-10-07 11:29:01.561220] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.153 [2024-10-07 11:29:01.561237] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.153 [2024-10-07 11:29:01.561260] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.153 [2024-10-07 11:29:01.561281] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.153 [2024-10-07 11:29:01.561296] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.153 [2024-10-07 11:29:01.561309] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.153 [2024-10-07 11:29:01.561331] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.153 [2024-10-07 11:29:01.574718] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.153 [2024-10-07 11:29:01.574849] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.153 [2024-10-07 11:29:01.574881] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.153 [2024-10-07 11:29:01.574898] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.153 [2024-10-07 11:29:01.574923] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.153 [2024-10-07 11:29:01.574945] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.153 [2024-10-07 11:29:01.574960] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.153 [2024-10-07 11:29:01.574973] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.153 [2024-10-07 11:29:01.574996] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.153 [2024-10-07 11:29:01.586074] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.153 [2024-10-07 11:29:01.586299] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.153 [2024-10-07 11:29:01.586334] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.153 [2024-10-07 11:29:01.586352] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.153 [2024-10-07 11:29:01.586525] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.153 [2024-10-07 11:29:01.586671] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.153 [2024-10-07 11:29:01.586695] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.153 [2024-10-07 11:29:01.586709] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.153 [2024-10-07 11:29:01.586839] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.153 [2024-10-07 11:29:01.596293] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.153 [2024-10-07 11:29:01.596406] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.153 [2024-10-07 11:29:01.596481] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.153 [2024-10-07 11:29:01.596498] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.153 [2024-10-07 11:29:01.596522] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.153 [2024-10-07 11:29:01.596544] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.153 [2024-10-07 11:29:01.596558] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.153 [2024-10-07 11:29:01.596571] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.153 [2024-10-07 11:29:01.596594] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.153 [2024-10-07 11:29:01.606394] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.153 [2024-10-07 11:29:01.606552] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.153 [2024-10-07 11:29:01.606585] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.153 [2024-10-07 11:29:01.606602] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.153 [2024-10-07 11:29:01.606626] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.153 [2024-10-07 11:29:01.606648] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.153 [2024-10-07 11:29:01.606661] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.153 [2024-10-07 11:29:01.606674] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.153 [2024-10-07 11:29:01.606697] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.153 [2024-10-07 11:29:01.616995] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.153 [2024-10-07 11:29:01.617179] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.153 [2024-10-07 11:29:01.617213] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.153 [2024-10-07 11:29:01.617251] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.153 [2024-10-07 11:29:01.617312] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.153 [2024-10-07 11:29:01.617341] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.153 [2024-10-07 11:29:01.617356] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.153 [2024-10-07 11:29:01.617370] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.153 [2024-10-07 11:29:01.617393] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.153 [2024-10-07 11:29:01.630401] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.153 [2024-10-07 11:29:01.630624] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.153 [2024-10-07 11:29:01.630659] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.153 [2024-10-07 11:29:01.630676] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.153 [2024-10-07 11:29:01.630701] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.153 [2024-10-07 11:29:01.630723] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.153 [2024-10-07 11:29:01.630737] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.153 [2024-10-07 11:29:01.630750] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.153 [2024-10-07 11:29:01.630773] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.153 [2024-10-07 11:29:01.642666] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.153 [2024-10-07 11:29:01.642821] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.153 [2024-10-07 11:29:01.642853] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.153 [2024-10-07 11:29:01.642871] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.153 [2024-10-07 11:29:01.642895] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.153 [2024-10-07 11:29:01.642916] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.153 [2024-10-07 11:29:01.642931] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.153 [2024-10-07 11:29:01.642944] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.153 [2024-10-07 11:29:01.642967] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.153 [2024-10-07 11:29:01.653141] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.153 [2024-10-07 11:29:01.653366] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.153 [2024-10-07 11:29:01.653399] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.153 [2024-10-07 11:29:01.653417] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.153 [2024-10-07 11:29:01.653554] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.153 [2024-10-07 11:29:01.653668] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.153 [2024-10-07 11:29:01.653708] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.153 [2024-10-07 11:29:01.653742] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.153 [2024-10-07 11:29:01.653855] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.153 [2024-10-07 11:29:01.663370] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.153 [2024-10-07 11:29:01.663508] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.153 [2024-10-07 11:29:01.663539] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.153 [2024-10-07 11:29:01.663560] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.153 [2024-10-07 11:29:01.663584] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.153 [2024-10-07 11:29:01.663606] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.153 [2024-10-07 11:29:01.663620] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.153 [2024-10-07 11:29:01.663633] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.153 [2024-10-07 11:29:01.663655] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.153 [2024-10-07 11:29:01.673482] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.153 [2024-10-07 11:29:01.673596] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.153 [2024-10-07 11:29:01.673629] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.153 [2024-10-07 11:29:01.673647] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.153 [2024-10-07 11:29:01.673676] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.153 [2024-10-07 11:29:01.673698] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.153 [2024-10-07 11:29:01.673713] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.153 [2024-10-07 11:29:01.673726] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.153 [2024-10-07 11:29:01.673749] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.153 [2024-10-07 11:29:01.684726] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.153 [2024-10-07 11:29:01.685025] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.153 [2024-10-07 11:29:01.685070] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.153 [2024-10-07 11:29:01.685090] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.153 [2024-10-07 11:29:01.685293] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.153 [2024-10-07 11:29:01.685366] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.153 [2024-10-07 11:29:01.685389] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.153 [2024-10-07 11:29:01.685403] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.153 [2024-10-07 11:29:01.685445] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.153 [2024-10-07 11:29:01.695088] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.153 [2024-10-07 11:29:01.695310] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.153 [2024-10-07 11:29:01.695345] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.153 [2024-10-07 11:29:01.695363] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.153 [2024-10-07 11:29:01.695498] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.153 [2024-10-07 11:29:01.698006] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.153 [2024-10-07 11:29:01.698047] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.153 [2024-10-07 11:29:01.698064] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.154 [2024-10-07 11:29:01.699897] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.154 [2024-10-07 11:29:01.705188] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.154 [2024-10-07 11:29:01.705301] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.154 [2024-10-07 11:29:01.705333] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.154 [2024-10-07 11:29:01.705351] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.154 [2024-10-07 11:29:01.705375] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.154 [2024-10-07 11:29:01.705398] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.154 [2024-10-07 11:29:01.705427] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.154 [2024-10-07 11:29:01.705443] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.154 [2024-10-07 11:29:01.705468] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.154 [2024-10-07 11:29:01.715611] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.154 [2024-10-07 11:29:01.715737] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.154 [2024-10-07 11:29:01.715768] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.154 [2024-10-07 11:29:01.715785] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.154 [2024-10-07 11:29:01.715808] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.154 [2024-10-07 11:29:01.715829] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.154 [2024-10-07 11:29:01.715843] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.154 [2024-10-07 11:29:01.715856] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.154 [2024-10-07 11:29:01.715878] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.154 [2024-10-07 11:29:01.725858] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.154 [2024-10-07 11:29:01.726012] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.154 [2024-10-07 11:29:01.726045] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.154 [2024-10-07 11:29:01.726063] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.154 [2024-10-07 11:29:01.726104] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.154 [2024-10-07 11:29:01.726129] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.154 [2024-10-07 11:29:01.726144] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.154 [2024-10-07 11:29:01.726158] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.154 [2024-10-07 11:29:01.726182] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.154 [2024-10-07 11:29:01.736297] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.154 [2024-10-07 11:29:01.736507] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.154 [2024-10-07 11:29:01.736539] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.154 [2024-10-07 11:29:01.736555] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.154 [2024-10-07 11:29:01.736629] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.154 [2024-10-07 11:29:01.736655] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.154 [2024-10-07 11:29:01.736669] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.154 [2024-10-07 11:29:01.736682] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.154 [2024-10-07 11:29:01.736705] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.154 [2024-10-07 11:29:01.746417] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.154 [2024-10-07 11:29:01.746569] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.154 [2024-10-07 11:29:01.746603] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.154 [2024-10-07 11:29:01.746620] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.154 [2024-10-07 11:29:01.748695] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.154 [2024-10-07 11:29:01.748985] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.154 [2024-10-07 11:29:01.749021] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.154 [2024-10-07 11:29:01.749038] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.154 [2024-10-07 11:29:01.749093] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.154 [2024-10-07 11:29:01.756536] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.154 [2024-10-07 11:29:01.756659] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.154 [2024-10-07 11:29:01.756689] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.154 [2024-10-07 11:29:01.756706] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.154 [2024-10-07 11:29:01.756874] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.154 [2024-10-07 11:29:01.756936] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.154 [2024-10-07 11:29:01.756957] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.154 [2024-10-07 11:29:01.756986] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.154 [2024-10-07 11:29:01.757012] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.154 [2024-10-07 11:29:01.766994] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.154 [2024-10-07 11:29:01.767122] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.154 [2024-10-07 11:29:01.767153] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.154 [2024-10-07 11:29:01.767171] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.154 [2024-10-07 11:29:01.767195] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.154 [2024-10-07 11:29:01.767216] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.154 [2024-10-07 11:29:01.767230] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.154 [2024-10-07 11:29:01.767243] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.154 [2024-10-07 11:29:01.767266] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.154 [2024-10-07 11:29:01.779589] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.154 [2024-10-07 11:29:01.779788] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.154 [2024-10-07 11:29:01.779819] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.154 [2024-10-07 11:29:01.779836] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.154 [2024-10-07 11:29:01.780669] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.155 [2024-10-07 11:29:01.782381] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.155 [2024-10-07 11:29:01.782448] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.155 [2024-10-07 11:29:01.782480] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.155 [2024-10-07 11:29:01.783088] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.155 [2024-10-07 11:29:01.793189] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.155 [2024-10-07 11:29:01.793420] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.155 [2024-10-07 11:29:01.793468] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.155 [2024-10-07 11:29:01.793486] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.155 [2024-10-07 11:29:01.793511] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.155 [2024-10-07 11:29:01.793549] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.155 [2024-10-07 11:29:01.793564] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.155 [2024-10-07 11:29:01.793576] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.155 [2024-10-07 11:29:01.793844] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.155 [2024-10-07 11:29:01.803287] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.155 [2024-10-07 11:29:01.803404] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.155 [2024-10-07 11:29:01.803469] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.155 [2024-10-07 11:29:01.803489] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.155 [2024-10-07 11:29:01.803515] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.155 [2024-10-07 11:29:01.803539] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.155 [2024-10-07 11:29:01.803553] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.155 [2024-10-07 11:29:01.803567] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.155 [2024-10-07 11:29:01.803606] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.155 [2024-10-07 11:29:01.814601] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.155 [2024-10-07 11:29:01.814750] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.155 [2024-10-07 11:29:01.814782] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.155 [2024-10-07 11:29:01.814799] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.155 [2024-10-07 11:29:01.814824] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.155 [2024-10-07 11:29:01.814859] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.155 [2024-10-07 11:29:01.814879] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.155 [2024-10-07 11:29:01.814893] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.155 [2024-10-07 11:29:01.814916] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.155 [2024-10-07 11:29:01.825610] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.155 [2024-10-07 11:29:01.826015] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.155 [2024-10-07 11:29:01.826061] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.155 [2024-10-07 11:29:01.826081] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.155 [2024-10-07 11:29:01.826239] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.155 [2024-10-07 11:29:01.826394] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.155 [2024-10-07 11:29:01.826450] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.155 [2024-10-07 11:29:01.826478] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.155 [2024-10-07 11:29:01.826608] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.155 [2024-10-07 11:29:01.837473] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.155 [2024-10-07 11:29:01.837602] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.155 [2024-10-07 11:29:01.837633] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.155 [2024-10-07 11:29:01.837650] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.155 [2024-10-07 11:29:01.837675] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.155 [2024-10-07 11:29:01.837716] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.155 [2024-10-07 11:29:01.837732] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.155 [2024-10-07 11:29:01.837745] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.155 [2024-10-07 11:29:01.837769] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.155 [2024-10-07 11:29:01.847572] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.155 [2024-10-07 11:29:01.847708] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.155 [2024-10-07 11:29:01.847739] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.155 [2024-10-07 11:29:01.847757] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.155 [2024-10-07 11:29:01.847781] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.155 [2024-10-07 11:29:01.847803] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.155 [2024-10-07 11:29:01.847823] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.155 [2024-10-07 11:29:01.847837] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.155 [2024-10-07 11:29:01.848737] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.155 [2024-10-07 11:29:01.857954] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.155 [2024-10-07 11:29:01.858093] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.155 [2024-10-07 11:29:01.858124] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.155 [2024-10-07 11:29:01.858141] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.155 [2024-10-07 11:29:01.858165] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.155 [2024-10-07 11:29:01.858187] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.155 [2024-10-07 11:29:01.858202] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.155 [2024-10-07 11:29:01.858215] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.155 [2024-10-07 11:29:01.858239] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.155 [2024-10-07 11:29:01.871687] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.155 [2024-10-07 11:29:01.871814] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.155 [2024-10-07 11:29:01.871846] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.155 [2024-10-07 11:29:01.871863] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.155 [2024-10-07 11:29:01.871888] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.156 [2024-10-07 11:29:01.871910] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.156 [2024-10-07 11:29:01.871924] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.156 [2024-10-07 11:29:01.871938] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.156 [2024-10-07 11:29:01.871961] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.156 [2024-10-07 11:29:01.886312] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.156 [2024-10-07 11:29:01.886452] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.156 [2024-10-07 11:29:01.886491] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.156 [2024-10-07 11:29:01.886510] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.156 [2024-10-07 11:29:01.886537] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.156 [2024-10-07 11:29:01.886560] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.156 [2024-10-07 11:29:01.886575] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.156 [2024-10-07 11:29:01.886590] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.156 [2024-10-07 11:29:01.886614] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.156 [2024-10-07 11:29:01.901144] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.156 [2024-10-07 11:29:01.902235] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.156 [2024-10-07 11:29:01.902284] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.156 [2024-10-07 11:29:01.902304] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.156 [2024-10-07 11:29:01.902880] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.156 [2024-10-07 11:29:01.902993] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.156 [2024-10-07 11:29:01.903022] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.156 [2024-10-07 11:29:01.903037] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.156 [2024-10-07 11:29:01.903062] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.156 [2024-10-07 11:29:01.914977] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.156 [2024-10-07 11:29:01.915107] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.156 [2024-10-07 11:29:01.915138] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.156 [2024-10-07 11:29:01.915155] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.156 [2024-10-07 11:29:01.915723] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.156 [2024-10-07 11:29:01.915837] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.156 [2024-10-07 11:29:01.915860] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.156 [2024-10-07 11:29:01.915874] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.156 [2024-10-07 11:29:01.915899] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.156 [2024-10-07 11:29:01.925558] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.156 [2024-10-07 11:29:01.925801] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.156 [2024-10-07 11:29:01.925841] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.156 [2024-10-07 11:29:01.925881] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.156 [2024-10-07 11:29:01.926005] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.156 [2024-10-07 11:29:01.926545] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.156 [2024-10-07 11:29:01.926585] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.156 [2024-10-07 11:29:01.926617] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.156 [2024-10-07 11:29:01.928426] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.156 [2024-10-07 11:29:01.937785] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.156 [2024-10-07 11:29:01.938011] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.156 [2024-10-07 11:29:01.938052] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.156 [2024-10-07 11:29:01.938083] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.156 [2024-10-07 11:29:01.938213] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.156 [2024-10-07 11:29:01.940539] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.156 [2024-10-07 11:29:01.940584] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.156 [2024-10-07 11:29:01.940602] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.156 [2024-10-07 11:29:01.942391] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.156 [2024-10-07 11:29:01.948601] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.156 [2024-10-07 11:29:01.948834] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.156 [2024-10-07 11:29:01.948869] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.156 [2024-10-07 11:29:01.948887] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.156 [2024-10-07 11:29:01.949004] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.156 [2024-10-07 11:29:01.949110] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.156 [2024-10-07 11:29:01.949130] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.156 [2024-10-07 11:29:01.949143] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.156 [2024-10-07 11:29:01.949276] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.156 [2024-10-07 11:29:01.958796] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.156 [2024-10-07 11:29:01.958922] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.156 [2024-10-07 11:29:01.958953] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.156 [2024-10-07 11:29:01.958971] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.156 [2024-10-07 11:29:01.958995] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.156 [2024-10-07 11:29:01.959017] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.156 [2024-10-07 11:29:01.959064] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.156 [2024-10-07 11:29:01.959097] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.156 [2024-10-07 11:29:01.959122] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.156 [2024-10-07 11:29:01.968891] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.156 [2024-10-07 11:29:01.969016] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.156 [2024-10-07 11:29:01.969046] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.156 [2024-10-07 11:29:01.969063] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.156 [2024-10-07 11:29:01.969087] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.156 [2024-10-07 11:29:01.969108] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.157 [2024-10-07 11:29:01.969122] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.157 [2024-10-07 11:29:01.969135] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.157 [2024-10-07 11:29:01.969158] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.157 [2024-10-07 11:29:01.979937] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.157 [2024-10-07 11:29:01.980110] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.157 [2024-10-07 11:29:01.980143] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.157 [2024-10-07 11:29:01.980160] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.157 [2024-10-07 11:29:01.980185] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.157 [2024-10-07 11:29:01.980206] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.157 [2024-10-07 11:29:01.980220] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.157 [2024-10-07 11:29:01.980233] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.157 [2024-10-07 11:29:01.980256] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.157 [2024-10-07 11:29:01.992972] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.157 [2024-10-07 11:29:01.993241] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.157 [2024-10-07 11:29:01.993277] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.157 [2024-10-07 11:29:01.993295] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.157 [2024-10-07 11:29:01.993409] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.157 [2024-10-07 11:29:01.993585] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.157 [2024-10-07 11:29:01.993618] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.157 [2024-10-07 11:29:01.993634] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.157 [2024-10-07 11:29:01.993692] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.157 [2024-10-07 11:29:02.006851] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.157 [2024-10-07 11:29:02.007403] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.157 [2024-10-07 11:29:02.007476] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.157 [2024-10-07 11:29:02.007513] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.157 [2024-10-07 11:29:02.007728] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.157 [2024-10-07 11:29:02.007928] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.157 [2024-10-07 11:29:02.007964] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.157 [2024-10-07 11:29:02.007980] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.157 [2024-10-07 11:29:02.008039] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.157 [2024-10-07 11:29:02.020358] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.157 [2024-10-07 11:29:02.020689] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.157 [2024-10-07 11:29:02.020736] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.157 [2024-10-07 11:29:02.020756] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.157 [2024-10-07 11:29:02.020881] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.157 [2024-10-07 11:29:02.021016] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.157 [2024-10-07 11:29:02.021043] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.157 [2024-10-07 11:29:02.021058] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.157 [2024-10-07 11:29:02.021178] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.157 [2024-10-07 11:29:02.030586] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.157 [2024-10-07 11:29:02.030711] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.157 [2024-10-07 11:29:02.030742] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.157 [2024-10-07 11:29:02.030759] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.157 [2024-10-07 11:29:02.030783] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.157 [2024-10-07 11:29:02.030804] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.157 [2024-10-07 11:29:02.030818] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.157 [2024-10-07 11:29:02.030831] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.157 [2024-10-07 11:29:02.030854] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.157 [2024-10-07 11:29:02.043694] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.157 [2024-10-07 11:29:02.043940] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.157 [2024-10-07 11:29:02.043993] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.157 [2024-10-07 11:29:02.044013] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.157 [2024-10-07 11:29:02.044076] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.157 [2024-10-07 11:29:02.044104] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.157 [2024-10-07 11:29:02.044118] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.157 [2024-10-07 11:29:02.044131] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.157 [2024-10-07 11:29:02.044155] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.157 [2024-10-07 11:29:02.056761] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.157 [2024-10-07 11:29:02.056888] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.157 [2024-10-07 11:29:02.056919] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.157 [2024-10-07 11:29:02.056937] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.157 [2024-10-07 11:29:02.056961] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.157 [2024-10-07 11:29:02.056983] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.157 [2024-10-07 11:29:02.057013] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.157 [2024-10-07 11:29:02.057027] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.157 [2024-10-07 11:29:02.057906] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.157 [2024-10-07 11:29:02.069623] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.157 [2024-10-07 11:29:02.069920] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.157 [2024-10-07 11:29:02.069976] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.157 [2024-10-07 11:29:02.069998] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.157 [2024-10-07 11:29:02.070192] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.157 [2024-10-07 11:29:02.070353] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.157 [2024-10-07 11:29:02.070387] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.158 [2024-10-07 11:29:02.070404] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.158 [2024-10-07 11:29:02.070491] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.158 [2024-10-07 11:29:02.080360] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.158 [2024-10-07 11:29:02.080522] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.158 [2024-10-07 11:29:02.080554] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.158 [2024-10-07 11:29:02.080571] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.158 [2024-10-07 11:29:02.080595] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.158 [2024-10-07 11:29:02.080617] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.158 [2024-10-07 11:29:02.080631] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.158 [2024-10-07 11:29:02.080662] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.158 [2024-10-07 11:29:02.080688] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.158 [2024-10-07 11:29:02.093419] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.158 [2024-10-07 11:29:02.093599] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.158 [2024-10-07 11:29:02.093632] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.158 [2024-10-07 11:29:02.093649] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.158 [2024-10-07 11:29:02.093673] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.158 [2024-10-07 11:29:02.093694] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.158 [2024-10-07 11:29:02.093708] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.158 [2024-10-07 11:29:02.093721] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.158 [2024-10-07 11:29:02.093744] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.158 [2024-10-07 11:29:02.106138] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.158 [2024-10-07 11:29:02.106375] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.158 [2024-10-07 11:29:02.106411] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.158 [2024-10-07 11:29:02.106456] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.158 [2024-10-07 11:29:02.106597] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.158 [2024-10-07 11:29:02.106701] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.158 [2024-10-07 11:29:02.106733] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.158 [2024-10-07 11:29:02.106749] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.158 [2024-10-07 11:29:02.107857] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.158 [2024-10-07 11:29:02.116687] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.158 [2024-10-07 11:29:02.118837] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.158 [2024-10-07 11:29:02.118900] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.158 [2024-10-07 11:29:02.118920] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.158 [2024-10-07 11:29:02.119298] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.158 [2024-10-07 11:29:02.119632] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.158 [2024-10-07 11:29:02.119669] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.158 [2024-10-07 11:29:02.119686] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.158 [2024-10-07 11:29:02.119828] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.158 [2024-10-07 11:29:02.126782] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.158 [2024-10-07 11:29:02.126910] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.158 [2024-10-07 11:29:02.126957] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.158 [2024-10-07 11:29:02.126976] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.158 [2024-10-07 11:29:02.127000] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.158 [2024-10-07 11:29:02.127036] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.158 [2024-10-07 11:29:02.127054] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.158 [2024-10-07 11:29:02.127068] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.158 [2024-10-07 11:29:02.127092] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.158 [2024-10-07 11:29:02.137913] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.158 [2024-10-07 11:29:02.138142] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.158 [2024-10-07 11:29:02.138182] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.158 [2024-10-07 11:29:02.138201] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.158 [2024-10-07 11:29:02.138365] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.158 [2024-10-07 11:29:02.138446] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.158 [2024-10-07 11:29:02.138481] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.158 [2024-10-07 11:29:02.138496] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.158 [2024-10-07 11:29:02.138521] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.158 [2024-10-07 11:29:02.152627] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.158 [2024-10-07 11:29:02.152753] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.158 [2024-10-07 11:29:02.152783] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.158 [2024-10-07 11:29:02.152800] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.158 [2024-10-07 11:29:02.152823] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.158 [2024-10-07 11:29:02.152845] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.158 [2024-10-07 11:29:02.152858] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.158 [2024-10-07 11:29:02.152871] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.158 [2024-10-07 11:29:02.152894] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.158 [2024-10-07 11:29:02.166793] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.158 [2024-10-07 11:29:02.166919] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.158 [2024-10-07 11:29:02.166951] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.158 [2024-10-07 11:29:02.166968] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.158 [2024-10-07 11:29:02.166992] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.158 [2024-10-07 11:29:02.167032] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.158 [2024-10-07 11:29:02.167047] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.159 [2024-10-07 11:29:02.167060] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.159 [2024-10-07 11:29:02.167083] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.159 [2024-10-07 11:29:02.179182] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.159 [2024-10-07 11:29:02.179308] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.159 [2024-10-07 11:29:02.179339] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.159 [2024-10-07 11:29:02.179357] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.159 [2024-10-07 11:29:02.179380] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.159 [2024-10-07 11:29:02.179402] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.159 [2024-10-07 11:29:02.179416] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.159 [2024-10-07 11:29:02.179445] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.159 [2024-10-07 11:29:02.179472] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.159 [2024-10-07 11:29:02.191766] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.159 [2024-10-07 11:29:02.191891] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.159 [2024-10-07 11:29:02.191922] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.159 [2024-10-07 11:29:02.191939] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.159 [2024-10-07 11:29:02.191962] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.159 [2024-10-07 11:29:02.191983] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.159 [2024-10-07 11:29:02.191996] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.159 [2024-10-07 11:29:02.192009] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.159 [2024-10-07 11:29:02.192032] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.159 [2024-10-07 11:29:02.206716] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.159 [2024-10-07 11:29:02.206832] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.159 [2024-10-07 11:29:02.206864] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.159 [2024-10-07 11:29:02.206882] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.159 [2024-10-07 11:29:02.207478] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.159 [2024-10-07 11:29:02.207616] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.159 [2024-10-07 11:29:02.207642] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.159 [2024-10-07 11:29:02.207657] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.159 [2024-10-07 11:29:02.207683] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.159 [2024-10-07 11:29:02.218989] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.159 [2024-10-07 11:29:02.220008] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.159 [2024-10-07 11:29:02.220068] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.159 [2024-10-07 11:29:02.220104] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.159 [2024-10-07 11:29:02.220327] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.159 [2024-10-07 11:29:02.220866] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.159 [2024-10-07 11:29:02.220916] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.159 [2024-10-07 11:29:02.220949] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.159 [2024-10-07 11:29:02.221067] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.159 [2024-10-07 11:29:02.232783] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.159 [2024-10-07 11:29:02.233039] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.159 [2024-10-07 11:29:02.233083] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.159 [2024-10-07 11:29:02.233102] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.159 [2024-10-07 11:29:02.233128] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.159 [2024-10-07 11:29:02.233150] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.159 [2024-10-07 11:29:02.233164] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.159 [2024-10-07 11:29:02.233177] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.159 [2024-10-07 11:29:02.233200] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.159 [2024-10-07 11:29:02.245518] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.159 [2024-10-07 11:29:02.245950] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.159 [2024-10-07 11:29:02.246026] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.159 [2024-10-07 11:29:02.246047] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.159 [2024-10-07 11:29:02.246122] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.159 [2024-10-07 11:29:02.246153] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.159 [2024-10-07 11:29:02.246168] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.159 [2024-10-07 11:29:02.246182] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.159 [2024-10-07 11:29:02.246206] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.159 [2024-10-07 11:29:02.256528] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.159 [2024-10-07 11:29:02.256677] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.159 [2024-10-07 11:29:02.256723] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.159 [2024-10-07 11:29:02.256759] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.159 [2024-10-07 11:29:02.256786] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.159 [2024-10-07 11:29:02.256810] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.159 [2024-10-07 11:29:02.256839] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.159 [2024-10-07 11:29:02.256853] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.159 [2024-10-07 11:29:02.256877] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.159 [2024-10-07 11:29:02.269989] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.159 [2024-10-07 11:29:02.270193] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.159 [2024-10-07 11:29:02.270227] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.159 [2024-10-07 11:29:02.270245] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.159 [2024-10-07 11:29:02.270913] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.159 [2024-10-07 11:29:02.271046] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.159 [2024-10-07 11:29:02.271071] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.159 [2024-10-07 11:29:02.271086] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.160 [2024-10-07 11:29:02.271112] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.160 [2024-10-07 11:29:02.282188] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.160 [2024-10-07 11:29:02.282463] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.160 [2024-10-07 11:29:02.282511] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.160 [2024-10-07 11:29:02.282533] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.160 [2024-10-07 11:29:02.282655] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.160 [2024-10-07 11:29:02.282771] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.160 [2024-10-07 11:29:02.282792] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.160 [2024-10-07 11:29:02.282808] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.160 [2024-10-07 11:29:02.282911] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.160 [2024-10-07 11:29:02.294756] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.160 [2024-10-07 11:29:02.297118] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.160 [2024-10-07 11:29:02.297168] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.160 [2024-10-07 11:29:02.297188] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.160 [2024-10-07 11:29:02.297459] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.160 [2024-10-07 11:29:02.297533] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.160 [2024-10-07 11:29:02.297579] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.160 [2024-10-07 11:29:02.297596] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.160 [2024-10-07 11:29:02.297623] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.160 [2024-10-07 11:29:02.304847] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.160 [2024-10-07 11:29:02.304980] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.160 [2024-10-07 11:29:02.305012] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.160 [2024-10-07 11:29:02.305030] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.160 [2024-10-07 11:29:02.305055] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.160 [2024-10-07 11:29:02.305078] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.160 [2024-10-07 11:29:02.305093] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.160 [2024-10-07 11:29:02.305107] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.160 [2024-10-07 11:29:02.305131] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.160 [2024-10-07 11:29:02.317351] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.160 [2024-10-07 11:29:02.317493] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.160 [2024-10-07 11:29:02.317526] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.160 [2024-10-07 11:29:02.317543] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.160 [2024-10-07 11:29:02.317568] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.160 [2024-10-07 11:29:02.317591] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.160 [2024-10-07 11:29:02.317605] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.160 [2024-10-07 11:29:02.317619] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.160 [2024-10-07 11:29:02.317642] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.160 [2024-10-07 11:29:02.330664] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.160 [2024-10-07 11:29:02.330813] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.160 [2024-10-07 11:29:02.330845] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.160 [2024-10-07 11:29:02.330863] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.160 [2024-10-07 11:29:02.331472] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.160 [2024-10-07 11:29:02.331623] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.160 [2024-10-07 11:29:02.331649] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.160 [2024-10-07 11:29:02.331664] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.160 [2024-10-07 11:29:02.331689] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.160 [2024-10-07 11:29:02.341320] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.160 [2024-10-07 11:29:02.341580] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.160 [2024-10-07 11:29:02.341617] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.160 [2024-10-07 11:29:02.341636] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.160 [2024-10-07 11:29:02.341767] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.160 [2024-10-07 11:29:02.341889] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.160 [2024-10-07 11:29:02.341921] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.160 [2024-10-07 11:29:02.341937] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.160 [2024-10-07 11:29:02.342072] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.160 [2024-10-07 11:29:02.353889] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.160 [2024-10-07 11:29:02.356245] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.160 [2024-10-07 11:29:02.356295] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.160 [2024-10-07 11:29:02.356316] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.161 [2024-10-07 11:29:02.356452] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.161 [2024-10-07 11:29:02.356487] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.161 [2024-10-07 11:29:02.356504] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.161 [2024-10-07 11:29:02.356518] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.161 [2024-10-07 11:29:02.356798] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.161 [2024-10-07 11:29:02.365232] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.161 [2024-10-07 11:29:02.365394] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.161 [2024-10-07 11:29:02.365443] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.161 [2024-10-07 11:29:02.365464] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.161 [2024-10-07 11:29:02.365490] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.161 [2024-10-07 11:29:02.365513] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.161 [2024-10-07 11:29:02.365528] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.161 [2024-10-07 11:29:02.365542] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.161 [2024-10-07 11:29:02.365566] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.161 [2024-10-07 11:29:02.377066] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.161 [2024-10-07 11:29:02.378426] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.161 [2024-10-07 11:29:02.378503] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.161 [2024-10-07 11:29:02.378525] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.161 [2024-10-07 11:29:02.378699] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.161 [2024-10-07 11:29:02.378732] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.161 [2024-10-07 11:29:02.378748] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.161 [2024-10-07 11:29:02.378762] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.161 [2024-10-07 11:29:02.378787] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.161 [2024-10-07 11:29:02.392563] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.161 [2024-10-07 11:29:02.392787] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.161 [2024-10-07 11:29:02.392828] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.161 [2024-10-07 11:29:02.392848] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.161 [2024-10-07 11:29:02.392874] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.161 [2024-10-07 11:29:02.392896] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.161 [2024-10-07 11:29:02.392911] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.161 [2024-10-07 11:29:02.392925] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.161 [2024-10-07 11:29:02.392949] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.161 8878.33 IOPS, 34.68 MiB/s [2024-10-07T11:29:15.872Z] [2024-10-07 11:29:02.408690] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.161 [2024-10-07 11:29:02.409006] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.161 [2024-10-07 11:29:02.409053] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.161 [2024-10-07 11:29:02.409074] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.161 [2024-10-07 11:29:02.409131] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.161 [2024-10-07 11:29:02.409161] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.161 [2024-10-07 11:29:02.409177] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.161 [2024-10-07 11:29:02.409191] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.161 [2024-10-07 11:29:02.409216] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.161 [2024-10-07 11:29:02.421834] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.161 [2024-10-07 11:29:02.423747] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.161 [2024-10-07 11:29:02.423797] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.161 [2024-10-07 11:29:02.423818] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.161 [2024-10-07 11:29:02.424459] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.161 [2024-10-07 11:29:02.424680] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.161 [2024-10-07 11:29:02.424708] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.161 [2024-10-07 11:29:02.424743] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.161 [2024-10-07 11:29:02.424790] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.161 [2024-10-07 11:29:02.433580] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.161 [2024-10-07 11:29:02.434070] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.161 [2024-10-07 11:29:02.434120] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.161 [2024-10-07 11:29:02.434141] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.161 [2024-10-07 11:29:02.434222] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.161 [2024-10-07 11:29:02.434254] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.161 [2024-10-07 11:29:02.434271] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.161 [2024-10-07 11:29:02.434285] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.161 [2024-10-07 11:29:02.434310] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.161 [2024-10-07 11:29:02.443668] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.161 [2024-10-07 11:29:02.443786] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.161 [2024-10-07 11:29:02.443818] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.161 [2024-10-07 11:29:02.443836] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.161 [2024-10-07 11:29:02.445503] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.161 [2024-10-07 11:29:02.445649] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.161 [2024-10-07 11:29:02.445675] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.161 [2024-10-07 11:29:02.445690] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.161 [2024-10-07 11:29:02.445717] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.161 [2024-10-07 11:29:02.453756] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.161 [2024-10-07 11:29:02.454205] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.161 [2024-10-07 11:29:02.454253] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.161 [2024-10-07 11:29:02.454274] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.161 [2024-10-07 11:29:02.454457] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.161 [2024-10-07 11:29:02.455587] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.161 [2024-10-07 11:29:02.455626] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.161 [2024-10-07 11:29:02.455659] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.161 [2024-10-07 11:29:02.456081] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.161 [2024-10-07 11:29:02.466191] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.161 [2024-10-07 11:29:02.466323] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.161 [2024-10-07 11:29:02.466371] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.162 [2024-10-07 11:29:02.466390] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.162 [2024-10-07 11:29:02.466979] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.162 [2024-10-07 11:29:02.467100] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.162 [2024-10-07 11:29:02.467124] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.162 [2024-10-07 11:29:02.467139] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.162 [2024-10-07 11:29:02.467165] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.162 [2024-10-07 11:29:02.476279] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.162 [2024-10-07 11:29:02.476408] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.162 [2024-10-07 11:29:02.476454] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.162 [2024-10-07 11:29:02.476474] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.162 [2024-10-07 11:29:02.476499] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.162 [2024-10-07 11:29:02.476521] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.162 [2024-10-07 11:29:02.476535] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.162 [2024-10-07 11:29:02.476548] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.162 [2024-10-07 11:29:02.476571] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.162 [2024-10-07 11:29:02.488833] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.162 [2024-10-07 11:29:02.489371] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.162 [2024-10-07 11:29:02.489461] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.162 [2024-10-07 11:29:02.489493] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.162 [2024-10-07 11:29:02.489674] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.162 [2024-10-07 11:29:02.489736] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.162 [2024-10-07 11:29:02.489757] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.162 [2024-10-07 11:29:02.489771] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.162 [2024-10-07 11:29:02.489796] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.162 [2024-10-07 11:29:02.499834] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.162 [2024-10-07 11:29:02.500044] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.162 [2024-10-07 11:29:02.500078] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.162 [2024-10-07 11:29:02.500096] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.162 [2024-10-07 11:29:02.500345] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.162 [2024-10-07 11:29:02.501043] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.162 [2024-10-07 11:29:02.501081] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.162 [2024-10-07 11:29:02.501098] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.162 [2024-10-07 11:29:02.503799] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.162 [2024-10-07 11:29:02.509919] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.162 [2024-10-07 11:29:02.510058] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.162 [2024-10-07 11:29:02.510090] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.162 [2024-10-07 11:29:02.510108] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.162 [2024-10-07 11:29:02.510133] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.162 [2024-10-07 11:29:02.510156] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.162 [2024-10-07 11:29:02.510170] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.162 [2024-10-07 11:29:02.510185] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.162 [2024-10-07 11:29:02.512331] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.162 [2024-10-07 11:29:02.520023] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.162 [2024-10-07 11:29:02.520169] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.162 [2024-10-07 11:29:02.520201] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.162 [2024-10-07 11:29:02.520219] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.162 [2024-10-07 11:29:02.520244] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.162 [2024-10-07 11:29:02.520267] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.162 [2024-10-07 11:29:02.520281] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.162 [2024-10-07 11:29:02.520295] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.162 [2024-10-07 11:29:02.520319] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.162 [2024-10-07 11:29:02.530123] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.162 [2024-10-07 11:29:02.530241] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.162 [2024-10-07 11:29:02.530274] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.162 [2024-10-07 11:29:02.530292] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.162 [2024-10-07 11:29:02.530332] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.162 [2024-10-07 11:29:02.530354] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.162 [2024-10-07 11:29:02.530379] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.162 [2024-10-07 11:29:02.530393] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.162 [2024-10-07 11:29:02.530451] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.162 [2024-10-07 11:29:02.541062] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.162 [2024-10-07 11:29:02.542591] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.162 [2024-10-07 11:29:02.542653] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.162 [2024-10-07 11:29:02.542674] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.162 [2024-10-07 11:29:02.544795] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.162 [2024-10-07 11:29:02.545471] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.162 [2024-10-07 11:29:02.545529] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.162 [2024-10-07 11:29:02.545564] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.162 [2024-10-07 11:29:02.545766] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.162 [2024-10-07 11:29:02.551401] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.162 [2024-10-07 11:29:02.551637] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.162 [2024-10-07 11:29:02.551677] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.162 [2024-10-07 11:29:02.551696] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.162 [2024-10-07 11:29:02.552726] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.162 [2024-10-07 11:29:02.553200] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.162 [2024-10-07 11:29:02.553236] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.162 [2024-10-07 11:29:02.553252] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.162 [2024-10-07 11:29:02.553717] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.162 [2024-10-07 11:29:02.561532] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.162 [2024-10-07 11:29:02.561666] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.162 [2024-10-07 11:29:02.561699] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.162 [2024-10-07 11:29:02.561717] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.162 [2024-10-07 11:29:02.561741] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.162 [2024-10-07 11:29:02.561764] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.162 [2024-10-07 11:29:02.561779] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.162 [2024-10-07 11:29:02.561793] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.162 [2024-10-07 11:29:02.561817] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.162 [2024-10-07 11:29:02.572410] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.162 [2024-10-07 11:29:02.572559] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.162 [2024-10-07 11:29:02.572591] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.162 [2024-10-07 11:29:02.572625] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.162 [2024-10-07 11:29:02.573215] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.162 [2024-10-07 11:29:02.573342] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.162 [2024-10-07 11:29:02.573365] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.162 [2024-10-07 11:29:02.573379] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.162 [2024-10-07 11:29:02.573402] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.162 [2024-10-07 11:29:02.582959] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.162 [2024-10-07 11:29:02.583120] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.163 [2024-10-07 11:29:02.583152] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.163 [2024-10-07 11:29:02.583170] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.163 [2024-10-07 11:29:02.584839] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.163 [2024-10-07 11:29:02.585487] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.163 [2024-10-07 11:29:02.585531] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.163 [2024-10-07 11:29:02.585565] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.163 [2024-10-07 11:29:02.585804] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.163 [2024-10-07 11:29:02.593380] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.163 [2024-10-07 11:29:02.593639] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.163 [2024-10-07 11:29:02.593676] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.163 [2024-10-07 11:29:02.593695] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.163 [2024-10-07 11:29:02.593831] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.163 [2024-10-07 11:29:02.593951] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.163 [2024-10-07 11:29:02.593988] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.163 [2024-10-07 11:29:02.594003] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.163 [2024-10-07 11:29:02.594124] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.163 [2024-10-07 11:29:02.603836] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.163 [2024-10-07 11:29:02.603983] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.163 [2024-10-07 11:29:02.604017] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.163 [2024-10-07 11:29:02.604035] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.163 [2024-10-07 11:29:02.604060] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.163 [2024-10-07 11:29:02.604083] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.163 [2024-10-07 11:29:02.604117] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.163 [2024-10-07 11:29:02.604132] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.163 [2024-10-07 11:29:02.604158] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.163 [2024-10-07 11:29:02.616744] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.163 [2024-10-07 11:29:02.616986] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.163 [2024-10-07 11:29:02.617040] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.163 [2024-10-07 11:29:02.617077] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.163 [2024-10-07 11:29:02.617277] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.163 [2024-10-07 11:29:02.617933] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.163 [2024-10-07 11:29:02.618000] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.163 [2024-10-07 11:29:02.618020] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.163 [2024-10-07 11:29:02.618274] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.163 [2024-10-07 11:29:02.633259] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.163 [2024-10-07 11:29:02.633529] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.163 [2024-10-07 11:29:02.633566] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.163 [2024-10-07 11:29:02.633584] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.163 [2024-10-07 11:29:02.633608] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.163 [2024-10-07 11:29:02.633629] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.163 [2024-10-07 11:29:02.633644] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.163 [2024-10-07 11:29:02.633657] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.163 [2024-10-07 11:29:02.633680] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.163 [2024-10-07 11:29:02.646807] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.163 [2024-10-07 11:29:02.646961] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.163 [2024-10-07 11:29:02.646994] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.163 [2024-10-07 11:29:02.647011] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.163 [2024-10-07 11:29:02.647036] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.163 [2024-10-07 11:29:02.647057] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.163 [2024-10-07 11:29:02.647072] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.163 [2024-10-07 11:29:02.647085] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.163 [2024-10-07 11:29:02.647107] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.163 [2024-10-07 11:29:02.660060] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.163 [2024-10-07 11:29:02.660270] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.163 [2024-10-07 11:29:02.660305] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.163 [2024-10-07 11:29:02.660323] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.163 [2024-10-07 11:29:02.660348] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.163 [2024-10-07 11:29:02.660370] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.163 [2024-10-07 11:29:02.660385] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.163 [2024-10-07 11:29:02.660399] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.163 [2024-10-07 11:29:02.660437] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.163 [2024-10-07 11:29:02.672542] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.163 [2024-10-07 11:29:02.672996] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.163 [2024-10-07 11:29:02.673042] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.163 [2024-10-07 11:29:02.673063] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.163 [2024-10-07 11:29:02.673133] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.163 [2024-10-07 11:29:02.673163] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.163 [2024-10-07 11:29:02.673181] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.163 [2024-10-07 11:29:02.673194] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.163 [2024-10-07 11:29:02.673219] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.163 [2024-10-07 11:29:02.687004] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.163 [2024-10-07 11:29:02.687135] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.163 [2024-10-07 11:29:02.687168] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.163 [2024-10-07 11:29:02.687201] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.163 [2024-10-07 11:29:02.687857] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.163 [2024-10-07 11:29:02.687975] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.163 [2024-10-07 11:29:02.687999] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.163 [2024-10-07 11:29:02.688014] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.163 [2024-10-07 11:29:02.688039] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.163 [2024-10-07 11:29:02.698162] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.163 [2024-10-07 11:29:02.698410] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.163 [2024-10-07 11:29:02.698443] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.163 [2024-10-07 11:29:02.698477] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.163 [2024-10-07 11:29:02.698618] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.163 [2024-10-07 11:29:02.698726] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.163 [2024-10-07 11:29:02.698769] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.163 [2024-10-07 11:29:02.698785] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.163 [2024-10-07 11:29:02.699113] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.163 [2024-10-07 11:29:02.709743] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.164 [2024-10-07 11:29:02.710028] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.164 [2024-10-07 11:29:02.710081] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.164 [2024-10-07 11:29:02.710101] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.164 [2024-10-07 11:29:02.710261] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.164 [2024-10-07 11:29:02.710443] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.164 [2024-10-07 11:29:02.710497] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.164 [2024-10-07 11:29:02.710514] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.164 [2024-10-07 11:29:02.710628] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.164 [2024-10-07 11:29:02.720833] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.164 [2024-10-07 11:29:02.720978] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.164 [2024-10-07 11:29:02.721012] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.164 [2024-10-07 11:29:02.721030] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.164 [2024-10-07 11:29:02.721355] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.164 [2024-10-07 11:29:02.721570] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.164 [2024-10-07 11:29:02.721610] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.164 [2024-10-07 11:29:02.721627] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.164 [2024-10-07 11:29:02.721732] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.164 [2024-10-07 11:29:02.731490] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.164 [2024-10-07 11:29:02.731632] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.164 [2024-10-07 11:29:02.731664] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.164 [2024-10-07 11:29:02.731682] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.164 [2024-10-07 11:29:02.731706] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.164 [2024-10-07 11:29:02.731744] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.164 [2024-10-07 11:29:02.731758] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.164 [2024-10-07 11:29:02.731792] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.164 [2024-10-07 11:29:02.731835] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.164 [2024-10-07 11:29:02.741655] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.164 [2024-10-07 11:29:02.741799] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.164 [2024-10-07 11:29:02.741831] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.164 [2024-10-07 11:29:02.741849] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.164 [2024-10-07 11:29:02.741873] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.164 [2024-10-07 11:29:02.741895] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.164 [2024-10-07 11:29:02.741926] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.164 [2024-10-07 11:29:02.741939] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.164 [2024-10-07 11:29:02.741978] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.164 [2024-10-07 11:29:02.752862] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.164 [2024-10-07 11:29:02.753116] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.164 [2024-10-07 11:29:02.753166] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.164 [2024-10-07 11:29:02.753186] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.164 [2024-10-07 11:29:02.754080] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.164 [2024-10-07 11:29:02.754344] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.164 [2024-10-07 11:29:02.754380] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.164 [2024-10-07 11:29:02.754397] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.164 [2024-10-07 11:29:02.754437] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.164 [2024-10-07 11:29:02.762961] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.164 [2024-10-07 11:29:02.763085] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.164 [2024-10-07 11:29:02.763115] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.164 [2024-10-07 11:29:02.763133] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.164 [2024-10-07 11:29:02.763156] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.164 [2024-10-07 11:29:02.763177] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.164 [2024-10-07 11:29:02.763191] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.164 [2024-10-07 11:29:02.763204] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.164 [2024-10-07 11:29:02.763226] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.164 [2024-10-07 11:29:02.775562] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.164 [2024-10-07 11:29:02.775687] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.164 [2024-10-07 11:29:02.775743] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.164 [2024-10-07 11:29:02.775763] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.164 [2024-10-07 11:29:02.776350] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.164 [2024-10-07 11:29:02.776472] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.164 [2024-10-07 11:29:02.776497] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.164 [2024-10-07 11:29:02.776512] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.164 [2024-10-07 11:29:02.776538] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.164 [2024-10-07 11:29:02.786127] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.164 [2024-10-07 11:29:02.786316] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.164 [2024-10-07 11:29:02.786359] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.164 [2024-10-07 11:29:02.786377] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.164 [2024-10-07 11:29:02.786509] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.164 [2024-10-07 11:29:02.786837] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.164 [2024-10-07 11:29:02.786863] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.164 [2024-10-07 11:29:02.786889] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.164 [2024-10-07 11:29:02.788906] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.164 [2024-10-07 11:29:02.797726] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.164 [2024-10-07 11:29:02.797996] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.164 [2024-10-07 11:29:02.798033] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.164 [2024-10-07 11:29:02.798052] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.164 [2024-10-07 11:29:02.798201] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.164 [2024-10-07 11:29:02.798336] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.164 [2024-10-07 11:29:02.798360] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.164 [2024-10-07 11:29:02.798375] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.164 [2024-10-07 11:29:02.798506] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.164 [2024-10-07 11:29:02.807839] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.164 [2024-10-07 11:29:02.807956] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.164 [2024-10-07 11:29:02.807989] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.164 [2024-10-07 11:29:02.808007] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.164 [2024-10-07 11:29:02.808152] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.164 [2024-10-07 11:29:02.808309] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.164 [2024-10-07 11:29:02.808335] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.164 [2024-10-07 11:29:02.808350] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.164 [2024-10-07 11:29:02.808571] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.164 [2024-10-07 11:29:02.819499] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.164 [2024-10-07 11:29:02.819729] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.165 [2024-10-07 11:29:02.819764] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.165 [2024-10-07 11:29:02.819782] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.165 [2024-10-07 11:29:02.819921] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.165 [2024-10-07 11:29:02.820056] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.165 [2024-10-07 11:29:02.820080] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.165 [2024-10-07 11:29:02.820094] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.165 [2024-10-07 11:29:02.820223] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.165 [2024-10-07 11:29:02.829585] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.165 [2024-10-07 11:29:02.829711] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.165 [2024-10-07 11:29:02.829757] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.165 [2024-10-07 11:29:02.829773] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.165 [2024-10-07 11:29:02.829796] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.165 [2024-10-07 11:29:02.829852] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.165 [2024-10-07 11:29:02.829866] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.165 [2024-10-07 11:29:02.829880] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.165 [2024-10-07 11:29:02.829903] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.165 [2024-10-07 11:29:02.841012] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.165 [2024-10-07 11:29:02.841140] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.165 [2024-10-07 11:29:02.841172] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.165 [2024-10-07 11:29:02.841204] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.165 [2024-10-07 11:29:02.841227] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.165 [2024-10-07 11:29:02.841263] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.165 [2024-10-07 11:29:02.841281] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.165 [2024-10-07 11:29:02.841294] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.165 [2024-10-07 11:29:02.841591] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.165 [2024-10-07 11:29:02.851864] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.165 [2024-10-07 11:29:02.852114] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.165 [2024-10-07 11:29:02.852148] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.165 [2024-10-07 11:29:02.852166] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.165 [2024-10-07 11:29:02.852285] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.165 [2024-10-07 11:29:02.852396] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.165 [2024-10-07 11:29:02.852415] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.165 [2024-10-07 11:29:02.852428] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.165 [2024-10-07 11:29:02.852467] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.165 [2024-10-07 11:29:02.862669] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.165 [2024-10-07 11:29:02.862812] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.165 [2024-10-07 11:29:02.862847] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.165 [2024-10-07 11:29:02.862865] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.165 [2024-10-07 11:29:02.862890] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.165 [2024-10-07 11:29:02.862913] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.165 [2024-10-07 11:29:02.862928] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.165 [2024-10-07 11:29:02.862941] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.165 [2024-10-07 11:29:02.862966] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.165 [2024-10-07 11:29:02.875358] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.165 [2024-10-07 11:29:02.875593] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.165 [2024-10-07 11:29:02.875629] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.165 [2024-10-07 11:29:02.875647] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.165 [2024-10-07 11:29:02.876017] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.165 [2024-10-07 11:29:02.877686] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.165 [2024-10-07 11:29:02.877725] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.165 [2024-10-07 11:29:02.877759] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.165 [2024-10-07 11:29:02.878381] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.165 [2024-10-07 11:29:02.886506] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.165 [2024-10-07 11:29:02.886745] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.165 [2024-10-07 11:29:02.886779] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.165 [2024-10-07 11:29:02.886831] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.165 [2024-10-07 11:29:02.886988] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.165 [2024-10-07 11:29:02.887111] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.165 [2024-10-07 11:29:02.887133] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.165 [2024-10-07 11:29:02.887148] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.165 [2024-10-07 11:29:02.887250] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.165 [2024-10-07 11:29:02.898143] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.165 [2024-10-07 11:29:02.898259] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.165 [2024-10-07 11:29:02.898307] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.165 [2024-10-07 11:29:02.898324] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.165 [2024-10-07 11:29:02.898348] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.165 [2024-10-07 11:29:02.898548] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.165 [2024-10-07 11:29:02.898577] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.165 [2024-10-07 11:29:02.898592] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.165 [2024-10-07 11:29:02.898737] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.165 [2024-10-07 11:29:02.909365] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.165 [2024-10-07 11:29:02.909532] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.165 [2024-10-07 11:29:02.909566] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.165 [2024-10-07 11:29:02.909584] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.165 [2024-10-07 11:29:02.909756] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.165 [2024-10-07 11:29:02.909894] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.165 [2024-10-07 11:29:02.909925] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.165 [2024-10-07 11:29:02.909940] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.165 [2024-10-07 11:29:02.910101] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.165 [2024-10-07 11:29:02.920875] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.165 [2024-10-07 11:29:02.921108] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.165 [2024-10-07 11:29:02.921144] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.165 [2024-10-07 11:29:02.921163] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.166 [2024-10-07 11:29:02.921323] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.166 [2024-10-07 11:29:02.922448] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.166 [2024-10-07 11:29:02.922534] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.166 [2024-10-07 11:29:02.922553] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.166 [2024-10-07 11:29:02.925743] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.166 [2024-10-07 11:29:02.931214] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.166 [2024-10-07 11:29:02.931476] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.166 [2024-10-07 11:29:02.931519] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.166 [2024-10-07 11:29:02.931538] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.166 [2024-10-07 11:29:02.931645] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.166 [2024-10-07 11:29:02.931742] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.166 [2024-10-07 11:29:02.931761] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.166 [2024-10-07 11:29:02.931775] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.166 [2024-10-07 11:29:02.931801] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.166 [2024-10-07 11:29:02.942799] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.166 [2024-10-07 11:29:02.943059] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.166 [2024-10-07 11:29:02.943107] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.166 [2024-10-07 11:29:02.943128] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.166 [2024-10-07 11:29:02.943257] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.166 [2024-10-07 11:29:02.943370] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.166 [2024-10-07 11:29:02.943398] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.166 [2024-10-07 11:29:02.943443] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.166 [2024-10-07 11:29:02.943569] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.166 [2024-10-07 11:29:02.953350] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.166 [2024-10-07 11:29:02.953551] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.166 [2024-10-07 11:29:02.953625] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.166 [2024-10-07 11:29:02.953663] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.166 [2024-10-07 11:29:02.953708] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.166 [2024-10-07 11:29:02.953745] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.166 [2024-10-07 11:29:02.953772] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.166 [2024-10-07 11:29:02.953799] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.166 [2024-10-07 11:29:02.953843] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.166 [2024-10-07 11:29:02.965612] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.166 [2024-10-07 11:29:02.965735] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.166 [2024-10-07 11:29:02.965769] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.166 [2024-10-07 11:29:02.965787] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.166 [2024-10-07 11:29:02.965813] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.166 [2024-10-07 11:29:02.965837] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.166 [2024-10-07 11:29:02.965851] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.166 [2024-10-07 11:29:02.965866] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.166 [2024-10-07 11:29:02.965890] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.166 [2024-10-07 11:29:02.976245] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.166 [2024-10-07 11:29:02.976494] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.166 [2024-10-07 11:29:02.976540] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.166 [2024-10-07 11:29:02.976561] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.166 [2024-10-07 11:29:02.976669] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.166 [2024-10-07 11:29:02.976811] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.166 [2024-10-07 11:29:02.976864] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.166 [2024-10-07 11:29:02.976890] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.166 [2024-10-07 11:29:02.980935] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.166 [2024-10-07 11:29:02.987341] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.166 [2024-10-07 11:29:02.987569] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.166 [2024-10-07 11:29:02.987615] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.166 [2024-10-07 11:29:02.987635] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.166 [2024-10-07 11:29:02.987732] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.166 [2024-10-07 11:29:02.987759] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.166 [2024-10-07 11:29:02.987774] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.166 [2024-10-07 11:29:02.987787] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.166 [2024-10-07 11:29:02.987812] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.166 [2024-10-07 11:29:02.997428] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.166 [2024-10-07 11:29:02.997551] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.166 [2024-10-07 11:29:02.997584] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.166 [2024-10-07 11:29:02.997601] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.166 [2024-10-07 11:29:02.997666] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.166 [2024-10-07 11:29:02.997694] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.166 [2024-10-07 11:29:02.997708] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.166 [2024-10-07 11:29:02.997722] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.166 [2024-10-07 11:29:02.997745] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.166 [2024-10-07 11:29:03.007524] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.166 [2024-10-07 11:29:03.007641] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.166 [2024-10-07 11:29:03.007673] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.166 [2024-10-07 11:29:03.007692] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.166 [2024-10-07 11:29:03.007838] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.166 [2024-10-07 11:29:03.008056] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.166 [2024-10-07 11:29:03.008093] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.166 [2024-10-07 11:29:03.008111] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.166 [2024-10-07 11:29:03.008212] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.166 [2024-10-07 11:29:03.020271] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.166 [2024-10-07 11:29:03.020505] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.166 [2024-10-07 11:29:03.020550] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.166 [2024-10-07 11:29:03.020569] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.166 [2024-10-07 11:29:03.022046] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.166 [2024-10-07 11:29:03.024663] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.166 [2024-10-07 11:29:03.024711] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.166 [2024-10-07 11:29:03.024747] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.166 [2024-10-07 11:29:03.025417] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.166 [2024-10-07 11:29:03.030363] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.166 [2024-10-07 11:29:03.030510] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.166 [2024-10-07 11:29:03.030543] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.166 [2024-10-07 11:29:03.030562] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.166 [2024-10-07 11:29:03.030588] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.166 [2024-10-07 11:29:03.030611] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.166 [2024-10-07 11:29:03.030626] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.166 [2024-10-07 11:29:03.030666] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.166 [2024-10-07 11:29:03.030693] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.166 [2024-10-07 11:29:03.042233] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.166 [2024-10-07 11:29:03.042591] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.166 [2024-10-07 11:29:03.042671] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.167 [2024-10-07 11:29:03.042713] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.167 [2024-10-07 11:29:03.042850] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.167 [2024-10-07 11:29:03.042968] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.167 [2024-10-07 11:29:03.042997] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.167 [2024-10-07 11:29:03.043013] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.167 [2024-10-07 11:29:03.044755] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.167 [2024-10-07 11:29:03.054393] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.167 [2024-10-07 11:29:03.054711] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.167 [2024-10-07 11:29:03.054778] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.167 [2024-10-07 11:29:03.054800] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.167 [2024-10-07 11:29:03.054971] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.167 [2024-10-07 11:29:03.055106] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.167 [2024-10-07 11:29:03.055137] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.167 [2024-10-07 11:29:03.055153] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.167 [2024-10-07 11:29:03.055786] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.167 [2024-10-07 11:29:03.064623] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.167 [2024-10-07 11:29:03.064752] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.167 [2024-10-07 11:29:03.064785] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.167 [2024-10-07 11:29:03.064807] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.167 [2024-10-07 11:29:03.065087] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.167 [2024-10-07 11:29:03.065261] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.167 [2024-10-07 11:29:03.065296] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.167 [2024-10-07 11:29:03.065313] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.167 [2024-10-07 11:29:03.065460] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.167 [2024-10-07 11:29:03.074722] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.167 [2024-10-07 11:29:03.074854] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.167 [2024-10-07 11:29:03.074904] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.167 [2024-10-07 11:29:03.074923] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.167 [2024-10-07 11:29:03.074948] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.167 [2024-10-07 11:29:03.074973] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.167 [2024-10-07 11:29:03.074988] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.167 [2024-10-07 11:29:03.075001] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.167 [2024-10-07 11:29:03.075025] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.167 [2024-10-07 11:29:03.084838] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.167 [2024-10-07 11:29:03.085046] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.167 [2024-10-07 11:29:03.085101] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.167 [2024-10-07 11:29:03.085133] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.167 [2024-10-07 11:29:03.087088] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.167 [2024-10-07 11:29:03.089060] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.167 [2024-10-07 11:29:03.089124] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.167 [2024-10-07 11:29:03.089174] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.167 [2024-10-07 11:29:03.089588] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.167 [2024-10-07 11:29:03.099951] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.167 [2024-10-07 11:29:03.100387] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.167 [2024-10-07 11:29:03.100467] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.167 [2024-10-07 11:29:03.100502] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.167 [2024-10-07 11:29:03.100590] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.167 [2024-10-07 11:29:03.100633] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.167 [2024-10-07 11:29:03.100662] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.167 [2024-10-07 11:29:03.100686] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.167 [2024-10-07 11:29:03.100723] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.167 [2024-10-07 11:29:03.115919] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.167 [2024-10-07 11:29:03.116520] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.167 [2024-10-07 11:29:03.116578] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.167 [2024-10-07 11:29:03.116607] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.167 [2024-10-07 11:29:03.116880] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.167 [2024-10-07 11:29:03.117201] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.167 [2024-10-07 11:29:03.117252] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.167 [2024-10-07 11:29:03.117279] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.167 [2024-10-07 11:29:03.117361] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.167 [2024-10-07 11:29:03.126707] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.167 [2024-10-07 11:29:03.127136] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.167 [2024-10-07 11:29:03.127222] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.167 [2024-10-07 11:29:03.127265] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.167 [2024-10-07 11:29:03.132470] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.167 [2024-10-07 11:29:03.137179] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.167 [2024-10-07 11:29:03.137238] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.167 [2024-10-07 11:29:03.137272] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.167 [2024-10-07 11:29:03.137324] bdev_nvme.c:3031:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:34.167 [2024-10-07 11:29:03.138283] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.167 [2024-10-07 11:29:03.147683] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.167 [2024-10-07 11:29:03.147938] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.167 [2024-10-07 11:29:03.147976] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.167 [2024-10-07 11:29:03.147999] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.167 [2024-10-07 11:29:03.148132] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.167 [2024-10-07 11:29:03.148263] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.167 [2024-10-07 11:29:03.148296] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.167 [2024-10-07 11:29:03.148318] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.167 [2024-10-07 11:29:03.148768] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.167 [2024-10-07 11:29:03.157997] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.167 [2024-10-07 11:29:03.158129] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.167 [2024-10-07 11:29:03.158166] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.167 [2024-10-07 11:29:03.158187] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.167 [2024-10-07 11:29:03.158218] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.167 [2024-10-07 11:29:03.158245] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.167 [2024-10-07 11:29:03.158273] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.167 [2024-10-07 11:29:03.158314] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.167 [2024-10-07 11:29:03.158345] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.167 [2024-10-07 11:29:03.168291] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.167 [2024-10-07 11:29:03.168440] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.168 [2024-10-07 11:29:03.168478] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.168 [2024-10-07 11:29:03.168500] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.168 [2024-10-07 11:29:03.170676] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.168 [2024-10-07 11:29:03.171696] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.168 [2024-10-07 11:29:03.171741] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.168 [2024-10-07 11:29:03.171762] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.168 [2024-10-07 11:29:03.171907] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.168 [2024-10-07 11:29:03.178391] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.168 [2024-10-07 11:29:03.178536] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.168 [2024-10-07 11:29:03.178574] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.168 [2024-10-07 11:29:03.178595] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.168 [2024-10-07 11:29:03.178624] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.168 [2024-10-07 11:29:03.178651] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.168 [2024-10-07 11:29:03.178670] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.168 [2024-10-07 11:29:03.178687] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.168 [2024-10-07 11:29:03.178715] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.168 [2024-10-07 11:29:03.191950] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.168 [2024-10-07 11:29:03.192805] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.168 [2024-10-07 11:29:03.192858] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.168 [2024-10-07 11:29:03.192882] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.168 [2024-10-07 11:29:03.193130] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.168 [2024-10-07 11:29:03.193279] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.168 [2024-10-07 11:29:03.193325] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.168 [2024-10-07 11:29:03.193345] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.168 [2024-10-07 11:29:03.193742] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.168 [2024-10-07 11:29:03.203670] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.168 [2024-10-07 11:29:03.205819] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.168 [2024-10-07 11:29:03.205892] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.168 [2024-10-07 11:29:03.205918] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.168 [2024-10-07 11:29:03.206560] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.168 [2024-10-07 11:29:03.206686] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.168 [2024-10-07 11:29:03.206714] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.168 [2024-10-07 11:29:03.206732] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.168 [2024-10-07 11:29:03.206772] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.168 [2024-10-07 11:29:03.217609] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.168 [2024-10-07 11:29:03.217744] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.168 [2024-10-07 11:29:03.217781] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.168 [2024-10-07 11:29:03.217802] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.168 [2024-10-07 11:29:03.217843] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.168 [2024-10-07 11:29:03.217871] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.168 [2024-10-07 11:29:03.217888] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.168 [2024-10-07 11:29:03.217905] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.168 [2024-10-07 11:29:03.217934] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.168 [2024-10-07 11:29:03.228953] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.168 [2024-10-07 11:29:03.229185] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.168 [2024-10-07 11:29:03.229225] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.168 [2024-10-07 11:29:03.229247] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.168 [2024-10-07 11:29:03.229376] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.168 [2024-10-07 11:29:03.230173] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.168 [2024-10-07 11:29:03.230219] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.168 [2024-10-07 11:29:03.230239] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.168 [2024-10-07 11:29:03.232560] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.168 [2024-10-07 11:29:03.241574] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.168 [2024-10-07 11:29:03.241857] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.168 [2024-10-07 11:29:03.241907] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.168 [2024-10-07 11:29:03.241930] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.168 [2024-10-07 11:29:03.242102] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.168 [2024-10-07 11:29:03.242264] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.168 [2024-10-07 11:29:03.242294] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.168 [2024-10-07 11:29:03.242313] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.168 [2024-10-07 11:29:03.242480] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.168 [2024-10-07 11:29:03.253141] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.168 [2024-10-07 11:29:03.253426] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.168 [2024-10-07 11:29:03.253472] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.168 [2024-10-07 11:29:03.253496] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.168 [2024-10-07 11:29:03.253697] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.168 [2024-10-07 11:29:03.253875] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.168 [2024-10-07 11:29:03.253911] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.168 [2024-10-07 11:29:03.253930] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.168 [2024-10-07 11:29:03.254083] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.168 [2024-10-07 11:29:03.263482] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.168 [2024-10-07 11:29:03.263623] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.168 [2024-10-07 11:29:03.263660] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.168 [2024-10-07 11:29:03.263682] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.168 [2024-10-07 11:29:03.263711] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.168 [2024-10-07 11:29:03.263738] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.168 [2024-10-07 11:29:03.263756] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.168 [2024-10-07 11:29:03.263773] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.168 [2024-10-07 11:29:03.263802] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.168 [2024-10-07 11:29:03.274247] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.168 [2024-10-07 11:29:03.274528] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.168 [2024-10-07 11:29:03.274574] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.168 [2024-10-07 11:29:03.274596] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.168 [2024-10-07 11:29:03.274750] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.168 [2024-10-07 11:29:03.275246] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.168 [2024-10-07 11:29:03.275286] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.168 [2024-10-07 11:29:03.275318] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.168 [2024-10-07 11:29:03.277941] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.168 [2024-10-07 11:29:03.284589] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.168 [2024-10-07 11:29:03.287105] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.168 [2024-10-07 11:29:03.287162] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.168 [2024-10-07 11:29:03.287187] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.168 [2024-10-07 11:29:03.288024] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.168 [2024-10-07 11:29:03.288164] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.168 [2024-10-07 11:29:03.288192] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.168 [2024-10-07 11:29:03.288219] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.168 [2024-10-07 11:29:03.288250] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.168 [2024-10-07 11:29:03.294698] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.169 [2024-10-07 11:29:03.294829] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.169 [2024-10-07 11:29:03.294866] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.169 [2024-10-07 11:29:03.294887] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.169 [2024-10-07 11:29:03.294917] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.169 [2024-10-07 11:29:03.294945] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.169 [2024-10-07 11:29:03.294963] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.169 [2024-10-07 11:29:03.294980] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.169 [2024-10-07 11:29:03.295008] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.169 [2024-10-07 11:29:03.304801] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.169 [2024-10-07 11:29:03.304933] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.169 [2024-10-07 11:29:03.304970] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.169 [2024-10-07 11:29:03.304991] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.169 [2024-10-07 11:29:03.305021] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.169 [2024-10-07 11:29:03.305048] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.169 [2024-10-07 11:29:03.305065] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.169 [2024-10-07 11:29:03.305082] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.169 [2024-10-07 11:29:03.305111] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.169 [2024-10-07 11:29:03.315045] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.169 [2024-10-07 11:29:03.315177] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.169 [2024-10-07 11:29:03.315224] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.169 [2024-10-07 11:29:03.315266] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.169 [2024-10-07 11:29:03.315297] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.169 [2024-10-07 11:29:03.315324] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.169 [2024-10-07 11:29:03.315342] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.169 [2024-10-07 11:29:03.315359] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.169 [2024-10-07 11:29:03.315388] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.169 [2024-10-07 11:29:03.325143] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.169 [2024-10-07 11:29:03.325282] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.169 [2024-10-07 11:29:03.325317] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.169 [2024-10-07 11:29:03.325338] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.169 [2024-10-07 11:29:03.325368] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.169 [2024-10-07 11:29:03.325394] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.169 [2024-10-07 11:29:03.325432] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.169 [2024-10-07 11:29:03.325452] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.169 [2024-10-07 11:29:03.325482] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.169 [2024-10-07 11:29:03.335926] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.169 [2024-10-07 11:29:03.336345] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.169 [2024-10-07 11:29:03.336396] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.169 [2024-10-07 11:29:03.336443] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.169 [2024-10-07 11:29:03.336633] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.169 [2024-10-07 11:29:03.336767] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.169 [2024-10-07 11:29:03.336801] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.169 [2024-10-07 11:29:03.336829] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.169 [2024-10-07 11:29:03.336925] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.169 [2024-10-07 11:29:03.348946] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.169 [2024-10-07 11:29:03.349203] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.169 [2024-10-07 11:29:03.349254] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.169 [2024-10-07 11:29:03.349278] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.169 [2024-10-07 11:29:03.349472] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.169 [2024-10-07 11:29:03.349652] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.169 [2024-10-07 11:29:03.349708] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.169 [2024-10-07 11:29:03.349729] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.169 [2024-10-07 11:29:03.349930] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.169 [2024-10-07 11:29:03.359517] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.169 [2024-10-07 11:29:03.359652] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.169 [2024-10-07 11:29:03.359689] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.169 [2024-10-07 11:29:03.359711] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.169 [2024-10-07 11:29:03.359740] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.169 [2024-10-07 11:29:03.359767] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.169 [2024-10-07 11:29:03.359786] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.169 [2024-10-07 11:29:03.359803] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.169 [2024-10-07 11:29:03.359842] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.169 [2024-10-07 11:29:03.370295] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.169 [2024-10-07 11:29:03.370540] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.169 [2024-10-07 11:29:03.370578] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.169 [2024-10-07 11:29:03.370600] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.169 [2024-10-07 11:29:03.371046] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.169 [2024-10-07 11:29:03.371147] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.169 [2024-10-07 11:29:03.371173] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.169 [2024-10-07 11:29:03.371190] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.169 [2024-10-07 11:29:03.371220] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.169 [2024-10-07 11:29:03.383508] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.169 [2024-10-07 11:29:03.384482] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.169 [2024-10-07 11:29:03.384534] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.169 [2024-10-07 11:29:03.384558] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.169 [2024-10-07 11:29:03.384724] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.169 [2024-10-07 11:29:03.384965] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.169 [2024-10-07 11:29:03.385010] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.169 [2024-10-07 11:29:03.385030] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.169 [2024-10-07 11:29:03.385884] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.169 [2024-10-07 11:29:03.394664] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.169 [2024-10-07 11:29:03.394957] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.169 [2024-10-07 11:29:03.395009] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.169 [2024-10-07 11:29:03.395033] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.169 [2024-10-07 11:29:03.395173] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.170 [2024-10-07 11:29:03.395305] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.170 [2024-10-07 11:29:03.395328] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.170 [2024-10-07 11:29:03.395346] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.170 [2024-10-07 11:29:03.395461] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.170 8877.00 IOPS, 34.68 MiB/s [2024-10-07T11:29:15.881Z] [2024-10-07 11:29:03.412590] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.170 [2024-10-07 11:29:03.413737] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.170 [2024-10-07 11:29:03.413802] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.170 [2024-10-07 11:29:03.413827] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.170 [2024-10-07 11:29:03.414461] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.170 [2024-10-07 11:29:03.414569] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.170 [2024-10-07 11:29:03.414596] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.170 [2024-10-07 11:29:03.414614] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.170 [2024-10-07 11:29:03.414645] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.170 [2024-10-07 11:29:03.428361] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.170 [2024-10-07 11:29:03.428727] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.170 [2024-10-07 11:29:03.428771] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.170 [2024-10-07 11:29:03.428791] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.170 [2024-10-07 11:29:03.428847] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.170 [2024-10-07 11:29:03.428876] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.170 [2024-10-07 11:29:03.428892] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.170 [2024-10-07 11:29:03.428907] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.170 [2024-10-07 11:29:03.428931] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.170 [2024-10-07 11:29:03.442721] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.170 [2024-10-07 11:29:03.443305] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.170 [2024-10-07 11:29:03.443366] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.170 [2024-10-07 11:29:03.443386] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.170 [2024-10-07 11:29:03.443675] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.170 [2024-10-07 11:29:03.443904] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.170 [2024-10-07 11:29:03.443941] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.170 [2024-10-07 11:29:03.443958] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.170 [2024-10-07 11:29:03.444019] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.170 [2024-10-07 11:29:03.455928] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.170 [2024-10-07 11:29:03.456148] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.170 [2024-10-07 11:29:03.456181] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.170 [2024-10-07 11:29:03.456199] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.170 [2024-10-07 11:29:03.457672] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.170 [2024-10-07 11:29:03.458192] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.170 [2024-10-07 11:29:03.458230] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.170 [2024-10-07 11:29:03.458247] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.170 [2024-10-07 11:29:03.458498] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.170 [2024-10-07 11:29:03.467516] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.170 [2024-10-07 11:29:03.467742] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.170 [2024-10-07 11:29:03.467781] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.170 [2024-10-07 11:29:03.467800] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.170 [2024-10-07 11:29:03.467945] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.170 [2024-10-07 11:29:03.468076] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.170 [2024-10-07 11:29:03.468099] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.170 [2024-10-07 11:29:03.468114] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.170 [2024-10-07 11:29:03.468226] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.170 [2024-10-07 11:29:03.477599] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.170 [2024-10-07 11:29:03.477707] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.170 [2024-10-07 11:29:03.477738] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.170 [2024-10-07 11:29:03.477755] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.170 [2024-10-07 11:29:03.477927] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.170 [2024-10-07 11:29:03.478098] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.170 [2024-10-07 11:29:03.478124] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.170 [2024-10-07 11:29:03.478156] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.170 [2024-10-07 11:29:03.478259] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.170 [2024-10-07 11:29:03.489852] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.170 [2024-10-07 11:29:03.490370] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.170 [2024-10-07 11:29:03.490436] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.170 [2024-10-07 11:29:03.490458] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.170 [2024-10-07 11:29:03.490675] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.170 [2024-10-07 11:29:03.490914] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.170 [2024-10-07 11:29:03.490949] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.170 [2024-10-07 11:29:03.490966] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.170 [2024-10-07 11:29:03.491027] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.170 [2024-10-07 11:29:03.502691] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.170 [2024-10-07 11:29:03.503080] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.170 [2024-10-07 11:29:03.503123] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.170 [2024-10-07 11:29:03.503143] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.170 [2024-10-07 11:29:03.503215] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.170 [2024-10-07 11:29:03.503243] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.170 [2024-10-07 11:29:03.503259] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.170 [2024-10-07 11:29:03.503273] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.170 [2024-10-07 11:29:03.503297] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.170 [2024-10-07 11:29:03.513007] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.170 [2024-10-07 11:29:03.513193] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.170 [2024-10-07 11:29:03.513224] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.170 [2024-10-07 11:29:03.513241] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.170 [2024-10-07 11:29:03.513332] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.170 [2024-10-07 11:29:03.513359] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.170 [2024-10-07 11:29:03.513374] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.170 [2024-10-07 11:29:03.513388] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.170 [2024-10-07 11:29:03.513426] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.170 [2024-10-07 11:29:03.523086] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.170 [2024-10-07 11:29:03.523215] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.170 [2024-10-07 11:29:03.523246] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.170 [2024-10-07 11:29:03.523264] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.170 [2024-10-07 11:29:03.523525] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.170 [2024-10-07 11:29:03.523684] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.170 [2024-10-07 11:29:03.523755] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.170 [2024-10-07 11:29:03.523771] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.170 [2024-10-07 11:29:03.523901] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.170 [2024-10-07 11:29:03.534784] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.170 [2024-10-07 11:29:03.535107] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.170 [2024-10-07 11:29:03.535149] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.170 [2024-10-07 11:29:03.535169] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.171 [2024-10-07 11:29:03.535385] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.171 [2024-10-07 11:29:03.535609] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.171 [2024-10-07 11:29:03.535644] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.171 [2024-10-07 11:29:03.535660] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.171 [2024-10-07 11:29:03.535720] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.171 [2024-10-07 11:29:03.545869] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.171 [2024-10-07 11:29:03.546079] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.171 [2024-10-07 11:29:03.546112] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.171 [2024-10-07 11:29:03.546129] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.171 [2024-10-07 11:29:03.546237] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.171 [2024-10-07 11:29:03.546344] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.171 [2024-10-07 11:29:03.546362] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.171 [2024-10-07 11:29:03.546377] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.171 [2024-10-07 11:29:03.547092] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.171 [2024-10-07 11:29:03.556202] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.171 [2024-10-07 11:29:03.556451] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.171 [2024-10-07 11:29:03.556485] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.171 [2024-10-07 11:29:03.556502] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.171 [2024-10-07 11:29:03.556604] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.171 [2024-10-07 11:29:03.556833] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.171 [2024-10-07 11:29:03.556863] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.171 [2024-10-07 11:29:03.556879] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.171 [2024-10-07 11:29:03.556939] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.171 [2024-10-07 11:29:03.566340] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.171 [2024-10-07 11:29:03.566464] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.171 [2024-10-07 11:29:03.566502] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.171 [2024-10-07 11:29:03.566520] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.171 [2024-10-07 11:29:03.566760] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.171 [2024-10-07 11:29:03.566914] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.171 [2024-10-07 11:29:03.566949] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.171 [2024-10-07 11:29:03.566966] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.171 [2024-10-07 11:29:03.567027] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.171 [2024-10-07 11:29:03.576421] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.171 [2024-10-07 11:29:03.576544] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.171 [2024-10-07 11:29:03.576575] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.171 [2024-10-07 11:29:03.576593] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.171 [2024-10-07 11:29:03.576617] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.171 [2024-10-07 11:29:03.576639] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.171 [2024-10-07 11:29:03.576655] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.171 [2024-10-07 11:29:03.576669] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.171 [2024-10-07 11:29:03.576692] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.171 [2024-10-07 11:29:03.586514] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.171 [2024-10-07 11:29:03.586627] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.171 [2024-10-07 11:29:03.586657] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.171 [2024-10-07 11:29:03.586675] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.171 [2024-10-07 11:29:03.586699] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.171 [2024-10-07 11:29:03.586721] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.171 [2024-10-07 11:29:03.586737] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.171 [2024-10-07 11:29:03.586750] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.171 [2024-10-07 11:29:03.586792] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.171 [2024-10-07 11:29:03.600086] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.171 [2024-10-07 11:29:03.600304] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.171 [2024-10-07 11:29:03.600337] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.171 [2024-10-07 11:29:03.600356] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.171 [2024-10-07 11:29:03.600477] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.171 [2024-10-07 11:29:03.600714] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.171 [2024-10-07 11:29:03.600737] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.171 [2024-10-07 11:29:03.600751] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.171 [2024-10-07 11:29:03.600839] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.171 [2024-10-07 11:29:03.611758] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.171 [2024-10-07 11:29:03.612002] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.171 [2024-10-07 11:29:03.612034] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.171 [2024-10-07 11:29:03.612051] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.171 [2024-10-07 11:29:03.612189] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.171 [2024-10-07 11:29:03.612317] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.171 [2024-10-07 11:29:03.612349] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.171 [2024-10-07 11:29:03.612366] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.171 [2024-10-07 11:29:03.612493] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.171 [2024-10-07 11:29:03.623866] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.171 [2024-10-07 11:29:03.624184] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.171 [2024-10-07 11:29:03.624218] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.171 [2024-10-07 11:29:03.624247] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.171 [2024-10-07 11:29:03.624305] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.171 [2024-10-07 11:29:03.624334] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.171 [2024-10-07 11:29:03.624349] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.171 [2024-10-07 11:29:03.624363] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.171 [2024-10-07 11:29:03.624387] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.171 [2024-10-07 11:29:03.634812] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.171 [2024-10-07 11:29:03.634978] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.171 [2024-10-07 11:29:03.635028] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.171 [2024-10-07 11:29:03.635098] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.171 [2024-10-07 11:29:03.635146] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.171 [2024-10-07 11:29:03.635189] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.171 [2024-10-07 11:29:03.635217] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.171 [2024-10-07 11:29:03.635241] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.171 [2024-10-07 11:29:03.635274] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.171 [2024-10-07 11:29:03.649648] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.171 [2024-10-07 11:29:03.649974] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.171 [2024-10-07 11:29:03.650026] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.171 [2024-10-07 11:29:03.650045] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.171 [2024-10-07 11:29:03.650536] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.171 [2024-10-07 11:29:03.650778] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.171 [2024-10-07 11:29:03.650813] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.171 [2024-10-07 11:29:03.650830] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.171 [2024-10-07 11:29:03.650886] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.171 [2024-10-07 11:29:03.663400] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.171 [2024-10-07 11:29:03.664593] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.172 [2024-10-07 11:29:03.664637] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.172 [2024-10-07 11:29:03.664656] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.172 [2024-10-07 11:29:03.665202] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.172 [2024-10-07 11:29:03.665463] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.172 [2024-10-07 11:29:03.665531] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.172 [2024-10-07 11:29:03.665549] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.172 [2024-10-07 11:29:03.665758] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.172 [2024-10-07 11:29:03.674585] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.172 [2024-10-07 11:29:03.674813] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.172 [2024-10-07 11:29:03.674852] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.172 [2024-10-07 11:29:03.674872] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.172 [2024-10-07 11:29:03.675015] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.172 [2024-10-07 11:29:03.675152] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.172 [2024-10-07 11:29:03.675214] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.172 [2024-10-07 11:29:03.675232] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.172 [2024-10-07 11:29:03.675340] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.172 [2024-10-07 11:29:03.685116] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.172 [2024-10-07 11:29:03.685270] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.172 [2024-10-07 11:29:03.685300] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.172 [2024-10-07 11:29:03.685318] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.172 [2024-10-07 11:29:03.685341] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.172 [2024-10-07 11:29:03.685362] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.172 [2024-10-07 11:29:03.685395] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.172 [2024-10-07 11:29:03.685409] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.172 [2024-10-07 11:29:03.685432] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.172 [2024-10-07 11:29:03.695244] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.172 [2024-10-07 11:29:03.696226] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.172 [2024-10-07 11:29:03.696270] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.172 [2024-10-07 11:29:03.696289] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.172 [2024-10-07 11:29:03.697793] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.172 [2024-10-07 11:29:03.697986] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.172 [2024-10-07 11:29:03.698012] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.172 [2024-10-07 11:29:03.698029] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.172 [2024-10-07 11:29:03.698054] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.172 [2024-10-07 11:29:03.706802] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.172 [2024-10-07 11:29:03.706923] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.172 [2024-10-07 11:29:03.706953] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.172 [2024-10-07 11:29:03.706971] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.172 [2024-10-07 11:29:03.706996] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.172 [2024-10-07 11:29:03.707018] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.172 [2024-10-07 11:29:03.707033] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.172 [2024-10-07 11:29:03.707047] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.172 [2024-10-07 11:29:03.707070] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.172 [2024-10-07 11:29:03.719677] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.172 [2024-10-07 11:29:03.719830] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.172 [2024-10-07 11:29:03.719862] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.172 [2024-10-07 11:29:03.719879] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.172 [2024-10-07 11:29:03.719903] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.172 [2024-10-07 11:29:03.719926] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.172 [2024-10-07 11:29:03.719940] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.172 [2024-10-07 11:29:03.719954] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.172 [2024-10-07 11:29:03.719977] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.172 [2024-10-07 11:29:03.730234] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.172 [2024-10-07 11:29:03.730434] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.172 [2024-10-07 11:29:03.730467] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.172 [2024-10-07 11:29:03.730484] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.172 [2024-10-07 11:29:03.730599] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.172 [2024-10-07 11:29:03.730666] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.172 [2024-10-07 11:29:03.730689] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.172 [2024-10-07 11:29:03.730704] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.172 [2024-10-07 11:29:03.730728] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.172 [2024-10-07 11:29:03.744463] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.172 [2024-10-07 11:29:03.745191] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.172 [2024-10-07 11:29:03.745234] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.172 [2024-10-07 11:29:03.745253] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.172 [2024-10-07 11:29:03.745343] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.172 [2024-10-07 11:29:03.745373] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.172 [2024-10-07 11:29:03.745388] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.172 [2024-10-07 11:29:03.745403] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.172 [2024-10-07 11:29:03.745444] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.172 [2024-10-07 11:29:03.756660] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.172 [2024-10-07 11:29:03.756797] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.172 [2024-10-07 11:29:03.756844] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.172 [2024-10-07 11:29:03.756861] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.172 [2024-10-07 11:29:03.757463] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.172 [2024-10-07 11:29:03.757622] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.172 [2024-10-07 11:29:03.757646] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.172 [2024-10-07 11:29:03.757660] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.172 [2024-10-07 11:29:03.757685] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.172 [2024-10-07 11:29:03.767295] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.172 [2024-10-07 11:29:03.767506] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.172 [2024-10-07 11:29:03.767539] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.172 [2024-10-07 11:29:03.767556] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.172 [2024-10-07 11:29:03.767923] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.172 [2024-10-07 11:29:03.769839] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.172 [2024-10-07 11:29:03.769877] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.172 [2024-10-07 11:29:03.769893] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.172 [2024-10-07 11:29:03.770530] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.172 [2024-10-07 11:29:03.778280] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.172 [2024-10-07 11:29:03.778527] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.172 [2024-10-07 11:29:03.778559] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.172 [2024-10-07 11:29:03.778577] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.172 [2024-10-07 11:29:03.778690] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.172 [2024-10-07 11:29:03.778811] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.172 [2024-10-07 11:29:03.778832] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.172 [2024-10-07 11:29:03.778846] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.172 [2024-10-07 11:29:03.779308] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.172 [2024-10-07 11:29:03.788377] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.173 [2024-10-07 11:29:03.788492] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.173 [2024-10-07 11:29:03.788522] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.173 [2024-10-07 11:29:03.788540] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.173 [2024-10-07 11:29:03.788719] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.173 [2024-10-07 11:29:03.788871] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.173 [2024-10-07 11:29:03.788895] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.173 [2024-10-07 11:29:03.788928] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.173 [2024-10-07 11:29:03.789068] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.173 [2024-10-07 11:29:03.798495] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.173 [2024-10-07 11:29:03.798614] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.173 [2024-10-07 11:29:03.798643] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.173 [2024-10-07 11:29:03.798660] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.173 [2024-10-07 11:29:03.798684] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.173 [2024-10-07 11:29:03.798706] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.173 [2024-10-07 11:29:03.798720] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.173 [2024-10-07 11:29:03.798732] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.173 [2024-10-07 11:29:03.798755] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.173 [2024-10-07 11:29:03.808637] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.173 [2024-10-07 11:29:03.808746] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.173 [2024-10-07 11:29:03.808778] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.173 [2024-10-07 11:29:03.808795] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.173 [2024-10-07 11:29:03.808819] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.173 [2024-10-07 11:29:03.808841] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.173 [2024-10-07 11:29:03.808856] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.173 [2024-10-07 11:29:03.808870] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.173 [2024-10-07 11:29:03.808893] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.173 [2024-10-07 11:29:03.818855] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.173 [2024-10-07 11:29:03.818965] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.173 [2024-10-07 11:29:03.818995] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.173 [2024-10-07 11:29:03.819012] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.173 [2024-10-07 11:29:03.819036] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.173 [2024-10-07 11:29:03.819059] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.173 [2024-10-07 11:29:03.819073] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.173 [2024-10-07 11:29:03.819087] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.173 [2024-10-07 11:29:03.819111] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.173 [2024-10-07 11:29:03.831479] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.173 [2024-10-07 11:29:03.831808] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.173 [2024-10-07 11:29:03.831852] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.173 [2024-10-07 11:29:03.831872] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.173 [2024-10-07 11:29:03.832350] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.173 [2024-10-07 11:29:03.832606] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.173 [2024-10-07 11:29:03.832642] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.173 [2024-10-07 11:29:03.832658] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.173 [2024-10-07 11:29:03.832860] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.173 [2024-10-07 11:29:03.843021] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.173 [2024-10-07 11:29:03.843221] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.173 [2024-10-07 11:29:03.843273] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.173 [2024-10-07 11:29:03.843293] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.173 [2024-10-07 11:29:03.843396] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.173 [2024-10-07 11:29:03.844183] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.173 [2024-10-07 11:29:03.844217] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.173 [2024-10-07 11:29:03.844249] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.173 [2024-10-07 11:29:03.846923] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.173 [2024-10-07 11:29:03.853103] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.173 [2024-10-07 11:29:03.853208] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.173 [2024-10-07 11:29:03.853237] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.173 [2024-10-07 11:29:03.853254] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.173 [2024-10-07 11:29:03.853278] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.173 [2024-10-07 11:29:03.853301] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.173 [2024-10-07 11:29:03.853315] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.173 [2024-10-07 11:29:03.853329] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.173 [2024-10-07 11:29:03.853352] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.173 [2024-10-07 11:29:03.864662] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.173 [2024-10-07 11:29:03.866942] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.173 [2024-10-07 11:29:03.866988] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.173 [2024-10-07 11:29:03.867008] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.173 [2024-10-07 11:29:03.867255] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.173 [2024-10-07 11:29:03.867350] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.173 [2024-10-07 11:29:03.867374] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.173 [2024-10-07 11:29:03.867388] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.173 [2024-10-07 11:29:03.867430] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.173 [2024-10-07 11:29:03.874742] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.173 [2024-10-07 11:29:03.874898] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.173 [2024-10-07 11:29:03.874929] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.173 [2024-10-07 11:29:03.874946] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.173 [2024-10-07 11:29:03.874970] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.173 [2024-10-07 11:29:03.874992] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.173 [2024-10-07 11:29:03.875007] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.173 [2024-10-07 11:29:03.875020] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.173 [2024-10-07 11:29:03.875044] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.173 [2024-10-07 11:29:03.887176] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.173 [2024-10-07 11:29:03.887315] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.173 [2024-10-07 11:29:03.887346] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.173 [2024-10-07 11:29:03.887364] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.173 [2024-10-07 11:29:03.887387] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.173 [2024-10-07 11:29:03.887409] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.173 [2024-10-07 11:29:03.887423] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.174 [2024-10-07 11:29:03.887451] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.174 [2024-10-07 11:29:03.887476] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.174 [2024-10-07 11:29:03.897862] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.174 [2024-10-07 11:29:03.898606] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.174 [2024-10-07 11:29:03.898665] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.174 [2024-10-07 11:29:03.898684] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.174 [2024-10-07 11:29:03.901220] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.174 [2024-10-07 11:29:03.901856] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.174 [2024-10-07 11:29:03.901891] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.174 [2024-10-07 11:29:03.901908] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.174 [2024-10-07 11:29:03.902160] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.174 [2024-10-07 11:29:03.907944] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.174 [2024-10-07 11:29:03.908052] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.174 [2024-10-07 11:29:03.908083] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.174 [2024-10-07 11:29:03.908100] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.174 [2024-10-07 11:29:03.908124] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.174 [2024-10-07 11:29:03.908146] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.174 [2024-10-07 11:29:03.908162] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.174 [2024-10-07 11:29:03.908176] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.174 [2024-10-07 11:29:03.908199] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.174 [2024-10-07 11:29:03.918021] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.174 [2024-10-07 11:29:03.918127] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.174 [2024-10-07 11:29:03.918165] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.174 [2024-10-07 11:29:03.918183] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.174 [2024-10-07 11:29:03.918206] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.174 [2024-10-07 11:29:03.918228] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.174 [2024-10-07 11:29:03.918242] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.174 [2024-10-07 11:29:03.918256] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.174 [2024-10-07 11:29:03.918278] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.174 [2024-10-07 11:29:03.928678] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.174 [2024-10-07 11:29:03.928941] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.174 [2024-10-07 11:29:03.928976] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.174 [2024-10-07 11:29:03.928994] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.174 [2024-10-07 11:29:03.929133] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.174 [2024-10-07 11:29:03.929242] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.174 [2024-10-07 11:29:03.929261] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.174 [2024-10-07 11:29:03.929275] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.174 [2024-10-07 11:29:03.929644] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.174 [2024-10-07 11:29:03.938777] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.174 [2024-10-07 11:29:03.938883] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.174 [2024-10-07 11:29:03.938914] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.174 [2024-10-07 11:29:03.938949] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.174 [2024-10-07 11:29:03.938974] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.174 [2024-10-07 11:29:03.938996] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.174 [2024-10-07 11:29:03.939010] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.174 [2024-10-07 11:29:03.939024] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.174 [2024-10-07 11:29:03.939048] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.174 [2024-10-07 11:29:03.949288] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.174 [2024-10-07 11:29:03.949524] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.174 [2024-10-07 11:29:03.949557] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.174 [2024-10-07 11:29:03.949576] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.174 [2024-10-07 11:29:03.949600] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.174 [2024-10-07 11:29:03.949622] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.174 [2024-10-07 11:29:03.949636] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.174 [2024-10-07 11:29:03.949650] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.174 [2024-10-07 11:29:03.949674] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.174 [2024-10-07 11:29:03.959471] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.174 [2024-10-07 11:29:03.959588] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.174 [2024-10-07 11:29:03.959619] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.174 [2024-10-07 11:29:03.959637] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.174 [2024-10-07 11:29:03.959691] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.174 [2024-10-07 11:29:03.959721] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.174 [2024-10-07 11:29:03.959736] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.174 [2024-10-07 11:29:03.959750] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.174 [2024-10-07 11:29:03.959774] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.174 [2024-10-07 11:29:03.970215] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.174 [2024-10-07 11:29:03.970320] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.174 [2024-10-07 11:29:03.970350] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.174 [2024-10-07 11:29:03.970367] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.174 [2024-10-07 11:29:03.970429] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.174 [2024-10-07 11:29:03.971263] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.174 [2024-10-07 11:29:03.971317] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.174 [2024-10-07 11:29:03.971351] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.174 [2024-10-07 11:29:03.971631] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.174 [2024-10-07 11:29:03.983171] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.174 [2024-10-07 11:29:03.983491] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.174 [2024-10-07 11:29:03.983534] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.174 [2024-10-07 11:29:03.983554] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.174 [2024-10-07 11:29:03.983681] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.174 [2024-10-07 11:29:03.983787] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.174 [2024-10-07 11:29:03.983813] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.174 [2024-10-07 11:29:03.983827] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.174 [2024-10-07 11:29:03.983915] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.174 [2024-10-07 11:29:03.994625] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.174 [2024-10-07 11:29:03.994865] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.174 [2024-10-07 11:29:03.994916] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.174 [2024-10-07 11:29:03.994935] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.174 [2024-10-07 11:29:03.995091] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.174 [2024-10-07 11:29:03.995270] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.174 [2024-10-07 11:29:03.995307] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.174 [2024-10-07 11:29:03.995324] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.174 [2024-10-07 11:29:03.995463] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.174 [2024-10-07 11:29:04.005517] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.174 [2024-10-07 11:29:04.005632] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.174 [2024-10-07 11:29:04.005662] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.175 [2024-10-07 11:29:04.005679] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.175 [2024-10-07 11:29:04.005703] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.175 [2024-10-07 11:29:04.005725] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.175 [2024-10-07 11:29:04.005739] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.175 [2024-10-07 11:29:04.005753] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.175 [2024-10-07 11:29:04.005776] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.175 [2024-10-07 11:29:04.015598] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.175 [2024-10-07 11:29:04.018123] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.175 [2024-10-07 11:29:04.018179] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.175 [2024-10-07 11:29:04.018199] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.175 [2024-10-07 11:29:04.018980] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.175 [2024-10-07 11:29:04.019193] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.175 [2024-10-07 11:29:04.019232] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.175 [2024-10-07 11:29:04.019246] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.175 [2024-10-07 11:29:04.019277] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.175 [2024-10-07 11:29:04.026273] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.175 [2024-10-07 11:29:04.026413] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.175 [2024-10-07 11:29:04.026458] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.175 [2024-10-07 11:29:04.026476] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.175 [2024-10-07 11:29:04.026501] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.175 [2024-10-07 11:29:04.026523] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.175 [2024-10-07 11:29:04.026537] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.175 [2024-10-07 11:29:04.026551] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.175 [2024-10-07 11:29:04.026574] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.175 [2024-10-07 11:29:04.037077] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.175 [2024-10-07 11:29:04.037201] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.175 [2024-10-07 11:29:04.037232] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.175 [2024-10-07 11:29:04.037249] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.175 [2024-10-07 11:29:04.037274] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.175 [2024-10-07 11:29:04.037296] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.175 [2024-10-07 11:29:04.037311] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.175 [2024-10-07 11:29:04.037325] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.175 [2024-10-07 11:29:04.037348] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.175 [2024-10-07 11:29:04.049767] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.175 [2024-10-07 11:29:04.050022] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.175 [2024-10-07 11:29:04.050065] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.175 [2024-10-07 11:29:04.050082] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.175 [2024-10-07 11:29:04.050613] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.175 [2024-10-07 11:29:04.052584] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.175 [2024-10-07 11:29:04.052622] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.175 [2024-10-07 11:29:04.052639] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.175 [2024-10-07 11:29:04.052876] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.175 [2024-10-07 11:29:04.059879] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.175 [2024-10-07 11:29:04.059984] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.175 [2024-10-07 11:29:04.060015] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.175 [2024-10-07 11:29:04.060032] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.175 [2024-10-07 11:29:04.060056] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.175 [2024-10-07 11:29:04.060079] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.175 [2024-10-07 11:29:04.060093] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.175 [2024-10-07 11:29:04.060107] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.175 [2024-10-07 11:29:04.060130] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.175 [2024-10-07 11:29:04.070922] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.175 [2024-10-07 11:29:04.071961] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.175 [2024-10-07 11:29:04.072004] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.175 [2024-10-07 11:29:04.072024] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.175 [2024-10-07 11:29:04.074220] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.175 [2024-10-07 11:29:04.074756] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.175 [2024-10-07 11:29:04.074792] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.175 [2024-10-07 11:29:04.074809] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.175 [2024-10-07 11:29:04.074899] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.175 [2024-10-07 11:29:04.081005] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.175 [2024-10-07 11:29:04.081116] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.175 [2024-10-07 11:29:04.081146] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.175 [2024-10-07 11:29:04.081164] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.175 [2024-10-07 11:29:04.081187] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.175 [2024-10-07 11:29:04.081209] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.175 [2024-10-07 11:29:04.081223] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.175 [2024-10-07 11:29:04.081264] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.175 [2024-10-07 11:29:04.081290] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.175 [2024-10-07 11:29:04.092588] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.175 [2024-10-07 11:29:04.092721] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.175 [2024-10-07 11:29:04.092753] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.175 [2024-10-07 11:29:04.092771] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.175 [2024-10-07 11:29:04.092795] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.175 [2024-10-07 11:29:04.093689] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.175 [2024-10-07 11:29:04.093727] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.175 [2024-10-07 11:29:04.093744] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.175 [2024-10-07 11:29:04.094429] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.175 [2024-10-07 11:29:04.106262] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.175 [2024-10-07 11:29:04.106747] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.175 [2024-10-07 11:29:04.106788] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.175 [2024-10-07 11:29:04.106807] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.175 [2024-10-07 11:29:04.107156] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.175 [2024-10-07 11:29:04.107247] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.175 [2024-10-07 11:29:04.107270] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.175 [2024-10-07 11:29:04.107284] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.175 [2024-10-07 11:29:04.107308] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.175 [2024-10-07 11:29:04.116341] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.175 [2024-10-07 11:29:04.119263] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.175 [2024-10-07 11:29:04.119324] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.175 [2024-10-07 11:29:04.119344] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.175 [2024-10-07 11:29:04.122301] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.175 [2024-10-07 11:29:04.122847] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.175 [2024-10-07 11:29:04.122882] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.175 [2024-10-07 11:29:04.122898] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.175 [2024-10-07 11:29:04.123129] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.175 [2024-10-07 11:29:04.126446] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.175 [2024-10-07 11:29:04.126566] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.176 [2024-10-07 11:29:04.126596] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.176 [2024-10-07 11:29:04.126614] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.176 [2024-10-07 11:29:04.126637] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.176 [2024-10-07 11:29:04.126659] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.176 [2024-10-07 11:29:04.126674] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.176 [2024-10-07 11:29:04.126687] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.176 [2024-10-07 11:29:04.126714] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.176 [2024-10-07 11:29:04.137144] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.176 [2024-10-07 11:29:04.137272] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.176 [2024-10-07 11:29:04.137303] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.176 [2024-10-07 11:29:04.137320] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.176 [2024-10-07 11:29:04.137344] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.176 [2024-10-07 11:29:04.137367] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.176 [2024-10-07 11:29:04.137381] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.176 [2024-10-07 11:29:04.137395] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.176 [2024-10-07 11:29:04.137432] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.176 [2024-10-07 11:29:04.149471] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.176 [2024-10-07 11:29:04.149792] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.176 [2024-10-07 11:29:04.149835] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.176 [2024-10-07 11:29:04.149855] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.176 [2024-10-07 11:29:04.150073] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.176 [2024-10-07 11:29:04.150137] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.176 [2024-10-07 11:29:04.150158] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.176 [2024-10-07 11:29:04.150173] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.176 [2024-10-07 11:29:04.150199] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.176 [2024-10-07 11:29:04.163056] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.176 [2024-10-07 11:29:04.163223] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.176 [2024-10-07 11:29:04.163255] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.176 [2024-10-07 11:29:04.163273] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.176 [2024-10-07 11:29:04.163322] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.176 [2024-10-07 11:29:04.163346] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.176 [2024-10-07 11:29:04.163361] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.176 [2024-10-07 11:29:04.163375] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.176 [2024-10-07 11:29:04.163399] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.176 [2024-10-07 11:29:04.176220] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.176 [2024-10-07 11:29:04.176579] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.176 [2024-10-07 11:29:04.176621] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.176 [2024-10-07 11:29:04.176641] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.176 [2024-10-07 11:29:04.176923] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.176 [2024-10-07 11:29:04.177591] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.176 [2024-10-07 11:29:04.177642] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.176 [2024-10-07 11:29:04.177659] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.176 [2024-10-07 11:29:04.177902] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.176 [2024-10-07 11:29:04.188723] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.176 [2024-10-07 11:29:04.188835] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.176 [2024-10-07 11:29:04.188866] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.176 [2024-10-07 11:29:04.188884] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.176 [2024-10-07 11:29:04.188908] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.176 [2024-10-07 11:29:04.188931] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.176 [2024-10-07 11:29:04.188945] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.176 [2024-10-07 11:29:04.188960] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.176 [2024-10-07 11:29:04.188983] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.176 [2024-10-07 11:29:04.199292] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.176 [2024-10-07 11:29:04.199506] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.176 [2024-10-07 11:29:04.199538] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.176 [2024-10-07 11:29:04.199556] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.176 [2024-10-07 11:29:04.199672] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.176 [2024-10-07 11:29:04.199777] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.176 [2024-10-07 11:29:04.199796] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.176 [2024-10-07 11:29:04.199810] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.176 [2024-10-07 11:29:04.200049] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.176 [2024-10-07 11:29:04.209600] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.176 [2024-10-07 11:29:04.209722] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.176 [2024-10-07 11:29:04.209764] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.176 [2024-10-07 11:29:04.209781] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.176 [2024-10-07 11:29:04.209805] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.176 [2024-10-07 11:29:04.209840] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.176 [2024-10-07 11:29:04.209855] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.176 [2024-10-07 11:29:04.209869] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.176 [2024-10-07 11:29:04.209893] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.176 [2024-10-07 11:29:04.219698] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.176 [2024-10-07 11:29:04.219805] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.176 [2024-10-07 11:29:04.219866] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.176 [2024-10-07 11:29:04.219883] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.176 [2024-10-07 11:29:04.219907] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.176 [2024-10-07 11:29:04.220357] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.176 [2024-10-07 11:29:04.220391] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.176 [2024-10-07 11:29:04.220407] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.176 [2024-10-07 11:29:04.220656] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.176 [2024-10-07 11:29:04.232462] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.176 [2024-10-07 11:29:04.232582] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.176 [2024-10-07 11:29:04.232612] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.176 [2024-10-07 11:29:04.232629] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.176 [2024-10-07 11:29:04.233193] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.176 [2024-10-07 11:29:04.233332] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.176 [2024-10-07 11:29:04.233354] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.176 [2024-10-07 11:29:04.233368] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.176 [2024-10-07 11:29:04.233392] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.176 [2024-10-07 11:29:04.243833] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.176 [2024-10-07 11:29:04.244043] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.176 [2024-10-07 11:29:04.244097] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.176 [2024-10-07 11:29:04.244118] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.176 [2024-10-07 11:29:04.244236] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.176 [2024-10-07 11:29:04.244341] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.176 [2024-10-07 11:29:04.244360] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.176 [2024-10-07 11:29:04.244374] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.176 [2024-10-07 11:29:04.244881] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.176 [2024-10-07 11:29:04.257416] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.177 [2024-10-07 11:29:04.257622] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.177 [2024-10-07 11:29:04.257659] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.177 [2024-10-07 11:29:04.257677] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.177 [2024-10-07 11:29:04.257798] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.177 [2024-10-07 11:29:04.257905] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.177 [2024-10-07 11:29:04.257930] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.177 [2024-10-07 11:29:04.257945] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.177 [2024-10-07 11:29:04.258405] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.177 [2024-10-07 11:29:04.268950] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.177 [2024-10-07 11:29:04.269059] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.177 [2024-10-07 11:29:04.269088] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.177 [2024-10-07 11:29:04.269106] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.177 [2024-10-07 11:29:04.269130] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.177 [2024-10-07 11:29:04.270810] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.177 [2024-10-07 11:29:04.270850] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.177 [2024-10-07 11:29:04.270868] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.177 [2024-10-07 11:29:04.271062] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.177 [2024-10-07 11:29:04.279033] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.177 [2024-10-07 11:29:04.279137] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.177 [2024-10-07 11:29:04.279167] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.177 [2024-10-07 11:29:04.279184] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.177 [2024-10-07 11:29:04.279209] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.177 [2024-10-07 11:29:04.279249] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.177 [2024-10-07 11:29:04.279265] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.177 [2024-10-07 11:29:04.279281] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.177 [2024-10-07 11:29:04.279304] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.177 [2024-10-07 11:29:04.291708] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.177 [2024-10-07 11:29:04.291814] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.177 [2024-10-07 11:29:04.291844] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.177 [2024-10-07 11:29:04.291862] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.177 [2024-10-07 11:29:04.291886] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.177 [2024-10-07 11:29:04.291908] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.177 [2024-10-07 11:29:04.291922] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.177 [2024-10-07 11:29:04.291936] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.177 [2024-10-07 11:29:04.291959] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.177 [2024-10-07 11:29:04.302195] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.177 [2024-10-07 11:29:04.302387] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.177 [2024-10-07 11:29:04.302432] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.177 [2024-10-07 11:29:04.302452] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.177 [2024-10-07 11:29:04.302584] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.177 [2024-10-07 11:29:04.302705] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.177 [2024-10-07 11:29:04.302728] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.177 [2024-10-07 11:29:04.302742] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.177 [2024-10-07 11:29:04.302767] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.177 [2024-10-07 11:29:04.312273] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.177 [2024-10-07 11:29:04.312373] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.177 [2024-10-07 11:29:04.312403] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.177 [2024-10-07 11:29:04.312437] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.177 [2024-10-07 11:29:04.312462] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.177 [2024-10-07 11:29:04.312484] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.177 [2024-10-07 11:29:04.312499] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.177 [2024-10-07 11:29:04.312513] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.177 [2024-10-07 11:29:04.312536] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.177 [2024-10-07 11:29:04.321369] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:86992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.177 [2024-10-07 11:29:04.321403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.177 [2024-10-07 11:29:04.321444] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:87000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.177 [2024-10-07 11:29:04.321461] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.177 [2024-10-07 11:29:04.321478] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:87008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.177 [2024-10-07 11:29:04.321492] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.177 [2024-10-07 11:29:04.321508] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:87016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.177 [2024-10-07 11:29:04.321522] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.177 [2024-10-07 11:29:04.321538] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:87024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.177 [2024-10-07 11:29:04.321553] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.177 [2024-10-07 11:29:04.321568] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:87032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.177 [2024-10-07 11:29:04.321582] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.177 [2024-10-07 11:29:04.321598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:87040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.177 [2024-10-07 11:29:04.321612] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.177 [2024-10-07 11:29:04.321627] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:87048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.177 [2024-10-07 11:29:04.321641] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.177 [2024-10-07 11:29:04.321657] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:87056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.177 [2024-10-07 11:29:04.321671] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.177 [2024-10-07 11:29:04.321687] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:87064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.177 [2024-10-07 11:29:04.321701] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.177 [2024-10-07 11:29:04.321716] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:87072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.177 [2024-10-07 11:29:04.321730] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.177 [2024-10-07 11:29:04.321746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:87080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.177 [2024-10-07 11:29:04.321760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.177 [2024-10-07 11:29:04.321775] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:87088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.177 [2024-10-07 11:29:04.321803] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.177 [2024-10-07 11:29:04.321820] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:87096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.177 [2024-10-07 11:29:04.321834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.177 [2024-10-07 11:29:04.321850] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:87104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.177 [2024-10-07 11:29:04.321865] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.178 [2024-10-07 11:29:04.321881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:87112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.178 [2024-10-07 11:29:04.321895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.178 [2024-10-07 11:29:04.321911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:87120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.178 [2024-10-07 11:29:04.321926] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.178 [2024-10-07 11:29:04.321943] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:87128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.178 [2024-10-07 11:29:04.321969] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.178 [2024-10-07 11:29:04.321988] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:87136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.178 [2024-10-07 11:29:04.322002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.178 [2024-10-07 11:29:04.322018] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:87144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.178 [2024-10-07 11:29:04.322033] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.178 [2024-10-07 11:29:04.322049] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:87152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.178 [2024-10-07 11:29:04.322063] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.178 [2024-10-07 11:29:04.322079] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:87160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.178 [2024-10-07 11:29:04.322093] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.178 [2024-10-07 11:29:04.322109] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:87168 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.178 [2024-10-07 11:29:04.322123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.178 [2024-10-07 11:29:04.322139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:87176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.178 [2024-10-07 11:29:04.322154] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.178 [2024-10-07 11:29:04.322170] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:87184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.178 [2024-10-07 11:29:04.322184] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.178 [2024-10-07 11:29:04.322209] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:87192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.178 [2024-10-07 11:29:04.322225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.178 [2024-10-07 11:29:04.322242] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:87200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.178 [2024-10-07 11:29:04.322257] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.178 [2024-10-07 11:29:04.322273] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:87208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.178 [2024-10-07 11:29:04.322287] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.178 [2024-10-07 11:29:04.322303] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:87216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.178 [2024-10-07 11:29:04.322317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.178 [2024-10-07 11:29:04.322333] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:87224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.178 [2024-10-07 11:29:04.322348] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.178 [2024-10-07 11:29:04.322364] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:87232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.178 [2024-10-07 11:29:04.322378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.178 [2024-10-07 11:29:04.322394] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:87240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.178 [2024-10-07 11:29:04.322420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.178 [2024-10-07 11:29:04.322440] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:87248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.178 [2024-10-07 11:29:04.322455] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.178 [2024-10-07 11:29:04.322472] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:87256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.178 [2024-10-07 11:29:04.322487] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.178 [2024-10-07 11:29:04.322503] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:87264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.178 [2024-10-07 11:29:04.322517] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.178 [2024-10-07 11:29:04.322533] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:87272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.178 [2024-10-07 11:29:04.322547] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.178 [2024-10-07 11:29:04.322564] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:87280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.178 [2024-10-07 11:29:04.322578] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.178 [2024-10-07 11:29:04.322594] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:87288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.178 [2024-10-07 11:29:04.322608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.178 [2024-10-07 11:29:04.322633] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:87296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.178 [2024-10-07 11:29:04.322648] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.178 [2024-10-07 11:29:04.322665] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:87304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.178 [2024-10-07 11:29:04.322679] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.178 [2024-10-07 11:29:04.322695] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:87312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.178 [2024-10-07 11:29:04.322709] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.178 [2024-10-07 11:29:04.322725] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:87320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.178 [2024-10-07 11:29:04.322739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.178 [2024-10-07 11:29:04.322755] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:87328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.178 [2024-10-07 11:29:04.322769] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.178 [2024-10-07 11:29:04.322785] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:87336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.178 [2024-10-07 11:29:04.322799] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.178 [2024-10-07 11:29:04.322815] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:87344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.178 [2024-10-07 11:29:04.322829] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.178 [2024-10-07 11:29:04.322845] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:87352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.178 [2024-10-07 11:29:04.322859] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.178 [2024-10-07 11:29:04.322879] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:87360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.178 [2024-10-07 11:29:04.322893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.178 [2024-10-07 11:29:04.322909] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:87368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.178 [2024-10-07 11:29:04.322923] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.178 [2024-10-07 11:29:04.322939] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:87376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.178 [2024-10-07 11:29:04.322954] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.178 [2024-10-07 11:29:04.322970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:87384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.178 [2024-10-07 11:29:04.322985] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.178 [2024-10-07 11:29:04.323001] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:87392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.178 [2024-10-07 11:29:04.323023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.178 [2024-10-07 11:29:04.323040] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:87400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.178 [2024-10-07 11:29:04.323054] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.178 [2024-10-07 11:29:04.323070] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:87408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.178 [2024-10-07 11:29:04.323084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.178 [2024-10-07 11:29:04.323100] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:87416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.178 [2024-10-07 11:29:04.323114] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.178 [2024-10-07 11:29:04.323130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:87424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.178 [2024-10-07 11:29:04.323156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.178 [2024-10-07 11:29:04.323173] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:87432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.178 [2024-10-07 11:29:04.323188] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.178 [2024-10-07 11:29:04.323203] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:87440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.178 [2024-10-07 11:29:04.323218] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.178 [2024-10-07 11:29:04.323234] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:87448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.179 [2024-10-07 11:29:04.323248] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.179 [2024-10-07 11:29:04.323263] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:87456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.179 [2024-10-07 11:29:04.323278] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.179 [2024-10-07 11:29:04.323294] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:87464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.179 [2024-10-07 11:29:04.323308] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.179 [2024-10-07 11:29:04.323324] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:87472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.179 [2024-10-07 11:29:04.323339] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.179 [2024-10-07 11:29:04.323355] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:87480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.179 [2024-10-07 11:29:04.323369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.179 [2024-10-07 11:29:04.323385] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:87488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.179 [2024-10-07 11:29:04.323399] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.179 [2024-10-07 11:29:04.323436] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:87496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.179 [2024-10-07 11:29:04.323452] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.179 [2024-10-07 11:29:04.323468] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:87504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:18:34.179 [2024-10-07 11:29:04.323483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.179 [2024-10-07 11:29:04.323500] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:87512 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:34.179 [2024-10-07 11:29:04.323515] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.179 [2024-10-07 11:29:04.323531] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:87520 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:34.179 [2024-10-07 11:29:04.323545] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.179 [2024-10-07 11:29:04.323561] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:87528 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:34.179 [2024-10-07 11:29:04.323576] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.179 [2024-10-07 11:29:04.323592] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:87536 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:34.179 [2024-10-07 11:29:04.323606] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.179 [2024-10-07 11:29:04.323622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:87544 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:34.179 [2024-10-07 11:29:04.323636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.179 [2024-10-07 11:29:04.323652] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:87552 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:34.179 [2024-10-07 11:29:04.323673] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.179 [2024-10-07 11:29:04.323689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:87560 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:34.179 [2024-10-07 11:29:04.323704] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.179 [2024-10-07 11:29:04.323720] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:87568 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:34.179 [2024-10-07 11:29:04.323734] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.179 [2024-10-07 11:29:04.323751] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:87576 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:34.179 [2024-10-07 11:29:04.323765] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.179 [2024-10-07 11:29:04.323781] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:87584 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:34.179 [2024-10-07 11:29:04.323795] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.179 [2024-10-07 11:29:04.323811] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:95 nsid:1 lba:87592 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:34.179 [2024-10-07 11:29:04.323833] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.179 [2024-10-07 11:29:04.323850] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:87600 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:34.179 [2024-10-07 11:29:04.323864] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.179 [2024-10-07 11:29:04.323880] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:87608 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:34.179 [2024-10-07 11:29:04.323895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.179 [2024-10-07 11:29:04.323911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:87616 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:34.179 [2024-10-07 11:29:04.323925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.179 [2024-10-07 11:29:04.323941] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:87624 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:34.179 [2024-10-07 11:29:04.323955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.179 [2024-10-07 11:29:04.323971] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:87632 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:34.179 [2024-10-07 11:29:04.323991] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.179 [2024-10-07 11:29:04.324008] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:87640 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:34.179 [2024-10-07 11:29:04.324023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.179 [2024-10-07 11:29:04.324039] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:87648 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:34.179 [2024-10-07 11:29:04.324053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.179 [2024-10-07 11:29:04.324069] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:87656 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:34.179 [2024-10-07 11:29:04.324084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.179 [2024-10-07 11:29:04.324099] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:87664 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:34.179 [2024-10-07 11:29:04.324113] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.179 [2024-10-07 11:29:04.324129] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:87672 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:34.179 [2024-10-07 11:29:04.324143] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.179 [2024-10-07 11:29:04.324159] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:87680 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:34.179 [2024-10-07 11:29:04.324180] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.179 [2024-10-07 11:29:04.324196] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:87688 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:34.179 [2024-10-07 11:29:04.324211] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.179 [2024-10-07 11:29:04.324227] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:87696 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:34.179 [2024-10-07 11:29:04.324249] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.179 [2024-10-07 11:29:04.324265] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:87704 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:34.179 [2024-10-07 11:29:04.324280] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.179 [2024-10-07 11:29:04.324296] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:87712 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:34.179 [2024-10-07 11:29:04.324310] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.179 [2024-10-07 11:29:04.324326] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:87720 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:34.179 [2024-10-07 11:29:04.324341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.179 [2024-10-07 11:29:04.324356] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:87728 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:34.179 [2024-10-07 11:29:04.324371] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.179 [2024-10-07 11:29:04.324386] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:87736 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:34.179 [2024-10-07 11:29:04.324400] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.179 [2024-10-07 11:29:04.324427] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:87744 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:34.179 [2024-10-07 11:29:04.324443] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.179 [2024-10-07 11:29:04.324459] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:87752 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:34.179 [2024-10-07 11:29:04.324474] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.179 [2024-10-07 11:29:04.324490] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:87760 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:34.179 [2024-10-07 11:29:04.324511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.179 [2024-10-07 11:29:04.324528] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:87768 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:34.179 [2024-10-07 11:29:04.324542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.179 [2024-10-07 11:29:04.324558] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:87776 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:34.179 [2024-10-07 11:29:04.324572] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.179 [2024-10-07 11:29:04.324588] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:87784 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:34.180 [2024-10-07 11:29:04.324602] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.180 [2024-10-07 11:29:04.324617] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:87792 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:34.180 [2024-10-07 11:29:04.324631] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.180 [2024-10-07 11:29:04.324656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:87800 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:34.180 [2024-10-07 11:29:04.324671] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.180 [2024-10-07 11:29:04.324687] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:87808 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:34.180 [2024-10-07 11:29:04.324706] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.180 [2024-10-07 11:29:04.324723] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:87816 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:34.180 [2024-10-07 11:29:04.324737] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.180 [2024-10-07 11:29:04.324753] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:87824 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:34.180 [2024-10-07 11:29:04.324768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.180 [2024-10-07 11:29:04.324783] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:87832 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:34.180 [2024-10-07 11:29:04.324798] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.180 [2024-10-07 11:29:04.324813] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:87840 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:34.180 [2024-10-07 11:29:04.324827] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.180 [2024-10-07 11:29:04.324843] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:87848 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:34.180 [2024-10-07 11:29:04.324858] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.180 [2024-10-07 11:29:04.324874] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:89 nsid:1 lba:87856 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:34.180 [2024-10-07 11:29:04.324888] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.180 [2024-10-07 11:29:04.324904] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:87864 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:34.180 [2024-10-07 11:29:04.324918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.180 [2024-10-07 11:29:04.324934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:87872 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:34.180 [2024-10-07 11:29:04.324948] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.180 [2024-10-07 11:29:04.324964] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:87880 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:34.180 [2024-10-07 11:29:04.324979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.180 [2024-10-07 11:29:04.324994] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:87888 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:18:34.180 [2024-10-07 11:29:04.325014] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.180 [2024-10-07 11:29:04.325047] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:34.180 [2024-10-07 11:29:04.325074] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:87896 len:8 PRP1 0x0 PRP2 0x0 00:18:34.180 [2024-10-07 11:29:04.325090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.180 [2024-10-07 11:29:04.325108] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:34.180 [2024-10-07 11:29:04.325119] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:34.180 [2024-10-07 11:29:04.325130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:87904 len:8 PRP1 0x0 PRP2 0x0 00:18:34.180 [2024-10-07 11:29:04.325144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.180 [2024-10-07 11:29:04.325158] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:34.180 [2024-10-07 11:29:04.325168] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:34.180 [2024-10-07 11:29:04.325179] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:87912 len:8 PRP1 0x0 PRP2 0x0 00:18:34.180 [2024-10-07 11:29:04.325203] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.180 [2024-10-07 11:29:04.325223] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:34.180 [2024-10-07 11:29:04.325234] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:34.180 [2024-10-07 11:29:04.325245] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:87920 len:8 PRP1 0x0 PRP2 0x0 00:18:34.180 [2024-10-07 11:29:04.325258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.180 [2024-10-07 11:29:04.325273] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:34.180 [2024-10-07 11:29:04.325283] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:34.180 [2024-10-07 11:29:04.325293] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:87928 len:8 PRP1 0x0 PRP2 0x0 00:18:34.180 [2024-10-07 11:29:04.325307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.180 [2024-10-07 11:29:04.325321] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:34.180 [2024-10-07 11:29:04.325332] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:34.180 [2024-10-07 11:29:04.325343] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:87936 len:8 PRP1 0x0 PRP2 0x0 00:18:34.180 [2024-10-07 11:29:04.325356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.180 [2024-10-07 11:29:04.325370] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:34.180 [2024-10-07 11:29:04.325381] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:34.180 [2024-10-07 11:29:04.325391] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:87944 len:8 PRP1 0x0 PRP2 0x0 00:18:34.180 [2024-10-07 11:29:04.325405] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.180 [2024-10-07 11:29:04.325434] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:34.180 [2024-10-07 11:29:04.325445] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:34.180 [2024-10-07 11:29:04.325456] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:87952 len:8 PRP1 0x0 PRP2 0x0 00:18:34.180 [2024-10-07 11:29:04.325470] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.180 [2024-10-07 11:29:04.325490] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:34.180 [2024-10-07 11:29:04.325508] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:34.180 [2024-10-07 11:29:04.325521] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:87960 len:8 PRP1 0x0 PRP2 0x0 00:18:34.180 [2024-10-07 11:29:04.325534] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.180 [2024-10-07 11:29:04.325548] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:34.180 [2024-10-07 11:29:04.325559] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:34.180 [2024-10-07 11:29:04.325570] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:87968 len:8 PRP1 0x0 PRP2 0x0 00:18:34.180 [2024-10-07 11:29:04.325583] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.180 [2024-10-07 11:29:04.325597] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:34.180 [2024-10-07 11:29:04.325607] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:34.180 [2024-10-07 11:29:04.325618] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:87976 len:8 PRP1 0x0 PRP2 0x0 00:18:34.180 [2024-10-07 11:29:04.325631] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.180 [2024-10-07 11:29:04.325650] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:34.180 [2024-10-07 11:29:04.325662] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:34.180 [2024-10-07 11:29:04.325673] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:87984 len:8 PRP1 0x0 PRP2 0x0 00:18:34.180 [2024-10-07 11:29:04.325686] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.180 [2024-10-07 11:29:04.325700] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:34.180 [2024-10-07 11:29:04.325710] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:34.180 [2024-10-07 11:29:04.325721] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:87992 len:8 PRP1 0x0 PRP2 0x0 00:18:34.180 [2024-10-07 11:29:04.325735] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.180 [2024-10-07 11:29:04.325749] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:34.180 [2024-10-07 11:29:04.325759] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:34.180 [2024-10-07 11:29:04.325770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:88000 len:8 PRP1 0x0 PRP2 0x0 00:18:34.180 [2024-10-07 11:29:04.325783] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.180 [2024-10-07 11:29:04.325797] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:18:34.180 [2024-10-07 11:29:04.325808] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:18:34.180 [2024-10-07 11:29:04.325818] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:88008 len:8 PRP1 0x0 PRP2 0x0 00:18:34.180 [2024-10-07 11:29:04.325832] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.180 [2024-10-07 11:29:04.325897] bdev_nvme.c:1730:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x69b060 was disconnected and freed. reset controller. 00:18:34.180 [2024-10-07 11:29:04.327184] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.180 [2024-10-07 11:29:04.327268] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.180 [2024-10-07 11:29:04.327305] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.180 [2024-10-07 11:29:04.327425] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.180 [2024-10-07 11:29:04.327456] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.180 [2024-10-07 11:29:04.327473] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.180 [2024-10-07 11:29:04.327526] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.180 [2024-10-07 11:29:04.327549] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.181 [2024-10-07 11:29:04.327564] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.181 [2024-10-07 11:29:04.327586] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.181 [2024-10-07 11:29:04.327606] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.181 [2024-10-07 11:29:04.327629] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.181 [2024-10-07 11:29:04.327645] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.181 [2024-10-07 11:29:04.327659] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.181 [2024-10-07 11:29:04.327674] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.181 [2024-10-07 11:29:04.327689] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.181 [2024-10-07 11:29:04.327702] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.181 [2024-10-07 11:29:04.327725] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.181 [2024-10-07 11:29:04.327739] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.181 [2024-10-07 11:29:04.337403] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.181 [2024-10-07 11:29:04.337477] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.181 [2024-10-07 11:29:04.337552] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.181 [2024-10-07 11:29:04.337592] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.181 [2024-10-07 11:29:04.337611] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.181 [2024-10-07 11:29:04.337668] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.181 [2024-10-07 11:29:04.337692] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.181 [2024-10-07 11:29:04.337708] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.181 [2024-10-07 11:29:04.337726] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.181 [2024-10-07 11:29:04.337750] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.181 [2024-10-07 11:29:04.337766] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.181 [2024-10-07 11:29:04.337780] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.181 [2024-10-07 11:29:04.337793] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.181 [2024-10-07 11:29:04.337816] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.181 [2024-10-07 11:29:04.337851] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.181 [2024-10-07 11:29:04.337867] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.181 [2024-10-07 11:29:04.337880] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.181 [2024-10-07 11:29:04.337902] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.181 [2024-10-07 11:29:04.350492] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.181 [2024-10-07 11:29:04.350540] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.181 [2024-10-07 11:29:04.350625] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.181 [2024-10-07 11:29:04.350653] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.181 [2024-10-07 11:29:04.350670] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.181 [2024-10-07 11:29:04.350717] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.181 [2024-10-07 11:29:04.350740] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.181 [2024-10-07 11:29:04.350755] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.181 [2024-10-07 11:29:04.350779] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.181 [2024-10-07 11:29:04.350799] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.181 [2024-10-07 11:29:04.350818] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.181 [2024-10-07 11:29:04.350833] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.181 [2024-10-07 11:29:04.350853] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.181 [2024-10-07 11:29:04.350868] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.181 [2024-10-07 11:29:04.350882] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.181 [2024-10-07 11:29:04.350896] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.181 [2024-10-07 11:29:04.350918] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.181 [2024-10-07 11:29:04.350931] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.181 [2024-10-07 11:29:04.366207] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.181 [2024-10-07 11:29:04.366264] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.181 [2024-10-07 11:29:04.367071] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.181 [2024-10-07 11:29:04.367125] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.181 [2024-10-07 11:29:04.367151] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.181 [2024-10-07 11:29:04.367213] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.181 [2024-10-07 11:29:04.367241] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.181 [2024-10-07 11:29:04.367262] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.181 [2024-10-07 11:29:04.367747] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.181 [2024-10-07 11:29:04.367780] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.181 [2024-10-07 11:29:04.367996] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.181 [2024-10-07 11:29:04.368028] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.181 [2024-10-07 11:29:04.368049] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.181 [2024-10-07 11:29:04.368071] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.181 [2024-10-07 11:29:04.368090] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.181 [2024-10-07 11:29:04.368108] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.181 [2024-10-07 11:29:04.368340] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.181 [2024-10-07 11:29:04.368370] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.181 [2024-10-07 11:29:04.377989] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.181 [2024-10-07 11:29:04.378069] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.181 [2024-10-07 11:29:04.378395] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.181 [2024-10-07 11:29:04.378459] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.181 [2024-10-07 11:29:04.378480] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.181 [2024-10-07 11:29:04.378534] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.181 [2024-10-07 11:29:04.378558] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.181 [2024-10-07 11:29:04.378574] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.181 [2024-10-07 11:29:04.378724] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.181 [2024-10-07 11:29:04.378762] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.181 [2024-10-07 11:29:04.378887] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.181 [2024-10-07 11:29:04.378913] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.181 [2024-10-07 11:29:04.378931] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.181 [2024-10-07 11:29:04.378948] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.181 [2024-10-07 11:29:04.378963] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.181 [2024-10-07 11:29:04.378977] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.181 [2024-10-07 11:29:04.379079] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.181 [2024-10-07 11:29:04.379098] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.181 [2024-10-07 11:29:04.390201] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.181 [2024-10-07 11:29:04.390381] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.181 [2024-10-07 11:29:04.390489] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.181 [2024-10-07 11:29:04.390542] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.181 [2024-10-07 11:29:04.390561] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.181 [2024-10-07 11:29:04.391510] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.181 [2024-10-07 11:29:04.391551] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.181 [2024-10-07 11:29:04.391570] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.181 [2024-10-07 11:29:04.391589] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.181 [2024-10-07 11:29:04.391814] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.181 [2024-10-07 11:29:04.391858] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.181 [2024-10-07 11:29:04.391873] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.181 [2024-10-07 11:29:04.391887] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.181 [2024-10-07 11:29:04.392013] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.182 [2024-10-07 11:29:04.392033] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.182 [2024-10-07 11:29:04.392047] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.182 [2024-10-07 11:29:04.392060] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.182 [2024-10-07 11:29:04.392167] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.182 [2024-10-07 11:29:04.400285] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.182 [2024-10-07 11:29:04.400400] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.182 [2024-10-07 11:29:04.400441] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.182 [2024-10-07 11:29:04.400460] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.182 8844.00 IOPS, 34.55 MiB/s [2024-10-07T11:29:15.893Z] [2024-10-07 11:29:04.403104] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.182 [2024-10-07 11:29:04.403415] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.182 [2024-10-07 11:29:04.403462] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.182 [2024-10-07 11:29:04.403480] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.182 [2024-10-07 11:29:04.403630] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.182 [2024-10-07 11:29:04.403658] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.182 [2024-10-07 11:29:04.403837] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.182 [2024-10-07 11:29:04.403896] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.182 [2024-10-07 11:29:04.403915] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.182 [2024-10-07 11:29:04.406023] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.182 [2024-10-07 11:29:04.406357] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.182 [2024-10-07 11:29:04.406421] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.182 [2024-10-07 11:29:04.406442] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.182 [2024-10-07 11:29:04.406615] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.182 [2024-10-07 11:29:04.411692] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.182 [2024-10-07 11:29:04.411842] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.182 [2024-10-07 11:29:04.411871] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.182 [2024-10-07 11:29:04.411888] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.182 [2024-10-07 11:29:04.411912] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.182 [2024-10-07 11:29:04.411933] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.182 [2024-10-07 11:29:04.411947] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.182 [2024-10-07 11:29:04.411961] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.182 [2024-10-07 11:29:04.411984] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.182 [2024-10-07 11:29:04.413702] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.182 [2024-10-07 11:29:04.413816] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.182 [2024-10-07 11:29:04.413846] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.182 [2024-10-07 11:29:04.413863] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.182 [2024-10-07 11:29:04.413887] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.182 [2024-10-07 11:29:04.413909] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.182 [2024-10-07 11:29:04.413923] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.182 [2024-10-07 11:29:04.413937] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.182 [2024-10-07 11:29:04.413969] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.182 [2024-10-07 11:29:04.424703] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.182 [2024-10-07 11:29:04.425690] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.182 [2024-10-07 11:29:04.425827] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.182 [2024-10-07 11:29:04.425856] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.182 [2024-10-07 11:29:04.425873] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.182 [2024-10-07 11:29:04.426957] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.182 [2024-10-07 11:29:04.426998] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.182 [2024-10-07 11:29:04.427017] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.182 [2024-10-07 11:29:04.427036] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.182 [2024-10-07 11:29:04.427924] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.182 [2024-10-07 11:29:04.427963] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.182 [2024-10-07 11:29:04.427980] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.182 [2024-10-07 11:29:04.427993] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.182 [2024-10-07 11:29:04.428385] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.182 [2024-10-07 11:29:04.428427] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.182 [2024-10-07 11:29:04.428444] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.182 [2024-10-07 11:29:04.428457] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.182 [2024-10-07 11:29:04.428526] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.182 [2024-10-07 11:29:04.435960] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.182 [2024-10-07 11:29:04.436204] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.182 [2024-10-07 11:29:04.436234] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.182 [2024-10-07 11:29:04.436250] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.182 [2024-10-07 11:29:04.436358] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.182 [2024-10-07 11:29:04.436407] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.182 [2024-10-07 11:29:04.436556] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.182 [2024-10-07 11:29:04.436589] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.182 [2024-10-07 11:29:04.436605] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.182 [2024-10-07 11:29:04.436620] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.182 [2024-10-07 11:29:04.436632] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.182 [2024-10-07 11:29:04.436645] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.182 [2024-10-07 11:29:04.437448] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.182 [2024-10-07 11:29:04.437535] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.182 [2024-10-07 11:29:04.438060] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.182 [2024-10-07 11:29:04.438098] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.182 [2024-10-07 11:29:04.438115] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.182 [2024-10-07 11:29:04.440483] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.182 [2024-10-07 11:29:04.446180] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.182 [2024-10-07 11:29:04.446293] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.182 [2024-10-07 11:29:04.446349] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.182 [2024-10-07 11:29:04.446365] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.182 [2024-10-07 11:29:04.446432] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.182 [2024-10-07 11:29:04.446484] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.182 [2024-10-07 11:29:04.446505] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.182 [2024-10-07 11:29:04.446526] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.182 [2024-10-07 11:29:04.446550] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.182 [2024-10-07 11:29:04.446570] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.182 [2024-10-07 11:29:04.446635] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.182 [2024-10-07 11:29:04.446661] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.182 [2024-10-07 11:29:04.446677] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.183 [2024-10-07 11:29:04.446700] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.183 [2024-10-07 11:29:04.446736] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.183 [2024-10-07 11:29:04.446750] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.183 [2024-10-07 11:29:04.446778] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.183 [2024-10-07 11:29:04.446800] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.183 [2024-10-07 11:29:04.457587] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.183 [2024-10-07 11:29:04.457638] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.183 [2024-10-07 11:29:04.458342] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.183 [2024-10-07 11:29:04.458386] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.183 [2024-10-07 11:29:04.458405] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.183 [2024-10-07 11:29:04.458471] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.183 [2024-10-07 11:29:04.458505] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.183 [2024-10-07 11:29:04.458521] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.183 [2024-10-07 11:29:04.458772] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.183 [2024-10-07 11:29:04.458803] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.183 [2024-10-07 11:29:04.458853] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.183 [2024-10-07 11:29:04.458874] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.183 [2024-10-07 11:29:04.458888] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.183 [2024-10-07 11:29:04.458905] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.183 [2024-10-07 11:29:04.458919] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.183 [2024-10-07 11:29:04.458948] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.183 [2024-10-07 11:29:04.458975] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.183 [2024-10-07 11:29:04.458990] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.183 [2024-10-07 11:29:04.471510] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.183 [2024-10-07 11:29:04.471558] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.183 [2024-10-07 11:29:04.472460] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.183 [2024-10-07 11:29:04.472513] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.183 [2024-10-07 11:29:04.472533] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.183 [2024-10-07 11:29:04.472585] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.183 [2024-10-07 11:29:04.472609] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.183 [2024-10-07 11:29:04.472625] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.183 [2024-10-07 11:29:04.473002] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.183 [2024-10-07 11:29:04.473033] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.183 [2024-10-07 11:29:04.473240] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.183 [2024-10-07 11:29:04.473275] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.183 [2024-10-07 11:29:04.473292] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.183 [2024-10-07 11:29:04.473309] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.183 [2024-10-07 11:29:04.473323] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.183 [2024-10-07 11:29:04.473336] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.183 [2024-10-07 11:29:04.473561] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.183 [2024-10-07 11:29:04.473586] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.183 [2024-10-07 11:29:04.482769] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.183 [2024-10-07 11:29:04.482849] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.183 [2024-10-07 11:29:04.483057] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.183 [2024-10-07 11:29:04.483121] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.183 [2024-10-07 11:29:04.483140] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.183 [2024-10-07 11:29:04.483189] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.183 [2024-10-07 11:29:04.483227] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.183 [2024-10-07 11:29:04.483242] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.183 [2024-10-07 11:29:04.483350] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.183 [2024-10-07 11:29:04.483374] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.183 [2024-10-07 11:29:04.483525] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.183 [2024-10-07 11:29:04.483549] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.183 [2024-10-07 11:29:04.483563] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.183 [2024-10-07 11:29:04.483580] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.183 [2024-10-07 11:29:04.483594] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.183 [2024-10-07 11:29:04.483607] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.183 [2024-10-07 11:29:04.483716] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.183 [2024-10-07 11:29:04.483736] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.183 [2024-10-07 11:29:04.493971] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.183 [2024-10-07 11:29:04.494019] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.183 [2024-10-07 11:29:04.494211] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.183 [2024-10-07 11:29:04.494241] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.183 [2024-10-07 11:29:04.494258] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.183 [2024-10-07 11:29:04.494320] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.183 [2024-10-07 11:29:04.494342] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.183 [2024-10-07 11:29:04.494357] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.183 [2024-10-07 11:29:04.494531] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.183 [2024-10-07 11:29:04.494560] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.183 [2024-10-07 11:29:04.494609] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.183 [2024-10-07 11:29:04.494629] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.183 [2024-10-07 11:29:04.494643] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.183 [2024-10-07 11:29:04.494659] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.183 [2024-10-07 11:29:04.494673] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.183 [2024-10-07 11:29:04.494686] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.183 [2024-10-07 11:29:04.494708] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.183 [2024-10-07 11:29:04.494722] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.183 [2024-10-07 11:29:04.504290] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.183 [2024-10-07 11:29:04.504341] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.183 [2024-10-07 11:29:04.504455] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.183 [2024-10-07 11:29:04.504485] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.183 [2024-10-07 11:29:04.504502] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.183 [2024-10-07 11:29:04.504570] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.183 [2024-10-07 11:29:04.504594] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.183 [2024-10-07 11:29:04.504609] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.183 [2024-10-07 11:29:04.504634] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.183 [2024-10-07 11:29:04.504653] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.183 [2024-10-07 11:29:04.504673] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.183 [2024-10-07 11:29:04.504687] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.183 [2024-10-07 11:29:04.504701] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.183 [2024-10-07 11:29:04.504716] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.183 [2024-10-07 11:29:04.504730] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.183 [2024-10-07 11:29:04.504743] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.183 [2024-10-07 11:29:04.504765] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.183 [2024-10-07 11:29:04.504779] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.183 [2024-10-07 11:29:04.514416] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.183 [2024-10-07 11:29:04.514506] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.183 [2024-10-07 11:29:04.514582] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.184 [2024-10-07 11:29:04.514609] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.184 [2024-10-07 11:29:04.514625] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.184 [2024-10-07 11:29:04.514677] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.184 [2024-10-07 11:29:04.514700] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.184 [2024-10-07 11:29:04.514716] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.184 [2024-10-07 11:29:04.514733] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.184 [2024-10-07 11:29:04.515633] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.184 [2024-10-07 11:29:04.515669] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.184 [2024-10-07 11:29:04.515701] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.184 [2024-10-07 11:29:04.515715] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.184 [2024-10-07 11:29:04.515849] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.184 [2024-10-07 11:29:04.515871] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.184 [2024-10-07 11:29:04.515884] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.184 [2024-10-07 11:29:04.515897] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.184 [2024-10-07 11:29:04.515934] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.184 [2024-10-07 11:29:04.525889] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.184 [2024-10-07 11:29:04.525938] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.184 [2024-10-07 11:29:04.526247] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.184 [2024-10-07 11:29:04.526289] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.184 [2024-10-07 11:29:04.526314] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.184 [2024-10-07 11:29:04.526363] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.184 [2024-10-07 11:29:04.526386] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.184 [2024-10-07 11:29:04.526401] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.184 [2024-10-07 11:29:04.526619] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.184 [2024-10-07 11:29:04.526649] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.184 [2024-10-07 11:29:04.526704] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.184 [2024-10-07 11:29:04.526726] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.184 [2024-10-07 11:29:04.526740] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.184 [2024-10-07 11:29:04.526756] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.184 [2024-10-07 11:29:04.526770] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.184 [2024-10-07 11:29:04.526783] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.184 [2024-10-07 11:29:04.526963] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.184 [2024-10-07 11:29:04.526985] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.184 [2024-10-07 11:29:04.540598] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.184 [2024-10-07 11:29:04.540646] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.184 [2024-10-07 11:29:04.540738] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.184 [2024-10-07 11:29:04.540781] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.184 [2024-10-07 11:29:04.540797] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.184 [2024-10-07 11:29:04.540859] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.184 [2024-10-07 11:29:04.540881] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.184 [2024-10-07 11:29:04.540897] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.184 [2024-10-07 11:29:04.540921] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.184 [2024-10-07 11:29:04.540941] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.184 [2024-10-07 11:29:04.540960] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.184 [2024-10-07 11:29:04.540998] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.184 [2024-10-07 11:29:04.541014] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.184 [2024-10-07 11:29:04.541030] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.184 [2024-10-07 11:29:04.541044] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.184 [2024-10-07 11:29:04.541057] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.184 [2024-10-07 11:29:04.541081] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.184 [2024-10-07 11:29:04.541095] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.184 [2024-10-07 11:29:04.554771] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.184 [2024-10-07 11:29:04.554820] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.184 [2024-10-07 11:29:04.554915] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.184 [2024-10-07 11:29:04.554943] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.184 [2024-10-07 11:29:04.554960] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.184 [2024-10-07 11:29:04.555015] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.184 [2024-10-07 11:29:04.555037] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.184 [2024-10-07 11:29:04.555053] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.184 [2024-10-07 11:29:04.555633] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.184 [2024-10-07 11:29:04.555673] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.184 [2024-10-07 11:29:04.555767] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.184 [2024-10-07 11:29:04.555789] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.184 [2024-10-07 11:29:04.555803] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.184 [2024-10-07 11:29:04.555819] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.184 [2024-10-07 11:29:04.555833] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.184 [2024-10-07 11:29:04.555847] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.184 [2024-10-07 11:29:04.555870] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.184 [2024-10-07 11:29:04.555884] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.184 [2024-10-07 11:29:04.565873] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.184 [2024-10-07 11:29:04.565949] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.184 [2024-10-07 11:29:04.566190] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.184 [2024-10-07 11:29:04.566242] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.184 [2024-10-07 11:29:04.566268] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.184 [2024-10-07 11:29:04.566343] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.184 [2024-10-07 11:29:04.566402] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.184 [2024-10-07 11:29:04.566445] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.184 [2024-10-07 11:29:04.566574] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.184 [2024-10-07 11:29:04.566604] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.184 [2024-10-07 11:29:04.566734] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.184 [2024-10-07 11:29:04.566771] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.184 [2024-10-07 11:29:04.566793] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.184 [2024-10-07 11:29:04.566817] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.184 [2024-10-07 11:29:04.566836] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.184 [2024-10-07 11:29:04.566854] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.184 [2024-10-07 11:29:04.569291] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.184 [2024-10-07 11:29:04.569336] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.184 [2024-10-07 11:29:04.578034] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.184 [2024-10-07 11:29:04.578082] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.184 [2024-10-07 11:29:04.578280] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.184 [2024-10-07 11:29:04.578321] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.184 [2024-10-07 11:29:04.578341] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.184 [2024-10-07 11:29:04.578390] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.184 [2024-10-07 11:29:04.578427] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.184 [2024-10-07 11:29:04.578446] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.184 [2024-10-07 11:29:04.578605] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.184 [2024-10-07 11:29:04.578634] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.184 [2024-10-07 11:29:04.578753] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.185 [2024-10-07 11:29:04.578785] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.185 [2024-10-07 11:29:04.578801] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.185 [2024-10-07 11:29:04.578818] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.185 [2024-10-07 11:29:04.578832] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.185 [2024-10-07 11:29:04.578846] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.185 [2024-10-07 11:29:04.578958] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.185 [2024-10-07 11:29:04.578978] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.185 [2024-10-07 11:29:04.588733] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.185 [2024-10-07 11:29:04.588779] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.185 [2024-10-07 11:29:04.588981] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.185 [2024-10-07 11:29:04.589018] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.185 [2024-10-07 11:29:04.589037] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.185 [2024-10-07 11:29:04.589086] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.185 [2024-10-07 11:29:04.589108] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.185 [2024-10-07 11:29:04.589124] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.185 [2024-10-07 11:29:04.589226] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.185 [2024-10-07 11:29:04.589250] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.185 [2024-10-07 11:29:04.589345] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.185 [2024-10-07 11:29:04.589364] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.185 [2024-10-07 11:29:04.589378] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.185 [2024-10-07 11:29:04.589394] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.185 [2024-10-07 11:29:04.589421] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.185 [2024-10-07 11:29:04.589437] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.185 [2024-10-07 11:29:04.591555] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.185 [2024-10-07 11:29:04.591593] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.185 [2024-10-07 11:29:04.604121] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.185 [2024-10-07 11:29:04.604170] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.185 [2024-10-07 11:29:04.606002] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.185 [2024-10-07 11:29:04.606045] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.185 [2024-10-07 11:29:04.606065] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.185 [2024-10-07 11:29:04.606115] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.185 [2024-10-07 11:29:04.606138] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.185 [2024-10-07 11:29:04.606153] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.185 [2024-10-07 11:29:04.607093] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.185 [2024-10-07 11:29:04.607140] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.185 [2024-10-07 11:29:04.607431] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.185 [2024-10-07 11:29:04.607467] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.185 [2024-10-07 11:29:04.607499] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.185 [2024-10-07 11:29:04.607518] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.185 [2024-10-07 11:29:04.607544] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.185 [2024-10-07 11:29:04.607557] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.185 [2024-10-07 11:29:04.607614] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.185 [2024-10-07 11:29:04.607635] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.185 [2024-10-07 11:29:04.615562] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.185 [2024-10-07 11:29:04.615612] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.185 [2024-10-07 11:29:04.620406] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.185 [2024-10-07 11:29:04.620478] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.185 [2024-10-07 11:29:04.620499] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.185 [2024-10-07 11:29:04.620551] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.185 [2024-10-07 11:29:04.620573] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.185 [2024-10-07 11:29:04.620589] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.185 [2024-10-07 11:29:04.621444] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.185 [2024-10-07 11:29:04.621512] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.185 [2024-10-07 11:29:04.621933] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.185 [2024-10-07 11:29:04.621979] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.185 [2024-10-07 11:29:04.621997] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.185 [2024-10-07 11:29:04.622015] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.185 [2024-10-07 11:29:04.622029] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.185 [2024-10-07 11:29:04.622042] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.185 [2024-10-07 11:29:04.622335] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.185 [2024-10-07 11:29:04.622395] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.185 [2024-10-07 11:29:04.626020] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.185 [2024-10-07 11:29:04.626066] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.185 [2024-10-07 11:29:04.626151] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.185 [2024-10-07 11:29:04.626179] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.185 [2024-10-07 11:29:04.626196] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.185 [2024-10-07 11:29:04.626243] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.185 [2024-10-07 11:29:04.626266] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.185 [2024-10-07 11:29:04.626324] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.185 [2024-10-07 11:29:04.626348] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.185 [2024-10-07 11:29:04.626366] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.185 [2024-10-07 11:29:04.626401] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.185 [2024-10-07 11:29:04.626416] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.185 [2024-10-07 11:29:04.626429] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.185 [2024-10-07 11:29:04.626459] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.185 [2024-10-07 11:29:04.626476] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.185 [2024-10-07 11:29:04.626489] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.185 [2024-10-07 11:29:04.626512] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.185 [2024-10-07 11:29:04.626526] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.185 [2024-10-07 11:29:04.636127] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.185 [2024-10-07 11:29:04.636192] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.185 [2024-10-07 11:29:04.636267] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.185 [2024-10-07 11:29:04.636295] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.185 [2024-10-07 11:29:04.636312] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.185 [2024-10-07 11:29:04.636366] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.185 [2024-10-07 11:29:04.636389] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.185 [2024-10-07 11:29:04.636404] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.185 [2024-10-07 11:29:04.636437] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.185 [2024-10-07 11:29:04.636463] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.185 [2024-10-07 11:29:04.636480] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.185 [2024-10-07 11:29:04.636493] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.185 [2024-10-07 11:29:04.636507] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.185 [2024-10-07 11:29:04.636529] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.185 [2024-10-07 11:29:04.636543] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.185 [2024-10-07 11:29:04.636556] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.185 [2024-10-07 11:29:04.636569] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.185 [2024-10-07 11:29:04.636597] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.185 [2024-10-07 11:29:04.649310] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.186 [2024-10-07 11:29:04.649373] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.186 [2024-10-07 11:29:04.650023] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.186 [2024-10-07 11:29:04.650068] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.186 [2024-10-07 11:29:04.650087] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.186 [2024-10-07 11:29:04.650135] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.186 [2024-10-07 11:29:04.650158] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.186 [2024-10-07 11:29:04.650173] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.186 [2024-10-07 11:29:04.650579] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.186 [2024-10-07 11:29:04.650649] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.186 [2024-10-07 11:29:04.650861] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.186 [2024-10-07 11:29:04.650895] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.186 [2024-10-07 11:29:04.650911] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.186 [2024-10-07 11:29:04.650943] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.186 [2024-10-07 11:29:04.650957] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.186 [2024-10-07 11:29:04.650969] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.186 [2024-10-07 11:29:04.651046] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.186 [2024-10-07 11:29:04.651066] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.186 [2024-10-07 11:29:04.663281] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.186 [2024-10-07 11:29:04.663333] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.186 [2024-10-07 11:29:04.663602] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.186 [2024-10-07 11:29:04.663633] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.186 [2024-10-07 11:29:04.663650] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.186 [2024-10-07 11:29:04.663697] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.186 [2024-10-07 11:29:04.663720] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.186 [2024-10-07 11:29:04.663735] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.186 [2024-10-07 11:29:04.663837] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.186 [2024-10-07 11:29:04.663861] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.186 [2024-10-07 11:29:04.663957] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.186 [2024-10-07 11:29:04.663975] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.186 [2024-10-07 11:29:04.663989] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.186 [2024-10-07 11:29:04.664021] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.186 [2024-10-07 11:29:04.664037] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.186 [2024-10-07 11:29:04.664050] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.186 [2024-10-07 11:29:04.664407] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.186 [2024-10-07 11:29:04.664455] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.186 [2024-10-07 11:29:04.673396] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.186 [2024-10-07 11:29:04.673469] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.186 [2024-10-07 11:29:04.673546] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.186 [2024-10-07 11:29:04.673574] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.186 [2024-10-07 11:29:04.673590] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.186 [2024-10-07 11:29:04.673645] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.186 [2024-10-07 11:29:04.673668] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.186 [2024-10-07 11:29:04.673684] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.186 [2024-10-07 11:29:04.673702] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.186 [2024-10-07 11:29:04.673726] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.186 [2024-10-07 11:29:04.673743] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.186 [2024-10-07 11:29:04.673756] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.186 [2024-10-07 11:29:04.673770] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.186 [2024-10-07 11:29:04.673792] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.186 [2024-10-07 11:29:04.673806] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.186 [2024-10-07 11:29:04.673819] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.186 [2024-10-07 11:29:04.673833] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.186 [2024-10-07 11:29:04.675337] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.186 [2024-10-07 11:29:04.683487] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.186 [2024-10-07 11:29:04.683594] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.186 [2024-10-07 11:29:04.683625] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.186 [2024-10-07 11:29:04.683643] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.186 [2024-10-07 11:29:04.683680] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.186 [2024-10-07 11:29:04.686126] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.186 [2024-10-07 11:29:04.686187] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.186 [2024-10-07 11:29:04.686205] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.186 [2024-10-07 11:29:04.686235] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.186 [2024-10-07 11:29:04.686821] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.186 [2024-10-07 11:29:04.686902] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.186 [2024-10-07 11:29:04.686929] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.186 [2024-10-07 11:29:04.686947] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.186 [2024-10-07 11:29:04.687296] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.186 [2024-10-07 11:29:04.687481] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.186 [2024-10-07 11:29:04.687514] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.186 [2024-10-07 11:29:04.687530] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.186 [2024-10-07 11:29:04.687663] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.186 [2024-10-07 11:29:04.693566] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.186 [2024-10-07 11:29:04.693671] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.186 [2024-10-07 11:29:04.693701] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.186 [2024-10-07 11:29:04.693718] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.186 [2024-10-07 11:29:04.693741] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.186 [2024-10-07 11:29:04.693763] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.186 [2024-10-07 11:29:04.693777] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.186 [2024-10-07 11:29:04.693791] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.186 [2024-10-07 11:29:04.693813] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.186 [2024-10-07 11:29:04.698495] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.186 [2024-10-07 11:29:04.698706] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.186 [2024-10-07 11:29:04.698738] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.186 [2024-10-07 11:29:04.698756] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.186 [2024-10-07 11:29:04.698866] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.186 [2024-10-07 11:29:04.698971] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.186 [2024-10-07 11:29:04.698989] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.186 [2024-10-07 11:29:04.699004] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.187 [2024-10-07 11:29:04.699108] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.187 [2024-10-07 11:29:04.703644] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.187 [2024-10-07 11:29:04.703745] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.187 [2024-10-07 11:29:04.703796] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.187 [2024-10-07 11:29:04.703816] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.187 [2024-10-07 11:29:04.706375] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.187 [2024-10-07 11:29:04.707326] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.187 [2024-10-07 11:29:04.707364] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.187 [2024-10-07 11:29:04.707381] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.187 [2024-10-07 11:29:04.707505] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.187 [2024-10-07 11:29:04.708577] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.187 [2024-10-07 11:29:04.708680] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.187 [2024-10-07 11:29:04.708710] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.187 [2024-10-07 11:29:04.708731] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.187 [2024-10-07 11:29:04.708756] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.187 [2024-10-07 11:29:04.708778] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.187 [2024-10-07 11:29:04.708792] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.187 [2024-10-07 11:29:04.708805] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.187 [2024-10-07 11:29:04.708828] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.187 [2024-10-07 11:29:04.713722] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.187 [2024-10-07 11:29:04.713822] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.187 [2024-10-07 11:29:04.713851] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.187 [2024-10-07 11:29:04.713873] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.187 [2024-10-07 11:29:04.713896] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.187 [2024-10-07 11:29:04.713918] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.187 [2024-10-07 11:29:04.713932] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.187 [2024-10-07 11:29:04.713946] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.187 [2024-10-07 11:29:04.713978] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.187 [2024-10-07 11:29:04.722371] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.187 [2024-10-07 11:29:04.722484] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.187 [2024-10-07 11:29:04.722514] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.187 [2024-10-07 11:29:04.722531] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.187 [2024-10-07 11:29:04.722555] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.187 [2024-10-07 11:29:04.722597] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.187 [2024-10-07 11:29:04.722614] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.187 [2024-10-07 11:29:04.722627] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.187 [2024-10-07 11:29:04.722651] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.187 [2024-10-07 11:29:04.723923] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.187 [2024-10-07 11:29:04.724510] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.187 [2024-10-07 11:29:04.724554] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.187 [2024-10-07 11:29:04.724573] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.187 [2024-10-07 11:29:04.724824] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.187 [2024-10-07 11:29:04.725039] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.187 [2024-10-07 11:29:04.725065] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.187 [2024-10-07 11:29:04.725082] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.187 [2024-10-07 11:29:04.725144] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.187 [2024-10-07 11:29:04.737330] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.187 [2024-10-07 11:29:04.737486] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.187 [2024-10-07 11:29:04.737572] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.187 [2024-10-07 11:29:04.737600] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.187 [2024-10-07 11:29:04.737618] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.187 [2024-10-07 11:29:04.737674] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.187 [2024-10-07 11:29:04.737698] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.187 [2024-10-07 11:29:04.737714] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.187 [2024-10-07 11:29:04.737732] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.187 [2024-10-07 11:29:04.737756] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.187 [2024-10-07 11:29:04.737773] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.187 [2024-10-07 11:29:04.737787] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.187 [2024-10-07 11:29:04.737800] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.187 [2024-10-07 11:29:04.737823] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.187 [2024-10-07 11:29:04.737838] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.187 [2024-10-07 11:29:04.737851] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.187 [2024-10-07 11:29:04.737864] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.187 [2024-10-07 11:29:04.737885] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.187 [2024-10-07 11:29:04.750061] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.187 [2024-10-07 11:29:04.750111] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.187 [2024-10-07 11:29:04.750238] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.187 [2024-10-07 11:29:04.750268] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.187 [2024-10-07 11:29:04.750286] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.187 [2024-10-07 11:29:04.750332] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.187 [2024-10-07 11:29:04.750354] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.187 [2024-10-07 11:29:04.750370] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.187 [2024-10-07 11:29:04.750422] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.187 [2024-10-07 11:29:04.750448] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.187 [2024-10-07 11:29:04.750476] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.187 [2024-10-07 11:29:04.750490] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.187 [2024-10-07 11:29:04.750504] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.187 [2024-10-07 11:29:04.750520] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.187 [2024-10-07 11:29:04.750535] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.187 [2024-10-07 11:29:04.750547] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.187 [2024-10-07 11:29:04.750570] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.187 [2024-10-07 11:29:04.750584] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.187 [2024-10-07 11:29:04.764192] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.187 [2024-10-07 11:29:04.764244] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.187 [2024-10-07 11:29:04.764711] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.187 [2024-10-07 11:29:04.764754] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.187 [2024-10-07 11:29:04.764772] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.187 [2024-10-07 11:29:04.764823] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.187 [2024-10-07 11:29:04.764846] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.187 [2024-10-07 11:29:04.764861] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.187 [2024-10-07 11:29:04.764927] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.187 [2024-10-07 11:29:04.764953] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.187 [2024-10-07 11:29:04.764974] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.187 [2024-10-07 11:29:04.764988] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.187 [2024-10-07 11:29:04.765018] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.187 [2024-10-07 11:29:04.765036] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.187 [2024-10-07 11:29:04.765050] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.187 [2024-10-07 11:29:04.765063] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.188 [2024-10-07 11:29:04.765087] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.188 [2024-10-07 11:29:04.765101] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.188 [2024-10-07 11:29:04.776399] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.188 [2024-10-07 11:29:04.776465] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.188 [2024-10-07 11:29:04.776683] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.188 [2024-10-07 11:29:04.776714] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.188 [2024-10-07 11:29:04.776732] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.188 [2024-10-07 11:29:04.776779] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.188 [2024-10-07 11:29:04.776801] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.188 [2024-10-07 11:29:04.776816] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.188 [2024-10-07 11:29:04.776953] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.188 [2024-10-07 11:29:04.776981] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.188 [2024-10-07 11:29:04.777089] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.188 [2024-10-07 11:29:04.777110] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.188 [2024-10-07 11:29:04.777124] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.188 [2024-10-07 11:29:04.777140] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.188 [2024-10-07 11:29:04.777155] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.188 [2024-10-07 11:29:04.777168] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.188 [2024-10-07 11:29:04.777268] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.188 [2024-10-07 11:29:04.777286] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.188 [2024-10-07 11:29:04.787906] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.188 [2024-10-07 11:29:04.787956] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.188 [2024-10-07 11:29:04.788150] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.188 [2024-10-07 11:29:04.788181] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.188 [2024-10-07 11:29:04.788198] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.188 [2024-10-07 11:29:04.788245] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.188 [2024-10-07 11:29:04.788267] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.188 [2024-10-07 11:29:04.788303] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.188 [2024-10-07 11:29:04.788451] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.188 [2024-10-07 11:29:04.788481] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.188 [2024-10-07 11:29:04.788592] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.188 [2024-10-07 11:29:04.788613] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.188 [2024-10-07 11:29:04.788627] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.188 [2024-10-07 11:29:04.788650] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.188 [2024-10-07 11:29:04.788664] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.188 [2024-10-07 11:29:04.788677] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.188 [2024-10-07 11:29:04.789101] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.188 [2024-10-07 11:29:04.789137] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.188 [2024-10-07 11:29:04.798020] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.188 [2024-10-07 11:29:04.798085] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.188 [2024-10-07 11:29:04.798165] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.188 [2024-10-07 11:29:04.798194] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.188 [2024-10-07 11:29:04.798212] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.188 [2024-10-07 11:29:04.798266] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.188 [2024-10-07 11:29:04.798290] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.188 [2024-10-07 11:29:04.798305] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.188 [2024-10-07 11:29:04.798324] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.188 [2024-10-07 11:29:04.798347] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.188 [2024-10-07 11:29:04.798365] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.188 [2024-10-07 11:29:04.798378] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.188 [2024-10-07 11:29:04.798392] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.188 [2024-10-07 11:29:04.798429] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.188 [2024-10-07 11:29:04.798447] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.188 [2024-10-07 11:29:04.798460] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.188 [2024-10-07 11:29:04.798473] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.188 [2024-10-07 11:29:04.798494] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.188 [2024-10-07 11:29:04.810846] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.188 [2024-10-07 11:29:04.810910] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.188 [2024-10-07 11:29:04.811270] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.188 [2024-10-07 11:29:04.811312] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.188 [2024-10-07 11:29:04.811332] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.188 [2024-10-07 11:29:04.811382] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.188 [2024-10-07 11:29:04.811405] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.188 [2024-10-07 11:29:04.811435] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.188 [2024-10-07 11:29:04.811566] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.188 [2024-10-07 11:29:04.811594] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.188 [2024-10-07 11:29:04.811656] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.188 [2024-10-07 11:29:04.811679] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.188 [2024-10-07 11:29:04.811693] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.188 [2024-10-07 11:29:04.811710] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.188 [2024-10-07 11:29:04.811724] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.188 [2024-10-07 11:29:04.811737] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.188 [2024-10-07 11:29:04.811784] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.188 [2024-10-07 11:29:04.811804] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.188 [2024-10-07 11:29:04.822353] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.188 [2024-10-07 11:29:04.822402] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.188 [2024-10-07 11:29:04.822612] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.188 [2024-10-07 11:29:04.822642] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.188 [2024-10-07 11:29:04.822659] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.188 [2024-10-07 11:29:04.822706] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.188 [2024-10-07 11:29:04.822729] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.188 [2024-10-07 11:29:04.822744] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.188 [2024-10-07 11:29:04.822896] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.188 [2024-10-07 11:29:04.822925] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.188 [2024-10-07 11:29:04.823049] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.188 [2024-10-07 11:29:04.823071] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.188 [2024-10-07 11:29:04.823086] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.188 [2024-10-07 11:29:04.823117] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.188 [2024-10-07 11:29:04.823134] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.188 [2024-10-07 11:29:04.823147] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.188 [2024-10-07 11:29:04.823275] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.188 [2024-10-07 11:29:04.823296] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.188 [2024-10-07 11:29:04.833011] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.188 [2024-10-07 11:29:04.833059] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.188 [2024-10-07 11:29:04.833142] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.188 [2024-10-07 11:29:04.833170] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.188 [2024-10-07 11:29:04.833186] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.188 [2024-10-07 11:29:04.833232] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.189 [2024-10-07 11:29:04.833254] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.189 [2024-10-07 11:29:04.833270] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.189 [2024-10-07 11:29:04.833293] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.189 [2024-10-07 11:29:04.833314] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.189 [2024-10-07 11:29:04.833334] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.189 [2024-10-07 11:29:04.833348] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.189 [2024-10-07 11:29:04.833361] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.189 [2024-10-07 11:29:04.833378] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.189 [2024-10-07 11:29:04.833391] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.189 [2024-10-07 11:29:04.833404] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.189 [2024-10-07 11:29:04.833443] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.189 [2024-10-07 11:29:04.833458] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.189 [2024-10-07 11:29:04.844109] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.189 [2024-10-07 11:29:04.844158] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.189 [2024-10-07 11:29:04.845044] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.189 [2024-10-07 11:29:04.845086] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.189 [2024-10-07 11:29:04.845106] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.189 [2024-10-07 11:29:04.845154] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.189 [2024-10-07 11:29:04.845177] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.189 [2024-10-07 11:29:04.845192] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.189 [2024-10-07 11:29:04.845461] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.189 [2024-10-07 11:29:04.845494] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.189 [2024-10-07 11:29:04.845653] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.189 [2024-10-07 11:29:04.845679] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.189 [2024-10-07 11:29:04.845693] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.189 [2024-10-07 11:29:04.845709] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.189 [2024-10-07 11:29:04.845723] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.189 [2024-10-07 11:29:04.845737] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.189 [2024-10-07 11:29:04.845787] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.189 [2024-10-07 11:29:04.845807] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.189 [2024-10-07 11:29:04.855370] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.189 [2024-10-07 11:29:04.855438] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.189 [2024-10-07 11:29:04.855561] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.189 [2024-10-07 11:29:04.855592] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.189 [2024-10-07 11:29:04.855611] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.189 [2024-10-07 11:29:04.855658] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.189 [2024-10-07 11:29:04.855680] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.189 [2024-10-07 11:29:04.855696] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.189 [2024-10-07 11:29:04.855728] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.189 [2024-10-07 11:29:04.855748] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.189 [2024-10-07 11:29:04.855767] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.189 [2024-10-07 11:29:04.855782] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.189 [2024-10-07 11:29:04.855796] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.189 [2024-10-07 11:29:04.855812] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.189 [2024-10-07 11:29:04.855826] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.189 [2024-10-07 11:29:04.855839] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.189 [2024-10-07 11:29:04.855862] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.189 [2024-10-07 11:29:04.855876] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.189 [2024-10-07 11:29:04.868652] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.189 [2024-10-07 11:29:04.868700] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.189 [2024-10-07 11:29:04.868940] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.189 [2024-10-07 11:29:04.868978] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.189 [2024-10-07 11:29:04.868997] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.189 [2024-10-07 11:29:04.869045] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.189 [2024-10-07 11:29:04.869067] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.189 [2024-10-07 11:29:04.869083] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.189 [2024-10-07 11:29:04.869268] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.189 [2024-10-07 11:29:04.869298] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.189 [2024-10-07 11:29:04.869437] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.189 [2024-10-07 11:29:04.869462] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.189 [2024-10-07 11:29:04.869477] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.189 [2024-10-07 11:29:04.869494] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.189 [2024-10-07 11:29:04.869507] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.189 [2024-10-07 11:29:04.869521] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.189 [2024-10-07 11:29:04.869622] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.189 [2024-10-07 11:29:04.869640] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.189 [2024-10-07 11:29:04.881708] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.189 [2024-10-07 11:29:04.881757] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.189 [2024-10-07 11:29:04.882924] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.189 [2024-10-07 11:29:04.882966] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.189 [2024-10-07 11:29:04.882986] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.189 [2024-10-07 11:29:04.883035] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.189 [2024-10-07 11:29:04.883058] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.189 [2024-10-07 11:29:04.883074] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.189 [2024-10-07 11:29:04.884160] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.189 [2024-10-07 11:29:04.884201] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.189 [2024-10-07 11:29:04.884671] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.189 [2024-10-07 11:29:04.884711] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.189 [2024-10-07 11:29:04.884728] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.189 [2024-10-07 11:29:04.884746] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.189 [2024-10-07 11:29:04.884786] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.189 [2024-10-07 11:29:04.884800] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.189 [2024-10-07 11:29:04.884875] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.189 [2024-10-07 11:29:04.884896] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.189 [2024-10-07 11:29:04.893518] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.189 [2024-10-07 11:29:04.893570] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.189 [2024-10-07 11:29:04.893749] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.189 [2024-10-07 11:29:04.893780] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.189 [2024-10-07 11:29:04.893797] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.189 [2024-10-07 11:29:04.893844] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.189 [2024-10-07 11:29:04.893867] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.189 [2024-10-07 11:29:04.893883] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.189 [2024-10-07 11:29:04.894017] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.189 [2024-10-07 11:29:04.894045] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.189 [2024-10-07 11:29:04.894146] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.189 [2024-10-07 11:29:04.894165] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.189 [2024-10-07 11:29:04.894179] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.189 [2024-10-07 11:29:04.894195] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.190 [2024-10-07 11:29:04.894209] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.190 [2024-10-07 11:29:04.894223] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.190 [2024-10-07 11:29:04.896497] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.190 [2024-10-07 11:29:04.896535] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.190 [2024-10-07 11:29:04.903638] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.190 [2024-10-07 11:29:04.903703] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.190 [2024-10-07 11:29:04.903782] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.190 [2024-10-07 11:29:04.903810] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.190 [2024-10-07 11:29:04.903828] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.190 [2024-10-07 11:29:04.903885] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.190 [2024-10-07 11:29:04.903920] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.190 [2024-10-07 11:29:04.903949] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.190 [2024-10-07 11:29:04.903971] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.190 [2024-10-07 11:29:04.904014] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.190 [2024-10-07 11:29:04.904032] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.190 [2024-10-07 11:29:04.904046] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.190 [2024-10-07 11:29:04.904059] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.190 [2024-10-07 11:29:04.904083] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.190 [2024-10-07 11:29:04.904098] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.190 [2024-10-07 11:29:04.904111] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.190 [2024-10-07 11:29:04.904125] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.190 [2024-10-07 11:29:04.904145] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.190 [2024-10-07 11:29:04.913718] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.190 [2024-10-07 11:29:04.913853] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.190 [2024-10-07 11:29:04.913885] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.190 [2024-10-07 11:29:04.913902] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.190 [2024-10-07 11:29:04.914193] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.190 [2024-10-07 11:29:04.914462] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.190 [2024-10-07 11:29:04.914510] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.190 [2024-10-07 11:29:04.914528] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.190 [2024-10-07 11:29:04.914543] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.190 [2024-10-07 11:29:04.914656] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.190 [2024-10-07 11:29:04.914734] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.190 [2024-10-07 11:29:04.914759] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.190 [2024-10-07 11:29:04.914775] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.190 [2024-10-07 11:29:04.914891] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.190 [2024-10-07 11:29:04.914999] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.190 [2024-10-07 11:29:04.915024] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.190 [2024-10-07 11:29:04.915038] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.190 [2024-10-07 11:29:04.915084] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.190 [2024-10-07 11:29:04.925055] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.190 [2024-10-07 11:29:04.925107] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.190 [2024-10-07 11:29:04.925843] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.190 [2024-10-07 11:29:04.925889] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.190 [2024-10-07 11:29:04.925926] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.190 [2024-10-07 11:29:04.925990] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.190 [2024-10-07 11:29:04.926015] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.190 [2024-10-07 11:29:04.926031] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.190 [2024-10-07 11:29:04.926125] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.190 [2024-10-07 11:29:04.926151] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.190 [2024-10-07 11:29:04.926172] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.190 [2024-10-07 11:29:04.926187] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.190 [2024-10-07 11:29:04.926201] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.190 [2024-10-07 11:29:04.926218] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.190 [2024-10-07 11:29:04.926232] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.190 [2024-10-07 11:29:04.926245] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.190 [2024-10-07 11:29:04.926277] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.190 [2024-10-07 11:29:04.926292] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.190 [2024-10-07 11:29:04.935173] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.190 [2024-10-07 11:29:04.935237] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.190 [2024-10-07 11:29:04.935311] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.190 [2024-10-07 11:29:04.935339] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.190 [2024-10-07 11:29:04.935355] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.190 [2024-10-07 11:29:04.935793] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.190 [2024-10-07 11:29:04.935834] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.190 [2024-10-07 11:29:04.935853] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.190 [2024-10-07 11:29:04.935872] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.190 [2024-10-07 11:29:04.935940] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.190 [2024-10-07 11:29:04.935963] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.190 [2024-10-07 11:29:04.935978] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.190 [2024-10-07 11:29:04.935992] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.190 [2024-10-07 11:29:04.938231] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.190 [2024-10-07 11:29:04.938271] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.190 [2024-10-07 11:29:04.938308] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.190 [2024-10-07 11:29:04.938339] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.190 [2024-10-07 11:29:04.939068] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.190 [2024-10-07 11:29:04.945645] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.190 [2024-10-07 11:29:04.945710] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.190 [2024-10-07 11:29:04.945944] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.190 [2024-10-07 11:29:04.945998] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.190 [2024-10-07 11:29:04.946016] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.190 [2024-10-07 11:29:04.946065] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.190 [2024-10-07 11:29:04.946087] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.190 [2024-10-07 11:29:04.946103] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.190 [2024-10-07 11:29:04.946227] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.190 [2024-10-07 11:29:04.946255] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.190 [2024-10-07 11:29:04.946363] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.190 [2024-10-07 11:29:04.946383] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.190 [2024-10-07 11:29:04.946398] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.190 [2024-10-07 11:29:04.946442] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.190 [2024-10-07 11:29:04.946459] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.190 [2024-10-07 11:29:04.946472] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.191 [2024-10-07 11:29:04.947943] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.191 [2024-10-07 11:29:04.947979] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.191 [2024-10-07 11:29:04.956105] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.191 [2024-10-07 11:29:04.956151] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.191 [2024-10-07 11:29:04.956235] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.191 [2024-10-07 11:29:04.956264] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.191 [2024-10-07 11:29:04.956281] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.191 [2024-10-07 11:29:04.956327] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.191 [2024-10-07 11:29:04.956349] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.191 [2024-10-07 11:29:04.956366] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.191 [2024-10-07 11:29:04.956566] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.191 [2024-10-07 11:29:04.956596] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.191 [2024-10-07 11:29:04.956667] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.191 [2024-10-07 11:29:04.956689] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.191 [2024-10-07 11:29:04.956704] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.191 [2024-10-07 11:29:04.956721] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.191 [2024-10-07 11:29:04.956735] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.191 [2024-10-07 11:29:04.956748] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.191 [2024-10-07 11:29:04.956771] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.191 [2024-10-07 11:29:04.956785] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.191 [2024-10-07 11:29:04.969279] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.191 [2024-10-07 11:29:04.969332] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.191 [2024-10-07 11:29:04.969627] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.191 [2024-10-07 11:29:04.969670] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.191 [2024-10-07 11:29:04.969689] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.191 [2024-10-07 11:29:04.969738] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.191 [2024-10-07 11:29:04.969761] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.191 [2024-10-07 11:29:04.969776] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.191 [2024-10-07 11:29:04.969990] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.191 [2024-10-07 11:29:04.970021] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.191 [2024-10-07 11:29:04.970078] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.191 [2024-10-07 11:29:04.970099] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.191 [2024-10-07 11:29:04.970114] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.191 [2024-10-07 11:29:04.970131] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.191 [2024-10-07 11:29:04.970145] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.191 [2024-10-07 11:29:04.970158] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.191 [2024-10-07 11:29:04.970182] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.191 [2024-10-07 11:29:04.970196] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.191 [2024-10-07 11:29:04.979781] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.191 [2024-10-07 11:29:04.979845] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.191 [2024-10-07 11:29:04.980151] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.191 [2024-10-07 11:29:04.980184] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.191 [2024-10-07 11:29:04.980231] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.191 [2024-10-07 11:29:04.980284] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.191 [2024-10-07 11:29:04.980308] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.191 [2024-10-07 11:29:04.980323] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.191 [2024-10-07 11:29:04.980403] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.191 [2024-10-07 11:29:04.980939] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.191 [2024-10-07 11:29:04.981801] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.191 [2024-10-07 11:29:04.981836] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.191 [2024-10-07 11:29:04.981853] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.191 [2024-10-07 11:29:04.981872] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.191 [2024-10-07 11:29:04.981887] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.191 [2024-10-07 11:29:04.981900] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.191 [2024-10-07 11:29:04.985602] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.191 [2024-10-07 11:29:04.985641] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.191 [2024-10-07 11:29:04.989909] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.191 [2024-10-07 11:29:04.989997] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.191 [2024-10-07 11:29:04.990074] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.191 [2024-10-07 11:29:04.990103] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.191 [2024-10-07 11:29:04.990120] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.191 [2024-10-07 11:29:04.990173] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.191 [2024-10-07 11:29:04.990197] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.191 [2024-10-07 11:29:04.990212] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.191 [2024-10-07 11:29:04.990232] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.191 [2024-10-07 11:29:04.990256] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.191 [2024-10-07 11:29:04.990273] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.191 [2024-10-07 11:29:04.990287] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.191 [2024-10-07 11:29:04.990300] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.191 [2024-10-07 11:29:04.990323] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.191 [2024-10-07 11:29:04.990338] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.191 [2024-10-07 11:29:04.990351] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.191 [2024-10-07 11:29:04.990379] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.191 [2024-10-07 11:29:04.990403] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.191 [2024-10-07 11:29:05.004235] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.191 [2024-10-07 11:29:05.004296] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.191 [2024-10-07 11:29:05.004486] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.191 [2024-10-07 11:29:05.004518] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.191 [2024-10-07 11:29:05.004535] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.191 [2024-10-07 11:29:05.004582] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.191 [2024-10-07 11:29:05.004605] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.191 [2024-10-07 11:29:05.004621] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.191 [2024-10-07 11:29:05.004646] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.191 [2024-10-07 11:29:05.004666] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.191 [2024-10-07 11:29:05.004686] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.191 [2024-10-07 11:29:05.004700] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.191 [2024-10-07 11:29:05.004714] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.191 [2024-10-07 11:29:05.004730] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.191 [2024-10-07 11:29:05.004745] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.191 [2024-10-07 11:29:05.004757] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.191 [2024-10-07 11:29:05.004781] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.191 [2024-10-07 11:29:05.004795] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.191 [2024-10-07 11:29:05.017272] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.191 [2024-10-07 11:29:05.017326] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.191 [2024-10-07 11:29:05.017428] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.191 [2024-10-07 11:29:05.017458] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.191 [2024-10-07 11:29:05.017476] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.191 [2024-10-07 11:29:05.017525] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.191 [2024-10-07 11:29:05.017548] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.191 [2024-10-07 11:29:05.017564] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.191 [2024-10-07 11:29:05.018150] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.191 [2024-10-07 11:29:05.018217] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.191 [2024-10-07 11:29:05.018317] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.191 [2024-10-07 11:29:05.018370] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.191 [2024-10-07 11:29:05.018386] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.191 [2024-10-07 11:29:05.018404] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.192 [2024-10-07 11:29:05.018434] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.192 [2024-10-07 11:29:05.018449] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.192 [2024-10-07 11:29:05.018474] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.192 [2024-10-07 11:29:05.018489] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.192 [2024-10-07 11:29:05.027878] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.192 [2024-10-07 11:29:05.027926] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.192 [2024-10-07 11:29:05.028101] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.192 [2024-10-07 11:29:05.028131] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.192 [2024-10-07 11:29:05.028148] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.192 [2024-10-07 11:29:05.028196] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.192 [2024-10-07 11:29:05.028219] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.192 [2024-10-07 11:29:05.028235] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.192 [2024-10-07 11:29:05.028367] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.192 [2024-10-07 11:29:05.028395] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.192 [2024-10-07 11:29:05.028554] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.192 [2024-10-07 11:29:05.028580] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.192 [2024-10-07 11:29:05.028595] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.192 [2024-10-07 11:29:05.028612] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.192 [2024-10-07 11:29:05.028626] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.192 [2024-10-07 11:29:05.028639] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.192 [2024-10-07 11:29:05.028993] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.192 [2024-10-07 11:29:05.029016] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.192 [2024-10-07 11:29:05.038011] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.192 [2024-10-07 11:29:05.038082] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.192 [2024-10-07 11:29:05.038163] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.192 [2024-10-07 11:29:05.038193] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.192 [2024-10-07 11:29:05.038210] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.192 [2024-10-07 11:29:05.038285] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.192 [2024-10-07 11:29:05.038311] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.192 [2024-10-07 11:29:05.038328] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.192 [2024-10-07 11:29:05.038346] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.192 [2024-10-07 11:29:05.038371] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.192 [2024-10-07 11:29:05.038387] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.192 [2024-10-07 11:29:05.038401] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.192 [2024-10-07 11:29:05.038429] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.192 [2024-10-07 11:29:05.038456] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.192 [2024-10-07 11:29:05.038471] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.192 [2024-10-07 11:29:05.038484] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.192 [2024-10-07 11:29:05.038497] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.192 [2024-10-07 11:29:05.038526] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.192 [2024-10-07 11:29:05.049300] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.192 [2024-10-07 11:29:05.049350] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.192 [2024-10-07 11:29:05.049492] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.192 [2024-10-07 11:29:05.049523] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.192 [2024-10-07 11:29:05.049540] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.192 [2024-10-07 11:29:05.049587] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.192 [2024-10-07 11:29:05.049610] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.192 [2024-10-07 11:29:05.049626] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.192 [2024-10-07 11:29:05.049651] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.192 [2024-10-07 11:29:05.049671] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.192 [2024-10-07 11:29:05.049691] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.192 [2024-10-07 11:29:05.049706] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.192 [2024-10-07 11:29:05.049719] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.192 [2024-10-07 11:29:05.049736] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.192 [2024-10-07 11:29:05.049750] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.192 [2024-10-07 11:29:05.049763] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.192 [2024-10-07 11:29:05.049785] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.192 [2024-10-07 11:29:05.049799] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.192 [2024-10-07 11:29:05.061037] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.192 [2024-10-07 11:29:05.061087] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.192 [2024-10-07 11:29:05.061200] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.192 [2024-10-07 11:29:05.061230] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.192 [2024-10-07 11:29:05.061246] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.192 [2024-10-07 11:29:05.061294] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.192 [2024-10-07 11:29:05.061317] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.192 [2024-10-07 11:29:05.061332] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.192 [2024-10-07 11:29:05.061356] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.192 [2024-10-07 11:29:05.061376] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.192 [2024-10-07 11:29:05.061422] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.192 [2024-10-07 11:29:05.061442] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.192 [2024-10-07 11:29:05.061456] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.192 [2024-10-07 11:29:05.061472] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.192 [2024-10-07 11:29:05.061486] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.192 [2024-10-07 11:29:05.061499] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.192 [2024-10-07 11:29:05.061522] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.192 [2024-10-07 11:29:05.061536] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.192 [2024-10-07 11:29:05.073072] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.192 [2024-10-07 11:29:05.073129] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.192 [2024-10-07 11:29:05.073369] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.192 [2024-10-07 11:29:05.073400] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.192 [2024-10-07 11:29:05.073445] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.192 [2024-10-07 11:29:05.073496] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.192 [2024-10-07 11:29:05.073519] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.192 [2024-10-07 11:29:05.073534] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.192 [2024-10-07 11:29:05.073676] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.192 [2024-10-07 11:29:05.073704] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.192 [2024-10-07 11:29:05.073811] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.192 [2024-10-07 11:29:05.073832] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.192 [2024-10-07 11:29:05.073862] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.192 [2024-10-07 11:29:05.073886] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.192 [2024-10-07 11:29:05.073901] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.192 [2024-10-07 11:29:05.073914] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.192 [2024-10-07 11:29:05.074027] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.192 [2024-10-07 11:29:05.074048] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.192 [2024-10-07 11:29:05.083192] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.192 [2024-10-07 11:29:05.083289] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.192 [2024-10-07 11:29:05.083364] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.192 [2024-10-07 11:29:05.083391] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.192 [2024-10-07 11:29:05.083408] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.192 [2024-10-07 11:29:05.083650] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.192 [2024-10-07 11:29:05.083680] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.192 [2024-10-07 11:29:05.083697] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.192 [2024-10-07 11:29:05.083715] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.192 [2024-10-07 11:29:05.083893] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.192 [2024-10-07 11:29:05.083921] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.193 [2024-10-07 11:29:05.083935] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.193 [2024-10-07 11:29:05.083949] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.193 [2024-10-07 11:29:05.084060] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.193 [2024-10-07 11:29:05.084080] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.193 [2024-10-07 11:29:05.084094] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.193 [2024-10-07 11:29:05.084107] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.193 [2024-10-07 11:29:05.084205] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.193 [2024-10-07 11:29:05.093881] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.193 [2024-10-07 11:29:05.093954] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.193 [2024-10-07 11:29:05.094072] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.193 [2024-10-07 11:29:05.094107] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.193 [2024-10-07 11:29:05.094129] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.193 [2024-10-07 11:29:05.094189] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.193 [2024-10-07 11:29:05.094217] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.193 [2024-10-07 11:29:05.094256] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.193 [2024-10-07 11:29:05.094288] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.193 [2024-10-07 11:29:05.094314] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.193 [2024-10-07 11:29:05.094340] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.193 [2024-10-07 11:29:05.094359] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.193 [2024-10-07 11:29:05.094379] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.193 [2024-10-07 11:29:05.094399] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.193 [2024-10-07 11:29:05.094436] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.193 [2024-10-07 11:29:05.094455] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.193 [2024-10-07 11:29:05.094496] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.193 [2024-10-07 11:29:05.094514] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.193 [2024-10-07 11:29:05.104527] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.193 [2024-10-07 11:29:05.104576] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.193 [2024-10-07 11:29:05.104663] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.193 [2024-10-07 11:29:05.104692] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.193 [2024-10-07 11:29:05.104709] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.193 [2024-10-07 11:29:05.104756] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.193 [2024-10-07 11:29:05.104793] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.193 [2024-10-07 11:29:05.104824] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.193 [2024-10-07 11:29:05.104848] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.193 [2024-10-07 11:29:05.104867] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.193 [2024-10-07 11:29:05.104887] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.193 [2024-10-07 11:29:05.104901] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.193 [2024-10-07 11:29:05.104915] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.193 [2024-10-07 11:29:05.104931] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.193 [2024-10-07 11:29:05.104945] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.193 [2024-10-07 11:29:05.104958] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.193 [2024-10-07 11:29:05.107192] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.193 [2024-10-07 11:29:05.107230] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.193 [2024-10-07 11:29:05.114673] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.193 [2024-10-07 11:29:05.114752] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.193 [2024-10-07 11:29:05.114828] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.193 [2024-10-07 11:29:05.114856] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.193 [2024-10-07 11:29:05.114873] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.193 [2024-10-07 11:29:05.114927] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.193 [2024-10-07 11:29:05.114961] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.193 [2024-10-07 11:29:05.114978] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.193 [2024-10-07 11:29:05.114996] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.193 [2024-10-07 11:29:05.115019] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.193 [2024-10-07 11:29:05.115036] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.193 [2024-10-07 11:29:05.115050] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.193 [2024-10-07 11:29:05.115063] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.193 [2024-10-07 11:29:05.115086] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.193 [2024-10-07 11:29:05.115101] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.193 [2024-10-07 11:29:05.115114] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.193 [2024-10-07 11:29:05.115127] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.193 [2024-10-07 11:29:05.115147] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.193 [2024-10-07 11:29:05.124769] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.193 [2024-10-07 11:29:05.124878] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.193 [2024-10-07 11:29:05.124908] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.193 [2024-10-07 11:29:05.124925] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.193 [2024-10-07 11:29:05.124963] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.193 [2024-10-07 11:29:05.124992] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.193 [2024-10-07 11:29:05.125019] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.193 [2024-10-07 11:29:05.125035] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.193 [2024-10-07 11:29:05.125049] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.193 [2024-10-07 11:29:05.125070] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.193 [2024-10-07 11:29:05.125129] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.193 [2024-10-07 11:29:05.125153] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.193 [2024-10-07 11:29:05.125169] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.193 [2024-10-07 11:29:05.127508] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.193 [2024-10-07 11:29:05.128239] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.193 [2024-10-07 11:29:05.128274] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.193 [2024-10-07 11:29:05.128306] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.193 [2024-10-07 11:29:05.128565] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.193 [2024-10-07 11:29:05.136530] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.193 [2024-10-07 11:29:05.136596] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.193 [2024-10-07 11:29:05.136673] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.193 [2024-10-07 11:29:05.136701] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.193 [2024-10-07 11:29:05.136718] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.193 [2024-10-07 11:29:05.136771] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.193 [2024-10-07 11:29:05.136794] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.193 [2024-10-07 11:29:05.136811] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.193 [2024-10-07 11:29:05.136829] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.193 [2024-10-07 11:29:05.136863] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.193 [2024-10-07 11:29:05.136879] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.193 [2024-10-07 11:29:05.136893] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.193 [2024-10-07 11:29:05.136906] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.193 [2024-10-07 11:29:05.136929] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.193 [2024-10-07 11:29:05.136944] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.193 [2024-10-07 11:29:05.136957] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.193 [2024-10-07 11:29:05.136970] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.193 [2024-10-07 11:29:05.136990] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.193 [2024-10-07 11:29:05.148272] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.193 [2024-10-07 11:29:05.148328] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.193 [2024-10-07 11:29:05.148430] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.193 [2024-10-07 11:29:05.148461] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.193 [2024-10-07 11:29:05.148479] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.193 [2024-10-07 11:29:05.148527] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.193 [2024-10-07 11:29:05.148550] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.194 [2024-10-07 11:29:05.148566] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.194 [2024-10-07 11:29:05.148623] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.194 [2024-10-07 11:29:05.148656] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.194 [2024-10-07 11:29:05.148703] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.194 [2024-10-07 11:29:05.148727] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.194 [2024-10-07 11:29:05.148746] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.194 [2024-10-07 11:29:05.148767] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.194 [2024-10-07 11:29:05.148786] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.194 [2024-10-07 11:29:05.148804] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.194 [2024-10-07 11:29:05.148844] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.194 [2024-10-07 11:29:05.148862] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.194 [2024-10-07 11:29:05.158390] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.194 [2024-10-07 11:29:05.158467] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.194 [2024-10-07 11:29:05.158573] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.194 [2024-10-07 11:29:05.158601] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.194 [2024-10-07 11:29:05.158618] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.194 [2024-10-07 11:29:05.158672] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.194 [2024-10-07 11:29:05.158696] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.194 [2024-10-07 11:29:05.158712] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.194 [2024-10-07 11:29:05.158731] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.194 [2024-10-07 11:29:05.158755] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.194 [2024-10-07 11:29:05.158772] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.194 [2024-10-07 11:29:05.158786] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.194 [2024-10-07 11:29:05.158800] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.194 [2024-10-07 11:29:05.159429] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.194 [2024-10-07 11:29:05.159463] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.194 [2024-10-07 11:29:05.159479] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.194 [2024-10-07 11:29:05.159493] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.194 [2024-10-07 11:29:05.160034] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.194 [2024-10-07 11:29:05.170306] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.194 [2024-10-07 11:29:05.170358] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.194 [2024-10-07 11:29:05.170668] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.194 [2024-10-07 11:29:05.170719] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.194 [2024-10-07 11:29:05.170739] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.194 [2024-10-07 11:29:05.170789] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.194 [2024-10-07 11:29:05.170811] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.194 [2024-10-07 11:29:05.170827] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.194 [2024-10-07 11:29:05.170871] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.194 [2024-10-07 11:29:05.170893] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.194 [2024-10-07 11:29:05.170914] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.194 [2024-10-07 11:29:05.170928] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.194 [2024-10-07 11:29:05.170942] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.194 [2024-10-07 11:29:05.170959] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.194 [2024-10-07 11:29:05.170973] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.194 [2024-10-07 11:29:05.170986] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.194 [2024-10-07 11:29:05.171173] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.194 [2024-10-07 11:29:05.171213] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.194 [2024-10-07 11:29:05.180470] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.194 [2024-10-07 11:29:05.180531] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.194 [2024-10-07 11:29:05.180607] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.194 [2024-10-07 11:29:05.180637] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.194 [2024-10-07 11:29:05.180654] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.194 [2024-10-07 11:29:05.180707] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.194 [2024-10-07 11:29:05.180730] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.194 [2024-10-07 11:29:05.180746] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.194 [2024-10-07 11:29:05.180764] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.194 [2024-10-07 11:29:05.180788] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.194 [2024-10-07 11:29:05.180805] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.194 [2024-10-07 11:29:05.180818] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.194 [2024-10-07 11:29:05.180832] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.194 [2024-10-07 11:29:05.180854] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.194 [2024-10-07 11:29:05.180888] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.194 [2024-10-07 11:29:05.180903] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.194 [2024-10-07 11:29:05.180917] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.194 [2024-10-07 11:29:05.180939] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.194 [2024-10-07 11:29:05.190548] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.194 [2024-10-07 11:29:05.190652] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.194 [2024-10-07 11:29:05.190683] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.194 [2024-10-07 11:29:05.190701] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.194 [2024-10-07 11:29:05.190737] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.194 [2024-10-07 11:29:05.190766] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.194 [2024-10-07 11:29:05.190793] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.194 [2024-10-07 11:29:05.190809] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.194 [2024-10-07 11:29:05.190823] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.194 [2024-10-07 11:29:05.190844] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.194 [2024-10-07 11:29:05.190899] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.194 [2024-10-07 11:29:05.190923] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.194 [2024-10-07 11:29:05.190939] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.194 [2024-10-07 11:29:05.190962] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.194 [2024-10-07 11:29:05.190998] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.194 [2024-10-07 11:29:05.191016] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.194 [2024-10-07 11:29:05.191030] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.194 [2024-10-07 11:29:05.191054] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.194 [2024-10-07 11:29:05.204281] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.194 [2024-10-07 11:29:05.204330] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.194 [2024-10-07 11:29:05.204521] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.194 [2024-10-07 11:29:05.204555] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.194 [2024-10-07 11:29:05.204573] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.194 [2024-10-07 11:29:05.204620] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.194 [2024-10-07 11:29:05.204643] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.194 [2024-10-07 11:29:05.204659] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.194 [2024-10-07 11:29:05.205239] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.194 [2024-10-07 11:29:05.205311] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.195 [2024-10-07 11:29:05.205425] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.195 [2024-10-07 11:29:05.205449] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.195 [2024-10-07 11:29:05.205464] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.195 [2024-10-07 11:29:05.205482] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.195 [2024-10-07 11:29:05.205496] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.195 [2024-10-07 11:29:05.205509] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.195 [2024-10-07 11:29:05.205533] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.195 [2024-10-07 11:29:05.205548] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.195 [2024-10-07 11:29:05.216222] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.195 [2024-10-07 11:29:05.216275] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.195 [2024-10-07 11:29:05.216575] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.195 [2024-10-07 11:29:05.216618] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.195 [2024-10-07 11:29:05.216637] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.195 [2024-10-07 11:29:05.216685] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.195 [2024-10-07 11:29:05.216708] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.195 [2024-10-07 11:29:05.216728] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.195 [2024-10-07 11:29:05.216929] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.195 [2024-10-07 11:29:05.216960] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.195 [2024-10-07 11:29:05.217154] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.195 [2024-10-07 11:29:05.217179] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.195 [2024-10-07 11:29:05.217194] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.195 [2024-10-07 11:29:05.217211] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.195 [2024-10-07 11:29:05.217237] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.195 [2024-10-07 11:29:05.217250] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.195 [2024-10-07 11:29:05.217322] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.195 [2024-10-07 11:29:05.217345] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.195 [2024-10-07 11:29:05.226587] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.195 [2024-10-07 11:29:05.226638] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.195 [2024-10-07 11:29:05.226809] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.195 [2024-10-07 11:29:05.226859] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.195 [2024-10-07 11:29:05.226878] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.195 [2024-10-07 11:29:05.226929] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.195 [2024-10-07 11:29:05.226952] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.195 [2024-10-07 11:29:05.226968] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.195 [2024-10-07 11:29:05.227086] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.195 [2024-10-07 11:29:05.227111] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.195 [2024-10-07 11:29:05.227685] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.195 [2024-10-07 11:29:05.227721] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.195 [2024-10-07 11:29:05.227737] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.195 [2024-10-07 11:29:05.227754] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.195 [2024-10-07 11:29:05.227770] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.195 [2024-10-07 11:29:05.227783] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.195 [2024-10-07 11:29:05.230861] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.195 [2024-10-07 11:29:05.230901] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.195 [2024-10-07 11:29:05.236699] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.195 [2024-10-07 11:29:05.236761] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.195 [2024-10-07 11:29:05.236835] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.195 [2024-10-07 11:29:05.236863] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.195 [2024-10-07 11:29:05.236879] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.195 [2024-10-07 11:29:05.237076] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.195 [2024-10-07 11:29:05.237106] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.195 [2024-10-07 11:29:05.237122] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.195 [2024-10-07 11:29:05.237141] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.195 [2024-10-07 11:29:05.237321] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.195 [2024-10-07 11:29:05.237348] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.195 [2024-10-07 11:29:05.237363] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.195 [2024-10-07 11:29:05.237377] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.195 [2024-10-07 11:29:05.237514] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.195 [2024-10-07 11:29:05.237538] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.195 [2024-10-07 11:29:05.237566] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.195 [2024-10-07 11:29:05.237581] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.195 [2024-10-07 11:29:05.237692] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.195 [2024-10-07 11:29:05.249104] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.195 [2024-10-07 11:29:05.249154] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.195 [2024-10-07 11:29:05.249267] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.195 [2024-10-07 11:29:05.249297] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.195 [2024-10-07 11:29:05.249313] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.195 [2024-10-07 11:29:05.249370] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.195 [2024-10-07 11:29:05.249393] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.195 [2024-10-07 11:29:05.249422] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.195 [2024-10-07 11:29:05.249451] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.195 [2024-10-07 11:29:05.249471] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.195 [2024-10-07 11:29:05.249490] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.195 [2024-10-07 11:29:05.249505] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.195 [2024-10-07 11:29:05.249518] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.195 [2024-10-07 11:29:05.249534] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.195 [2024-10-07 11:29:05.249548] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.195 [2024-10-07 11:29:05.249561] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.195 [2024-10-07 11:29:05.249584] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.195 [2024-10-07 11:29:05.249597] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.195 [2024-10-07 11:29:05.261066] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.195 [2024-10-07 11:29:05.261122] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.195 [2024-10-07 11:29:05.261329] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.195 [2024-10-07 11:29:05.261360] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.195 [2024-10-07 11:29:05.261377] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.195 [2024-10-07 11:29:05.261438] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.195 [2024-10-07 11:29:05.261464] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.195 [2024-10-07 11:29:05.261480] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.195 [2024-10-07 11:29:05.261602] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.195 [2024-10-07 11:29:05.261630] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.195 [2024-10-07 11:29:05.261765] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.195 [2024-10-07 11:29:05.261786] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.195 [2024-10-07 11:29:05.261801] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.195 [2024-10-07 11:29:05.261817] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.195 [2024-10-07 11:29:05.261832] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.195 [2024-10-07 11:29:05.261845] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.195 [2024-10-07 11:29:05.261967] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.195 [2024-10-07 11:29:05.261988] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.195 [2024-10-07 11:29:05.271183] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.195 [2024-10-07 11:29:05.271290] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.195 [2024-10-07 11:29:05.271363] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.195 [2024-10-07 11:29:05.271390] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.195 [2024-10-07 11:29:05.271406] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.195 [2024-10-07 11:29:05.271475] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.195 [2024-10-07 11:29:05.271500] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.195 [2024-10-07 11:29:05.271516] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.195 [2024-10-07 11:29:05.271533] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.195 [2024-10-07 11:29:05.271556] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.195 [2024-10-07 11:29:05.271573] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.195 [2024-10-07 11:29:05.271586] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.196 [2024-10-07 11:29:05.271599] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.196 [2024-10-07 11:29:05.271621] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.196 [2024-10-07 11:29:05.271635] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.196 [2024-10-07 11:29:05.271648] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.196 [2024-10-07 11:29:05.271660] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.196 [2024-10-07 11:29:05.271680] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.196 [2024-10-07 11:29:05.281988] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.196 [2024-10-07 11:29:05.282036] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.196 [2024-10-07 11:29:05.282131] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.196 [2024-10-07 11:29:05.282159] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.196 [2024-10-07 11:29:05.282197] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.196 [2024-10-07 11:29:05.282248] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.196 [2024-10-07 11:29:05.282271] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.196 [2024-10-07 11:29:05.282287] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.196 [2024-10-07 11:29:05.282311] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.196 [2024-10-07 11:29:05.282331] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.196 [2024-10-07 11:29:05.282350] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.196 [2024-10-07 11:29:05.282365] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.196 [2024-10-07 11:29:05.282378] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.196 [2024-10-07 11:29:05.282394] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.196 [2024-10-07 11:29:05.282421] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.196 [2024-10-07 11:29:05.282438] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.196 [2024-10-07 11:29:05.282593] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.196 [2024-10-07 11:29:05.282618] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.196 [2024-10-07 11:29:05.294845] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.196 [2024-10-07 11:29:05.294895] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.196 [2024-10-07 11:29:05.295021] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.196 [2024-10-07 11:29:05.295051] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.196 [2024-10-07 11:29:05.295068] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.196 [2024-10-07 11:29:05.295114] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.196 [2024-10-07 11:29:05.295137] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.196 [2024-10-07 11:29:05.295153] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.196 [2024-10-07 11:29:05.295177] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.196 [2024-10-07 11:29:05.295197] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.196 [2024-10-07 11:29:05.295217] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.196 [2024-10-07 11:29:05.295231] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.196 [2024-10-07 11:29:05.295245] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.196 [2024-10-07 11:29:05.295261] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.196 [2024-10-07 11:29:05.295275] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.196 [2024-10-07 11:29:05.295288] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.196 [2024-10-07 11:29:05.295327] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.196 [2024-10-07 11:29:05.295343] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.196 [2024-10-07 11:29:05.305651] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.196 [2024-10-07 11:29:05.305699] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.196 [2024-10-07 11:29:05.305898] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.196 [2024-10-07 11:29:05.305929] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.196 [2024-10-07 11:29:05.305946] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.196 [2024-10-07 11:29:05.306007] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.196 [2024-10-07 11:29:05.306031] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.196 [2024-10-07 11:29:05.306047] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.196 [2024-10-07 11:29:05.306160] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.196 [2024-10-07 11:29:05.306186] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.196 [2024-10-07 11:29:05.306312] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.196 [2024-10-07 11:29:05.306335] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.196 [2024-10-07 11:29:05.306349] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.196 [2024-10-07 11:29:05.306366] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.196 [2024-10-07 11:29:05.306380] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.196 [2024-10-07 11:29:05.306393] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.196 [2024-10-07 11:29:05.306522] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.196 [2024-10-07 11:29:05.306545] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.196 [2024-10-07 11:29:05.316194] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.196 [2024-10-07 11:29:05.316241] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.196 [2024-10-07 11:29:05.316340] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.196 [2024-10-07 11:29:05.316368] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.196 [2024-10-07 11:29:05.316385] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.196 [2024-10-07 11:29:05.316445] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.196 [2024-10-07 11:29:05.316470] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.196 [2024-10-07 11:29:05.316486] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.196 [2024-10-07 11:29:05.316937] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.196 [2024-10-07 11:29:05.316977] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.196 [2024-10-07 11:29:05.317201] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.196 [2024-10-07 11:29:05.317254] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.196 [2024-10-07 11:29:05.317271] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.196 [2024-10-07 11:29:05.317288] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.196 [2024-10-07 11:29:05.317303] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.196 [2024-10-07 11:29:05.317316] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.196 [2024-10-07 11:29:05.317538] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.196 [2024-10-07 11:29:05.317563] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.196 [2024-10-07 11:29:05.328815] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.196 [2024-10-07 11:29:05.328865] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.196 [2024-10-07 11:29:05.328957] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.196 [2024-10-07 11:29:05.328986] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.196 [2024-10-07 11:29:05.329003] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.196 [2024-10-07 11:29:05.329049] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.196 [2024-10-07 11:29:05.329071] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.196 [2024-10-07 11:29:05.329087] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.196 [2024-10-07 11:29:05.329670] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.196 [2024-10-07 11:29:05.329733] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.196 [2024-10-07 11:29:05.329832] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.196 [2024-10-07 11:29:05.329854] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.196 [2024-10-07 11:29:05.329868] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.196 [2024-10-07 11:29:05.329886] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.196 [2024-10-07 11:29:05.329900] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.196 [2024-10-07 11:29:05.329913] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.196 [2024-10-07 11:29:05.329936] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.196 [2024-10-07 11:29:05.329950] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.196 [2024-10-07 11:29:05.339454] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.196 [2024-10-07 11:29:05.339552] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.196 [2024-10-07 11:29:05.340364] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.196 [2024-10-07 11:29:05.340406] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.196 [2024-10-07 11:29:05.340439] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.196 [2024-10-07 11:29:05.340535] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.196 [2024-10-07 11:29:05.340565] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.196 [2024-10-07 11:29:05.340582] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.197 [2024-10-07 11:29:05.340992] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.197 [2024-10-07 11:29:05.341051] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.197 [2024-10-07 11:29:05.341104] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.197 [2024-10-07 11:29:05.341125] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.197 [2024-10-07 11:29:05.341140] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.197 [2024-10-07 11:29:05.341158] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.197 [2024-10-07 11:29:05.341172] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.197 [2024-10-07 11:29:05.341185] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.197 [2024-10-07 11:29:05.341209] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.197 [2024-10-07 11:29:05.341224] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.197 [2024-10-07 11:29:05.350001] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.197 [2024-10-07 11:29:05.350054] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.197 [2024-10-07 11:29:05.350458] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.197 [2024-10-07 11:29:05.350511] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.197 [2024-10-07 11:29:05.350547] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.197 [2024-10-07 11:29:05.350598] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.197 [2024-10-07 11:29:05.350622] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.197 [2024-10-07 11:29:05.350637] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.197 [2024-10-07 11:29:05.350784] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.197 [2024-10-07 11:29:05.350812] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.197 [2024-10-07 11:29:05.350931] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.197 [2024-10-07 11:29:05.350949] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.197 [2024-10-07 11:29:05.350961] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.197 [2024-10-07 11:29:05.350976] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.197 [2024-10-07 11:29:05.350989] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.197 [2024-10-07 11:29:05.351002] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.197 [2024-10-07 11:29:05.351049] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.197 [2024-10-07 11:29:05.351084] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.197 [2024-10-07 11:29:05.364528] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.197 [2024-10-07 11:29:05.364575] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.197 [2024-10-07 11:29:05.364672] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.197 [2024-10-07 11:29:05.364700] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.197 [2024-10-07 11:29:05.364717] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.197 [2024-10-07 11:29:05.364762] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.197 [2024-10-07 11:29:05.364783] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.197 [2024-10-07 11:29:05.364799] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.197 [2024-10-07 11:29:05.364822] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.197 [2024-10-07 11:29:05.364841] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.197 [2024-10-07 11:29:05.364860] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.197 [2024-10-07 11:29:05.364874] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.197 [2024-10-07 11:29:05.364887] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.197 [2024-10-07 11:29:05.364903] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.197 [2024-10-07 11:29:05.364916] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.197 [2024-10-07 11:29:05.364928] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.197 [2024-10-07 11:29:05.364950] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.197 [2024-10-07 11:29:05.364963] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.197 [2024-10-07 11:29:05.379801] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.197 [2024-10-07 11:29:05.379853] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.197 [2024-10-07 11:29:05.380294] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.197 [2024-10-07 11:29:05.380355] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.197 [2024-10-07 11:29:05.380374] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.197 [2024-10-07 11:29:05.380435] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.197 [2024-10-07 11:29:05.380461] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.197 [2024-10-07 11:29:05.380478] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.197 [2024-10-07 11:29:05.380694] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.197 [2024-10-07 11:29:05.380725] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.197 [2024-10-07 11:29:05.380781] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.197 [2024-10-07 11:29:05.380802] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.197 [2024-10-07 11:29:05.380836] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.197 [2024-10-07 11:29:05.380854] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.197 [2024-10-07 11:29:05.380869] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.197 [2024-10-07 11:29:05.380883] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.197 [2024-10-07 11:29:05.381056] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.197 [2024-10-07 11:29:05.381078] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.197 [2024-10-07 11:29:05.390170] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.197 [2024-10-07 11:29:05.390219] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.197 [2024-10-07 11:29:05.390401] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.197 [2024-10-07 11:29:05.390446] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.197 [2024-10-07 11:29:05.390464] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.197 [2024-10-07 11:29:05.390516] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.197 [2024-10-07 11:29:05.390539] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.197 [2024-10-07 11:29:05.390554] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.197 [2024-10-07 11:29:05.390668] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.197 [2024-10-07 11:29:05.390694] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.197 [2024-10-07 11:29:05.393310] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.197 [2024-10-07 11:29:05.393348] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.197 [2024-10-07 11:29:05.393381] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.197 [2024-10-07 11:29:05.393398] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.198 [2024-10-07 11:29:05.393413] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.198 [2024-10-07 11:29:05.393438] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.198 [2024-10-07 11:29:05.395214] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.198 [2024-10-07 11:29:05.395252] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.198 [2024-10-07 11:29:05.403064] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.198 [2024-10-07 11:29:05.403109] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.198 8831.83 IOPS, 34.50 MiB/s [2024-10-07T11:29:15.909Z] [2024-10-07 11:29:05.403320] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.198 [2024-10-07 11:29:05.403349] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.198 [2024-10-07 11:29:05.403366] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.198 [2024-10-07 11:29:05.403411] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.198 [2024-10-07 11:29:05.403464] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.198 [2024-10-07 11:29:05.403482] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.198 [2024-10-07 11:29:05.404285] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.198 [2024-10-07 11:29:05.404327] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.198 [2024-10-07 11:29:05.405137] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.198 [2024-10-07 11:29:05.405174] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.198 [2024-10-07 11:29:05.405190] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.198 [2024-10-07 11:29:05.405208] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.198 [2024-10-07 11:29:05.405222] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.198 [2024-10-07 11:29:05.405235] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.198 [2024-10-07 11:29:05.406497] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.198 [2024-10-07 11:29:05.406533] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.198 [2024-10-07 11:29:05.413424] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.198 [2024-10-07 11:29:05.413473] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.198 [2024-10-07 11:29:05.413713] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.198 [2024-10-07 11:29:05.413751] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.198 [2024-10-07 11:29:05.413769] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.198 [2024-10-07 11:29:05.413818] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.198 [2024-10-07 11:29:05.413840] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.198 [2024-10-07 11:29:05.413856] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.198 [2024-10-07 11:29:05.413911] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.198 [2024-10-07 11:29:05.413936] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.198 [2024-10-07 11:29:05.414118] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.198 [2024-10-07 11:29:05.414142] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.198 [2024-10-07 11:29:05.414156] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.198 [2024-10-07 11:29:05.414173] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.198 [2024-10-07 11:29:05.414188] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.198 [2024-10-07 11:29:05.414200] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.198 [2024-10-07 11:29:05.414257] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.198 [2024-10-07 11:29:05.414277] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.198 [2024-10-07 11:29:05.426102] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.198 [2024-10-07 11:29:05.426152] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.198 [2024-10-07 11:29:05.426262] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.198 [2024-10-07 11:29:05.426293] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.198 [2024-10-07 11:29:05.426310] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.198 [2024-10-07 11:29:05.426358] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.198 [2024-10-07 11:29:05.426380] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.198 [2024-10-07 11:29:05.426396] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.198 [2024-10-07 11:29:05.426435] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.198 [2024-10-07 11:29:05.426458] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.198 [2024-10-07 11:29:05.426477] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.198 [2024-10-07 11:29:05.426491] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.198 [2024-10-07 11:29:05.426505] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.198 [2024-10-07 11:29:05.426522] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.198 [2024-10-07 11:29:05.426536] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.198 [2024-10-07 11:29:05.426549] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.198 [2024-10-07 11:29:05.426572] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.198 [2024-10-07 11:29:05.426586] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.198 [2024-10-07 11:29:05.439669] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.198 [2024-10-07 11:29:05.439717] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.198 [2024-10-07 11:29:05.439816] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.198 [2024-10-07 11:29:05.439844] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.198 [2024-10-07 11:29:05.439860] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.198 [2024-10-07 11:29:05.439905] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.198 [2024-10-07 11:29:05.439927] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.198 [2024-10-07 11:29:05.439942] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.198 [2024-10-07 11:29:05.439964] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.198 [2024-10-07 11:29:05.439984] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.198 [2024-10-07 11:29:05.440003] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.198 [2024-10-07 11:29:05.440016] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.198 [2024-10-07 11:29:05.440046] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.198 [2024-10-07 11:29:05.440064] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.198 [2024-10-07 11:29:05.440078] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.198 [2024-10-07 11:29:05.440091] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.198 [2024-10-07 11:29:05.440114] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.198 [2024-10-07 11:29:05.440128] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.198 [2024-10-07 11:29:05.452339] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.198 [2024-10-07 11:29:05.452387] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.198 [2024-10-07 11:29:05.452485] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.198 [2024-10-07 11:29:05.452514] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.198 [2024-10-07 11:29:05.452532] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.198 [2024-10-07 11:29:05.452577] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.199 [2024-10-07 11:29:05.452600] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.199 [2024-10-07 11:29:05.452615] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.199 [2024-10-07 11:29:05.453187] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.199 [2024-10-07 11:29:05.453227] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.199 [2024-10-07 11:29:05.453318] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.199 [2024-10-07 11:29:05.453340] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.199 [2024-10-07 11:29:05.453354] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.199 [2024-10-07 11:29:05.453386] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.199 [2024-10-07 11:29:05.453400] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.199 [2024-10-07 11:29:05.453413] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.199 [2024-10-07 11:29:05.453449] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.199 [2024-10-07 11:29:05.453467] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.199 [2024-10-07 11:29:05.462666] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.199 [2024-10-07 11:29:05.462825] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.199 [2024-10-07 11:29:05.462903] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.199 [2024-10-07 11:29:05.462930] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.199 [2024-10-07 11:29:05.462947] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.199 [2024-10-07 11:29:05.463302] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.199 [2024-10-07 11:29:05.463342] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.199 [2024-10-07 11:29:05.463380] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.199 [2024-10-07 11:29:05.463402] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.199 [2024-10-07 11:29:05.465423] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.199 [2024-10-07 11:29:05.465474] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.199 [2024-10-07 11:29:05.465506] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.199 [2024-10-07 11:29:05.465520] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.199 [2024-10-07 11:29:05.466357] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.199 [2024-10-07 11:29:05.466392] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.199 [2024-10-07 11:29:05.466446] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.199 [2024-10-07 11:29:05.466462] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.199 [2024-10-07 11:29:05.466581] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.199 [2024-10-07 11:29:05.476559] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.199 [2024-10-07 11:29:05.476610] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.199 [2024-10-07 11:29:05.476786] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.199 [2024-10-07 11:29:05.476816] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.199 [2024-10-07 11:29:05.476834] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.199 [2024-10-07 11:29:05.476881] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.199 [2024-10-07 11:29:05.476904] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.199 [2024-10-07 11:29:05.476921] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.199 [2024-10-07 11:29:05.478399] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.199 [2024-10-07 11:29:05.478463] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.199 [2024-10-07 11:29:05.480102] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.199 [2024-10-07 11:29:05.480139] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.199 [2024-10-07 11:29:05.480173] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.199 [2024-10-07 11:29:05.480191] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.199 [2024-10-07 11:29:05.480206] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.199 [2024-10-07 11:29:05.480219] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.199 [2024-10-07 11:29:05.480733] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.199 [2024-10-07 11:29:05.480760] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.199 [2024-10-07 11:29:05.487758] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.199 [2024-10-07 11:29:05.487808] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.199 [2024-10-07 11:29:05.487913] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.199 [2024-10-07 11:29:05.487942] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.199 [2024-10-07 11:29:05.487959] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.199 [2024-10-07 11:29:05.488006] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.199 [2024-10-07 11:29:05.488029] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.199 [2024-10-07 11:29:05.488045] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.199 [2024-10-07 11:29:05.490269] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.199 [2024-10-07 11:29:05.490314] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.199 [2024-10-07 11:29:05.490857] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.199 [2024-10-07 11:29:05.490894] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.199 [2024-10-07 11:29:05.490910] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.199 [2024-10-07 11:29:05.490928] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.199 [2024-10-07 11:29:05.490942] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.199 [2024-10-07 11:29:05.490955] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.199 [2024-10-07 11:29:05.491387] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.199 [2024-10-07 11:29:05.491427] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.199 [2024-10-07 11:29:05.501144] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.199 [2024-10-07 11:29:05.501192] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.199 [2024-10-07 11:29:05.501292] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.199 [2024-10-07 11:29:05.501320] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.199 [2024-10-07 11:29:05.501337] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.199 [2024-10-07 11:29:05.501381] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.199 [2024-10-07 11:29:05.501402] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.199 [2024-10-07 11:29:05.501417] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.199 [2024-10-07 11:29:05.501473] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.199 [2024-10-07 11:29:05.501493] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.199 [2024-10-07 11:29:05.501764] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.199 [2024-10-07 11:29:05.501790] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.199 [2024-10-07 11:29:05.501806] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.199 [2024-10-07 11:29:05.501838] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.199 [2024-10-07 11:29:05.501866] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.199 [2024-10-07 11:29:05.501880] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.199 [2024-10-07 11:29:05.502072] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.199 [2024-10-07 11:29:05.502096] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.199 [2024-10-07 11:29:05.511267] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.199 [2024-10-07 11:29:05.511348] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.199 [2024-10-07 11:29:05.511440] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.199 [2024-10-07 11:29:05.511470] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.199 [2024-10-07 11:29:05.511487] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.199 [2024-10-07 11:29:05.511543] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.199 [2024-10-07 11:29:05.511566] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.199 [2024-10-07 11:29:05.511581] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.199 [2024-10-07 11:29:05.511599] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.199 [2024-10-07 11:29:05.511624] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.199 [2024-10-07 11:29:05.511641] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.200 [2024-10-07 11:29:05.511654] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.200 [2024-10-07 11:29:05.511668] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.200 [2024-10-07 11:29:05.511691] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.200 [2024-10-07 11:29:05.511706] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.200 [2024-10-07 11:29:05.511719] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.200 [2024-10-07 11:29:05.511732] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.200 [2024-10-07 11:29:05.511752] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.200 [2024-10-07 11:29:05.523533] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.200 [2024-10-07 11:29:05.523580] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.200 [2024-10-07 11:29:05.523680] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.200 [2024-10-07 11:29:05.523708] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.200 [2024-10-07 11:29:05.523725] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.200 [2024-10-07 11:29:05.523770] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.200 [2024-10-07 11:29:05.523792] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.200 [2024-10-07 11:29:05.523806] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.200 [2024-10-07 11:29:05.523845] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.200 [2024-10-07 11:29:05.523865] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.200 [2024-10-07 11:29:05.523884] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.200 [2024-10-07 11:29:05.523898] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.200 [2024-10-07 11:29:05.523911] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.200 [2024-10-07 11:29:05.523927] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.200 [2024-10-07 11:29:05.523941] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.200 [2024-10-07 11:29:05.523953] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.200 [2024-10-07 11:29:05.524006] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.200 [2024-10-07 11:29:05.524040] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.200 [2024-10-07 11:29:05.535327] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.200 [2024-10-07 11:29:05.535375] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.200 [2024-10-07 11:29:05.535954] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.200 [2024-10-07 11:29:05.536010] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.200 [2024-10-07 11:29:05.536028] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.200 [2024-10-07 11:29:05.536075] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.200 [2024-10-07 11:29:05.536097] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.200 [2024-10-07 11:29:05.536111] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.200 [2024-10-07 11:29:05.538346] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.200 [2024-10-07 11:29:05.538390] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.200 [2024-10-07 11:29:05.538712] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.200 [2024-10-07 11:29:05.538750] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.200 [2024-10-07 11:29:05.538767] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.200 [2024-10-07 11:29:05.538784] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.200 [2024-10-07 11:29:05.538798] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.200 [2024-10-07 11:29:05.538811] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.200 [2024-10-07 11:29:05.538968] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.200 [2024-10-07 11:29:05.538990] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.200 [2024-10-07 11:29:05.545805] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.200 [2024-10-07 11:29:05.545850] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.200 [2024-10-07 11:29:05.545944] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.200 [2024-10-07 11:29:05.546018] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.200 [2024-10-07 11:29:05.546037] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.200 [2024-10-07 11:29:05.546089] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.200 [2024-10-07 11:29:05.546112] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.200 [2024-10-07 11:29:05.546128] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.200 [2024-10-07 11:29:05.546152] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.200 [2024-10-07 11:29:05.546172] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.200 [2024-10-07 11:29:05.546192] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.200 [2024-10-07 11:29:05.546206] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.200 [2024-10-07 11:29:05.546219] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.200 [2024-10-07 11:29:05.546235] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.200 [2024-10-07 11:29:05.546250] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.200 [2024-10-07 11:29:05.546262] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.200 [2024-10-07 11:29:05.546316] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.200 [2024-10-07 11:29:05.546329] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.200 [2024-10-07 11:29:05.557507] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.200 [2024-10-07 11:29:05.557557] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.200 [2024-10-07 11:29:05.557908] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.200 [2024-10-07 11:29:05.557949] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.200 [2024-10-07 11:29:05.558005] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.200 [2024-10-07 11:29:05.558057] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.200 [2024-10-07 11:29:05.558080] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.200 [2024-10-07 11:29:05.558096] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.200 [2024-10-07 11:29:05.558775] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.200 [2024-10-07 11:29:05.558830] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.200 [2024-10-07 11:29:05.559388] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.200 [2024-10-07 11:29:05.559466] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.200 [2024-10-07 11:29:05.559484] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.200 [2024-10-07 11:29:05.559502] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.200 [2024-10-07 11:29:05.559516] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.200 [2024-10-07 11:29:05.559547] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.200 [2024-10-07 11:29:05.559845] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.200 [2024-10-07 11:29:05.559869] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.200 [2024-10-07 11:29:05.568400] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.200 [2024-10-07 11:29:05.568454] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.200 [2024-10-07 11:29:05.571076] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.200 [2024-10-07 11:29:05.571137] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.200 [2024-10-07 11:29:05.571156] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.200 [2024-10-07 11:29:05.571202] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.200 [2024-10-07 11:29:05.571223] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.200 [2024-10-07 11:29:05.571237] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.200 [2024-10-07 11:29:05.571607] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.200 [2024-10-07 11:29:05.571639] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.200 [2024-10-07 11:29:05.572141] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.200 [2024-10-07 11:29:05.572172] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.200 [2024-10-07 11:29:05.572204] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.200 [2024-10-07 11:29:05.572220] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.201 [2024-10-07 11:29:05.572234] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.201 [2024-10-07 11:29:05.572246] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.201 [2024-10-07 11:29:05.573290] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.201 [2024-10-07 11:29:05.573339] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.201 [2024-10-07 11:29:05.578533] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.201 [2024-10-07 11:29:05.578610] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.201 [2024-10-07 11:29:05.578685] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.201 [2024-10-07 11:29:05.578713] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.201 [2024-10-07 11:29:05.578729] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.201 [2024-10-07 11:29:05.578783] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.201 [2024-10-07 11:29:05.578806] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.201 [2024-10-07 11:29:05.578837] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.201 [2024-10-07 11:29:05.578854] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.201 [2024-10-07 11:29:05.578897] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.201 [2024-10-07 11:29:05.578915] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.201 [2024-10-07 11:29:05.578928] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.201 [2024-10-07 11:29:05.578941] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.201 [2024-10-07 11:29:05.578963] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.201 [2024-10-07 11:29:05.578977] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.201 [2024-10-07 11:29:05.578990] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.201 [2024-10-07 11:29:05.579003] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.201 [2024-10-07 11:29:05.579022] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.201 [2024-10-07 11:29:05.589895] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.201 [2024-10-07 11:29:05.589984] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.201 [2024-10-07 11:29:05.590271] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.201 [2024-10-07 11:29:05.590343] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.201 [2024-10-07 11:29:05.590378] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.201 [2024-10-07 11:29:05.590438] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.201 [2024-10-07 11:29:05.590476] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.201 [2024-10-07 11:29:05.590494] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.201 [2024-10-07 11:29:05.590552] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.201 [2024-10-07 11:29:05.590578] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.201 [2024-10-07 11:29:05.590599] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.201 [2024-10-07 11:29:05.590613] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.201 [2024-10-07 11:29:05.590628] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.201 [2024-10-07 11:29:05.590644] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.201 [2024-10-07 11:29:05.590658] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.201 [2024-10-07 11:29:05.590671] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.201 [2024-10-07 11:29:05.590694] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.201 [2024-10-07 11:29:05.590708] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.201 [2024-10-07 11:29:05.601529] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.201 [2024-10-07 11:29:05.601575] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.201 [2024-10-07 11:29:05.601812] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.201 [2024-10-07 11:29:05.601848] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.201 [2024-10-07 11:29:05.601880] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.201 [2024-10-07 11:29:05.601929] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.201 [2024-10-07 11:29:05.601952] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.201 [2024-10-07 11:29:05.601994] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.201 [2024-10-07 11:29:05.602126] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.201 [2024-10-07 11:29:05.602153] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.201 [2024-10-07 11:29:05.602280] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.201 [2024-10-07 11:29:05.602314] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.201 [2024-10-07 11:29:05.602328] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.201 [2024-10-07 11:29:05.602344] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.201 [2024-10-07 11:29:05.602357] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.201 [2024-10-07 11:29:05.602369] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.201 [2024-10-07 11:29:05.602500] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.201 [2024-10-07 11:29:05.602522] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.201 [2024-10-07 11:29:05.611647] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.201 [2024-10-07 11:29:05.611722] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.201 [2024-10-07 11:29:05.611792] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.201 [2024-10-07 11:29:05.611851] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.201 [2024-10-07 11:29:05.611868] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.201 [2024-10-07 11:29:05.611921] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.201 [2024-10-07 11:29:05.611944] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.201 [2024-10-07 11:29:05.611960] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.201 [2024-10-07 11:29:05.611978] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.201 [2024-10-07 11:29:05.612002] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.201 [2024-10-07 11:29:05.612018] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.201 [2024-10-07 11:29:05.612032] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.201 [2024-10-07 11:29:05.612046] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.201 [2024-10-07 11:29:05.612069] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.201 [2024-10-07 11:29:05.612083] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.201 [2024-10-07 11:29:05.612096] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.201 [2024-10-07 11:29:05.612125] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.201 [2024-10-07 11:29:05.612362] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.201 [2024-10-07 11:29:05.622644] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.201 [2024-10-07 11:29:05.622693] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.201 [2024-10-07 11:29:05.623740] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.201 [2024-10-07 11:29:05.623783] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.201 [2024-10-07 11:29:05.623803] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.201 [2024-10-07 11:29:05.623851] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.201 [2024-10-07 11:29:05.623874] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.201 [2024-10-07 11:29:05.623889] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.201 [2024-10-07 11:29:05.624104] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.201 [2024-10-07 11:29:05.624137] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.201 [2024-10-07 11:29:05.624183] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.201 [2024-10-07 11:29:05.624205] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.201 [2024-10-07 11:29:05.624219] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.201 [2024-10-07 11:29:05.624236] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.201 [2024-10-07 11:29:05.624250] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.201 [2024-10-07 11:29:05.624264] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.201 [2024-10-07 11:29:05.624287] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.201 [2024-10-07 11:29:05.624301] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.201 [2024-10-07 11:29:05.633144] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.201 [2024-10-07 11:29:05.633208] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.201 [2024-10-07 11:29:05.633308] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.201 [2024-10-07 11:29:05.633337] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.202 [2024-10-07 11:29:05.633354] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.202 [2024-10-07 11:29:05.633401] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.202 [2024-10-07 11:29:05.633423] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.202 [2024-10-07 11:29:05.633454] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.202 [2024-10-07 11:29:05.633479] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.202 [2024-10-07 11:29:05.633499] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.202 [2024-10-07 11:29:05.633540] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.202 [2024-10-07 11:29:05.633555] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.202 [2024-10-07 11:29:05.633569] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.202 [2024-10-07 11:29:05.633585] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.202 [2024-10-07 11:29:05.633599] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.202 [2024-10-07 11:29:05.633613] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.202 [2024-10-07 11:29:05.633799] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.202 [2024-10-07 11:29:05.633827] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.202 [2024-10-07 11:29:05.646453] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.202 [2024-10-07 11:29:05.646501] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.202 [2024-10-07 11:29:05.646658] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.202 [2024-10-07 11:29:05.646688] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.202 [2024-10-07 11:29:05.646706] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.202 [2024-10-07 11:29:05.646752] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.202 [2024-10-07 11:29:05.646775] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.202 [2024-10-07 11:29:05.646791] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.202 [2024-10-07 11:29:05.646816] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.202 [2024-10-07 11:29:05.646835] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.202 [2024-10-07 11:29:05.646855] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.202 [2024-10-07 11:29:05.646869] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.202 [2024-10-07 11:29:05.646882] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.202 [2024-10-07 11:29:05.646898] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.202 [2024-10-07 11:29:05.646912] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.202 [2024-10-07 11:29:05.646925] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.202 [2024-10-07 11:29:05.646948] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.202 [2024-10-07 11:29:05.646962] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.202 [2024-10-07 11:29:05.661760] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.202 [2024-10-07 11:29:05.661809] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.202 [2024-10-07 11:29:05.661909] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.202 [2024-10-07 11:29:05.661938] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.202 [2024-10-07 11:29:05.661954] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.202 [2024-10-07 11:29:05.662046] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.202 [2024-10-07 11:29:05.662070] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.202 [2024-10-07 11:29:05.662091] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.202 [2024-10-07 11:29:05.662116] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.202 [2024-10-07 11:29:05.662135] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.202 [2024-10-07 11:29:05.662155] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.202 [2024-10-07 11:29:05.662169] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.202 [2024-10-07 11:29:05.662183] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.202 [2024-10-07 11:29:05.662200] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.202 [2024-10-07 11:29:05.662214] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.202 [2024-10-07 11:29:05.662227] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.202 [2024-10-07 11:29:05.662249] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.202 [2024-10-07 11:29:05.662263] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.202 [2024-10-07 11:29:05.673624] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.202 [2024-10-07 11:29:05.673673] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.202 [2024-10-07 11:29:05.673756] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.202 [2024-10-07 11:29:05.673785] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.202 [2024-10-07 11:29:05.673802] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.202 [2024-10-07 11:29:05.673848] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.202 [2024-10-07 11:29:05.673870] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.202 [2024-10-07 11:29:05.673891] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.202 [2024-10-07 11:29:05.673915] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.202 [2024-10-07 11:29:05.673934] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.202 [2024-10-07 11:29:05.673954] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.202 [2024-10-07 11:29:05.673979] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.202 [2024-10-07 11:29:05.673993] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.202 [2024-10-07 11:29:05.674008] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.202 [2024-10-07 11:29:05.674022] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.202 [2024-10-07 11:29:05.674035] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.202 [2024-10-07 11:29:05.674058] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.202 [2024-10-07 11:29:05.674087] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.202 [2024-10-07 11:29:05.686899] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.202 [2024-10-07 11:29:05.686950] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.202 [2024-10-07 11:29:05.687582] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.202 [2024-10-07 11:29:05.687637] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.202 [2024-10-07 11:29:05.687656] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.202 [2024-10-07 11:29:05.687704] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.202 [2024-10-07 11:29:05.687726] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.202 [2024-10-07 11:29:05.687741] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.202 [2024-10-07 11:29:05.689314] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.202 [2024-10-07 11:29:05.689357] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.202 [2024-10-07 11:29:05.689569] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.202 [2024-10-07 11:29:05.689596] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.202 [2024-10-07 11:29:05.689610] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.202 [2024-10-07 11:29:05.689628] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.202 [2024-10-07 11:29:05.689642] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.202 [2024-10-07 11:29:05.689655] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.202 [2024-10-07 11:29:05.689709] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.202 [2024-10-07 11:29:05.689729] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.202 [2024-10-07 11:29:05.697392] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.202 [2024-10-07 11:29:05.697479] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.202 [2024-10-07 11:29:05.697555] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.202 [2024-10-07 11:29:05.697583] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.202 [2024-10-07 11:29:05.697600] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.202 [2024-10-07 11:29:05.697654] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.202 [2024-10-07 11:29:05.697677] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.202 [2024-10-07 11:29:05.697693] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.202 [2024-10-07 11:29:05.697711] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.202 [2024-10-07 11:29:05.697739] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.203 [2024-10-07 11:29:05.697774] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.203 [2024-10-07 11:29:05.697813] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.203 [2024-10-07 11:29:05.697833] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.203 [2024-10-07 11:29:05.697863] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.203 [2024-10-07 11:29:05.697881] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.203 [2024-10-07 11:29:05.697900] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.203 [2024-10-07 11:29:05.697918] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.203 [2024-10-07 11:29:05.697943] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.203 [2024-10-07 11:29:05.711636] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.203 [2024-10-07 11:29:05.711702] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.203 [2024-10-07 11:29:05.712365] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.203 [2024-10-07 11:29:05.712421] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.203 [2024-10-07 11:29:05.712452] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.203 [2024-10-07 11:29:05.712504] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.203 [2024-10-07 11:29:05.712527] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.203 [2024-10-07 11:29:05.712543] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.203 [2024-10-07 11:29:05.712905] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.203 [2024-10-07 11:29:05.712938] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.203 [2024-10-07 11:29:05.713002] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.203 [2024-10-07 11:29:05.713023] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.203 [2024-10-07 11:29:05.713037] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.203 [2024-10-07 11:29:05.713054] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.203 [2024-10-07 11:29:05.713069] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.203 [2024-10-07 11:29:05.713082] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.203 [2024-10-07 11:29:05.713252] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.203 [2024-10-07 11:29:05.713274] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.203 [2024-10-07 11:29:05.721830] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.203 [2024-10-07 11:29:05.721928] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.203 [2024-10-07 11:29:05.722012] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.203 [2024-10-07 11:29:05.722041] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.203 [2024-10-07 11:29:05.722058] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.203 [2024-10-07 11:29:05.724667] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.203 [2024-10-07 11:29:05.724747] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.203 [2024-10-07 11:29:05.724778] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.203 [2024-10-07 11:29:05.724807] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.203 [2024-10-07 11:29:05.725569] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.203 [2024-10-07 11:29:05.725611] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.203 [2024-10-07 11:29:05.725628] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.203 [2024-10-07 11:29:05.725643] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.203 [2024-10-07 11:29:05.725993] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.203 [2024-10-07 11:29:05.726023] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.203 [2024-10-07 11:29:05.726037] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.203 [2024-10-07 11:29:05.726052] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.203 [2024-10-07 11:29:05.726356] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.203 [2024-10-07 11:29:05.732179] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.203 [2024-10-07 11:29:05.732324] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.203 [2024-10-07 11:29:05.732405] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.203 [2024-10-07 11:29:05.732447] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.203 [2024-10-07 11:29:05.732465] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.203 [2024-10-07 11:29:05.732892] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.203 [2024-10-07 11:29:05.732933] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.203 [2024-10-07 11:29:05.732951] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.203 [2024-10-07 11:29:05.732970] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.203 [2024-10-07 11:29:05.733201] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.203 [2024-10-07 11:29:05.733241] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.203 [2024-10-07 11:29:05.733258] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.203 [2024-10-07 11:29:05.733272] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.203 [2024-10-07 11:29:05.733333] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.203 [2024-10-07 11:29:05.733354] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.203 [2024-10-07 11:29:05.733369] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.203 [2024-10-07 11:29:05.733382] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.203 [2024-10-07 11:29:05.733404] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.203 [2024-10-07 11:29:05.742259] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.203 [2024-10-07 11:29:05.742363] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.203 [2024-10-07 11:29:05.742392] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.203 [2024-10-07 11:29:05.742421] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.203 [2024-10-07 11:29:05.742449] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.203 [2024-10-07 11:29:05.742484] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.203 [2024-10-07 11:29:05.742502] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.203 [2024-10-07 11:29:05.742517] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.203 [2024-10-07 11:29:05.742541] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.203 [2024-10-07 11:29:05.742560] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.203 [2024-10-07 11:29:05.742622] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.203 [2024-10-07 11:29:05.742647] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.203 [2024-10-07 11:29:05.742664] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.203 [2024-10-07 11:29:05.742686] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.203 [2024-10-07 11:29:05.742708] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.203 [2024-10-07 11:29:05.742722] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.203 [2024-10-07 11:29:05.742735] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.203 [2024-10-07 11:29:05.742757] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.203 [2024-10-07 11:29:05.752600] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.203 [2024-10-07 11:29:05.752818] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.203 [2024-10-07 11:29:05.752850] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.203 [2024-10-07 11:29:05.752868] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.203 [2024-10-07 11:29:05.752981] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.203 [2024-10-07 11:29:05.753017] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.203 [2024-10-07 11:29:05.753157] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.204 [2024-10-07 11:29:05.753214] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.204 [2024-10-07 11:29:05.753232] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.204 [2024-10-07 11:29:05.753247] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.204 [2024-10-07 11:29:05.753260] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.204 [2024-10-07 11:29:05.753273] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.204 [2024-10-07 11:29:05.753881] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.204 [2024-10-07 11:29:05.753938] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.204 [2024-10-07 11:29:05.757954] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.204 [2024-10-07 11:29:05.758002] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.204 [2024-10-07 11:29:05.758019] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.204 [2024-10-07 11:29:05.758557] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.204 [2024-10-07 11:29:05.763393] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.204 [2024-10-07 11:29:05.763447] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.204 [2024-10-07 11:29:05.763532] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.204 [2024-10-07 11:29:05.763560] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.204 [2024-10-07 11:29:05.763577] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.204 [2024-10-07 11:29:05.763623] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.204 [2024-10-07 11:29:05.763645] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.204 [2024-10-07 11:29:05.763661] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.204 [2024-10-07 11:29:05.763684] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.204 [2024-10-07 11:29:05.763704] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.204 [2024-10-07 11:29:05.763723] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.204 [2024-10-07 11:29:05.763737] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.204 [2024-10-07 11:29:05.763751] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.204 [2024-10-07 11:29:05.763767] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.204 [2024-10-07 11:29:05.763780] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.204 [2024-10-07 11:29:05.763793] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.204 [2024-10-07 11:29:05.763816] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.204 [2024-10-07 11:29:05.763829] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.204 [2024-10-07 11:29:05.773519] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.204 [2024-10-07 11:29:05.773594] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.204 [2024-10-07 11:29:05.773666] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.204 [2024-10-07 11:29:05.773694] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.204 [2024-10-07 11:29:05.773710] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.204 [2024-10-07 11:29:05.773762] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.204 [2024-10-07 11:29:05.773784] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.204 [2024-10-07 11:29:05.773835] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.204 [2024-10-07 11:29:05.773854] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.204 [2024-10-07 11:29:05.773878] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.204 [2024-10-07 11:29:05.773895] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.204 [2024-10-07 11:29:05.773909] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.204 [2024-10-07 11:29:05.773922] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.204 [2024-10-07 11:29:05.773945] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.204 [2024-10-07 11:29:05.773970] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.204 [2024-10-07 11:29:05.773985] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.204 [2024-10-07 11:29:05.773999] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.204 [2024-10-07 11:29:05.774020] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.204 [2024-10-07 11:29:05.786116] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.204 [2024-10-07 11:29:05.786177] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.204 [2024-10-07 11:29:05.786545] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.204 [2024-10-07 11:29:05.786601] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.204 [2024-10-07 11:29:05.786626] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.204 [2024-10-07 11:29:05.786689] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.204 [2024-10-07 11:29:05.786716] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.204 [2024-10-07 11:29:05.786732] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.204 [2024-10-07 11:29:05.786785] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.204 [2024-10-07 11:29:05.786811] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.204 [2024-10-07 11:29:05.786831] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.204 [2024-10-07 11:29:05.786846] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.204 [2024-10-07 11:29:05.786860] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.204 [2024-10-07 11:29:05.786876] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.204 [2024-10-07 11:29:05.786891] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.204 [2024-10-07 11:29:05.786904] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.204 [2024-10-07 11:29:05.786927] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.204 [2024-10-07 11:29:05.786942] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.204 [2024-10-07 11:29:05.800094] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.204 [2024-10-07 11:29:05.800170] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.204 [2024-10-07 11:29:05.800256] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.204 [2024-10-07 11:29:05.800285] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.204 [2024-10-07 11:29:05.800302] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.204 [2024-10-07 11:29:05.800348] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.204 [2024-10-07 11:29:05.800370] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.204 [2024-10-07 11:29:05.800386] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.204 [2024-10-07 11:29:05.800422] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.204 [2024-10-07 11:29:05.800446] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.204 [2024-10-07 11:29:05.800466] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.204 [2024-10-07 11:29:05.800481] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.204 [2024-10-07 11:29:05.800494] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.204 [2024-10-07 11:29:05.800510] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.204 [2024-10-07 11:29:05.800524] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.204 [2024-10-07 11:29:05.800537] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.204 [2024-10-07 11:29:05.800559] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.204 [2024-10-07 11:29:05.800572] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.204 [2024-10-07 11:29:05.813832] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.204 [2024-10-07 11:29:05.813899] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.204 [2024-10-07 11:29:05.814011] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.204 [2024-10-07 11:29:05.814040] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.204 [2024-10-07 11:29:05.814058] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.204 [2024-10-07 11:29:05.814104] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.204 [2024-10-07 11:29:05.814127] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.204 [2024-10-07 11:29:05.814151] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.204 [2024-10-07 11:29:05.814176] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.205 [2024-10-07 11:29:05.814195] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.205 [2024-10-07 11:29:05.814215] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.205 [2024-10-07 11:29:05.814229] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.205 [2024-10-07 11:29:05.814243] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.205 [2024-10-07 11:29:05.814259] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.205 [2024-10-07 11:29:05.814292] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.205 [2024-10-07 11:29:05.814306] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.205 [2024-10-07 11:29:05.814330] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.205 [2024-10-07 11:29:05.814345] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.205 [2024-10-07 11:29:05.825625] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.205 [2024-10-07 11:29:05.828024] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.205 [2024-10-07 11:29:05.828142] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.205 [2024-10-07 11:29:05.828173] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.205 [2024-10-07 11:29:05.828190] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.205 [2024-10-07 11:29:05.828555] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.205 [2024-10-07 11:29:05.828597] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.205 [2024-10-07 11:29:05.828616] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.205 [2024-10-07 11:29:05.828635] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.205 [2024-10-07 11:29:05.828765] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.205 [2024-10-07 11:29:05.828791] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.205 [2024-10-07 11:29:05.828806] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.205 [2024-10-07 11:29:05.828820] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.205 [2024-10-07 11:29:05.828999] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.205 [2024-10-07 11:29:05.829023] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.205 [2024-10-07 11:29:05.829038] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.205 [2024-10-07 11:29:05.829052] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.205 [2024-10-07 11:29:05.829102] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.205 [2024-10-07 11:29:05.838889] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.205 [2024-10-07 11:29:05.839906] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.205 [2024-10-07 11:29:05.840031] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.205 [2024-10-07 11:29:05.840059] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.205 [2024-10-07 11:29:05.840080] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.205 [2024-10-07 11:29:05.840282] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.205 [2024-10-07 11:29:05.840310] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.205 [2024-10-07 11:29:05.840326] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.205 [2024-10-07 11:29:05.840378] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.205 [2024-10-07 11:29:05.840535] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.205 [2024-10-07 11:29:05.840562] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.205 [2024-10-07 11:29:05.840576] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.205 [2024-10-07 11:29:05.840590] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.205 [2024-10-07 11:29:05.840639] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.205 [2024-10-07 11:29:05.840659] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.205 [2024-10-07 11:29:05.840671] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.205 [2024-10-07 11:29:05.840684] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.205 [2024-10-07 11:29:05.840704] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.205 [2024-10-07 11:29:05.851907] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.205 [2024-10-07 11:29:05.851970] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.205 [2024-10-07 11:29:05.853180] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.205 [2024-10-07 11:29:05.853235] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.205 [2024-10-07 11:29:05.853254] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.205 [2024-10-07 11:29:05.853300] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.205 [2024-10-07 11:29:05.853323] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.205 [2024-10-07 11:29:05.853337] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.205 [2024-10-07 11:29:05.853933] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.205 [2024-10-07 11:29:05.853998] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.205 [2024-10-07 11:29:05.854366] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.205 [2024-10-07 11:29:05.854399] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.205 [2024-10-07 11:29:05.854451] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.205 [2024-10-07 11:29:05.854471] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.205 [2024-10-07 11:29:05.854485] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.205 [2024-10-07 11:29:05.854498] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.205 [2024-10-07 11:29:05.854706] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.205 [2024-10-07 11:29:05.854730] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.205 [2024-10-07 11:29:05.862529] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.205 [2024-10-07 11:29:05.862583] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.205 [2024-10-07 11:29:05.862799] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.205 [2024-10-07 11:29:05.862848] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.205 [2024-10-07 11:29:05.862867] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.205 [2024-10-07 11:29:05.862926] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.205 [2024-10-07 11:29:05.862949] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.205 [2024-10-07 11:29:05.862965] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.205 [2024-10-07 11:29:05.863097] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.205 [2024-10-07 11:29:05.863126] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.205 [2024-10-07 11:29:05.863278] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.205 [2024-10-07 11:29:05.863302] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.205 [2024-10-07 11:29:05.863316] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.205 [2024-10-07 11:29:05.863341] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.205 [2024-10-07 11:29:05.863368] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.205 [2024-10-07 11:29:05.863393] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.205 [2024-10-07 11:29:05.863546] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.205 [2024-10-07 11:29:05.863569] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.206 [2024-10-07 11:29:05.874443] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.206 [2024-10-07 11:29:05.874492] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.206 [2024-10-07 11:29:05.874607] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.206 [2024-10-07 11:29:05.874637] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.206 [2024-10-07 11:29:05.874665] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.206 [2024-10-07 11:29:05.874711] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.206 [2024-10-07 11:29:05.874734] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.206 [2024-10-07 11:29:05.874750] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.206 [2024-10-07 11:29:05.874774] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.206 [2024-10-07 11:29:05.874793] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.206 [2024-10-07 11:29:05.874813] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.206 [2024-10-07 11:29:05.874827] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.206 [2024-10-07 11:29:05.874841] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.206 [2024-10-07 11:29:05.874857] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.206 [2024-10-07 11:29:05.874871] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.206 [2024-10-07 11:29:05.874902] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.206 [2024-10-07 11:29:05.874928] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.206 [2024-10-07 11:29:05.874943] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.206 [2024-10-07 11:29:05.884883] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.206 [2024-10-07 11:29:05.884934] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.206 [2024-10-07 11:29:05.885095] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.206 [2024-10-07 11:29:05.885125] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.206 [2024-10-07 11:29:05.885142] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.206 [2024-10-07 11:29:05.885188] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.206 [2024-10-07 11:29:05.885210] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.206 [2024-10-07 11:29:05.885226] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.206 [2024-10-07 11:29:05.885263] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.206 [2024-10-07 11:29:05.885286] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.206 [2024-10-07 11:29:05.885306] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.206 [2024-10-07 11:29:05.885320] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.206 [2024-10-07 11:29:05.885334] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.206 [2024-10-07 11:29:05.885349] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.206 [2024-10-07 11:29:05.885364] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.206 [2024-10-07 11:29:05.885377] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.206 [2024-10-07 11:29:05.885400] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.206 [2024-10-07 11:29:05.885428] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.206 [2024-10-07 11:29:05.894994] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.206 [2024-10-07 11:29:05.895056] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.206 [2024-10-07 11:29:05.895131] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.206 [2024-10-07 11:29:05.895159] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.206 [2024-10-07 11:29:05.895175] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.206 [2024-10-07 11:29:05.895227] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.206 [2024-10-07 11:29:05.895250] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.206 [2024-10-07 11:29:05.895266] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.206 [2024-10-07 11:29:05.895284] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.206 [2024-10-07 11:29:05.895478] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.206 [2024-10-07 11:29:05.895508] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.206 [2024-10-07 11:29:05.895525] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.206 [2024-10-07 11:29:05.895538] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.206 [2024-10-07 11:29:05.895684] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.206 [2024-10-07 11:29:05.895708] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.206 [2024-10-07 11:29:05.895721] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.206 [2024-10-07 11:29:05.895735] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.206 [2024-10-07 11:29:05.895851] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.206 [2024-10-07 11:29:05.906291] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.206 [2024-10-07 11:29:05.906340] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.206 [2024-10-07 11:29:05.906666] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.206 [2024-10-07 11:29:05.906701] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.206 [2024-10-07 11:29:05.906719] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.206 [2024-10-07 11:29:05.906765] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.206 [2024-10-07 11:29:05.906788] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.206 [2024-10-07 11:29:05.906804] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.206 [2024-10-07 11:29:05.906938] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.206 [2024-10-07 11:29:05.906966] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.206 [2024-10-07 11:29:05.907081] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.206 [2024-10-07 11:29:05.907102] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.206 [2024-10-07 11:29:05.907116] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.206 [2024-10-07 11:29:05.907133] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.206 [2024-10-07 11:29:05.907147] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.206 [2024-10-07 11:29:05.907160] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.206 [2024-10-07 11:29:05.907273] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.206 [2024-10-07 11:29:05.907293] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.206 [2024-10-07 11:29:05.916401] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.206 [2024-10-07 11:29:05.916476] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.206 [2024-10-07 11:29:05.916550] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.206 [2024-10-07 11:29:05.916578] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.206 [2024-10-07 11:29:05.916611] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.206 [2024-10-07 11:29:05.916679] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.206 [2024-10-07 11:29:05.916703] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.206 [2024-10-07 11:29:05.916719] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.206 [2024-10-07 11:29:05.916737] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.206 [2024-10-07 11:29:05.916761] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.206 [2024-10-07 11:29:05.916778] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.206 [2024-10-07 11:29:05.916791] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.206 [2024-10-07 11:29:05.916804] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.206 [2024-10-07 11:29:05.916828] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.206 [2024-10-07 11:29:05.916842] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.206 [2024-10-07 11:29:05.916855] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.206 [2024-10-07 11:29:05.916868] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.206 [2024-10-07 11:29:05.916889] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.206 [2024-10-07 11:29:05.927492] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.206 [2024-10-07 11:29:05.927547] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.206 [2024-10-07 11:29:05.927692] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.206 [2024-10-07 11:29:05.927737] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.206 [2024-10-07 11:29:05.927764] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.206 [2024-10-07 11:29:05.927818] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.206 [2024-10-07 11:29:05.927841] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.207 [2024-10-07 11:29:05.927857] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.207 [2024-10-07 11:29:05.927882] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.207 [2024-10-07 11:29:05.927902] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.207 [2024-10-07 11:29:05.927922] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.207 [2024-10-07 11:29:05.927937] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.207 [2024-10-07 11:29:05.927951] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.207 [2024-10-07 11:29:05.927968] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.207 [2024-10-07 11:29:05.927982] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.207 [2024-10-07 11:29:05.927995] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.207 [2024-10-07 11:29:05.928034] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.207 [2024-10-07 11:29:05.928050] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.207 [2024-10-07 11:29:05.937733] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.207 [2024-10-07 11:29:05.937782] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.207 [2024-10-07 11:29:05.940073] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.207 [2024-10-07 11:29:05.940120] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.207 [2024-10-07 11:29:05.940139] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.207 [2024-10-07 11:29:05.940189] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.207 [2024-10-07 11:29:05.940211] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.207 [2024-10-07 11:29:05.940227] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.207 [2024-10-07 11:29:05.940642] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.207 [2024-10-07 11:29:05.940702] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.207 [2024-10-07 11:29:05.940793] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.207 [2024-10-07 11:29:05.940816] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.207 [2024-10-07 11:29:05.940830] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.207 [2024-10-07 11:29:05.940848] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.207 [2024-10-07 11:29:05.940862] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.207 [2024-10-07 11:29:05.940875] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.207 [2024-10-07 11:29:05.940899] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.207 [2024-10-07 11:29:05.940913] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.207 [2024-10-07 11:29:05.947852] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.207 [2024-10-07 11:29:05.947931] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.207 [2024-10-07 11:29:05.948027] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.207 [2024-10-07 11:29:05.948061] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.207 [2024-10-07 11:29:05.948083] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.207 [2024-10-07 11:29:05.948150] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.207 [2024-10-07 11:29:05.948179] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.207 [2024-10-07 11:29:05.948200] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.207 [2024-10-07 11:29:05.948224] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.207 [2024-10-07 11:29:05.948255] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.207 [2024-10-07 11:29:05.948323] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.207 [2024-10-07 11:29:05.948345] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.207 [2024-10-07 11:29:05.948364] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.207 [2024-10-07 11:29:05.948394] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.207 [2024-10-07 11:29:05.948429] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.207 [2024-10-07 11:29:05.948450] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.207 [2024-10-07 11:29:05.948469] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.207 [2024-10-07 11:29:05.948495] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.207 [2024-10-07 11:29:05.958237] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.207 [2024-10-07 11:29:05.958290] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.207 [2024-10-07 11:29:05.958498] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.207 [2024-10-07 11:29:05.958531] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.207 [2024-10-07 11:29:05.958549] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.207 [2024-10-07 11:29:05.958596] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.207 [2024-10-07 11:29:05.958618] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.207 [2024-10-07 11:29:05.958634] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.207 [2024-10-07 11:29:05.958762] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.207 [2024-10-07 11:29:05.958789] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.207 [2024-10-07 11:29:05.958889] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.208 [2024-10-07 11:29:05.958908] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.208 [2024-10-07 11:29:05.958922] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.208 [2024-10-07 11:29:05.958939] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.208 [2024-10-07 11:29:05.958953] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.208 [2024-10-07 11:29:05.958966] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.208 [2024-10-07 11:29:05.959722] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.208 [2024-10-07 11:29:05.959757] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.208 [2024-10-07 11:29:05.968871] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.208 [2024-10-07 11:29:05.968922] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.208 [2024-10-07 11:29:05.969081] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.208 [2024-10-07 11:29:05.969113] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.208 [2024-10-07 11:29:05.969130] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.208 [2024-10-07 11:29:05.969215] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.208 [2024-10-07 11:29:05.969239] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.208 [2024-10-07 11:29:05.969254] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.208 [2024-10-07 11:29:05.969297] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.208 [2024-10-07 11:29:05.969323] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.208 [2024-10-07 11:29:05.969343] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.208 [2024-10-07 11:29:05.969358] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.208 [2024-10-07 11:29:05.969372] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.208 [2024-10-07 11:29:05.969388] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.208 [2024-10-07 11:29:05.969403] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.208 [2024-10-07 11:29:05.969456] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.208 [2024-10-07 11:29:05.969483] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.208 [2024-10-07 11:29:05.969498] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.208 [2024-10-07 11:29:05.978984] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.208 [2024-10-07 11:29:05.979050] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.208 [2024-10-07 11:29:05.979125] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.208 [2024-10-07 11:29:05.979154] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.208 [2024-10-07 11:29:05.979170] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.208 [2024-10-07 11:29:05.979224] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.208 [2024-10-07 11:29:05.979247] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.208 [2024-10-07 11:29:05.979263] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.208 [2024-10-07 11:29:05.979281] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.208 [2024-10-07 11:29:05.981336] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.208 [2024-10-07 11:29:05.981383] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.208 [2024-10-07 11:29:05.981400] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.208 [2024-10-07 11:29:05.981427] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.208 [2024-10-07 11:29:05.982081] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.208 [2024-10-07 11:29:05.982122] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.208 [2024-10-07 11:29:05.982140] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.208 [2024-10-07 11:29:05.982154] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.208 [2024-10-07 11:29:05.982454] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.208 [2024-10-07 11:29:05.989399] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.208 [2024-10-07 11:29:05.989459] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.208 [2024-10-07 11:29:05.989653] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.208 [2024-10-07 11:29:05.989686] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.208 [2024-10-07 11:29:05.989704] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.208 [2024-10-07 11:29:05.989752] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.208 [2024-10-07 11:29:05.989774] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.208 [2024-10-07 11:29:05.989790] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.208 [2024-10-07 11:29:05.989922] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.208 [2024-10-07 11:29:05.989950] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.208 [2024-10-07 11:29:05.990242] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.208 [2024-10-07 11:29:05.990277] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.208 [2024-10-07 11:29:05.990294] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.208 [2024-10-07 11:29:05.990311] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.208 [2024-10-07 11:29:05.990326] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.208 [2024-10-07 11:29:05.990339] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.208 [2024-10-07 11:29:05.990488] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.208 [2024-10-07 11:29:05.990511] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.208 [2024-10-07 11:29:05.999836] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.208 [2024-10-07 11:29:05.999883] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.208 [2024-10-07 11:29:06.000055] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.208 [2024-10-07 11:29:06.000096] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.208 [2024-10-07 11:29:06.000113] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.208 [2024-10-07 11:29:06.000161] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.208 [2024-10-07 11:29:06.000184] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.208 [2024-10-07 11:29:06.000200] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.208 [2024-10-07 11:29:06.000439] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.208 [2024-10-07 11:29:06.000470] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.208 [2024-10-07 11:29:06.002363] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.208 [2024-10-07 11:29:06.002427] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.208 [2024-10-07 11:29:06.002447] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.208 [2024-10-07 11:29:06.002464] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.208 [2024-10-07 11:29:06.002479] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.208 [2024-10-07 11:29:06.002492] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.208 [2024-10-07 11:29:06.003107] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.208 [2024-10-07 11:29:06.003141] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.208 [2024-10-07 11:29:06.011657] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.208 [2024-10-07 11:29:06.011704] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.208 [2024-10-07 11:29:06.011788] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.208 [2024-10-07 11:29:06.011817] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.208 [2024-10-07 11:29:06.011833] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.208 [2024-10-07 11:29:06.011879] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.208 [2024-10-07 11:29:06.011902] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.208 [2024-10-07 11:29:06.011917] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.208 [2024-10-07 11:29:06.011941] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.208 [2024-10-07 11:29:06.011961] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.208 [2024-10-07 11:29:06.011981] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.208 [2024-10-07 11:29:06.011995] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.209 [2024-10-07 11:29:06.012009] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.209 [2024-10-07 11:29:06.012025] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.209 [2024-10-07 11:29:06.012038] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.209 [2024-10-07 11:29:06.012052] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.209 [2024-10-07 11:29:06.012074] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.209 [2024-10-07 11:29:06.012088] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.209 [2024-10-07 11:29:06.021765] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.209 [2024-10-07 11:29:06.021831] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.209 [2024-10-07 11:29:06.021908] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.209 [2024-10-07 11:29:06.021936] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.209 [2024-10-07 11:29:06.021953] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.209 [2024-10-07 11:29:06.022019] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.209 [2024-10-07 11:29:06.022062] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.209 [2024-10-07 11:29:06.022080] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.209 [2024-10-07 11:29:06.022099] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.209 [2024-10-07 11:29:06.022124] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.209 [2024-10-07 11:29:06.022140] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.209 [2024-10-07 11:29:06.022154] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.209 [2024-10-07 11:29:06.022168] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.209 [2024-10-07 11:29:06.022191] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.209 [2024-10-07 11:29:06.022206] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.209 [2024-10-07 11:29:06.022219] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.209 [2024-10-07 11:29:06.022232] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.209 [2024-10-07 11:29:06.022252] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.209 [2024-10-07 11:29:06.034031] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.209 [2024-10-07 11:29:06.034081] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.209 [2024-10-07 11:29:06.034712] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.209 [2024-10-07 11:29:06.034766] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.209 [2024-10-07 11:29:06.034786] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.209 [2024-10-07 11:29:06.034835] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.209 [2024-10-07 11:29:06.034859] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.209 [2024-10-07 11:29:06.034875] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.209 [2024-10-07 11:29:06.037172] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.209 [2024-10-07 11:29:06.037219] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.209 [2024-10-07 11:29:06.037582] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.209 [2024-10-07 11:29:06.037619] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.209 [2024-10-07 11:29:06.037636] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.209 [2024-10-07 11:29:06.037654] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.209 [2024-10-07 11:29:06.037669] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.209 [2024-10-07 11:29:06.037682] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.209 [2024-10-07 11:29:06.037838] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.209 [2024-10-07 11:29:06.037861] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.209 [2024-10-07 11:29:06.046723] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.209 [2024-10-07 11:29:06.046774] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.209 [2024-10-07 11:29:06.047104] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.209 [2024-10-07 11:29:06.047145] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.209 [2024-10-07 11:29:06.047164] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.209 [2024-10-07 11:29:06.047213] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.209 [2024-10-07 11:29:06.047235] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.209 [2024-10-07 11:29:06.047251] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.209 [2024-10-07 11:29:06.047303] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.209 [2024-10-07 11:29:06.047329] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.209 [2024-10-07 11:29:06.047350] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.209 [2024-10-07 11:29:06.047365] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.209 [2024-10-07 11:29:06.047378] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.209 [2024-10-07 11:29:06.047394] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.209 [2024-10-07 11:29:06.047421] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.209 [2024-10-07 11:29:06.047438] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.209 [2024-10-07 11:29:06.047462] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.209 [2024-10-07 11:29:06.047477] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.209 [2024-10-07 11:29:06.057402] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.209 [2024-10-07 11:29:06.057461] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.209 [2024-10-07 11:29:06.057770] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.209 [2024-10-07 11:29:06.057815] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.209 [2024-10-07 11:29:06.057835] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.209 [2024-10-07 11:29:06.057884] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.209 [2024-10-07 11:29:06.057907] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.209 [2024-10-07 11:29:06.057923] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.209 [2024-10-07 11:29:06.057991] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.209 [2024-10-07 11:29:06.058019] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.209 [2024-10-07 11:29:06.058039] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.209 [2024-10-07 11:29:06.058054] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.209 [2024-10-07 11:29:06.058085] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.209 [2024-10-07 11:29:06.058103] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.209 [2024-10-07 11:29:06.058118] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.209 [2024-10-07 11:29:06.058131] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.209 [2024-10-07 11:29:06.058180] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.209 [2024-10-07 11:29:06.058197] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.209 [2024-10-07 11:29:06.070550] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.210 [2024-10-07 11:29:06.070601] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.210 [2024-10-07 11:29:06.070768] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.210 [2024-10-07 11:29:06.070798] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.210 [2024-10-07 11:29:06.070815] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.210 [2024-10-07 11:29:06.070862] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.210 [2024-10-07 11:29:06.070884] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.210 [2024-10-07 11:29:06.070900] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.210 [2024-10-07 11:29:06.071215] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.210 [2024-10-07 11:29:06.071244] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.210 [2024-10-07 11:29:06.071313] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.210 [2024-10-07 11:29:06.071335] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.210 [2024-10-07 11:29:06.071349] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.210 [2024-10-07 11:29:06.071365] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.210 [2024-10-07 11:29:06.071380] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.210 [2024-10-07 11:29:06.071393] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.210 [2024-10-07 11:29:06.071430] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.210 [2024-10-07 11:29:06.071448] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.210 [2024-10-07 11:29:06.082442] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.210 [2024-10-07 11:29:06.082501] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.210 [2024-10-07 11:29:06.082964] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.210 [2024-10-07 11:29:06.083006] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.210 [2024-10-07 11:29:06.083025] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.210 [2024-10-07 11:29:06.083077] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.210 [2024-10-07 11:29:06.083100] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.210 [2024-10-07 11:29:06.083136] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.210 [2024-10-07 11:29:06.083355] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.210 [2024-10-07 11:29:06.083386] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.210 [2024-10-07 11:29:06.083597] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.210 [2024-10-07 11:29:06.083633] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.210 [2024-10-07 11:29:06.083649] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.210 [2024-10-07 11:29:06.083666] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.210 [2024-10-07 11:29:06.083680] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.210 [2024-10-07 11:29:06.083694] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.210 [2024-10-07 11:29:06.083753] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.210 [2024-10-07 11:29:06.083774] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.210 [2024-10-07 11:29:06.092872] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.210 [2024-10-07 11:29:06.092920] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.210 [2024-10-07 11:29:06.093106] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.210 [2024-10-07 11:29:06.093151] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.210 [2024-10-07 11:29:06.093170] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.210 [2024-10-07 11:29:06.093226] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.210 [2024-10-07 11:29:06.093249] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.210 [2024-10-07 11:29:06.093265] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.210 [2024-10-07 11:29:06.093377] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.210 [2024-10-07 11:29:06.093402] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.210 [2024-10-07 11:29:06.093548] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.210 [2024-10-07 11:29:06.093581] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.210 [2024-10-07 11:29:06.093598] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.210 [2024-10-07 11:29:06.093615] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.210 [2024-10-07 11:29:06.093629] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.210 [2024-10-07 11:29:06.093642] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.210 [2024-10-07 11:29:06.093753] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.210 [2024-10-07 11:29:06.093772] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.210 [2024-10-07 11:29:06.103100] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.210 [2024-10-07 11:29:06.103164] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.210 [2024-10-07 11:29:06.103250] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.210 [2024-10-07 11:29:06.103279] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.210 [2024-10-07 11:29:06.103295] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.210 [2024-10-07 11:29:06.103342] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.210 [2024-10-07 11:29:06.103364] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.210 [2024-10-07 11:29:06.103380] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.210 [2024-10-07 11:29:06.103427] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.210 [2024-10-07 11:29:06.103450] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.210 [2024-10-07 11:29:06.103470] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.210 [2024-10-07 11:29:06.103485] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.210 [2024-10-07 11:29:06.103498] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.210 [2024-10-07 11:29:06.103514] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.210 [2024-10-07 11:29:06.103528] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.210 [2024-10-07 11:29:06.103541] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.210 [2024-10-07 11:29:06.103564] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.210 [2024-10-07 11:29:06.103577] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.210 [2024-10-07 11:29:06.113228] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.210 [2024-10-07 11:29:06.113297] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.210 [2024-10-07 11:29:06.113377] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.210 [2024-10-07 11:29:06.113405] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.210 [2024-10-07 11:29:06.113440] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.210 [2024-10-07 11:29:06.113498] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.210 [2024-10-07 11:29:06.113523] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.210 [2024-10-07 11:29:06.113538] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.210 [2024-10-07 11:29:06.113556] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.210 [2024-10-07 11:29:06.113580] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.210 [2024-10-07 11:29:06.113597] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.210 [2024-10-07 11:29:06.113610] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.210 [2024-10-07 11:29:06.113624] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.210 [2024-10-07 11:29:06.113663] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.210 [2024-10-07 11:29:06.113680] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.210 [2024-10-07 11:29:06.113694] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.210 [2024-10-07 11:29:06.113707] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.210 [2024-10-07 11:29:06.113727] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.210 [2024-10-07 11:29:06.125524] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.210 [2024-10-07 11:29:06.125574] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.210 [2024-10-07 11:29:06.125809] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.210 [2024-10-07 11:29:06.125853] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.211 [2024-10-07 11:29:06.125872] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.211 [2024-10-07 11:29:06.125922] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.211 [2024-10-07 11:29:06.125945] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.211 [2024-10-07 11:29:06.125972] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.211 [2024-10-07 11:29:06.126087] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.211 [2024-10-07 11:29:06.126113] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.211 [2024-10-07 11:29:06.126210] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.211 [2024-10-07 11:29:06.126230] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.211 [2024-10-07 11:29:06.126244] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.211 [2024-10-07 11:29:06.126260] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.211 [2024-10-07 11:29:06.126275] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.211 [2024-10-07 11:29:06.126288] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.211 [2024-10-07 11:29:06.127594] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.211 [2024-10-07 11:29:06.127628] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.211 [2024-10-07 11:29:06.135636] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.211 [2024-10-07 11:29:06.135713] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.211 [2024-10-07 11:29:06.135788] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.211 [2024-10-07 11:29:06.135816] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.211 [2024-10-07 11:29:06.135833] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.211 [2024-10-07 11:29:06.135885] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.211 [2024-10-07 11:29:06.135908] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.211 [2024-10-07 11:29:06.135923] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.211 [2024-10-07 11:29:06.135958] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.211 [2024-10-07 11:29:06.135983] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.211 [2024-10-07 11:29:06.136000] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.211 [2024-10-07 11:29:06.136013] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.211 [2024-10-07 11:29:06.136027] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.211 [2024-10-07 11:29:06.136475] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.211 [2024-10-07 11:29:06.136502] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.211 [2024-10-07 11:29:06.136516] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.211 [2024-10-07 11:29:06.136530] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.211 [2024-10-07 11:29:06.136723] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.211 [2024-10-07 11:29:06.147115] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.211 [2024-10-07 11:29:06.147166] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.211 [2024-10-07 11:29:06.147484] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.211 [2024-10-07 11:29:06.147526] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.211 [2024-10-07 11:29:06.147546] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.211 [2024-10-07 11:29:06.147595] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.211 [2024-10-07 11:29:06.147618] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.211 [2024-10-07 11:29:06.147633] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.211 [2024-10-07 11:29:06.147658] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.211 [2024-10-07 11:29:06.147678] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.211 [2024-10-07 11:29:06.147698] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.211 [2024-10-07 11:29:06.147713] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.211 [2024-10-07 11:29:06.147726] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.211 [2024-10-07 11:29:06.147742] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.211 [2024-10-07 11:29:06.147757] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.211 [2024-10-07 11:29:06.147769] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.211 [2024-10-07 11:29:06.147792] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.211 [2024-10-07 11:29:06.147806] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.211 [2024-10-07 11:29:06.157366] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.211 [2024-10-07 11:29:06.157413] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.211 [2024-10-07 11:29:06.157531] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.211 [2024-10-07 11:29:06.157560] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.211 [2024-10-07 11:29:06.157577] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.211 [2024-10-07 11:29:06.157624] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.211 [2024-10-07 11:29:06.157646] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.211 [2024-10-07 11:29:06.157661] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.211 [2024-10-07 11:29:06.157869] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.211 [2024-10-07 11:29:06.157897] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.211 [2024-10-07 11:29:06.157950] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.211 [2024-10-07 11:29:06.157984] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.211 [2024-10-07 11:29:06.157999] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.211 [2024-10-07 11:29:06.158015] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.211 [2024-10-07 11:29:06.158029] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.211 [2024-10-07 11:29:06.158042] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.211 [2024-10-07 11:29:06.158065] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.211 [2024-10-07 11:29:06.158079] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.211 [2024-10-07 11:29:06.167756] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.211 [2024-10-07 11:29:06.167805] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.211 [2024-10-07 11:29:06.167993] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.211 [2024-10-07 11:29:06.168023] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.211 [2024-10-07 11:29:06.168040] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.211 [2024-10-07 11:29:06.168086] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.211 [2024-10-07 11:29:06.168108] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.211 [2024-10-07 11:29:06.168124] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.211 [2024-10-07 11:29:06.168766] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.211 [2024-10-07 11:29:06.168807] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.211 [2024-10-07 11:29:06.171999] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.211 [2024-10-07 11:29:06.172039] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.211 [2024-10-07 11:29:06.172057] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.211 [2024-10-07 11:29:06.172074] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.211 [2024-10-07 11:29:06.172088] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.211 [2024-10-07 11:29:06.172115] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.211 [2024-10-07 11:29:06.172563] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.212 [2024-10-07 11:29:06.172609] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.212 [2024-10-07 11:29:06.177870] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.212 [2024-10-07 11:29:06.177932] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.212 [2024-10-07 11:29:06.178016] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.212 [2024-10-07 11:29:06.178044] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.212 [2024-10-07 11:29:06.178061] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.212 [2024-10-07 11:29:06.178116] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.212 [2024-10-07 11:29:06.178139] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.212 [2024-10-07 11:29:06.178155] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.212 [2024-10-07 11:29:06.178173] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.212 [2024-10-07 11:29:06.178197] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.212 [2024-10-07 11:29:06.178214] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.212 [2024-10-07 11:29:06.178228] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.212 [2024-10-07 11:29:06.178241] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.212 [2024-10-07 11:29:06.178264] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.212 [2024-10-07 11:29:06.178278] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.212 [2024-10-07 11:29:06.178291] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.212 [2024-10-07 11:29:06.178304] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.212 [2024-10-07 11:29:06.178325] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.212 [2024-10-07 11:29:06.188046] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.212 [2024-10-07 11:29:06.188095] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.212 [2024-10-07 11:29:06.188178] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.212 [2024-10-07 11:29:06.188207] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.212 [2024-10-07 11:29:06.188224] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.212 [2024-10-07 11:29:06.188281] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.212 [2024-10-07 11:29:06.188303] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.212 [2024-10-07 11:29:06.188319] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.212 [2024-10-07 11:29:06.188343] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.212 [2024-10-07 11:29:06.188381] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.212 [2024-10-07 11:29:06.188431] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.212 [2024-10-07 11:29:06.188452] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.212 [2024-10-07 11:29:06.188466] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.212 [2024-10-07 11:29:06.188482] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.212 [2024-10-07 11:29:06.188496] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.212 [2024-10-07 11:29:06.188509] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.212 [2024-10-07 11:29:06.188533] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.212 [2024-10-07 11:29:06.188546] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.212 [2024-10-07 11:29:06.198219] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.212 [2024-10-07 11:29:06.198267] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.212 [2024-10-07 11:29:06.198351] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.212 [2024-10-07 11:29:06.198379] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.212 [2024-10-07 11:29:06.198396] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.212 [2024-10-07 11:29:06.198457] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.212 [2024-10-07 11:29:06.198482] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.212 [2024-10-07 11:29:06.198498] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.212 [2024-10-07 11:29:06.198522] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.212 [2024-10-07 11:29:06.198542] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.212 [2024-10-07 11:29:06.198561] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.212 [2024-10-07 11:29:06.198576] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.212 [2024-10-07 11:29:06.198590] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.212 [2024-10-07 11:29:06.198605] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.212 [2024-10-07 11:29:06.198619] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.212 [2024-10-07 11:29:06.198632] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.212 [2024-10-07 11:29:06.198654] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.212 [2024-10-07 11:29:06.198668] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.212 [2024-10-07 11:29:06.208334] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.212 [2024-10-07 11:29:06.208402] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.212 [2024-10-07 11:29:06.208505] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.212 [2024-10-07 11:29:06.208534] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.212 [2024-10-07 11:29:06.208571] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.212 [2024-10-07 11:29:06.208630] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.212 [2024-10-07 11:29:06.208654] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.212 [2024-10-07 11:29:06.208669] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.212 [2024-10-07 11:29:06.208688] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.212 [2024-10-07 11:29:06.208712] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.212 [2024-10-07 11:29:06.208730] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.212 [2024-10-07 11:29:06.208743] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.212 [2024-10-07 11:29:06.208757] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.212 [2024-10-07 11:29:06.208781] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.212 [2024-10-07 11:29:06.208795] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.212 [2024-10-07 11:29:06.208809] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.212 [2024-10-07 11:29:06.208822] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.212 [2024-10-07 11:29:06.208843] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.212 [2024-10-07 11:29:06.220497] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.212 [2024-10-07 11:29:06.220545] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.212 [2024-10-07 11:29:06.220631] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.212 [2024-10-07 11:29:06.220660] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.212 [2024-10-07 11:29:06.220676] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.212 [2024-10-07 11:29:06.220723] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.213 [2024-10-07 11:29:06.220746] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.213 [2024-10-07 11:29:06.220762] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.213 [2024-10-07 11:29:06.221325] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.213 [2024-10-07 11:29:06.221366] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.213 [2024-10-07 11:29:06.221474] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.213 [2024-10-07 11:29:06.221498] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.213 [2024-10-07 11:29:06.221512] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.213 [2024-10-07 11:29:06.221529] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.213 [2024-10-07 11:29:06.221544] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.213 [2024-10-07 11:29:06.221572] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.213 [2024-10-07 11:29:06.221599] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.213 [2024-10-07 11:29:06.221614] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.213 [2024-10-07 11:29:06.231117] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.213 [2024-10-07 11:29:06.231166] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.213 [2024-10-07 11:29:06.231338] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.213 [2024-10-07 11:29:06.231369] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.213 [2024-10-07 11:29:06.231386] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.213 [2024-10-07 11:29:06.231447] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.213 [2024-10-07 11:29:06.231472] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.213 [2024-10-07 11:29:06.231488] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.213 [2024-10-07 11:29:06.231591] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.213 [2024-10-07 11:29:06.231614] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.213 [2024-10-07 11:29:06.231727] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.213 [2024-10-07 11:29:06.231748] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.213 [2024-10-07 11:29:06.231762] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.213 [2024-10-07 11:29:06.231779] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.213 [2024-10-07 11:29:06.231794] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.213 [2024-10-07 11:29:06.231807] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.213 [2024-10-07 11:29:06.232154] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.213 [2024-10-07 11:29:06.232179] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.213 [2024-10-07 11:29:06.241230] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.213 [2024-10-07 11:29:06.241293] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.213 [2024-10-07 11:29:06.241369] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.213 [2024-10-07 11:29:06.241397] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.213 [2024-10-07 11:29:06.241430] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.213 [2024-10-07 11:29:06.241488] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.213 [2024-10-07 11:29:06.241512] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.213 [2024-10-07 11:29:06.241528] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.213 [2024-10-07 11:29:06.241546] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.213 [2024-10-07 11:29:06.241569] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.213 [2024-10-07 11:29:06.241602] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.213 [2024-10-07 11:29:06.241617] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.213 [2024-10-07 11:29:06.241631] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.213 [2024-10-07 11:29:06.241654] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.213 [2024-10-07 11:29:06.241669] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.213 [2024-10-07 11:29:06.241682] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.213 [2024-10-07 11:29:06.241695] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.213 [2024-10-07 11:29:06.241715] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.213 [2024-10-07 11:29:06.252843] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.213 [2024-10-07 11:29:06.252892] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.213 [2024-10-07 11:29:06.253003] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.213 [2024-10-07 11:29:06.253034] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.213 [2024-10-07 11:29:06.253051] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.213 [2024-10-07 11:29:06.253097] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.213 [2024-10-07 11:29:06.253120] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.213 [2024-10-07 11:29:06.253135] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.213 [2024-10-07 11:29:06.253159] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.213 [2024-10-07 11:29:06.253178] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.213 [2024-10-07 11:29:06.253198] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.213 [2024-10-07 11:29:06.253212] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.213 [2024-10-07 11:29:06.253225] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.213 [2024-10-07 11:29:06.253241] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.213 [2024-10-07 11:29:06.253255] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.213 [2024-10-07 11:29:06.253268] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.213 [2024-10-07 11:29:06.253307] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.213 [2024-10-07 11:29:06.253325] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.213 [2024-10-07 11:29:06.263017] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.213 [2024-10-07 11:29:06.263063] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.213 [2024-10-07 11:29:06.263146] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.213 [2024-10-07 11:29:06.263174] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.213 [2024-10-07 11:29:06.263191] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.213 [2024-10-07 11:29:06.263254] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.213 [2024-10-07 11:29:06.263278] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.213 [2024-10-07 11:29:06.263294] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.213 [2024-10-07 11:29:06.263892] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.213 [2024-10-07 11:29:06.263933] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.213 [2024-10-07 11:29:06.264027] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.213 [2024-10-07 11:29:06.264049] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.213 [2024-10-07 11:29:06.264064] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.213 [2024-10-07 11:29:06.264080] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.213 [2024-10-07 11:29:06.264094] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.213 [2024-10-07 11:29:06.264107] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.213 [2024-10-07 11:29:06.264130] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.213 [2024-10-07 11:29:06.264144] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.213 [2024-10-07 11:29:06.275584] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.213 [2024-10-07 11:29:06.275635] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.213 [2024-10-07 11:29:06.275769] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.213 [2024-10-07 11:29:06.275799] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.213 [2024-10-07 11:29:06.275817] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.213 [2024-10-07 11:29:06.275863] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.213 [2024-10-07 11:29:06.275885] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.213 [2024-10-07 11:29:06.275901] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.213 [2024-10-07 11:29:06.275925] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.213 [2024-10-07 11:29:06.275945] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.213 [2024-10-07 11:29:06.275981] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.214 [2024-10-07 11:29:06.276000] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.214 [2024-10-07 11:29:06.276014] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.214 [2024-10-07 11:29:06.276030] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.214 [2024-10-07 11:29:06.276044] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.214 [2024-10-07 11:29:06.276057] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.214 [2024-10-07 11:29:06.276080] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.214 [2024-10-07 11:29:06.276110] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.214 [2024-10-07 11:29:06.290056] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.214 [2024-10-07 11:29:06.290108] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.214 [2024-10-07 11:29:06.290554] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.214 [2024-10-07 11:29:06.290597] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.214 [2024-10-07 11:29:06.290616] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.214 [2024-10-07 11:29:06.290664] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.214 [2024-10-07 11:29:06.290686] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.214 [2024-10-07 11:29:06.290702] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.214 [2024-10-07 11:29:06.291232] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.214 [2024-10-07 11:29:06.291273] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.214 [2024-10-07 11:29:06.291513] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.214 [2024-10-07 11:29:06.291548] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.214 [2024-10-07 11:29:06.291566] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.214 [2024-10-07 11:29:06.291583] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.214 [2024-10-07 11:29:06.291598] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.214 [2024-10-07 11:29:06.291611] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.214 [2024-10-07 11:29:06.291814] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.214 [2024-10-07 11:29:06.291839] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.214 [2024-10-07 11:29:06.303310] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.214 [2024-10-07 11:29:06.303360] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.214 [2024-10-07 11:29:06.304218] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.214 [2024-10-07 11:29:06.304260] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.214 [2024-10-07 11:29:06.304279] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.214 [2024-10-07 11:29:06.304328] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.214 [2024-10-07 11:29:06.304350] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.214 [2024-10-07 11:29:06.304366] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.214 [2024-10-07 11:29:06.304630] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.214 [2024-10-07 11:29:06.304662] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.214 [2024-10-07 11:29:06.304711] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.214 [2024-10-07 11:29:06.304749] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.214 [2024-10-07 11:29:06.304764] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.214 [2024-10-07 11:29:06.304788] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.214 [2024-10-07 11:29:06.304803] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.214 [2024-10-07 11:29:06.304816] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.214 [2024-10-07 11:29:06.304954] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.214 [2024-10-07 11:29:06.304978] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.214 [2024-10-07 11:29:06.314290] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.214 [2024-10-07 11:29:06.314341] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.214 [2024-10-07 11:29:06.314532] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.214 [2024-10-07 11:29:06.314563] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.214 [2024-10-07 11:29:06.314581] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.214 [2024-10-07 11:29:06.314630] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.214 [2024-10-07 11:29:06.314653] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.214 [2024-10-07 11:29:06.314669] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.214 [2024-10-07 11:29:06.314773] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.214 [2024-10-07 11:29:06.314797] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.214 [2024-10-07 11:29:06.316777] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.214 [2024-10-07 11:29:06.316830] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.214 [2024-10-07 11:29:06.316853] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.214 [2024-10-07 11:29:06.316871] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.214 [2024-10-07 11:29:06.316885] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.214 [2024-10-07 11:29:06.316899] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.214 [2024-10-07 11:29:06.319073] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.214 [2024-10-07 11:29:06.319116] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.214 [2024-10-07 11:29:06.330159] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.214 [2024-10-07 11:29:06.330210] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.214 [2024-10-07 11:29:06.330671] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.214 [2024-10-07 11:29:06.330714] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.214 [2024-10-07 11:29:06.330734] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.214 [2024-10-07 11:29:06.330783] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.214 [2024-10-07 11:29:06.330825] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.214 [2024-10-07 11:29:06.330843] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.214 [2024-10-07 11:29:06.330911] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.214 [2024-10-07 11:29:06.330937] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.214 [2024-10-07 11:29:06.330958] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.214 [2024-10-07 11:29:06.330973] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.214 [2024-10-07 11:29:06.330987] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.214 [2024-10-07 11:29:06.331003] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.214 [2024-10-07 11:29:06.331018] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.214 [2024-10-07 11:29:06.331030] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.214 [2024-10-07 11:29:06.331054] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.214 [2024-10-07 11:29:06.331069] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.214 [2024-10-07 11:29:06.340909] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.214 [2024-10-07 11:29:06.340957] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.214 [2024-10-07 11:29:06.341129] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.214 [2024-10-07 11:29:06.341159] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.214 [2024-10-07 11:29:06.341177] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.214 [2024-10-07 11:29:06.341224] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.214 [2024-10-07 11:29:06.341246] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.214 [2024-10-07 11:29:06.341262] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.214 [2024-10-07 11:29:06.344838] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.214 [2024-10-07 11:29:06.344888] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.214 [2024-10-07 11:29:06.345093] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.214 [2024-10-07 11:29:06.345120] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.214 [2024-10-07 11:29:06.345135] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.214 [2024-10-07 11:29:06.345153] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.214 [2024-10-07 11:29:06.345167] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.214 [2024-10-07 11:29:06.345180] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.214 [2024-10-07 11:29:06.345319] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.214 [2024-10-07 11:29:06.345341] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.215 [2024-10-07 11:29:06.351436] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.215 [2024-10-07 11:29:06.351495] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.215 [2024-10-07 11:29:06.351581] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.215 [2024-10-07 11:29:06.351611] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.215 [2024-10-07 11:29:06.351628] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.215 [2024-10-07 11:29:06.351674] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.215 [2024-10-07 11:29:06.351697] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.215 [2024-10-07 11:29:06.351712] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.215 [2024-10-07 11:29:06.353295] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.215 [2024-10-07 11:29:06.353339] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.215 [2024-10-07 11:29:06.354154] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.215 [2024-10-07 11:29:06.354191] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.215 [2024-10-07 11:29:06.354208] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.215 [2024-10-07 11:29:06.354226] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.215 [2024-10-07 11:29:06.354240] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.215 [2024-10-07 11:29:06.354253] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.215 [2024-10-07 11:29:06.354357] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.215 [2024-10-07 11:29:06.354378] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.215 [2024-10-07 11:29:06.361557] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.215 [2024-10-07 11:29:06.361619] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.215 [2024-10-07 11:29:06.361702] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.215 [2024-10-07 11:29:06.361730] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.215 [2024-10-07 11:29:06.361747] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.215 [2024-10-07 11:29:06.361816] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.215 [2024-10-07 11:29:06.361839] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.215 [2024-10-07 11:29:06.361854] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.215 [2024-10-07 11:29:06.361872] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.215 [2024-10-07 11:29:06.361895] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.215 [2024-10-07 11:29:06.361911] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.215 [2024-10-07 11:29:06.361925] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.215 [2024-10-07 11:29:06.361956] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.215 [2024-10-07 11:29:06.362028] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.215 [2024-10-07 11:29:06.362047] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.215 [2024-10-07 11:29:06.362060] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.215 [2024-10-07 11:29:06.362074] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.215 [2024-10-07 11:29:06.362094] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.215 [2024-10-07 11:29:06.374223] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.215 [2024-10-07 11:29:06.374275] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.215 [2024-10-07 11:29:06.374473] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.215 [2024-10-07 11:29:06.374504] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.215 [2024-10-07 11:29:06.374522] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.215 [2024-10-07 11:29:06.374568] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.215 [2024-10-07 11:29:06.374591] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.215 [2024-10-07 11:29:06.374606] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.215 [2024-10-07 11:29:06.374770] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.215 [2024-10-07 11:29:06.374799] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.215 [2024-10-07 11:29:06.375024] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.215 [2024-10-07 11:29:06.375049] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.215 [2024-10-07 11:29:06.375065] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.215 [2024-10-07 11:29:06.375081] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.215 [2024-10-07 11:29:06.375095] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.215 [2024-10-07 11:29:06.375108] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.215 [2024-10-07 11:29:06.375246] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.215 [2024-10-07 11:29:06.375270] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.215 [2024-10-07 11:29:06.384338] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.215 [2024-10-07 11:29:06.384401] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.215 [2024-10-07 11:29:06.384492] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.215 [2024-10-07 11:29:06.384520] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.215 [2024-10-07 11:29:06.384537] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.215 [2024-10-07 11:29:06.384593] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.215 [2024-10-07 11:29:06.384616] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.215 [2024-10-07 11:29:06.384650] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.215 [2024-10-07 11:29:06.384670] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.215 [2024-10-07 11:29:06.386908] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.215 [2024-10-07 11:29:06.386952] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.215 [2024-10-07 11:29:06.386973] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.215 [2024-10-07 11:29:06.387001] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.215 [2024-10-07 11:29:06.387722] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.215 [2024-10-07 11:29:06.387758] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.215 [2024-10-07 11:29:06.387774] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.215 [2024-10-07 11:29:06.387788] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.215 [2024-10-07 11:29:06.387909] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.215 [2024-10-07 11:29:06.394419] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.215 [2024-10-07 11:29:06.394570] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.215 [2024-10-07 11:29:06.394601] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.215 [2024-10-07 11:29:06.394619] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.215 [2024-10-07 11:29:06.394673] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.215 [2024-10-07 11:29:06.394703] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.215 [2024-10-07 11:29:06.394729] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.215 [2024-10-07 11:29:06.394744] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.215 [2024-10-07 11:29:06.394757] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.215 [2024-10-07 11:29:06.394777] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.215 [2024-10-07 11:29:06.394829] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.215 [2024-10-07 11:29:06.394853] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.215 [2024-10-07 11:29:06.394868] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.215 [2024-10-07 11:29:06.394890] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.215 [2024-10-07 11:29:06.394912] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.215 [2024-10-07 11:29:06.394926] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.215 [2024-10-07 11:29:06.394939] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.215 [2024-10-07 11:29:06.394960] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.215 8854.71 IOPS, 34.59 MiB/s [2024-10-07T11:29:15.926Z] [2024-10-07 11:29:06.405671] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.215 [2024-10-07 11:29:06.405733] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.215 [2024-10-07 11:29:06.405944] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.215 [2024-10-07 11:29:06.405987] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.215 [2024-10-07 11:29:06.406012] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.215 [2024-10-07 11:29:06.406060] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.215 [2024-10-07 11:29:06.406083] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.216 [2024-10-07 11:29:06.406099] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.216 [2024-10-07 11:29:06.406214] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.216 [2024-10-07 11:29:06.406239] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.216 [2024-10-07 11:29:06.406337] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.216 [2024-10-07 11:29:06.406356] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.216 [2024-10-07 11:29:06.406369] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.216 [2024-10-07 11:29:06.406385] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.216 [2024-10-07 11:29:06.406399] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.216 [2024-10-07 11:29:06.406428] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.216 [2024-10-07 11:29:06.406544] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.216 [2024-10-07 11:29:06.406564] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.216 [2024-10-07 11:29:06.416333] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.216 [2024-10-07 11:29:06.416382] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.216 [2024-10-07 11:29:06.416632] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.216 [2024-10-07 11:29:06.416666] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.216 [2024-10-07 11:29:06.416683] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.216 [2024-10-07 11:29:06.416730] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.216 [2024-10-07 11:29:06.416752] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.216 [2024-10-07 11:29:06.416768] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.216 [2024-10-07 11:29:06.416823] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.216 [2024-10-07 11:29:06.416849] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.216 [2024-10-07 11:29:06.416869] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.216 [2024-10-07 11:29:06.416884] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.216 [2024-10-07 11:29:06.416898] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.216 [2024-10-07 11:29:06.416929] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.216 [2024-10-07 11:29:06.416945] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.216 [2024-10-07 11:29:06.416958] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.216 [2024-10-07 11:29:06.416981] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.216 [2024-10-07 11:29:06.416995] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.216 [2024-10-07 11:29:06.429714] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.216 [2024-10-07 11:29:06.429766] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.216 [2024-10-07 11:29:06.429850] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.216 [2024-10-07 11:29:06.429879] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.216 [2024-10-07 11:29:06.429896] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.216 [2024-10-07 11:29:06.429943] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.216 [2024-10-07 11:29:06.429977] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.216 [2024-10-07 11:29:06.429994] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.216 [2024-10-07 11:29:06.430615] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.216 [2024-10-07 11:29:06.430658] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.216 [2024-10-07 11:29:06.430746] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.216 [2024-10-07 11:29:06.430767] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.216 [2024-10-07 11:29:06.430782] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.216 [2024-10-07 11:29:06.430798] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.216 [2024-10-07 11:29:06.430812] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.216 [2024-10-07 11:29:06.430825] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.216 [2024-10-07 11:29:06.430848] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.216 [2024-10-07 11:29:06.430863] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.216 [2024-10-07 11:29:06.440909] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.216 [2024-10-07 11:29:06.440957] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.216 [2024-10-07 11:29:06.441152] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.216 [2024-10-07 11:29:06.441183] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.216 [2024-10-07 11:29:06.441200] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.216 [2024-10-07 11:29:06.441246] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.216 [2024-10-07 11:29:06.441268] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.216 [2024-10-07 11:29:06.441283] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.216 [2024-10-07 11:29:06.441512] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.216 [2024-10-07 11:29:06.441543] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.216 [2024-10-07 11:29:06.441696] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.216 [2024-10-07 11:29:06.441720] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.216 [2024-10-07 11:29:06.441734] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.216 [2024-10-07 11:29:06.441767] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.216 [2024-10-07 11:29:06.441780] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.216 [2024-10-07 11:29:06.441793] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.216 [2024-10-07 11:29:06.442523] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.216 [2024-10-07 11:29:06.442573] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.216 [2024-10-07 11:29:06.451546] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.216 [2024-10-07 11:29:06.451608] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.216 [2024-10-07 11:29:06.451708] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.216 [2024-10-07 11:29:06.451736] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.216 [2024-10-07 11:29:06.451753] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.216 [2024-10-07 11:29:06.451799] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.216 [2024-10-07 11:29:06.451822] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.216 [2024-10-07 11:29:06.451837] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.216 [2024-10-07 11:29:06.451860] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.216 [2024-10-07 11:29:06.451879] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.216 [2024-10-07 11:29:06.451899] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.216 [2024-10-07 11:29:06.451914] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.216 [2024-10-07 11:29:06.451927] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.216 [2024-10-07 11:29:06.451943] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.216 [2024-10-07 11:29:06.451957] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.216 [2024-10-07 11:29:06.451969] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.216 [2024-10-07 11:29:06.451993] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.216 [2024-10-07 11:29:06.452006] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.216 [2024-10-07 11:29:06.464492] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.216 [2024-10-07 11:29:06.464544] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.216 [2024-10-07 11:29:06.464648] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.216 [2024-10-07 11:29:06.464678] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.216 [2024-10-07 11:29:06.464695] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.216 [2024-10-07 11:29:06.464742] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.216 [2024-10-07 11:29:06.464765] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.216 [2024-10-07 11:29:06.464780] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.216 [2024-10-07 11:29:06.464804] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.217 [2024-10-07 11:29:06.464838] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.217 [2024-10-07 11:29:06.464858] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.217 [2024-10-07 11:29:06.464872] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.217 [2024-10-07 11:29:06.464885] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.217 [2024-10-07 11:29:06.464901] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.217 [2024-10-07 11:29:06.464914] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.217 [2024-10-07 11:29:06.464928] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.217 [2024-10-07 11:29:06.464950] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.217 [2024-10-07 11:29:06.464963] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.217 [2024-10-07 11:29:06.475166] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.217 [2024-10-07 11:29:06.475214] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.217 [2024-10-07 11:29:06.475314] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.217 [2024-10-07 11:29:06.475342] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.217 [2024-10-07 11:29:06.475359] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.217 [2024-10-07 11:29:06.475422] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.217 [2024-10-07 11:29:06.475457] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.217 [2024-10-07 11:29:06.475491] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.217 [2024-10-07 11:29:06.475515] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.217 [2024-10-07 11:29:06.475534] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.217 [2024-10-07 11:29:06.477518] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.217 [2024-10-07 11:29:06.477554] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.217 [2024-10-07 11:29:06.477587] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.217 [2024-10-07 11:29:06.477604] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.217 [2024-10-07 11:29:06.477634] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.217 [2024-10-07 11:29:06.477649] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.217 [2024-10-07 11:29:06.478308] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.217 [2024-10-07 11:29:06.478360] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.217 [2024-10-07 11:29:06.486065] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.217 [2024-10-07 11:29:06.486235] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.217 [2024-10-07 11:29:06.486330] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.217 [2024-10-07 11:29:06.486357] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.217 [2024-10-07 11:29:06.486373] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.217 [2024-10-07 11:29:06.486652] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.217 [2024-10-07 11:29:06.486691] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.217 [2024-10-07 11:29:06.486709] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.217 [2024-10-07 11:29:06.486727] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.217 [2024-10-07 11:29:06.486849] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.217 [2024-10-07 11:29:06.486873] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.217 [2024-10-07 11:29:06.486887] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.217 [2024-10-07 11:29:06.486899] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.217 [2024-10-07 11:29:06.487351] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.217 [2024-10-07 11:29:06.487387] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.217 [2024-10-07 11:29:06.487419] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.217 [2024-10-07 11:29:06.487456] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.217 [2024-10-07 11:29:06.487626] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.217 [2024-10-07 11:29:06.496145] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.217 [2024-10-07 11:29:06.496249] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.217 [2024-10-07 11:29:06.496279] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.217 [2024-10-07 11:29:06.496296] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.217 [2024-10-07 11:29:06.496320] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.217 [2024-10-07 11:29:06.496355] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.217 [2024-10-07 11:29:06.496382] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.217 [2024-10-07 11:29:06.496406] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.217 [2024-10-07 11:29:06.496461] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.217 [2024-10-07 11:29:06.496501] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.217 [2024-10-07 11:29:06.496571] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.217 [2024-10-07 11:29:06.496599] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.217 [2024-10-07 11:29:06.496615] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.217 [2024-10-07 11:29:06.496639] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.217 [2024-10-07 11:29:06.496661] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.217 [2024-10-07 11:29:06.496675] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.217 [2024-10-07 11:29:06.496688] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.217 [2024-10-07 11:29:06.496710] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.217 [2024-10-07 11:29:06.506673] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.217 [2024-10-07 11:29:06.506738] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.217 [2024-10-07 11:29:06.506813] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.217 [2024-10-07 11:29:06.506841] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.217 [2024-10-07 11:29:06.506864] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.217 [2024-10-07 11:29:06.507491] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.217 [2024-10-07 11:29:06.507531] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.217 [2024-10-07 11:29:06.507550] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.217 [2024-10-07 11:29:06.507569] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.217 [2024-10-07 11:29:06.507680] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.217 [2024-10-07 11:29:06.507707] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.217 [2024-10-07 11:29:06.507721] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.217 [2024-10-07 11:29:06.507735] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.217 [2024-10-07 11:29:06.507769] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.217 [2024-10-07 11:29:06.507786] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.218 [2024-10-07 11:29:06.507800] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.218 [2024-10-07 11:29:06.507813] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.218 [2024-10-07 11:29:06.507834] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.218 [2024-10-07 11:29:06.517021] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.218 [2024-10-07 11:29:06.517071] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.218 [2024-10-07 11:29:06.517507] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.218 [2024-10-07 11:29:06.517565] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.218 [2024-10-07 11:29:06.517586] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.218 [2024-10-07 11:29:06.517647] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.218 [2024-10-07 11:29:06.517670] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.218 [2024-10-07 11:29:06.517686] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.218 [2024-10-07 11:29:06.519545] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.218 [2024-10-07 11:29:06.519590] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.218 [2024-10-07 11:29:06.520218] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.218 [2024-10-07 11:29:06.520254] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.218 [2024-10-07 11:29:06.520271] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.218 [2024-10-07 11:29:06.520288] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.218 [2024-10-07 11:29:06.520302] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.218 [2024-10-07 11:29:06.520315] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.218 [2024-10-07 11:29:06.520571] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.218 [2024-10-07 11:29:06.520597] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.218 [2024-10-07 11:29:06.528380] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.218 [2024-10-07 11:29:06.528440] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.218 [2024-10-07 11:29:06.528633] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.218 [2024-10-07 11:29:06.528664] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.218 [2024-10-07 11:29:06.528681] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.218 [2024-10-07 11:29:06.528729] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.218 [2024-10-07 11:29:06.528752] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.218 [2024-10-07 11:29:06.528767] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.218 [2024-10-07 11:29:06.528936] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.218 [2024-10-07 11:29:06.528965] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.218 [2024-10-07 11:29:06.529080] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.218 [2024-10-07 11:29:06.529101] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.218 [2024-10-07 11:29:06.529115] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.218 [2024-10-07 11:29:06.529131] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.218 [2024-10-07 11:29:06.529145] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.218 [2024-10-07 11:29:06.529173] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.218 [2024-10-07 11:29:06.529276] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.218 [2024-10-07 11:29:06.529295] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.218 [2024-10-07 11:29:06.540651] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.218 [2024-10-07 11:29:06.540698] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.218 [2024-10-07 11:29:06.540839] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.218 [2024-10-07 11:29:06.540868] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.218 [2024-10-07 11:29:06.540885] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.218 [2024-10-07 11:29:06.540931] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.218 [2024-10-07 11:29:06.540969] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.218 [2024-10-07 11:29:06.540985] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.218 [2024-10-07 11:29:06.541010] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.218 [2024-10-07 11:29:06.541029] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.218 [2024-10-07 11:29:06.541049] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.218 [2024-10-07 11:29:06.541063] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.218 [2024-10-07 11:29:06.541077] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.218 [2024-10-07 11:29:06.541093] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.218 [2024-10-07 11:29:06.541107] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.218 [2024-10-07 11:29:06.541120] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.218 [2024-10-07 11:29:06.541144] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.218 [2024-10-07 11:29:06.541157] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.218 [2024-10-07 11:29:06.551665] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.218 [2024-10-07 11:29:06.551713] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.218 [2024-10-07 11:29:06.551797] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.218 [2024-10-07 11:29:06.551826] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.218 [2024-10-07 11:29:06.551843] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.218 [2024-10-07 11:29:06.551890] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.218 [2024-10-07 11:29:06.551912] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.218 [2024-10-07 11:29:06.551928] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.218 [2024-10-07 11:29:06.551953] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.218 [2024-10-07 11:29:06.551972] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.218 [2024-10-07 11:29:06.552008] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.218 [2024-10-07 11:29:06.552024] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.218 [2024-10-07 11:29:06.552038] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.218 [2024-10-07 11:29:06.552054] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.218 [2024-10-07 11:29:06.552067] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.218 [2024-10-07 11:29:06.552081] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.218 [2024-10-07 11:29:06.552273] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.218 [2024-10-07 11:29:06.552303] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.218 [2024-10-07 11:29:06.562268] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.218 [2024-10-07 11:29:06.562318] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.218 [2024-10-07 11:29:06.562406] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.218 [2024-10-07 11:29:06.562450] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.218 [2024-10-07 11:29:06.562468] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.218 [2024-10-07 11:29:06.562517] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.218 [2024-10-07 11:29:06.562540] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.218 [2024-10-07 11:29:06.562556] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.218 [2024-10-07 11:29:06.562580] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.218 [2024-10-07 11:29:06.562600] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.218 [2024-10-07 11:29:06.562620] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.218 [2024-10-07 11:29:06.562634] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.218 [2024-10-07 11:29:06.562648] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.218 [2024-10-07 11:29:06.562664] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.218 [2024-10-07 11:29:06.562694] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.218 [2024-10-07 11:29:06.562706] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.218 [2024-10-07 11:29:06.562729] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.218 [2024-10-07 11:29:06.562742] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.218 [2024-10-07 11:29:06.572584] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.219 [2024-10-07 11:29:06.572629] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.219 [2024-10-07 11:29:06.572715] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.219 [2024-10-07 11:29:06.572744] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.219 [2024-10-07 11:29:06.572775] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.219 [2024-10-07 11:29:06.572826] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.219 [2024-10-07 11:29:06.572850] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.219 [2024-10-07 11:29:06.572865] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.219 [2024-10-07 11:29:06.572889] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.219 [2024-10-07 11:29:06.572908] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.219 [2024-10-07 11:29:06.572928] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.219 [2024-10-07 11:29:06.572942] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.219 [2024-10-07 11:29:06.572956] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.219 [2024-10-07 11:29:06.572971] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.219 [2024-10-07 11:29:06.572985] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.219 [2024-10-07 11:29:06.572998] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.219 [2024-10-07 11:29:06.573021] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.219 [2024-10-07 11:29:06.573035] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.219 [2024-10-07 11:29:06.583426] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.219 [2024-10-07 11:29:06.583500] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.219 [2024-10-07 11:29:06.583610] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.219 [2024-10-07 11:29:06.583657] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.219 [2024-10-07 11:29:06.583674] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.219 [2024-10-07 11:29:06.583721] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.219 [2024-10-07 11:29:06.583743] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.219 [2024-10-07 11:29:06.583758] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.219 [2024-10-07 11:29:06.583797] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.219 [2024-10-07 11:29:06.583816] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.219 [2024-10-07 11:29:06.583835] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.219 [2024-10-07 11:29:06.583849] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.219 [2024-10-07 11:29:06.583863] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.219 [2024-10-07 11:29:06.583878] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.219 [2024-10-07 11:29:06.583908] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.219 [2024-10-07 11:29:06.583921] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.219 [2024-10-07 11:29:06.583961] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.219 [2024-10-07 11:29:06.583977] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.219 [2024-10-07 11:29:06.598103] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.219 [2024-10-07 11:29:06.598155] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.219 [2024-10-07 11:29:06.598506] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.219 [2024-10-07 11:29:06.598548] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.219 [2024-10-07 11:29:06.598567] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.219 [2024-10-07 11:29:06.598617] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.219 [2024-10-07 11:29:06.598640] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.219 [2024-10-07 11:29:06.598655] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.219 [2024-10-07 11:29:06.598710] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.219 [2024-10-07 11:29:06.598735] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.219 [2024-10-07 11:29:06.598756] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.219 [2024-10-07 11:29:06.598770] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.219 [2024-10-07 11:29:06.598784] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.219 [2024-10-07 11:29:06.598802] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.219 [2024-10-07 11:29:06.598816] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.219 [2024-10-07 11:29:06.598830] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.219 [2024-10-07 11:29:06.598853] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.219 [2024-10-07 11:29:06.598867] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.219 [2024-10-07 11:29:06.611489] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.219 [2024-10-07 11:29:06.611536] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.219 [2024-10-07 11:29:06.611664] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.219 [2024-10-07 11:29:06.611694] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.219 [2024-10-07 11:29:06.611711] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.219 [2024-10-07 11:29:06.611757] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.219 [2024-10-07 11:29:06.611779] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.219 [2024-10-07 11:29:06.611794] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.219 [2024-10-07 11:29:06.611818] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.219 [2024-10-07 11:29:06.611838] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.219 [2024-10-07 11:29:06.611858] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.219 [2024-10-07 11:29:06.611896] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.219 [2024-10-07 11:29:06.611912] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.219 [2024-10-07 11:29:06.611928] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.219 [2024-10-07 11:29:06.611943] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.219 [2024-10-07 11:29:06.611956] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.219 [2024-10-07 11:29:06.612216] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.219 [2024-10-07 11:29:06.612241] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.219 [2024-10-07 11:29:06.621612] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.219 [2024-10-07 11:29:06.621662] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.219 [2024-10-07 11:29:06.621748] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.219 [2024-10-07 11:29:06.621777] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.219 [2024-10-07 11:29:06.621794] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.219 [2024-10-07 11:29:06.621841] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.219 [2024-10-07 11:29:06.621863] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.219 [2024-10-07 11:29:06.621879] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.219 [2024-10-07 11:29:06.621903] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.219 [2024-10-07 11:29:06.621922] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.219 [2024-10-07 11:29:06.621942] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.219 [2024-10-07 11:29:06.621956] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.219 [2024-10-07 11:29:06.621983] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.219 [2024-10-07 11:29:06.621999] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.219 [2024-10-07 11:29:06.622013] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.219 [2024-10-07 11:29:06.622036] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.219 [2024-10-07 11:29:06.622058] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.219 [2024-10-07 11:29:06.622072] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.219 [2024-10-07 11:29:06.633841] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.219 [2024-10-07 11:29:06.633889] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.219 [2024-10-07 11:29:06.634561] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.219 [2024-10-07 11:29:06.634617] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.219 [2024-10-07 11:29:06.634636] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.220 [2024-10-07 11:29:06.634703] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.220 [2024-10-07 11:29:06.634727] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.220 [2024-10-07 11:29:06.634741] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.220 [2024-10-07 11:29:06.635054] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.220 [2024-10-07 11:29:06.635084] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.220 [2024-10-07 11:29:06.635226] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.220 [2024-10-07 11:29:06.635248] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.220 [2024-10-07 11:29:06.635262] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.220 [2024-10-07 11:29:06.635278] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.220 [2024-10-07 11:29:06.635292] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.220 [2024-10-07 11:29:06.635304] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.220 [2024-10-07 11:29:06.635417] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.220 [2024-10-07 11:29:06.635435] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.220 [2024-10-07 11:29:06.645078] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.220 [2024-10-07 11:29:06.645158] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.220 [2024-10-07 11:29:06.645410] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.220 [2024-10-07 11:29:06.645483] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.220 [2024-10-07 11:29:06.645503] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.220 [2024-10-07 11:29:06.645552] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.220 [2024-10-07 11:29:06.645574] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.220 [2024-10-07 11:29:06.645590] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.220 [2024-10-07 11:29:06.645635] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.220 [2024-10-07 11:29:06.645659] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.220 [2024-10-07 11:29:06.645696] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.220 [2024-10-07 11:29:06.645711] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.220 [2024-10-07 11:29:06.645724] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.220 [2024-10-07 11:29:06.645740] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.220 [2024-10-07 11:29:06.645754] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.220 [2024-10-07 11:29:06.645767] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.220 [2024-10-07 11:29:06.645790] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.220 [2024-10-07 11:29:06.645819] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.220 [2024-10-07 11:29:06.657791] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.220 [2024-10-07 11:29:06.657869] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.220 [2024-10-07 11:29:06.659077] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.220 [2024-10-07 11:29:06.659133] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.220 [2024-10-07 11:29:06.659152] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.220 [2024-10-07 11:29:06.659199] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.220 [2024-10-07 11:29:06.659221] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.220 [2024-10-07 11:29:06.659236] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.220 [2024-10-07 11:29:06.659583] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.220 [2024-10-07 11:29:06.659614] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.220 [2024-10-07 11:29:06.659965] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.220 [2024-10-07 11:29:06.659999] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.220 [2024-10-07 11:29:06.660015] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.220 [2024-10-07 11:29:06.660031] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.220 [2024-10-07 11:29:06.660045] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.220 [2024-10-07 11:29:06.660057] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.220 [2024-10-07 11:29:06.660910] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.220 [2024-10-07 11:29:06.660945] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.220 [2024-10-07 11:29:06.674389] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.220 [2024-10-07 11:29:06.674446] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.220 [2024-10-07 11:29:06.674635] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.220 [2024-10-07 11:29:06.674666] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.220 [2024-10-07 11:29:06.674683] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.220 [2024-10-07 11:29:06.674730] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.220 [2024-10-07 11:29:06.674753] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.220 [2024-10-07 11:29:06.674768] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.220 [2024-10-07 11:29:06.674806] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.220 [2024-10-07 11:29:06.674826] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.220 [2024-10-07 11:29:06.674845] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.220 [2024-10-07 11:29:06.674859] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.220 [2024-10-07 11:29:06.674888] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.220 [2024-10-07 11:29:06.674906] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.220 [2024-10-07 11:29:06.674920] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.220 [2024-10-07 11:29:06.674933] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.220 [2024-10-07 11:29:06.674956] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.220 [2024-10-07 11:29:06.674970] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.220 [2024-10-07 11:29:06.685261] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.220 [2024-10-07 11:29:06.685312] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.220 [2024-10-07 11:29:06.685398] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.220 [2024-10-07 11:29:06.685441] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.220 [2024-10-07 11:29:06.685460] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.220 [2024-10-07 11:29:06.685509] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.220 [2024-10-07 11:29:06.685532] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.220 [2024-10-07 11:29:06.685547] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.220 [2024-10-07 11:29:06.685762] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.220 [2024-10-07 11:29:06.685793] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.220 [2024-10-07 11:29:06.685954] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.220 [2024-10-07 11:29:06.685996] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.220 [2024-10-07 11:29:06.686011] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.220 [2024-10-07 11:29:06.686029] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.220 [2024-10-07 11:29:06.686043] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.220 [2024-10-07 11:29:06.686056] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.220 [2024-10-07 11:29:06.686187] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.220 [2024-10-07 11:29:06.686210] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.220 [2024-10-07 11:29:06.695373] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.220 [2024-10-07 11:29:06.695477] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.220 [2024-10-07 11:29:06.695555] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.220 [2024-10-07 11:29:06.695592] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.220 [2024-10-07 11:29:06.695609] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.220 [2024-10-07 11:29:06.695664] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.220 [2024-10-07 11:29:06.695687] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.220 [2024-10-07 11:29:06.695718] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.220 [2024-10-07 11:29:06.695738] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.220 [2024-10-07 11:29:06.695762] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.220 [2024-10-07 11:29:06.695779] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.220 [2024-10-07 11:29:06.695793] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.221 [2024-10-07 11:29:06.695807] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.221 [2024-10-07 11:29:06.695829] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.221 [2024-10-07 11:29:06.695844] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.221 [2024-10-07 11:29:06.695857] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.221 [2024-10-07 11:29:06.695870] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.221 [2024-10-07 11:29:06.695890] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.221 [2024-10-07 11:29:06.705503] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.221 [2024-10-07 11:29:06.705649] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.221 [2024-10-07 11:29:06.705686] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.221 [2024-10-07 11:29:06.705709] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.221 [2024-10-07 11:29:06.705754] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.221 [2024-10-07 11:29:06.705790] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.221 [2024-10-07 11:29:06.705826] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.221 [2024-10-07 11:29:06.705847] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.221 [2024-10-07 11:29:06.705866] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.221 [2024-10-07 11:29:06.706851] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.221 [2024-10-07 11:29:06.706964] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.221 [2024-10-07 11:29:06.706992] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.221 [2024-10-07 11:29:06.707010] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.221 [2024-10-07 11:29:06.707129] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.221 [2024-10-07 11:29:06.707158] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.221 [2024-10-07 11:29:06.707173] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.221 [2024-10-07 11:29:06.707187] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.221 [2024-10-07 11:29:06.707210] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.221 [2024-10-07 11:29:06.715601] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.221 [2024-10-07 11:29:06.715742] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.221 [2024-10-07 11:29:06.715772] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.221 [2024-10-07 11:29:06.715804] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.221 [2024-10-07 11:29:06.715827] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.221 [2024-10-07 11:29:06.716456] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.221 [2024-10-07 11:29:06.716530] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.221 [2024-10-07 11:29:06.716549] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.221 [2024-10-07 11:29:06.716630] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.221 [2024-10-07 11:29:06.716656] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.221 [2024-10-07 11:29:06.716724] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.221 [2024-10-07 11:29:06.716751] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.221 [2024-10-07 11:29:06.716767] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.221 [2024-10-07 11:29:06.716789] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.221 [2024-10-07 11:29:06.716826] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.221 [2024-10-07 11:29:06.716841] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.221 [2024-10-07 11:29:06.716854] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.221 [2024-10-07 11:29:06.716876] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.221 [2024-10-07 11:29:06.727391] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.221 [2024-10-07 11:29:06.727605] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.221 [2024-10-07 11:29:06.727686] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.221 [2024-10-07 11:29:06.727713] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.221 [2024-10-07 11:29:06.727730] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.221 [2024-10-07 11:29:06.731644] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.221 [2024-10-07 11:29:06.731687] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.221 [2024-10-07 11:29:06.731707] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.221 [2024-10-07 11:29:06.731726] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.221 [2024-10-07 11:29:06.732827] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.221 [2024-10-07 11:29:06.732879] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.221 [2024-10-07 11:29:06.732910] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.221 [2024-10-07 11:29:06.732922] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.221 [2024-10-07 11:29:06.733199] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.221 [2024-10-07 11:29:06.733240] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.221 [2024-10-07 11:29:06.733254] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.221 [2024-10-07 11:29:06.733267] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.221 [2024-10-07 11:29:06.733621] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.221 [2024-10-07 11:29:06.737510] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.221 [2024-10-07 11:29:06.737637] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.221 [2024-10-07 11:29:06.737665] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.221 [2024-10-07 11:29:06.737682] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.221 [2024-10-07 11:29:06.737705] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.221 [2024-10-07 11:29:06.737752] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.221 [2024-10-07 11:29:06.737768] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.221 [2024-10-07 11:29:06.737781] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.221 [2024-10-07 11:29:06.737803] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.221 [2024-10-07 11:29:06.737820] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.221 [2024-10-07 11:29:06.737877] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.221 [2024-10-07 11:29:06.737901] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.221 [2024-10-07 11:29:06.737916] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.221 [2024-10-07 11:29:06.738734] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.221 [2024-10-07 11:29:06.738976] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.221 [2024-10-07 11:29:06.739008] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.221 [2024-10-07 11:29:06.739023] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.221 [2024-10-07 11:29:06.739165] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.221 [2024-10-07 11:29:06.748602] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.221 [2024-10-07 11:29:06.748650] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.221 [2024-10-07 11:29:06.748832] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.221 [2024-10-07 11:29:06.748861] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.221 [2024-10-07 11:29:06.748878] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.221 [2024-10-07 11:29:06.748940] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.221 [2024-10-07 11:29:06.748969] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.221 [2024-10-07 11:29:06.748984] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.222 [2024-10-07 11:29:06.749025] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.222 [2024-10-07 11:29:06.749046] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.222 [2024-10-07 11:29:06.749066] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.222 [2024-10-07 11:29:06.749082] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.222 [2024-10-07 11:29:06.749104] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.222 [2024-10-07 11:29:06.749125] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.222 [2024-10-07 11:29:06.749140] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.222 [2024-10-07 11:29:06.749153] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.222 [2024-10-07 11:29:06.749176] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.222 [2024-10-07 11:29:06.749190] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.222 [2024-10-07 11:29:06.760366] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.222 [2024-10-07 11:29:06.760442] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.222 [2024-10-07 11:29:06.760527] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.222 [2024-10-07 11:29:06.760556] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.222 [2024-10-07 11:29:06.760572] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.222 [2024-10-07 11:29:06.760617] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.222 [2024-10-07 11:29:06.760638] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.222 [2024-10-07 11:29:06.760653] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.222 [2024-10-07 11:29:06.760676] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.222 [2024-10-07 11:29:06.760695] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.222 [2024-10-07 11:29:06.760714] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.222 [2024-10-07 11:29:06.760728] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.222 [2024-10-07 11:29:06.760741] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.222 [2024-10-07 11:29:06.760757] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.222 [2024-10-07 11:29:06.760770] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.222 [2024-10-07 11:29:06.760783] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.222 [2024-10-07 11:29:06.760806] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.222 [2024-10-07 11:29:06.760819] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.222 [2024-10-07 11:29:06.772410] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.222 [2024-10-07 11:29:06.772468] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.222 [2024-10-07 11:29:06.772666] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.222 [2024-10-07 11:29:06.772695] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.222 [2024-10-07 11:29:06.772711] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.222 [2024-10-07 11:29:06.772755] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.222 [2024-10-07 11:29:06.772777] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.222 [2024-10-07 11:29:06.772791] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.222 [2024-10-07 11:29:06.772888] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.222 [2024-10-07 11:29:06.772911] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.222 [2024-10-07 11:29:06.773034] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.222 [2024-10-07 11:29:06.773053] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.222 [2024-10-07 11:29:06.773067] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.222 [2024-10-07 11:29:06.773083] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.222 [2024-10-07 11:29:06.773098] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.222 [2024-10-07 11:29:06.773112] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.222 [2024-10-07 11:29:06.773425] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.222 [2024-10-07 11:29:06.773450] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.222 [2024-10-07 11:29:06.783239] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.222 [2024-10-07 11:29:06.783285] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.222 [2024-10-07 11:29:06.783529] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.222 [2024-10-07 11:29:06.783560] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.222 [2024-10-07 11:29:06.783576] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.222 [2024-10-07 11:29:06.783623] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.222 [2024-10-07 11:29:06.783645] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.222 [2024-10-07 11:29:06.783660] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.222 [2024-10-07 11:29:06.783781] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.222 [2024-10-07 11:29:06.783808] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.222 [2024-10-07 11:29:06.783925] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.222 [2024-10-07 11:29:06.783945] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.222 [2024-10-07 11:29:06.783958] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.222 [2024-10-07 11:29:06.783974] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.222 [2024-10-07 11:29:06.784004] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.222 [2024-10-07 11:29:06.784017] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.222 [2024-10-07 11:29:06.784113] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.222 [2024-10-07 11:29:06.784131] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.222 [2024-10-07 11:29:06.793827] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.222 [2024-10-07 11:29:06.793879] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.222 [2024-10-07 11:29:06.793982] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.222 [2024-10-07 11:29:06.794013] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.222 [2024-10-07 11:29:06.794030] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.222 [2024-10-07 11:29:06.794077] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.222 [2024-10-07 11:29:06.794100] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.222 [2024-10-07 11:29:06.794115] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.222 [2024-10-07 11:29:06.794139] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.222 [2024-10-07 11:29:06.794166] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.222 [2024-10-07 11:29:06.794186] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.222 [2024-10-07 11:29:06.794200] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.222 [2024-10-07 11:29:06.794215] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.222 [2024-10-07 11:29:06.794230] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.222 [2024-10-07 11:29:06.794244] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.222 [2024-10-07 11:29:06.794258] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.222 [2024-10-07 11:29:06.794281] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.222 [2024-10-07 11:29:06.794294] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.222 [2024-10-07 11:29:06.806830] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.222 [2024-10-07 11:29:06.806876] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.222 [2024-10-07 11:29:06.806974] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.222 [2024-10-07 11:29:06.807001] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.222 [2024-10-07 11:29:06.807018] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.222 [2024-10-07 11:29:06.807078] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.222 [2024-10-07 11:29:06.807100] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.222 [2024-10-07 11:29:06.807116] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.222 [2024-10-07 11:29:06.807139] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.222 [2024-10-07 11:29:06.807180] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.222 [2024-10-07 11:29:06.807201] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.222 [2024-10-07 11:29:06.807215] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.222 [2024-10-07 11:29:06.807228] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.222 [2024-10-07 11:29:06.807244] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.222 [2024-10-07 11:29:06.807258] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.223 [2024-10-07 11:29:06.807271] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.223 [2024-10-07 11:29:06.807526] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.223 [2024-10-07 11:29:06.807552] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.223 [2024-10-07 11:29:06.820518] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.223 [2024-10-07 11:29:06.820566] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.223 [2024-10-07 11:29:06.820666] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.223 [2024-10-07 11:29:06.820694] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.223 [2024-10-07 11:29:06.820712] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.223 [2024-10-07 11:29:06.820758] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.223 [2024-10-07 11:29:06.820781] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.223 [2024-10-07 11:29:06.820796] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.223 [2024-10-07 11:29:06.820835] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.223 [2024-10-07 11:29:06.820854] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.223 [2024-10-07 11:29:06.820873] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.223 [2024-10-07 11:29:06.820887] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.223 [2024-10-07 11:29:06.820901] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.223 [2024-10-07 11:29:06.820916] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.223 [2024-10-07 11:29:06.820944] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.223 [2024-10-07 11:29:06.820957] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.223 [2024-10-07 11:29:06.820978] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.223 [2024-10-07 11:29:06.820991] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.223 [2024-10-07 11:29:06.833051] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.223 [2024-10-07 11:29:06.833096] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.223 [2024-10-07 11:29:06.833191] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.223 [2024-10-07 11:29:06.833232] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.223 [2024-10-07 11:29:06.833249] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.223 [2024-10-07 11:29:06.833296] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.223 [2024-10-07 11:29:06.833318] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.223 [2024-10-07 11:29:06.833333] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.223 [2024-10-07 11:29:06.833879] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.223 [2024-10-07 11:29:06.833918] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.223 [2024-10-07 11:29:06.834039] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.223 [2024-10-07 11:29:06.834062] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.223 [2024-10-07 11:29:06.834076] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.223 [2024-10-07 11:29:06.834093] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.223 [2024-10-07 11:29:06.834108] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.223 [2024-10-07 11:29:06.834122] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.223 [2024-10-07 11:29:06.834163] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.223 [2024-10-07 11:29:06.834181] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.223 [2024-10-07 11:29:06.843168] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.223 [2024-10-07 11:29:06.843260] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.223 [2024-10-07 11:29:06.843334] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.223 [2024-10-07 11:29:06.843361] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.223 [2024-10-07 11:29:06.843377] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.223 [2024-10-07 11:29:06.845336] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.223 [2024-10-07 11:29:06.845391] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.223 [2024-10-07 11:29:06.845409] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.223 [2024-10-07 11:29:06.845439] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.223 [2024-10-07 11:29:06.846072] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.223 [2024-10-07 11:29:06.846109] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.223 [2024-10-07 11:29:06.846126] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.223 [2024-10-07 11:29:06.846140] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.223 [2024-10-07 11:29:06.846615] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.223 [2024-10-07 11:29:06.846642] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.223 [2024-10-07 11:29:06.846672] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.223 [2024-10-07 11:29:06.846687] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.223 [2024-10-07 11:29:06.846789] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.223 [2024-10-07 11:29:06.856441] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.223 [2024-10-07 11:29:06.856499] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.223 [2024-10-07 11:29:06.856674] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.223 [2024-10-07 11:29:06.856703] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.223 [2024-10-07 11:29:06.856720] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.223 [2024-10-07 11:29:06.856765] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.223 [2024-10-07 11:29:06.856787] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.223 [2024-10-07 11:29:06.856802] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.223 [2024-10-07 11:29:06.858094] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.223 [2024-10-07 11:29:06.858139] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.223 [2024-10-07 11:29:06.859956] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.223 [2024-10-07 11:29:06.859999] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.223 [2024-10-07 11:29:06.860032] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.223 [2024-10-07 11:29:06.860057] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.223 [2024-10-07 11:29:06.860076] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.223 [2024-10-07 11:29:06.860094] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.223 [2024-10-07 11:29:06.860828] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.223 [2024-10-07 11:29:06.860870] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.223 [2024-10-07 11:29:06.867508] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.223 [2024-10-07 11:29:06.867554] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.223 [2024-10-07 11:29:06.867754] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.223 [2024-10-07 11:29:06.867784] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.223 [2024-10-07 11:29:06.867800] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.223 [2024-10-07 11:29:06.867860] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.223 [2024-10-07 11:29:06.867882] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.223 [2024-10-07 11:29:06.867896] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.223 [2024-10-07 11:29:06.868027] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.223 [2024-10-07 11:29:06.868053] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.223 [2024-10-07 11:29:06.868191] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.223 [2024-10-07 11:29:06.868213] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.223 [2024-10-07 11:29:06.868227] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.223 [2024-10-07 11:29:06.868243] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.223 [2024-10-07 11:29:06.868257] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.223 [2024-10-07 11:29:06.868269] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.223 [2024-10-07 11:29:06.868374] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.223 [2024-10-07 11:29:06.868393] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.223 [2024-10-07 11:29:06.878492] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.223 [2024-10-07 11:29:06.878538] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.223 [2024-10-07 11:29:06.878661] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.223 [2024-10-07 11:29:06.878690] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.224 [2024-10-07 11:29:06.878706] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.224 [2024-10-07 11:29:06.878750] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.224 [2024-10-07 11:29:06.878772] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.224 [2024-10-07 11:29:06.878786] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.224 [2024-10-07 11:29:06.878809] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.224 [2024-10-07 11:29:06.878827] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.224 [2024-10-07 11:29:06.878845] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.224 [2024-10-07 11:29:06.878859] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.224 [2024-10-07 11:29:06.878872] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.224 [2024-10-07 11:29:06.878887] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.224 [2024-10-07 11:29:06.878900] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.224 [2024-10-07 11:29:06.878912] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.224 [2024-10-07 11:29:06.878934] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.224 [2024-10-07 11:29:06.878948] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.224 [2024-10-07 11:29:06.888613] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.224 [2024-10-07 11:29:06.888689] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.224 [2024-10-07 11:29:06.888762] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.224 [2024-10-07 11:29:06.888789] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.224 [2024-10-07 11:29:06.888820] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.224 [2024-10-07 11:29:06.888890] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.224 [2024-10-07 11:29:06.888912] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.224 [2024-10-07 11:29:06.888927] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.224 [2024-10-07 11:29:06.888945] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.224 [2024-10-07 11:29:06.888967] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.224 [2024-10-07 11:29:06.888983] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.224 [2024-10-07 11:29:06.888996] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.224 [2024-10-07 11:29:06.889008] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.224 [2024-10-07 11:29:06.889030] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.224 [2024-10-07 11:29:06.889044] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.224 [2024-10-07 11:29:06.889056] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.224 [2024-10-07 11:29:06.889069] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.224 [2024-10-07 11:29:06.889088] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.224 [2024-10-07 11:29:06.898799] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.224 [2024-10-07 11:29:06.898876] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.224 [2024-10-07 11:29:06.898947] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.224 [2024-10-07 11:29:06.898973] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.224 [2024-10-07 11:29:06.898989] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.224 [2024-10-07 11:29:06.899039] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.224 [2024-10-07 11:29:06.899061] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.224 [2024-10-07 11:29:06.899076] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.224 [2024-10-07 11:29:06.899093] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.224 [2024-10-07 11:29:06.899116] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.224 [2024-10-07 11:29:06.899132] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.224 [2024-10-07 11:29:06.899144] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.224 [2024-10-07 11:29:06.899157] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.224 [2024-10-07 11:29:06.900852] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.224 [2024-10-07 11:29:06.900889] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.224 [2024-10-07 11:29:06.900920] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.224 [2024-10-07 11:29:06.900956] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.224 [2024-10-07 11:29:06.901016] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.224 [2024-10-07 11:29:06.910895] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.224 [2024-10-07 11:29:06.910940] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.224 [2024-10-07 11:29:06.911080] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.224 [2024-10-07 11:29:06.911108] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.224 [2024-10-07 11:29:06.911124] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.224 [2024-10-07 11:29:06.911170] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.224 [2024-10-07 11:29:06.911192] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.224 [2024-10-07 11:29:06.911207] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.224 [2024-10-07 11:29:06.911241] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.224 [2024-10-07 11:29:06.911262] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.224 [2024-10-07 11:29:06.911282] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.224 [2024-10-07 11:29:06.911296] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.224 [2024-10-07 11:29:06.911309] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.224 [2024-10-07 11:29:06.911325] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.224 [2024-10-07 11:29:06.911339] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.224 [2024-10-07 11:29:06.911366] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.224 [2024-10-07 11:29:06.911387] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.224 [2024-10-07 11:29:06.911400] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.224 [2024-10-07 11:29:06.923287] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.224 [2024-10-07 11:29:06.923334] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.224 [2024-10-07 11:29:06.923487] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.224 [2024-10-07 11:29:06.923517] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.224 [2024-10-07 11:29:06.923534] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.224 [2024-10-07 11:29:06.923579] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.224 [2024-10-07 11:29:06.923602] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.224 [2024-10-07 11:29:06.923617] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.224 [2024-10-07 11:29:06.923655] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.224 [2024-10-07 11:29:06.923678] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.224 [2024-10-07 11:29:06.923698] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.224 [2024-10-07 11:29:06.923727] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.224 [2024-10-07 11:29:06.923742] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.224 [2024-10-07 11:29:06.923758] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.224 [2024-10-07 11:29:06.923787] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.224 [2024-10-07 11:29:06.923799] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.224 [2024-10-07 11:29:06.923821] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.224 [2024-10-07 11:29:06.923834] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.224 [2024-10-07 11:29:06.935860] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.224 [2024-10-07 11:29:06.935907] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.224 [2024-10-07 11:29:06.936222] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.224 [2024-10-07 11:29:06.936252] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.224 [2024-10-07 11:29:06.936268] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.224 [2024-10-07 11:29:06.936311] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.224 [2024-10-07 11:29:06.936332] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.224 [2024-10-07 11:29:06.936347] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.224 [2024-10-07 11:29:06.936867] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.224 [2024-10-07 11:29:06.936908] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.224 [2024-10-07 11:29:06.937120] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.225 [2024-10-07 11:29:06.937154] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.225 [2024-10-07 11:29:06.937169] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.225 [2024-10-07 11:29:06.937186] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.225 [2024-10-07 11:29:06.937199] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.225 [2024-10-07 11:29:06.937212] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.225 [2024-10-07 11:29:06.937263] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.225 [2024-10-07 11:29:06.937282] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.225 [2024-10-07 11:29:06.946181] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.225 [2024-10-07 11:29:06.950339] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.225 [2024-10-07 11:29:06.950462] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.225 [2024-10-07 11:29:06.950491] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.225 [2024-10-07 11:29:06.950507] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.225 [2024-10-07 11:29:06.951524] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.225 [2024-10-07 11:29:06.951580] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.225 [2024-10-07 11:29:06.951599] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.225 [2024-10-07 11:29:06.951617] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.225 [2024-10-07 11:29:06.951953] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.225 [2024-10-07 11:29:06.951983] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.225 [2024-10-07 11:29:06.951997] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.225 [2024-10-07 11:29:06.952010] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.225 [2024-10-07 11:29:06.952126] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.225 [2024-10-07 11:29:06.952149] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.225 [2024-10-07 11:29:06.952161] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.225 [2024-10-07 11:29:06.952174] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.225 [2024-10-07 11:29:06.952195] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.225 [2024-10-07 11:29:06.956861] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.225 [2024-10-07 11:29:06.957033] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.225 [2024-10-07 11:29:06.957063] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.225 [2024-10-07 11:29:06.957079] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.225 [2024-10-07 11:29:06.957175] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.225 [2024-10-07 11:29:06.957258] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.225 [2024-10-07 11:29:06.957276] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.225 [2024-10-07 11:29:06.957289] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.225 [2024-10-07 11:29:06.957311] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.225 [2024-10-07 11:29:06.964433] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.225 [2024-10-07 11:29:06.964729] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.225 [2024-10-07 11:29:06.964785] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.225 [2024-10-07 11:29:06.964804] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.225 [2024-10-07 11:29:06.965177] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.225 [2024-10-07 11:29:06.965257] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.225 [2024-10-07 11:29:06.965278] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.225 [2024-10-07 11:29:06.965292] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.225 [2024-10-07 11:29:06.966121] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.225 [2024-10-07 11:29:06.966977] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.225 [2024-10-07 11:29:06.967084] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.225 [2024-10-07 11:29:06.967112] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.225 [2024-10-07 11:29:06.967128] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.225 [2024-10-07 11:29:06.967150] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.225 [2024-10-07 11:29:06.967170] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.225 [2024-10-07 11:29:06.967183] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.225 [2024-10-07 11:29:06.967196] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.225 [2024-10-07 11:29:06.967218] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.225 [2024-10-07 11:29:06.977140] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.225 [2024-10-07 11:29:06.977234] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.225 [2024-10-07 11:29:06.977310] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.225 [2024-10-07 11:29:06.977337] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.225 [2024-10-07 11:29:06.977354] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.225 [2024-10-07 11:29:06.977407] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.225 [2024-10-07 11:29:06.977430] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.225 [2024-10-07 11:29:06.977460] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.225 [2024-10-07 11:29:06.977480] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.225 [2024-10-07 11:29:06.977505] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.225 [2024-10-07 11:29:06.977522] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.225 [2024-10-07 11:29:06.977535] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.225 [2024-10-07 11:29:06.977549] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.225 [2024-10-07 11:29:06.977571] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.225 [2024-10-07 11:29:06.977585] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.225 [2024-10-07 11:29:06.977601] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.225 [2024-10-07 11:29:06.977623] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.225 [2024-10-07 11:29:06.977650] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.225 [2024-10-07 11:29:06.989655] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.225 [2024-10-07 11:29:06.989701] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.225 [2024-10-07 11:29:06.989859] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.225 [2024-10-07 11:29:06.989901] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.225 [2024-10-07 11:29:06.989919] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.225 [2024-10-07 11:29:06.989993] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.225 [2024-10-07 11:29:06.990018] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.225 [2024-10-07 11:29:06.990034] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.225 [2024-10-07 11:29:06.990074] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.225 [2024-10-07 11:29:06.990098] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.225 [2024-10-07 11:29:06.990118] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.225 [2024-10-07 11:29:06.990132] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.225 [2024-10-07 11:29:06.990146] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.225 [2024-10-07 11:29:06.990162] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.225 [2024-10-07 11:29:06.990176] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.226 [2024-10-07 11:29:06.990189] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.226 [2024-10-07 11:29:06.990212] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.226 [2024-10-07 11:29:06.990226] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.226 [2024-10-07 11:29:07.000405] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.226 [2024-10-07 11:29:07.000466] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.226 [2024-10-07 11:29:07.000664] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.226 [2024-10-07 11:29:07.000711] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.226 [2024-10-07 11:29:07.000729] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.226 [2024-10-07 11:29:07.000776] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.226 [2024-10-07 11:29:07.000814] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.226 [2024-10-07 11:29:07.000830] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.226 [2024-10-07 11:29:07.000944] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.226 [2024-10-07 11:29:07.000969] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.226 [2024-10-07 11:29:07.001062] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.226 [2024-10-07 11:29:07.001095] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.226 [2024-10-07 11:29:07.001108] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.226 [2024-10-07 11:29:07.001123] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.226 [2024-10-07 11:29:07.001137] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.226 [2024-10-07 11:29:07.001164] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.226 [2024-10-07 11:29:07.003575] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.226 [2024-10-07 11:29:07.003613] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.226 [2024-10-07 11:29:07.011043] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.226 [2024-10-07 11:29:07.011088] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.226 [2024-10-07 11:29:07.011184] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.226 [2024-10-07 11:29:07.011212] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.226 [2024-10-07 11:29:07.011228] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.226 [2024-10-07 11:29:07.011271] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.226 [2024-10-07 11:29:07.011292] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.226 [2024-10-07 11:29:07.011307] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.226 [2024-10-07 11:29:07.011329] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.226 [2024-10-07 11:29:07.011347] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.226 [2024-10-07 11:29:07.011366] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.226 [2024-10-07 11:29:07.011379] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.226 [2024-10-07 11:29:07.011392] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.226 [2024-10-07 11:29:07.011407] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.226 [2024-10-07 11:29:07.011420] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.226 [2024-10-07 11:29:07.011448] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.226 [2024-10-07 11:29:07.011472] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.226 [2024-10-07 11:29:07.011485] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.226 [2024-10-07 11:29:07.021318] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.226 [2024-10-07 11:29:07.021367] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.226 [2024-10-07 11:29:07.021464] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.226 [2024-10-07 11:29:07.021493] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.226 [2024-10-07 11:29:07.021510] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.226 [2024-10-07 11:29:07.021557] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.226 [2024-10-07 11:29:07.021579] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.226 [2024-10-07 11:29:07.021595] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.226 [2024-10-07 11:29:07.021619] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.226 [2024-10-07 11:29:07.021655] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.226 [2024-10-07 11:29:07.021678] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.226 [2024-10-07 11:29:07.021693] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.226 [2024-10-07 11:29:07.021707] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.226 [2024-10-07 11:29:07.021723] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.226 [2024-10-07 11:29:07.021737] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.226 [2024-10-07 11:29:07.021750] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.226 [2024-10-07 11:29:07.021772] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.226 [2024-10-07 11:29:07.021787] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.226 [2024-10-07 11:29:07.031427] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.226 [2024-10-07 11:29:07.031514] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.226 [2024-10-07 11:29:07.031600] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.226 [2024-10-07 11:29:07.031628] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.226 [2024-10-07 11:29:07.031644] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.226 [2024-10-07 11:29:07.031696] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.226 [2024-10-07 11:29:07.031719] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.226 [2024-10-07 11:29:07.031750] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.226 [2024-10-07 11:29:07.031767] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.226 [2024-10-07 11:29:07.031789] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.226 [2024-10-07 11:29:07.031805] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.226 [2024-10-07 11:29:07.031818] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.226 [2024-10-07 11:29:07.031831] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.226 [2024-10-07 11:29:07.031852] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.226 [2024-10-07 11:29:07.031866] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.226 [2024-10-07 11:29:07.031878] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.226 [2024-10-07 11:29:07.031890] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.226 [2024-10-07 11:29:07.031910] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.226 [2024-10-07 11:29:07.043822] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.226 [2024-10-07 11:29:07.043867] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.226 [2024-10-07 11:29:07.043961] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.226 [2024-10-07 11:29:07.043988] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.226 [2024-10-07 11:29:07.044021] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.226 [2024-10-07 11:29:07.044069] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.226 [2024-10-07 11:29:07.044091] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.226 [2024-10-07 11:29:07.044106] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.226 [2024-10-07 11:29:07.044942] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.226 [2024-10-07 11:29:07.044981] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.226 [2024-10-07 11:29:07.045179] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.226 [2024-10-07 11:29:07.045202] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.226 [2024-10-07 11:29:07.045215] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.226 [2024-10-07 11:29:07.045232] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.226 [2024-10-07 11:29:07.045246] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.226 [2024-10-07 11:29:07.045258] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.226 [2024-10-07 11:29:07.046073] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.226 [2024-10-07 11:29:07.046106] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.226 [2024-10-07 11:29:07.053944] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.226 [2024-10-07 11:29:07.054019] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.226 [2024-10-07 11:29:07.054095] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.226 [2024-10-07 11:29:07.054123] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.226 [2024-10-07 11:29:07.054139] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.226 [2024-10-07 11:29:07.054192] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.226 [2024-10-07 11:29:07.054215] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.226 [2024-10-07 11:29:07.054231] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.226 [2024-10-07 11:29:07.054249] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.226 [2024-10-07 11:29:07.054273] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.227 [2024-10-07 11:29:07.054290] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.227 [2024-10-07 11:29:07.054303] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.227 [2024-10-07 11:29:07.054317] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.227 [2024-10-07 11:29:07.054340] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.227 [2024-10-07 11:29:07.054354] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.227 [2024-10-07 11:29:07.054367] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.227 [2024-10-07 11:29:07.054397] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.227 [2024-10-07 11:29:07.054436] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.227 [2024-10-07 11:29:07.064959] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.227 [2024-10-07 11:29:07.065005] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.227 [2024-10-07 11:29:07.065102] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.227 [2024-10-07 11:29:07.065130] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.227 [2024-10-07 11:29:07.065146] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.227 [2024-10-07 11:29:07.065209] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.227 [2024-10-07 11:29:07.065232] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.227 [2024-10-07 11:29:07.065248] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.227 [2024-10-07 11:29:07.065788] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.227 [2024-10-07 11:29:07.065846] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.227 [2024-10-07 11:29:07.066031] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.227 [2024-10-07 11:29:07.066064] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.227 [2024-10-07 11:29:07.066080] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.227 [2024-10-07 11:29:07.066098] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.227 [2024-10-07 11:29:07.066113] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.227 [2024-10-07 11:29:07.066126] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.227 [2024-10-07 11:29:07.066227] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.227 [2024-10-07 11:29:07.066245] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.227 [2024-10-07 11:29:07.078524] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.227 [2024-10-07 11:29:07.078571] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.227 [2024-10-07 11:29:07.079019] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.227 [2024-10-07 11:29:07.079060] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.227 [2024-10-07 11:29:07.079079] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.227 [2024-10-07 11:29:07.079126] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.227 [2024-10-07 11:29:07.079164] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.227 [2024-10-07 11:29:07.079180] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.227 [2024-10-07 11:29:07.079232] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.227 [2024-10-07 11:29:07.079258] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.227 [2024-10-07 11:29:07.079550] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.227 [2024-10-07 11:29:07.079579] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.227 [2024-10-07 11:29:07.079593] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.227 [2024-10-07 11:29:07.079610] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.227 [2024-10-07 11:29:07.079624] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.227 [2024-10-07 11:29:07.079638] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.227 [2024-10-07 11:29:07.079772] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.227 [2024-10-07 11:29:07.079796] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.227 [2024-10-07 11:29:07.093895] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.227 [2024-10-07 11:29:07.093944] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.227 [2024-10-07 11:29:07.094187] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.227 [2024-10-07 11:29:07.094218] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.227 [2024-10-07 11:29:07.094236] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.227 [2024-10-07 11:29:07.094283] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.227 [2024-10-07 11:29:07.094305] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.227 [2024-10-07 11:29:07.094321] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.227 [2024-10-07 11:29:07.094346] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.227 [2024-10-07 11:29:07.094367] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.227 [2024-10-07 11:29:07.094387] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.227 [2024-10-07 11:29:07.094402] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.227 [2024-10-07 11:29:07.094415] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.227 [2024-10-07 11:29:07.094444] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.227 [2024-10-07 11:29:07.094462] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.227 [2024-10-07 11:29:07.094476] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.227 [2024-10-07 11:29:07.094500] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.227 [2024-10-07 11:29:07.094514] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.227 [2024-10-07 11:29:07.108144] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.227 [2024-10-07 11:29:07.108192] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.227 [2024-10-07 11:29:07.108293] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.227 [2024-10-07 11:29:07.108321] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.227 [2024-10-07 11:29:07.108338] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.227 [2024-10-07 11:29:07.108402] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.227 [2024-10-07 11:29:07.108438] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.227 [2024-10-07 11:29:07.108457] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.227 [2024-10-07 11:29:07.108482] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.227 [2024-10-07 11:29:07.108501] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.227 [2024-10-07 11:29:07.108521] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.227 [2024-10-07 11:29:07.108548] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.227 [2024-10-07 11:29:07.108561] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.227 [2024-10-07 11:29:07.108578] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.227 [2024-10-07 11:29:07.108591] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.227 [2024-10-07 11:29:07.108604] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.227 [2024-10-07 11:29:07.108627] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.227 [2024-10-07 11:29:07.108640] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.227 [2024-10-07 11:29:07.123189] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.227 [2024-10-07 11:29:07.123255] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.227 [2024-10-07 11:29:07.123342] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.227 [2024-10-07 11:29:07.123371] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.227 [2024-10-07 11:29:07.123388] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.227 [2024-10-07 11:29:07.123452] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.227 [2024-10-07 11:29:07.123477] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.227 [2024-10-07 11:29:07.123492] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.227 [2024-10-07 11:29:07.123517] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.227 [2024-10-07 11:29:07.123536] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.227 [2024-10-07 11:29:07.123556] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.227 [2024-10-07 11:29:07.123571] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.227 [2024-10-07 11:29:07.123585] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.227 [2024-10-07 11:29:07.123603] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.227 [2024-10-07 11:29:07.123617] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.227 [2024-10-07 11:29:07.123630] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.227 [2024-10-07 11:29:07.123662] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.227 [2024-10-07 11:29:07.123691] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.227 [2024-10-07 11:29:07.135071] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.227 [2024-10-07 11:29:07.135122] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.227 [2024-10-07 11:29:07.135207] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.227 [2024-10-07 11:29:07.135236] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.227 [2024-10-07 11:29:07.135253] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.227 [2024-10-07 11:29:07.135301] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.227 [2024-10-07 11:29:07.135323] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.227 [2024-10-07 11:29:07.135339] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.228 [2024-10-07 11:29:07.135363] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.228 [2024-10-07 11:29:07.135383] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.228 [2024-10-07 11:29:07.135402] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.228 [2024-10-07 11:29:07.135435] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.228 [2024-10-07 11:29:07.135451] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.228 [2024-10-07 11:29:07.135468] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.228 [2024-10-07 11:29:07.135482] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.228 [2024-10-07 11:29:07.135495] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.228 [2024-10-07 11:29:07.135518] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.228 [2024-10-07 11:29:07.135532] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.228 [2024-10-07 11:29:07.146142] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.228 [2024-10-07 11:29:07.146190] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.228 [2024-10-07 11:29:07.148149] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.228 [2024-10-07 11:29:07.148206] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.228 [2024-10-07 11:29:07.148225] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.228 [2024-10-07 11:29:07.148273] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.228 [2024-10-07 11:29:07.148295] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.228 [2024-10-07 11:29:07.148310] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.228 [2024-10-07 11:29:07.149589] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.228 [2024-10-07 11:29:07.149635] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.228 [2024-10-07 11:29:07.149911] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.228 [2024-10-07 11:29:07.149945] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.228 [2024-10-07 11:29:07.150005] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.228 [2024-10-07 11:29:07.150024] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.228 [2024-10-07 11:29:07.150039] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.228 [2024-10-07 11:29:07.150052] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.228 [2024-10-07 11:29:07.150190] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.228 [2024-10-07 11:29:07.150213] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.228 [2024-10-07 11:29:07.156252] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.228 [2024-10-07 11:29:07.156329] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.228 [2024-10-07 11:29:07.156403] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.228 [2024-10-07 11:29:07.156461] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.228 [2024-10-07 11:29:07.156481] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.228 [2024-10-07 11:29:07.158249] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.228 [2024-10-07 11:29:07.158293] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.228 [2024-10-07 11:29:07.158331] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.228 [2024-10-07 11:29:07.158349] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.228 [2024-10-07 11:29:07.158871] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.228 [2024-10-07 11:29:07.158910] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.228 [2024-10-07 11:29:07.158943] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.228 [2024-10-07 11:29:07.158957] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.228 [2024-10-07 11:29:07.159042] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.228 [2024-10-07 11:29:07.159063] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.228 [2024-10-07 11:29:07.159077] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.228 [2024-10-07 11:29:07.159091] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.228 [2024-10-07 11:29:07.159112] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.228 [2024-10-07 11:29:07.168359] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.228 [2024-10-07 11:29:07.168406] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.228 [2024-10-07 11:29:07.168565] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.228 [2024-10-07 11:29:07.168596] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.228 [2024-10-07 11:29:07.168613] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.228 [2024-10-07 11:29:07.168658] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.228 [2024-10-07 11:29:07.168697] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.228 [2024-10-07 11:29:07.168715] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.228 [2024-10-07 11:29:07.168739] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.228 [2024-10-07 11:29:07.168759] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.228 [2024-10-07 11:29:07.168779] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.228 [2024-10-07 11:29:07.168794] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.228 [2024-10-07 11:29:07.168822] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.228 [2024-10-07 11:29:07.168838] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.228 [2024-10-07 11:29:07.168852] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.228 [2024-10-07 11:29:07.168865] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.228 [2024-10-07 11:29:07.168887] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.228 [2024-10-07 11:29:07.168900] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.228 [2024-10-07 11:29:07.178977] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.228 [2024-10-07 11:29:07.179024] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.228 [2024-10-07 11:29:07.179223] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.228 [2024-10-07 11:29:07.179253] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.228 [2024-10-07 11:29:07.179270] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.228 [2024-10-07 11:29:07.179315] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.228 [2024-10-07 11:29:07.179337] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.228 [2024-10-07 11:29:07.179352] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.228 [2024-10-07 11:29:07.179495] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.228 [2024-10-07 11:29:07.179523] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.228 [2024-10-07 11:29:07.180626] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.228 [2024-10-07 11:29:07.180662] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.228 [2024-10-07 11:29:07.180679] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.228 [2024-10-07 11:29:07.180696] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.228 [2024-10-07 11:29:07.180711] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.228 [2024-10-07 11:29:07.180724] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.228 [2024-10-07 11:29:07.180851] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.228 [2024-10-07 11:29:07.180873] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.228 [2024-10-07 11:29:07.192584] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.228 [2024-10-07 11:29:07.192632] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.228 [2024-10-07 11:29:07.192819] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.228 [2024-10-07 11:29:07.192848] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.228 [2024-10-07 11:29:07.192864] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.228 [2024-10-07 11:29:07.192909] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.228 [2024-10-07 11:29:07.192930] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.228 [2024-10-07 11:29:07.192945] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.228 [2024-10-07 11:29:07.192968] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.228 [2024-10-07 11:29:07.192987] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.228 [2024-10-07 11:29:07.193006] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.228 [2024-10-07 11:29:07.193020] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.228 [2024-10-07 11:29:07.193034] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.228 [2024-10-07 11:29:07.193049] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.228 [2024-10-07 11:29:07.193063] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.228 [2024-10-07 11:29:07.193076] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.228 [2024-10-07 11:29:07.193098] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.228 [2024-10-07 11:29:07.193112] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.228 [2024-10-07 11:29:07.207082] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.228 [2024-10-07 11:29:07.207131] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.228 [2024-10-07 11:29:07.207230] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.228 [2024-10-07 11:29:07.207258] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.228 [2024-10-07 11:29:07.207275] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.228 [2024-10-07 11:29:07.207319] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.229 [2024-10-07 11:29:07.207342] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.229 [2024-10-07 11:29:07.207357] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.229 [2024-10-07 11:29:07.207380] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.229 [2024-10-07 11:29:07.207399] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.229 [2024-10-07 11:29:07.207418] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.229 [2024-10-07 11:29:07.207446] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.229 [2024-10-07 11:29:07.207461] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.229 [2024-10-07 11:29:07.207496] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.229 [2024-10-07 11:29:07.207512] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.229 [2024-10-07 11:29:07.207525] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.229 [2024-10-07 11:29:07.207548] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.229 [2024-10-07 11:29:07.207562] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.229 [2024-10-07 11:29:07.221562] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.229 [2024-10-07 11:29:07.221610] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.229 [2024-10-07 11:29:07.221694] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.229 [2024-10-07 11:29:07.221722] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.229 [2024-10-07 11:29:07.221739] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.229 [2024-10-07 11:29:07.221786] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.229 [2024-10-07 11:29:07.221808] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.229 [2024-10-07 11:29:07.221824] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.229 [2024-10-07 11:29:07.221848] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.229 [2024-10-07 11:29:07.221867] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.229 [2024-10-07 11:29:07.221887] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.229 [2024-10-07 11:29:07.221901] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.229 [2024-10-07 11:29:07.221915] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.229 [2024-10-07 11:29:07.221931] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.229 [2024-10-07 11:29:07.221944] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.229 [2024-10-07 11:29:07.221957] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.229 [2024-10-07 11:29:07.221993] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.229 [2024-10-07 11:29:07.222007] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.229 [2024-10-07 11:29:07.232766] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.229 [2024-10-07 11:29:07.232814] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.229 [2024-10-07 11:29:07.235731] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.229 [2024-10-07 11:29:07.235778] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.229 [2024-10-07 11:29:07.235797] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.229 [2024-10-07 11:29:07.235847] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.229 [2024-10-07 11:29:07.235871] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.229 [2024-10-07 11:29:07.235910] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.229 [2024-10-07 11:29:07.236794] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.229 [2024-10-07 11:29:07.236868] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.229 [2024-10-07 11:29:07.237080] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.229 [2024-10-07 11:29:07.237105] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.229 [2024-10-07 11:29:07.237120] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.229 [2024-10-07 11:29:07.237137] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.229 [2024-10-07 11:29:07.237151] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.229 [2024-10-07 11:29:07.237166] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.229 [2024-10-07 11:29:07.237290] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.229 [2024-10-07 11:29:07.237311] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.229 [2024-10-07 11:29:07.245807] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.229 [2024-10-07 11:29:07.245854] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.229 [2024-10-07 11:29:07.246006] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.229 [2024-10-07 11:29:07.246037] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.229 [2024-10-07 11:29:07.246053] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.229 [2024-10-07 11:29:07.246100] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.229 [2024-10-07 11:29:07.246122] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.229 [2024-10-07 11:29:07.246138] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.229 [2024-10-07 11:29:07.246164] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.229 [2024-10-07 11:29:07.246183] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.229 [2024-10-07 11:29:07.246203] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.229 [2024-10-07 11:29:07.246217] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.229 [2024-10-07 11:29:07.246230] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.229 [2024-10-07 11:29:07.246247] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.229 [2024-10-07 11:29:07.246261] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.229 [2024-10-07 11:29:07.246274] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.229 [2024-10-07 11:29:07.246297] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.229 [2024-10-07 11:29:07.246311] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.229 [2024-10-07 11:29:07.257433] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.229 [2024-10-07 11:29:07.257494] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.229 [2024-10-07 11:29:07.257741] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.229 [2024-10-07 11:29:07.257778] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.229 [2024-10-07 11:29:07.257797] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.229 [2024-10-07 11:29:07.257842] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.229 [2024-10-07 11:29:07.257865] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.229 [2024-10-07 11:29:07.257879] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.229 [2024-10-07 11:29:07.257923] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.229 [2024-10-07 11:29:07.257947] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.229 [2024-10-07 11:29:07.257995] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.229 [2024-10-07 11:29:07.258011] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.229 [2024-10-07 11:29:07.258025] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.229 [2024-10-07 11:29:07.258041] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.229 [2024-10-07 11:29:07.258055] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.229 [2024-10-07 11:29:07.258068] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.229 [2024-10-07 11:29:07.258091] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.229 [2024-10-07 11:29:07.258105] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.229 [2024-10-07 11:29:07.267589] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.229 [2024-10-07 11:29:07.267652] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.229 [2024-10-07 11:29:07.267727] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.229 [2024-10-07 11:29:07.267755] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.229 [2024-10-07 11:29:07.267772] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.229 [2024-10-07 11:29:07.270565] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.229 [2024-10-07 11:29:07.270623] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.229 [2024-10-07 11:29:07.270642] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.229 [2024-10-07 11:29:07.270661] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.230 [2024-10-07 11:29:07.271550] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.230 [2024-10-07 11:29:07.271587] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.230 [2024-10-07 11:29:07.271620] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.230 [2024-10-07 11:29:07.271633] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.230 [2024-10-07 11:29:07.271874] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.230 [2024-10-07 11:29:07.271914] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.230 [2024-10-07 11:29:07.271930] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.230 [2024-10-07 11:29:07.271944] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.230 [2024-10-07 11:29:07.272066] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.230 [2024-10-07 11:29:07.277909] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.230 [2024-10-07 11:29:07.277956] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.230 [2024-10-07 11:29:07.278191] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.230 [2024-10-07 11:29:07.278223] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.230 [2024-10-07 11:29:07.278240] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.230 [2024-10-07 11:29:07.278286] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.230 [2024-10-07 11:29:07.278308] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.230 [2024-10-07 11:29:07.278338] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.230 [2024-10-07 11:29:07.278389] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.230 [2024-10-07 11:29:07.278413] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.230 [2024-10-07 11:29:07.278448] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.230 [2024-10-07 11:29:07.278464] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.230 [2024-10-07 11:29:07.278477] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.230 [2024-10-07 11:29:07.278493] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.230 [2024-10-07 11:29:07.278507] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.230 [2024-10-07 11:29:07.278520] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.230 [2024-10-07 11:29:07.278542] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.230 [2024-10-07 11:29:07.278556] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.230 [2024-10-07 11:29:07.290889] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.230 [2024-10-07 11:29:07.290953] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.230 [2024-10-07 11:29:07.291266] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.230 [2024-10-07 11:29:07.291307] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.230 [2024-10-07 11:29:07.291326] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.230 [2024-10-07 11:29:07.291390] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.230 [2024-10-07 11:29:07.291412] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.230 [2024-10-07 11:29:07.291441] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.230 [2024-10-07 11:29:07.291532] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.230 [2024-10-07 11:29:07.291561] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.230 [2024-10-07 11:29:07.291581] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.230 [2024-10-07 11:29:07.291596] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.230 [2024-10-07 11:29:07.291609] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.230 [2024-10-07 11:29:07.291626] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.230 [2024-10-07 11:29:07.291641] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.230 [2024-10-07 11:29:07.291654] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.230 [2024-10-07 11:29:07.291677] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.230 [2024-10-07 11:29:07.291706] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.230 [2024-10-07 11:29:07.305170] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.230 [2024-10-07 11:29:07.305220] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.230 [2024-10-07 11:29:07.306485] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.230 [2024-10-07 11:29:07.306548] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.230 [2024-10-07 11:29:07.306567] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.230 [2024-10-07 11:29:07.306618] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.230 [2024-10-07 11:29:07.306641] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.230 [2024-10-07 11:29:07.306656] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.230 [2024-10-07 11:29:07.306784] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.230 [2024-10-07 11:29:07.306811] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.230 [2024-10-07 11:29:07.306832] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.230 [2024-10-07 11:29:07.306847] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.230 [2024-10-07 11:29:07.306860] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.230 [2024-10-07 11:29:07.306879] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.230 [2024-10-07 11:29:07.306893] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.230 [2024-10-07 11:29:07.306906] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.230 [2024-10-07 11:29:07.306929] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.230 [2024-10-07 11:29:07.306944] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.230 [2024-10-07 11:29:07.319023] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.230 [2024-10-07 11:29:07.319072] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.230 [2024-10-07 11:29:07.319806] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.230 [2024-10-07 11:29:07.319875] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.230 [2024-10-07 11:29:07.319895] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.230 [2024-10-07 11:29:07.319945] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.230 [2024-10-07 11:29:07.319967] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.230 [2024-10-07 11:29:07.319982] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.230 [2024-10-07 11:29:07.320710] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.230 [2024-10-07 11:29:07.320751] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.230 [2024-10-07 11:29:07.321013] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.230 [2024-10-07 11:29:07.321040] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.230 [2024-10-07 11:29:07.321054] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.230 [2024-10-07 11:29:07.321071] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.230 [2024-10-07 11:29:07.321085] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.230 [2024-10-07 11:29:07.321097] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.230 [2024-10-07 11:29:07.321289] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.230 [2024-10-07 11:29:07.321315] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.230 [2024-10-07 11:29:07.331944] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.230 [2024-10-07 11:29:07.331991] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.230 [2024-10-07 11:29:07.332091] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.230 [2024-10-07 11:29:07.332120] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.230 [2024-10-07 11:29:07.332136] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.230 [2024-10-07 11:29:07.332183] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.230 [2024-10-07 11:29:07.332206] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.230 [2024-10-07 11:29:07.332222] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.230 [2024-10-07 11:29:07.332797] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.230 [2024-10-07 11:29:07.332836] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.230 [2024-10-07 11:29:07.332928] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.230 [2024-10-07 11:29:07.332966] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.230 [2024-10-07 11:29:07.332982] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.230 [2024-10-07 11:29:07.332999] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.230 [2024-10-07 11:29:07.333013] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.230 [2024-10-07 11:29:07.333044] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.230 [2024-10-07 11:29:07.333070] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.230 [2024-10-07 11:29:07.333084] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.230 [2024-10-07 11:29:07.342068] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.230 [2024-10-07 11:29:07.343400] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.230 [2024-10-07 11:29:07.343518] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.230 [2024-10-07 11:29:07.343554] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.230 [2024-10-07 11:29:07.343577] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.230 [2024-10-07 11:29:07.344236] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.231 [2024-10-07 11:29:07.344277] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.231 [2024-10-07 11:29:07.344296] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.231 [2024-10-07 11:29:07.344315] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.231 [2024-10-07 11:29:07.344564] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.231 [2024-10-07 11:29:07.344595] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.231 [2024-10-07 11:29:07.344609] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.231 [2024-10-07 11:29:07.344623] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.231 [2024-10-07 11:29:07.344832] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.231 [2024-10-07 11:29:07.344860] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.231 [2024-10-07 11:29:07.344875] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.231 [2024-10-07 11:29:07.344889] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.231 [2024-10-07 11:29:07.344946] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.231 [2024-10-07 11:29:07.352954] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.231 [2024-10-07 11:29:07.353180] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.231 [2024-10-07 11:29:07.353211] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.231 [2024-10-07 11:29:07.353228] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.231 [2024-10-07 11:29:07.353370] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.231 [2024-10-07 11:29:07.353532] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.231 [2024-10-07 11:29:07.353574] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.231 [2024-10-07 11:29:07.353590] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.231 [2024-10-07 11:29:07.353701] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.231 [2024-10-07 11:29:07.354327] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.231 [2024-10-07 11:29:07.356202] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.231 [2024-10-07 11:29:07.356243] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.231 [2024-10-07 11:29:07.356278] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.231 [2024-10-07 11:29:07.357297] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.231 [2024-10-07 11:29:07.357652] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.231 [2024-10-07 11:29:07.357690] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.231 [2024-10-07 11:29:07.357707] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.231 [2024-10-07 11:29:07.357881] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.231 [2024-10-07 11:29:07.363800] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.231 [2024-10-07 11:29:07.363916] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.231 [2024-10-07 11:29:07.363945] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.231 [2024-10-07 11:29:07.363963] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.231 [2024-10-07 11:29:07.363986] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.231 [2024-10-07 11:29:07.364007] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.231 [2024-10-07 11:29:07.364021] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.231 [2024-10-07 11:29:07.364034] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.231 [2024-10-07 11:29:07.364056] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.231 [2024-10-07 11:29:07.364397] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.231 [2024-10-07 11:29:07.364498] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.231 [2024-10-07 11:29:07.364526] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.231 [2024-10-07 11:29:07.364542] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.231 [2024-10-07 11:29:07.364565] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.231 [2024-10-07 11:29:07.364587] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.231 [2024-10-07 11:29:07.364601] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.231 [2024-10-07 11:29:07.364614] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.231 [2024-10-07 11:29:07.364637] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.231 [2024-10-07 11:29:07.375932] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.231 [2024-10-07 11:29:07.375980] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.231 [2024-10-07 11:29:07.376271] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.231 [2024-10-07 11:29:07.376313] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.231 [2024-10-07 11:29:07.376347] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.231 [2024-10-07 11:29:07.376400] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.231 [2024-10-07 11:29:07.376438] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.231 [2024-10-07 11:29:07.376455] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.231 [2024-10-07 11:29:07.376945] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.231 [2024-10-07 11:29:07.376986] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.231 [2024-10-07 11:29:07.377198] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.231 [2024-10-07 11:29:07.377232] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.231 [2024-10-07 11:29:07.377247] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.231 [2024-10-07 11:29:07.377264] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.231 [2024-10-07 11:29:07.377278] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.231 [2024-10-07 11:29:07.377291] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.231 [2024-10-07 11:29:07.377528] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.231 [2024-10-07 11:29:07.377554] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.231 [2024-10-07 11:29:07.388421] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.231 [2024-10-07 11:29:07.388467] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.231 [2024-10-07 11:29:07.388915] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.231 [2024-10-07 11:29:07.388957] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.231 [2024-10-07 11:29:07.388975] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.231 [2024-10-07 11:29:07.389023] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.231 [2024-10-07 11:29:07.389045] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.231 [2024-10-07 11:29:07.389060] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.231 [2024-10-07 11:29:07.389395] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.231 [2024-10-07 11:29:07.389465] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.231 [2024-10-07 11:29:07.389539] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.231 [2024-10-07 11:29:07.389561] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.231 [2024-10-07 11:29:07.389575] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.231 [2024-10-07 11:29:07.389591] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.231 [2024-10-07 11:29:07.389606] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.231 [2024-10-07 11:29:07.389619] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.231 [2024-10-07 11:29:07.389657] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.231 [2024-10-07 11:29:07.389674] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.231 [2024-10-07 11:29:07.405489] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.231 [2024-10-07 11:29:07.405537] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.231 8885.88 IOPS, 34.71 MiB/s [2024-10-07T11:29:15.942Z] [2024-10-07 11:29:07.405650] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.231 [2024-10-07 11:29:07.405678] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.231 [2024-10-07 11:29:07.405696] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.231 [2024-10-07 11:29:07.405742] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.231 [2024-10-07 11:29:07.405764] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.231 [2024-10-07 11:29:07.405779] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.231 [2024-10-07 11:29:07.405803] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.231 [2024-10-07 11:29:07.405823] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.231 [2024-10-07 11:29:07.405857] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.231 [2024-10-07 11:29:07.405871] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.231 [2024-10-07 11:29:07.405885] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.231 [2024-10-07 11:29:07.405900] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.231 [2024-10-07 11:29:07.405914] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.231 [2024-10-07 11:29:07.405927] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.231 [2024-10-07 11:29:07.406980] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.231 [2024-10-07 11:29:07.407030] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.231 [2024-10-07 11:29:07.418424] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.231 [2024-10-07 11:29:07.418502] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.231 [2024-10-07 11:29:07.418799] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.231 [2024-10-07 11:29:07.418833] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.231 [2024-10-07 11:29:07.418851] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.231 [2024-10-07 11:29:07.418898] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.231 [2024-10-07 11:29:07.418920] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.231 [2024-10-07 11:29:07.418936] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.231 [2024-10-07 11:29:07.419137] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.232 [2024-10-07 11:29:07.419167] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.232 [2024-10-07 11:29:07.419381] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.232 [2024-10-07 11:29:07.419428] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.232 [2024-10-07 11:29:07.419447] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.232 [2024-10-07 11:29:07.419464] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.232 [2024-10-07 11:29:07.419478] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.232 [2024-10-07 11:29:07.419491] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.232 [2024-10-07 11:29:07.419550] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.232 [2024-10-07 11:29:07.419571] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.232 [2024-10-07 11:29:07.428849] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.232 [2024-10-07 11:29:07.428897] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.232 [2024-10-07 11:29:07.429096] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.232 [2024-10-07 11:29:07.429126] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.232 [2024-10-07 11:29:07.429142] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.232 [2024-10-07 11:29:07.429188] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.232 [2024-10-07 11:29:07.429210] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.232 [2024-10-07 11:29:07.429226] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.232 [2024-10-07 11:29:07.431777] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.232 [2024-10-07 11:29:07.431822] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.232 [2024-10-07 11:29:07.433670] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.232 [2024-10-07 11:29:07.433707] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.232 [2024-10-07 11:29:07.433740] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.232 [2024-10-07 11:29:07.433758] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.232 [2024-10-07 11:29:07.433772] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.232 [2024-10-07 11:29:07.433785] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.232 [2024-10-07 11:29:07.434033] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.232 [2024-10-07 11:29:07.434059] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.232 [2024-10-07 11:29:07.438973] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.232 [2024-10-07 11:29:07.439046] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.232 [2024-10-07 11:29:07.439119] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.232 [2024-10-07 11:29:07.439146] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.232 [2024-10-07 11:29:07.439162] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.232 [2024-10-07 11:29:07.439232] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.232 [2024-10-07 11:29:07.439256] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.232 [2024-10-07 11:29:07.439271] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.232 [2024-10-07 11:29:07.439289] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.232 [2024-10-07 11:29:07.439312] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.232 [2024-10-07 11:29:07.439329] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.232 [2024-10-07 11:29:07.439343] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.232 [2024-10-07 11:29:07.439355] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.232 [2024-10-07 11:29:07.439378] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.232 [2024-10-07 11:29:07.439392] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.232 [2024-10-07 11:29:07.439405] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.232 [2024-10-07 11:29:07.439418] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.232 [2024-10-07 11:29:07.439453] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.232 [2024-10-07 11:29:07.449096] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.232 [2024-10-07 11:29:07.449213] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.232 [2024-10-07 11:29:07.449244] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.232 [2024-10-07 11:29:07.449263] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.232 [2024-10-07 11:29:07.449288] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.232 [2024-10-07 11:29:07.449318] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.232 [2024-10-07 11:29:07.449377] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.232 [2024-10-07 11:29:07.449400] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.232 [2024-10-07 11:29:07.449431] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.232 [2024-10-07 11:29:07.449448] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.232 [2024-10-07 11:29:07.449461] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.232 [2024-10-07 11:29:07.449475] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.232 [2024-10-07 11:29:07.449499] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.232 [2024-10-07 11:29:07.449517] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.232 [2024-10-07 11:29:07.449758] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.232 [2024-10-07 11:29:07.449800] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.232 [2024-10-07 11:29:07.449814] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.232 [2024-10-07 11:29:07.450020] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.232 [2024-10-07 11:29:07.460597] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.232 [2024-10-07 11:29:07.460644] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.232 [2024-10-07 11:29:07.460741] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.232 [2024-10-07 11:29:07.460769] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.232 [2024-10-07 11:29:07.460785] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.232 [2024-10-07 11:29:07.460829] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.232 [2024-10-07 11:29:07.460851] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.232 [2024-10-07 11:29:07.460866] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.232 [2024-10-07 11:29:07.460889] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.232 [2024-10-07 11:29:07.460908] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.232 [2024-10-07 11:29:07.460927] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.232 [2024-10-07 11:29:07.460941] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.232 [2024-10-07 11:29:07.460954] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.232 [2024-10-07 11:29:07.460970] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.232 [2024-10-07 11:29:07.460983] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.232 [2024-10-07 11:29:07.460996] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.232 [2024-10-07 11:29:07.461018] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.232 [2024-10-07 11:29:07.461031] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.232 [2024-10-07 11:29:07.472462] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.232 [2024-10-07 11:29:07.472510] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.232 [2024-10-07 11:29:07.473095] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.232 [2024-10-07 11:29:07.473166] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.232 [2024-10-07 11:29:07.473201] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.232 [2024-10-07 11:29:07.473250] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.232 [2024-10-07 11:29:07.473274] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.232 [2024-10-07 11:29:07.473290] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.232 [2024-10-07 11:29:07.475564] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.232 [2024-10-07 11:29:07.475612] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.232 [2024-10-07 11:29:07.475955] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.232 [2024-10-07 11:29:07.476016] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.232 [2024-10-07 11:29:07.476034] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.232 [2024-10-07 11:29:07.476052] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.232 [2024-10-07 11:29:07.476067] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.232 [2024-10-07 11:29:07.476080] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.232 [2024-10-07 11:29:07.476230] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.232 [2024-10-07 11:29:07.476254] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.232 [2024-10-07 11:29:07.483500] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.232 [2024-10-07 11:29:07.483547] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.232 [2024-10-07 11:29:07.483648] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.232 [2024-10-07 11:29:07.483676] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.232 [2024-10-07 11:29:07.483694] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.232 [2024-10-07 11:29:07.483754] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.232 [2024-10-07 11:29:07.483777] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.232 [2024-10-07 11:29:07.483792] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.232 [2024-10-07 11:29:07.483829] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.232 [2024-10-07 11:29:07.483852] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.232 [2024-10-07 11:29:07.483872] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.232 [2024-10-07 11:29:07.483886] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.232 [2024-10-07 11:29:07.483899] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.232 [2024-10-07 11:29:07.483915] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.233 [2024-10-07 11:29:07.483928] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.233 [2024-10-07 11:29:07.483941] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.233 [2024-10-07 11:29:07.483963] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.233 [2024-10-07 11:29:07.483976] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.233 [2024-10-07 11:29:07.495571] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.233 [2024-10-07 11:29:07.495618] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.233 [2024-10-07 11:29:07.495959] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.233 [2024-10-07 11:29:07.496000] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.233 [2024-10-07 11:29:07.496018] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.233 [2024-10-07 11:29:07.496068] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.233 [2024-10-07 11:29:07.496105] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.233 [2024-10-07 11:29:07.496122] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.233 [2024-10-07 11:29:07.496195] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.233 [2024-10-07 11:29:07.496223] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.233 [2024-10-07 11:29:07.496243] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.233 [2024-10-07 11:29:07.496258] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.233 [2024-10-07 11:29:07.496271] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.233 [2024-10-07 11:29:07.496287] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.233 [2024-10-07 11:29:07.496300] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.233 [2024-10-07 11:29:07.496313] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.233 [2024-10-07 11:29:07.496335] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.233 [2024-10-07 11:29:07.496349] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.233 [2024-10-07 11:29:07.508311] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.233 [2024-10-07 11:29:07.508358] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.233 [2024-10-07 11:29:07.509200] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.233 [2024-10-07 11:29:07.509257] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.233 [2024-10-07 11:29:07.509276] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.233 [2024-10-07 11:29:07.509324] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.233 [2024-10-07 11:29:07.509346] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.233 [2024-10-07 11:29:07.509361] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.233 [2024-10-07 11:29:07.509703] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.233 [2024-10-07 11:29:07.509735] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.233 [2024-10-07 11:29:07.509874] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.233 [2024-10-07 11:29:07.509897] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.233 [2024-10-07 11:29:07.509911] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.233 [2024-10-07 11:29:07.509928] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.233 [2024-10-07 11:29:07.509942] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.233 [2024-10-07 11:29:07.509955] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.233 [2024-10-07 11:29:07.510019] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.233 [2024-10-07 11:29:07.510036] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.233 [2024-10-07 11:29:07.519418] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.233 [2024-10-07 11:29:07.519480] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.233 [2024-10-07 11:29:07.519658] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.233 [2024-10-07 11:29:07.519687] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.233 [2024-10-07 11:29:07.519703] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.233 [2024-10-07 11:29:07.519749] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.233 [2024-10-07 11:29:07.519770] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.233 [2024-10-07 11:29:07.519786] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.233 [2024-10-07 11:29:07.519902] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.233 [2024-10-07 11:29:07.519929] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.233 [2024-10-07 11:29:07.520032] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.233 [2024-10-07 11:29:07.520052] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.233 [2024-10-07 11:29:07.520067] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.233 [2024-10-07 11:29:07.520083] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.233 [2024-10-07 11:29:07.520097] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.233 [2024-10-07 11:29:07.520109] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.233 [2024-10-07 11:29:07.520622] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.233 [2024-10-07 11:29:07.520656] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.233 [2024-10-07 11:29:07.529843] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.233 [2024-10-07 11:29:07.529890] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.233 [2024-10-07 11:29:07.530090] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.233 [2024-10-07 11:29:07.530121] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.233 [2024-10-07 11:29:07.530138] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.233 [2024-10-07 11:29:07.530185] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.233 [2024-10-07 11:29:07.530207] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.233 [2024-10-07 11:29:07.530223] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.233 [2024-10-07 11:29:07.531622] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.233 [2024-10-07 11:29:07.531664] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.233 [2024-10-07 11:29:07.534096] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.233 [2024-10-07 11:29:07.534132] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.233 [2024-10-07 11:29:07.534165] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.233 [2024-10-07 11:29:07.534184] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.233 [2024-10-07 11:29:07.534199] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.233 [2024-10-07 11:29:07.534212] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.233 [2024-10-07 11:29:07.534945] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.233 [2024-10-07 11:29:07.534972] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.233 [2024-10-07 11:29:07.539964] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.233 [2024-10-07 11:29:07.541838] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.233 [2024-10-07 11:29:07.541950] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.233 [2024-10-07 11:29:07.541989] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.233 [2024-10-07 11:29:07.542007] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.233 [2024-10-07 11:29:07.542585] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.233 [2024-10-07 11:29:07.542626] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.233 [2024-10-07 11:29:07.542645] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.233 [2024-10-07 11:29:07.542664] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.233 [2024-10-07 11:29:07.542867] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.233 [2024-10-07 11:29:07.542896] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.233 [2024-10-07 11:29:07.542911] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.233 [2024-10-07 11:29:07.542924] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.233 [2024-10-07 11:29:07.543086] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.233 [2024-10-07 11:29:07.543112] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.233 [2024-10-07 11:29:07.543127] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.233 [2024-10-07 11:29:07.543140] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.233 [2024-10-07 11:29:07.543189] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.233 [2024-10-07 11:29:07.550565] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.233 [2024-10-07 11:29:07.550759] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.233 [2024-10-07 11:29:07.550800] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.233 [2024-10-07 11:29:07.550834] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.233 [2024-10-07 11:29:07.550935] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.233 [2024-10-07 11:29:07.551670] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.233 [2024-10-07 11:29:07.551706] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.233 [2024-10-07 11:29:07.551739] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.233 [2024-10-07 11:29:07.554022] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.233 [2024-10-07 11:29:07.554546] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.233 [2024-10-07 11:29:07.554760] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.234 [2024-10-07 11:29:07.554801] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.234 [2024-10-07 11:29:07.554821] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.234 [2024-10-07 11:29:07.554923] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.234 [2024-10-07 11:29:07.555059] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.234 [2024-10-07 11:29:07.555091] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.234 [2024-10-07 11:29:07.555107] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.234 [2024-10-07 11:29:07.555233] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.234 [2024-10-07 11:29:07.560645] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.234 [2024-10-07 11:29:07.560766] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.234 [2024-10-07 11:29:07.560795] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.234 [2024-10-07 11:29:07.560811] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.234 [2024-10-07 11:29:07.561545] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.234 [2024-10-07 11:29:07.562885] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.234 [2024-10-07 11:29:07.562922] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.234 [2024-10-07 11:29:07.562955] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.234 [2024-10-07 11:29:07.563370] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.234 [2024-10-07 11:29:07.564620] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.234 [2024-10-07 11:29:07.564729] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.234 [2024-10-07 11:29:07.564758] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.234 [2024-10-07 11:29:07.564775] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.234 [2024-10-07 11:29:07.564798] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.234 [2024-10-07 11:29:07.564820] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.234 [2024-10-07 11:29:07.564834] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.234 [2024-10-07 11:29:07.564848] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.234 [2024-10-07 11:29:07.564870] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.234 [2024-10-07 11:29:07.572924] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.234 [2024-10-07 11:29:07.573274] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.234 [2024-10-07 11:29:07.573317] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.234 [2024-10-07 11:29:07.573337] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.234 [2024-10-07 11:29:07.573554] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.234 [2024-10-07 11:29:07.573633] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.234 [2024-10-07 11:29:07.573655] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.234 [2024-10-07 11:29:07.573669] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.234 [2024-10-07 11:29:07.573693] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.234 [2024-10-07 11:29:07.575055] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.234 [2024-10-07 11:29:07.575167] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.234 [2024-10-07 11:29:07.575195] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.234 [2024-10-07 11:29:07.575212] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.234 [2024-10-07 11:29:07.575234] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.234 [2024-10-07 11:29:07.575256] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.234 [2024-10-07 11:29:07.575271] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.234 [2024-10-07 11:29:07.575284] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.234 [2024-10-07 11:29:07.575305] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.234 [2024-10-07 11:29:07.585812] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.234 [2024-10-07 11:29:07.585861] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.234 [2024-10-07 11:29:07.586103] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.234 [2024-10-07 11:29:07.586135] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.234 [2024-10-07 11:29:07.586152] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.234 [2024-10-07 11:29:07.586199] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.234 [2024-10-07 11:29:07.586222] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.234 [2024-10-07 11:29:07.586237] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.234 [2024-10-07 11:29:07.586351] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.234 [2024-10-07 11:29:07.586377] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.234 [2024-10-07 11:29:07.586488] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.234 [2024-10-07 11:29:07.586510] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.234 [2024-10-07 11:29:07.586524] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.234 [2024-10-07 11:29:07.586558] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.234 [2024-10-07 11:29:07.586575] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.234 [2024-10-07 11:29:07.586588] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.234 [2024-10-07 11:29:07.586954] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.234 [2024-10-07 11:29:07.586988] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.234 [2024-10-07 11:29:07.597902] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.234 [2024-10-07 11:29:07.597949] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.234 [2024-10-07 11:29:07.600262] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.234 [2024-10-07 11:29:07.600322] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.234 [2024-10-07 11:29:07.600342] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.234 [2024-10-07 11:29:07.600389] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.234 [2024-10-07 11:29:07.600411] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.234 [2024-10-07 11:29:07.600440] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.234 [2024-10-07 11:29:07.600686] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.234 [2024-10-07 11:29:07.600717] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.234 [2024-10-07 11:29:07.600766] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.234 [2024-10-07 11:29:07.600787] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.234 [2024-10-07 11:29:07.600801] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.234 [2024-10-07 11:29:07.600833] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.234 [2024-10-07 11:29:07.600847] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.234 [2024-10-07 11:29:07.600861] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.234 [2024-10-07 11:29:07.601013] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.234 [2024-10-07 11:29:07.601037] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.234 [2024-10-07 11:29:07.608056] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.234 [2024-10-07 11:29:07.608133] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.234 [2024-10-07 11:29:07.608214] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.234 [2024-10-07 11:29:07.608242] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.234 [2024-10-07 11:29:07.608259] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.234 [2024-10-07 11:29:07.608311] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.234 [2024-10-07 11:29:07.608334] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.234 [2024-10-07 11:29:07.608349] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.234 [2024-10-07 11:29:07.608385] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.234 [2024-10-07 11:29:07.608410] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.234 [2024-10-07 11:29:07.608440] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.234 [2024-10-07 11:29:07.608456] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.234 [2024-10-07 11:29:07.608470] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.234 [2024-10-07 11:29:07.608493] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.234 [2024-10-07 11:29:07.608508] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.234 [2024-10-07 11:29:07.608521] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.234 [2024-10-07 11:29:07.608533] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.234 [2024-10-07 11:29:07.608553] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.234 [2024-10-07 11:29:07.621486] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.234 [2024-10-07 11:29:07.621532] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.234 [2024-10-07 11:29:07.621632] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.234 [2024-10-07 11:29:07.621661] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.234 [2024-10-07 11:29:07.621677] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.234 [2024-10-07 11:29:07.621722] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.234 [2024-10-07 11:29:07.621744] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61c2c0 with addr=10.0.0.3, port=4420 00:18:34.234 [2024-10-07 11:29:07.621759] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61c2c0 is same with the state(6) to be set 00:18:34.234 [2024-10-07 11:29:07.621782] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.234 [2024-10-07 11:29:07.621801] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61c2c0 (9): Bad file descriptor 00:18:34.234 [2024-10-07 11:29:07.621820] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.234 [2024-10-07 11:29:07.621834] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.234 [2024-10-07 11:29:07.621848] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.234 [2024-10-07 11:29:07.621863] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.234 [2024-10-07 11:29:07.621877] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.234 [2024-10-07 11:29:07.621889] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.234 [2024-10-07 11:29:07.621912] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.234 [2024-10-07 11:29:07.621925] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.234 [2024-10-07 11:29:07.632712] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.234 [2024-10-07 11:29:07.632761] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.234 [2024-10-07 11:29:07.633026] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.234 [2024-10-07 11:29:07.633070] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.234 [2024-10-07 11:29:07.633089] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.235 [2024-10-07 11:29:07.633237] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.235 [2024-10-07 11:29:07.633348] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.235 [2024-10-07 11:29:07.633375] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.235 [2024-10-07 11:29:07.633389] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.235 [2024-10-07 11:29:07.635896] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.235 [2024-10-07 11:29:07.642934] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.235 [2024-10-07 11:29:07.643340] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.235 [2024-10-07 11:29:07.643384] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.235 [2024-10-07 11:29:07.643403] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.235 [2024-10-07 11:29:07.643606] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.235 [2024-10-07 11:29:07.643759] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.235 [2024-10-07 11:29:07.643808] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.235 [2024-10-07 11:29:07.643824] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.235 [2024-10-07 11:29:07.643938] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.235 [2024-10-07 11:29:07.653030] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.235 [2024-10-07 11:29:07.653136] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.235 [2024-10-07 11:29:07.653166] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.235 [2024-10-07 11:29:07.653184] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.235 [2024-10-07 11:29:07.653209] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.235 [2024-10-07 11:29:07.653231] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.235 [2024-10-07 11:29:07.653245] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.235 [2024-10-07 11:29:07.653259] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.235 [2024-10-07 11:29:07.653283] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.235 [2024-10-07 11:29:07.655710] bdev_nvme.c:2183:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:18:34.235 [2024-10-07 11:29:07.667166] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.235 [2024-10-07 11:29:07.667282] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.235 [2024-10-07 11:29:07.667311] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.235 [2024-10-07 11:29:07.667328] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.235 [2024-10-07 11:29:07.667366] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.235 [2024-10-07 11:29:07.667388] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.235 [2024-10-07 11:29:07.667401] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.235 [2024-10-07 11:29:07.667415] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.235 [2024-10-07 11:29:07.667450] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.235 [2024-10-07 11:29:07.678710] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.235 [2024-10-07 11:29:07.678923] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.235 [2024-10-07 11:29:07.678954] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.235 [2024-10-07 11:29:07.678971] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.235 [2024-10-07 11:29:07.679086] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.235 [2024-10-07 11:29:07.679898] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.235 [2024-10-07 11:29:07.679936] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.235 [2024-10-07 11:29:07.679953] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.235 [2024-10-07 11:29:07.681263] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.235 [2024-10-07 11:29:07.689269] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.235 [2024-10-07 11:29:07.689511] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.235 [2024-10-07 11:29:07.689543] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.235 [2024-10-07 11:29:07.689560] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.235 [2024-10-07 11:29:07.689683] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.235 [2024-10-07 11:29:07.689796] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.235 [2024-10-07 11:29:07.689818] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.235 [2024-10-07 11:29:07.689832] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.235 [2024-10-07 11:29:07.689931] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.235 [2024-10-07 11:29:07.699698] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.235 [2024-10-07 11:29:07.699819] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.235 [2024-10-07 11:29:07.699848] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.235 [2024-10-07 11:29:07.699864] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.235 [2024-10-07 11:29:07.699888] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.235 [2024-10-07 11:29:07.699909] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.235 [2024-10-07 11:29:07.699923] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.235 [2024-10-07 11:29:07.699951] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.235 [2024-10-07 11:29:07.699975] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.235 [2024-10-07 11:29:07.711948] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.235 [2024-10-07 11:29:07.712293] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.235 [2024-10-07 11:29:07.712337] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.235 [2024-10-07 11:29:07.712356] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.235 [2024-10-07 11:29:07.712422] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.235 [2024-10-07 11:29:07.712471] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.235 [2024-10-07 11:29:07.712490] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.235 [2024-10-07 11:29:07.712504] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.235 [2024-10-07 11:29:07.712528] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.235 [2024-10-07 11:29:07.722301] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.235 [2024-10-07 11:29:07.725394] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.235 [2024-10-07 11:29:07.725494] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.235 [2024-10-07 11:29:07.725515] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.235 [2024-10-07 11:29:07.727231] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.235 [2024-10-07 11:29:07.727322] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.235 [2024-10-07 11:29:07.727345] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.235 [2024-10-07 11:29:07.727360] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.235 [2024-10-07 11:29:07.727384] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.235 [2024-10-07 11:29:07.732536] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.235 [2024-10-07 11:29:07.732640] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.235 [2024-10-07 11:29:07.732669] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.235 [2024-10-07 11:29:07.732687] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.235 [2024-10-07 11:29:07.732711] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.235 [2024-10-07 11:29:07.732733] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.235 [2024-10-07 11:29:07.732747] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.235 [2024-10-07 11:29:07.732761] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.235 [2024-10-07 11:29:07.732783] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.235 [2024-10-07 11:29:07.743343] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.235 [2024-10-07 11:29:07.743584] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.235 [2024-10-07 11:29:07.743658] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.235 [2024-10-07 11:29:07.743679] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.235 [2024-10-07 11:29:07.743784] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.235 [2024-10-07 11:29:07.743916] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.235 [2024-10-07 11:29:07.743936] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.235 [2024-10-07 11:29:07.743952] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.235 [2024-10-07 11:29:07.746052] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.235 [2024-10-07 11:29:07.753698] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.235 [2024-10-07 11:29:07.753815] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.235 [2024-10-07 11:29:07.753845] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.235 [2024-10-07 11:29:07.753862] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.235 [2024-10-07 11:29:07.753886] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.235 [2024-10-07 11:29:07.753907] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.235 [2024-10-07 11:29:07.753921] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.235 [2024-10-07 11:29:07.753934] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.235 [2024-10-07 11:29:07.753956] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.235 [2024-10-07 11:29:07.765771] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.235 [2024-10-07 11:29:07.765948] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.235 [2024-10-07 11:29:07.766007] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.235 [2024-10-07 11:29:07.766025] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.235 [2024-10-07 11:29:07.766050] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.235 [2024-10-07 11:29:07.766295] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.235 [2024-10-07 11:29:07.766344] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.235 [2024-10-07 11:29:07.766360] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.235 [2024-10-07 11:29:07.766441] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.235 [2024-10-07 11:29:07.778566] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.235 [2024-10-07 11:29:07.778676] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.235 [2024-10-07 11:29:07.778713] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.235 [2024-10-07 11:29:07.778736] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.235 [2024-10-07 11:29:07.778767] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.235 [2024-10-07 11:29:07.778815] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.235 [2024-10-07 11:29:07.778836] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.235 [2024-10-07 11:29:07.778855] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.236 [2024-10-07 11:29:07.778884] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.236 [2024-10-07 11:29:07.788650] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.236 [2024-10-07 11:29:07.788757] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.236 [2024-10-07 11:29:07.788787] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.236 [2024-10-07 11:29:07.788805] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.236 [2024-10-07 11:29:07.788844] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.236 [2024-10-07 11:29:07.788866] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.236 [2024-10-07 11:29:07.788880] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.236 [2024-10-07 11:29:07.788893] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.236 [2024-10-07 11:29:07.788916] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.236 [2024-10-07 11:29:07.800517] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.236 [2024-10-07 11:29:07.800662] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.236 [2024-10-07 11:29:07.800693] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.236 [2024-10-07 11:29:07.800710] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.236 [2024-10-07 11:29:07.800733] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.236 [2024-10-07 11:29:07.800755] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.236 [2024-10-07 11:29:07.800769] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.236 [2024-10-07 11:29:07.800782] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.236 [2024-10-07 11:29:07.800805] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.236 [2024-10-07 11:29:07.811840] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.236 [2024-10-07 11:29:07.812082] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.236 [2024-10-07 11:29:07.812115] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.236 [2024-10-07 11:29:07.812132] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.236 [2024-10-07 11:29:07.812262] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.236 [2024-10-07 11:29:07.812404] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.236 [2024-10-07 11:29:07.812440] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.236 [2024-10-07 11:29:07.812466] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.236 [2024-10-07 11:29:07.812593] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.236 [2024-10-07 11:29:07.822413] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.236 [2024-10-07 11:29:07.822645] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.236 [2024-10-07 11:29:07.822682] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.236 [2024-10-07 11:29:07.822699] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.236 [2024-10-07 11:29:07.822817] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.236 [2024-10-07 11:29:07.822926] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.236 [2024-10-07 11:29:07.822947] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.236 [2024-10-07 11:29:07.822961] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.236 [2024-10-07 11:29:07.823057] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.236 [2024-10-07 11:29:07.835079] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.236 [2024-10-07 11:29:07.837119] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.236 [2024-10-07 11:29:07.837164] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.236 [2024-10-07 11:29:07.837185] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.236 [2024-10-07 11:29:07.837455] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.236 [2024-10-07 11:29:07.837521] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.236 [2024-10-07 11:29:07.837542] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.236 [2024-10-07 11:29:07.837557] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.236 [2024-10-07 11:29:07.837582] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.236 [2024-10-07 11:29:07.845176] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.236 [2024-10-07 11:29:07.845283] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.236 [2024-10-07 11:29:07.845313] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.236 [2024-10-07 11:29:07.845330] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.236 [2024-10-07 11:29:07.845355] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.236 [2024-10-07 11:29:07.845376] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.236 [2024-10-07 11:29:07.845390] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.236 [2024-10-07 11:29:07.845402] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.236 [2024-10-07 11:29:07.845465] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.236 [2024-10-07 11:29:07.856641] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.236 [2024-10-07 11:29:07.856756] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.236 [2024-10-07 11:29:07.856785] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.236 [2024-10-07 11:29:07.856825] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.236 [2024-10-07 11:29:07.856849] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.236 [2024-10-07 11:29:07.856870] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.236 [2024-10-07 11:29:07.856885] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.236 [2024-10-07 11:29:07.856897] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.236 [2024-10-07 11:29:07.856920] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.236 [2024-10-07 11:29:07.871275] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.236 [2024-10-07 11:29:07.871408] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.236 [2024-10-07 11:29:07.871454] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.236 [2024-10-07 11:29:07.871486] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.236 [2024-10-07 11:29:07.871511] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.236 [2024-10-07 11:29:07.871533] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.236 [2024-10-07 11:29:07.871549] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.236 [2024-10-07 11:29:07.871563] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.236 [2024-10-07 11:29:07.871586] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.236 [2024-10-07 11:29:07.886426] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.236 [2024-10-07 11:29:07.887333] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.236 [2024-10-07 11:29:07.887390] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.236 [2024-10-07 11:29:07.887408] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.236 [2024-10-07 11:29:07.887802] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.236 [2024-10-07 11:29:07.888035] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.236 [2024-10-07 11:29:07.888068] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.236 [2024-10-07 11:29:07.888083] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.236 [2024-10-07 11:29:07.888140] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.236 [2024-10-07 11:29:07.896784] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.236 [2024-10-07 11:29:07.896972] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.236 [2024-10-07 11:29:07.897004] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.236 [2024-10-07 11:29:07.897021] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.236 [2024-10-07 11:29:07.897133] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.236 [2024-10-07 11:29:07.897805] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.236 [2024-10-07 11:29:07.897859] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.236 [2024-10-07 11:29:07.897877] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.236 [2024-10-07 11:29:07.901186] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.236 [2024-10-07 11:29:07.906960] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.236 [2024-10-07 11:29:07.907067] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.236 [2024-10-07 11:29:07.907097] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.236 [2024-10-07 11:29:07.907115] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.236 [2024-10-07 11:29:07.907140] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.236 [2024-10-07 11:29:07.907162] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.236 [2024-10-07 11:29:07.907177] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.236 [2024-10-07 11:29:07.907191] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.236 [2024-10-07 11:29:07.907228] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.236 [2024-10-07 11:29:07.917140] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.236 [2024-10-07 11:29:07.917265] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.236 [2024-10-07 11:29:07.917296] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.236 [2024-10-07 11:29:07.917314] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.236 [2024-10-07 11:29:07.919248] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.236 [2024-10-07 11:29:07.919904] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.236 [2024-10-07 11:29:07.919947] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.236 [2024-10-07 11:29:07.919963] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.236 [2024-10-07 11:29:07.920200] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.236 [2024-10-07 11:29:07.927772] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.236 [2024-10-07 11:29:07.928005] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.236 [2024-10-07 11:29:07.928037] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.236 [2024-10-07 11:29:07.928055] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.237 [2024-10-07 11:29:07.928181] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.237 [2024-10-07 11:29:07.928300] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.237 [2024-10-07 11:29:07.928322] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.237 [2024-10-07 11:29:07.928337] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.237 [2024-10-07 11:29:07.928466] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.237 [2024-10-07 11:29:07.937858] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.237 [2024-10-07 11:29:07.937995] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.237 [2024-10-07 11:29:07.938032] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.237 [2024-10-07 11:29:07.938055] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.237 [2024-10-07 11:29:07.938085] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.237 [2024-10-07 11:29:07.938114] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.237 [2024-10-07 11:29:07.938135] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.237 [2024-10-07 11:29:07.938155] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.237 [2024-10-07 11:29:07.938188] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.237 [2024-10-07 11:29:07.947950] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.237 [2024-10-07 11:29:07.948051] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.237 [2024-10-07 11:29:07.948080] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.237 [2024-10-07 11:29:07.948096] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.237 [2024-10-07 11:29:07.948354] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.237 [2024-10-07 11:29:07.948529] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.237 [2024-10-07 11:29:07.948561] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.237 [2024-10-07 11:29:07.948588] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.237 [2024-10-07 11:29:07.948685] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.237 [2024-10-07 11:29:07.958607] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.237 [2024-10-07 11:29:07.958725] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.237 [2024-10-07 11:29:07.958754] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.237 [2024-10-07 11:29:07.958772] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.237 [2024-10-07 11:29:07.958796] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.237 [2024-10-07 11:29:07.958832] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.237 [2024-10-07 11:29:07.958846] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.237 [2024-10-07 11:29:07.958858] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.237 [2024-10-07 11:29:07.958880] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.237 [2024-10-07 11:29:07.969109] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.237 [2024-10-07 11:29:07.969339] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.237 [2024-10-07 11:29:07.969382] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.237 [2024-10-07 11:29:07.969401] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.237 [2024-10-07 11:29:07.970774] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.237 [2024-10-07 11:29:07.971024] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.237 [2024-10-07 11:29:07.971049] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.237 [2024-10-07 11:29:07.971063] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.237 [2024-10-07 11:29:07.971413] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.237 [2024-10-07 11:29:07.979187] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.237 [2024-10-07 11:29:07.979335] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.237 [2024-10-07 11:29:07.979365] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.237 [2024-10-07 11:29:07.979381] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.237 [2024-10-07 11:29:07.979405] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.237 [2024-10-07 11:29:07.979443] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.237 [2024-10-07 11:29:07.979474] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.237 [2024-10-07 11:29:07.979490] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.237 [2024-10-07 11:29:07.979514] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.237 [2024-10-07 11:29:07.989259] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.237 [2024-10-07 11:29:07.989376] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.237 [2024-10-07 11:29:07.989406] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.237 [2024-10-07 11:29:07.989423] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.237 [2024-10-07 11:29:07.989464] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.237 [2024-10-07 11:29:07.989486] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.237 [2024-10-07 11:29:07.989501] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.237 [2024-10-07 11:29:07.989514] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.237 [2024-10-07 11:29:07.989537] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.237 [2024-10-07 11:29:07.999352] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.237 [2024-10-07 11:29:07.999471] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.237 [2024-10-07 11:29:07.999502] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.237 [2024-10-07 11:29:07.999519] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.237 [2024-10-07 11:29:07.999543] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.237 [2024-10-07 11:29:07.999566] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.237 [2024-10-07 11:29:07.999580] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.237 [2024-10-07 11:29:07.999613] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.237 [2024-10-07 11:29:07.999639] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.237 [2024-10-07 11:29:08.009850] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.237 [2024-10-07 11:29:08.010213] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.237 [2024-10-07 11:29:08.010257] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.237 [2024-10-07 11:29:08.010277] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.237 [2024-10-07 11:29:08.010431] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.237 [2024-10-07 11:29:08.010560] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.237 [2024-10-07 11:29:08.010582] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.237 [2024-10-07 11:29:08.010597] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.237 [2024-10-07 11:29:08.010826] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.237 [2024-10-07 11:29:08.019953] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.237 [2024-10-07 11:29:08.020071] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.237 [2024-10-07 11:29:08.020101] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.237 [2024-10-07 11:29:08.020118] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.237 [2024-10-07 11:29:08.020141] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.237 [2024-10-07 11:29:08.020162] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.237 [2024-10-07 11:29:08.020176] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.237 [2024-10-07 11:29:08.020189] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.237 [2024-10-07 11:29:08.020211] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.237 [2024-10-07 11:29:08.030636] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.237 [2024-10-07 11:29:08.030778] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.237 [2024-10-07 11:29:08.030808] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.237 [2024-10-07 11:29:08.030825] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.237 [2024-10-07 11:29:08.030848] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.237 [2024-10-07 11:29:08.030870] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.237 [2024-10-07 11:29:08.030884] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.237 [2024-10-07 11:29:08.030896] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.237 [2024-10-07 11:29:08.030918] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.237 [2024-10-07 11:29:08.043500] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.237 [2024-10-07 11:29:08.043702] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.237 [2024-10-07 11:29:08.043733] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.237 [2024-10-07 11:29:08.043750] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.238 [2024-10-07 11:29:08.043804] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.238 [2024-10-07 11:29:08.043829] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.238 [2024-10-07 11:29:08.043843] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.238 [2024-10-07 11:29:08.043856] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.238 [2024-10-07 11:29:08.043878] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.238 [2024-10-07 11:29:08.055115] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.238 [2024-10-07 11:29:08.055278] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.238 [2024-10-07 11:29:08.055309] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.238 [2024-10-07 11:29:08.055341] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.238 [2024-10-07 11:29:08.055365] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.238 [2024-10-07 11:29:08.055403] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.238 [2024-10-07 11:29:08.055418] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.238 [2024-10-07 11:29:08.055448] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.238 [2024-10-07 11:29:08.055484] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.238 [2024-10-07 11:29:08.067908] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.238 [2024-10-07 11:29:08.068051] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.238 [2024-10-07 11:29:08.068080] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.238 [2024-10-07 11:29:08.068097] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.238 [2024-10-07 11:29:08.068973] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.238 [2024-10-07 11:29:08.069764] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.238 [2024-10-07 11:29:08.069798] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.238 [2024-10-07 11:29:08.069830] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.238 [2024-10-07 11:29:08.070393] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.238 [2024-10-07 11:29:08.081544] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.238 [2024-10-07 11:29:08.081819] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.238 [2024-10-07 11:29:08.081861] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.238 [2024-10-07 11:29:08.081880] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.238 [2024-10-07 11:29:08.082144] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.238 [2024-10-07 11:29:08.082231] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.238 [2024-10-07 11:29:08.082254] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.238 [2024-10-07 11:29:08.082269] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.238 [2024-10-07 11:29:08.082295] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.238 [2024-10-07 11:29:08.094573] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.238 [2024-10-07 11:29:08.094883] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.238 [2024-10-07 11:29:08.094944] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.238 [2024-10-07 11:29:08.094963] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.238 [2024-10-07 11:29:08.095020] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.238 [2024-10-07 11:29:08.095048] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.238 [2024-10-07 11:29:08.095062] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.238 [2024-10-07 11:29:08.095075] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.238 [2024-10-07 11:29:08.095098] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.238 [2024-10-07 11:29:08.108111] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.238 [2024-10-07 11:29:08.108228] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.238 [2024-10-07 11:29:08.108256] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.238 [2024-10-07 11:29:08.108273] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.238 [2024-10-07 11:29:08.108296] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.238 [2024-10-07 11:29:08.108317] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.238 [2024-10-07 11:29:08.108331] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.239 [2024-10-07 11:29:08.108344] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.239 [2024-10-07 11:29:08.108366] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.239 [2024-10-07 11:29:08.121828] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.239 [2024-10-07 11:29:08.121950] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.239 [2024-10-07 11:29:08.121992] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.239 [2024-10-07 11:29:08.122010] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.239 [2024-10-07 11:29:08.122035] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.239 [2024-10-07 11:29:08.122057] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.239 [2024-10-07 11:29:08.122072] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.239 [2024-10-07 11:29:08.122085] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.239 [2024-10-07 11:29:08.122126] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.239 [2024-10-07 11:29:08.134128] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.239 [2024-10-07 11:29:08.134281] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.239 [2024-10-07 11:29:08.134314] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.239 [2024-10-07 11:29:08.134331] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.239 [2024-10-07 11:29:08.134356] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.239 [2024-10-07 11:29:08.134378] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.239 [2024-10-07 11:29:08.134394] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.239 [2024-10-07 11:29:08.134407] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.239 [2024-10-07 11:29:08.134448] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.239 [2024-10-07 11:29:08.147807] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.239 [2024-10-07 11:29:08.149113] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.239 [2024-10-07 11:29:08.149157] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.239 [2024-10-07 11:29:08.149177] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.239 [2024-10-07 11:29:08.149793] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.239 [2024-10-07 11:29:08.150061] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.239 [2024-10-07 11:29:08.150097] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.239 [2024-10-07 11:29:08.150114] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.239 [2024-10-07 11:29:08.150318] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.239 [2024-10-07 11:29:08.158303] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.239 [2024-10-07 11:29:08.158535] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.239 [2024-10-07 11:29:08.158576] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.239 [2024-10-07 11:29:08.158595] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.239 [2024-10-07 11:29:08.158716] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.239 [2024-10-07 11:29:08.158844] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.239 [2024-10-07 11:29:08.158865] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.239 [2024-10-07 11:29:08.158880] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.239 [2024-10-07 11:29:08.158982] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.239 [2024-10-07 11:29:08.168387] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.239 [2024-10-07 11:29:08.168518] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.239 [2024-10-07 11:29:08.168548] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.239 [2024-10-07 11:29:08.168591] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.239 [2024-10-07 11:29:08.168616] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.239 [2024-10-07 11:29:08.168638] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.239 [2024-10-07 11:29:08.168652] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.239 [2024-10-07 11:29:08.168665] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.239 [2024-10-07 11:29:08.168687] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.239 [2024-10-07 11:29:08.178852] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.239 [2024-10-07 11:29:08.178969] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.239 [2024-10-07 11:29:08.178998] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.239 [2024-10-07 11:29:08.179014] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.239 [2024-10-07 11:29:08.179038] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.239 [2024-10-07 11:29:08.179059] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.239 [2024-10-07 11:29:08.179073] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.239 [2024-10-07 11:29:08.179086] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.239 [2024-10-07 11:29:08.179107] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.239 [2024-10-07 11:29:08.189296] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.239 [2024-10-07 11:29:08.189500] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.239 [2024-10-07 11:29:08.189542] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.239 [2024-10-07 11:29:08.189561] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.239 [2024-10-07 11:29:08.189658] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.239 [2024-10-07 11:29:08.189943] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.239 [2024-10-07 11:29:08.189987] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.239 [2024-10-07 11:29:08.190003] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.239 [2024-10-07 11:29:08.190190] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.239 [2024-10-07 11:29:08.199391] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.239 [2024-10-07 11:29:08.199523] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.239 [2024-10-07 11:29:08.199567] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.239 [2024-10-07 11:29:08.199589] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.239 [2024-10-07 11:29:08.199615] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.239 [2024-10-07 11:29:08.199637] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.239 [2024-10-07 11:29:08.199669] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.239 [2024-10-07 11:29:08.199684] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.239 [2024-10-07 11:29:08.199709] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.239 [2024-10-07 11:29:08.209488] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.239 [2024-10-07 11:29:08.209608] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.239 [2024-10-07 11:29:08.209638] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.239 [2024-10-07 11:29:08.209654] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.239 [2024-10-07 11:29:08.209677] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.239 [2024-10-07 11:29:08.209698] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.239 [2024-10-07 11:29:08.209711] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.239 [2024-10-07 11:29:08.209724] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.239 [2024-10-07 11:29:08.209745] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.239 [2024-10-07 11:29:08.221164] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.239 [2024-10-07 11:29:08.221286] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.239 [2024-10-07 11:29:08.221315] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.239 [2024-10-07 11:29:08.221332] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.239 [2024-10-07 11:29:08.221354] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.239 [2024-10-07 11:29:08.221375] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.239 [2024-10-07 11:29:08.221388] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.239 [2024-10-07 11:29:08.221401] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.239 [2024-10-07 11:29:08.221657] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.239 [2024-10-07 11:29:08.234069] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.239 [2024-10-07 11:29:08.234188] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.239 [2024-10-07 11:29:08.234217] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.239 [2024-10-07 11:29:08.234234] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.240 [2024-10-07 11:29:08.234258] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.240 [2024-10-07 11:29:08.234279] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.240 [2024-10-07 11:29:08.234295] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.240 [2024-10-07 11:29:08.234308] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.240 [2024-10-07 11:29:08.234331] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.240 [2024-10-07 11:29:08.246143] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.240 [2024-10-07 11:29:08.246355] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.240 [2024-10-07 11:29:08.246385] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.240 [2024-10-07 11:29:08.246402] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.240 [2024-10-07 11:29:08.247027] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.240 [2024-10-07 11:29:08.247711] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.240 [2024-10-07 11:29:08.247760] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.240 [2024-10-07 11:29:08.247792] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.240 [2024-10-07 11:29:08.247900] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.240 [2024-10-07 11:29:08.256239] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.240 [2024-10-07 11:29:08.256357] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.240 [2024-10-07 11:29:08.256386] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.240 [2024-10-07 11:29:08.256403] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.240 [2024-10-07 11:29:08.256440] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.240 [2024-10-07 11:29:08.256465] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.240 [2024-10-07 11:29:08.256479] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.240 [2024-10-07 11:29:08.256492] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.240 [2024-10-07 11:29:08.256513] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.240 [2024-10-07 11:29:08.267133] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.240 [2024-10-07 11:29:08.267327] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.240 [2024-10-07 11:29:08.267359] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.240 [2024-10-07 11:29:08.267376] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.240 [2024-10-07 11:29:08.267399] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.240 [2024-10-07 11:29:08.267422] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.240 [2024-10-07 11:29:08.267450] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.240 [2024-10-07 11:29:08.267465] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.240 [2024-10-07 11:29:08.267504] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.240 [2024-10-07 11:29:08.277665] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.240 [2024-10-07 11:29:08.277817] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.240 [2024-10-07 11:29:08.277854] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.240 [2024-10-07 11:29:08.277877] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.240 [2024-10-07 11:29:08.277939] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.240 [2024-10-07 11:29:08.278004] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.240 [2024-10-07 11:29:08.278031] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.240 [2024-10-07 11:29:08.278051] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.240 [2024-10-07 11:29:08.278086] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.240 [2024-10-07 11:29:08.291575] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.240 [2024-10-07 11:29:08.291876] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.240 [2024-10-07 11:29:08.291915] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.240 [2024-10-07 11:29:08.291934] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.240 [2024-10-07 11:29:08.292172] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.240 [2024-10-07 11:29:08.292240] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.240 [2024-10-07 11:29:08.292262] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.240 [2024-10-07 11:29:08.292277] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.240 [2024-10-07 11:29:08.292301] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.240 [2024-10-07 11:29:08.304989] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.240 [2024-10-07 11:29:08.305174] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.240 [2024-10-07 11:29:08.305204] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.240 [2024-10-07 11:29:08.305221] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.240 [2024-10-07 11:29:08.305243] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.240 [2024-10-07 11:29:08.305265] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.240 [2024-10-07 11:29:08.305279] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.240 [2024-10-07 11:29:08.305292] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.240 [2024-10-07 11:29:08.305314] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.240 [2024-10-07 11:29:08.315278] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.240 [2024-10-07 11:29:08.315497] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.240 [2024-10-07 11:29:08.315528] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.240 [2024-10-07 11:29:08.315545] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.240 [2024-10-07 11:29:08.315651] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.240 [2024-10-07 11:29:08.315751] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.240 [2024-10-07 11:29:08.315770] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.240 [2024-10-07 11:29:08.315800] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.240 [2024-10-07 11:29:08.316560] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.240 [2024-10-07 11:29:08.325371] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.240 [2024-10-07 11:29:08.325533] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.240 [2024-10-07 11:29:08.325564] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.240 [2024-10-07 11:29:08.325581] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.240 [2024-10-07 11:29:08.325605] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.240 [2024-10-07 11:29:08.325627] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.240 [2024-10-07 11:29:08.325641] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.240 [2024-10-07 11:29:08.325654] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.240 [2024-10-07 11:29:08.325678] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.240 [2024-10-07 11:29:08.335703] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.240 [2024-10-07 11:29:08.336069] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.240 [2024-10-07 11:29:08.336112] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.240 [2024-10-07 11:29:08.336131] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.240 [2024-10-07 11:29:08.336262] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.240 [2024-10-07 11:29:08.336372] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.240 [2024-10-07 11:29:08.336392] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.240 [2024-10-07 11:29:08.336405] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.240 [2024-10-07 11:29:08.337028] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.240 [2024-10-07 11:29:08.345937] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.240 [2024-10-07 11:29:08.346056] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.240 [2024-10-07 11:29:08.346086] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.241 [2024-10-07 11:29:08.346104] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.241 [2024-10-07 11:29:08.346127] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.241 [2024-10-07 11:29:08.346150] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.241 [2024-10-07 11:29:08.346164] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.241 [2024-10-07 11:29:08.346178] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.241 [2024-10-07 11:29:08.346206] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.241 [2024-10-07 11:29:08.359121] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.241 [2024-10-07 11:29:08.359660] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.241 [2024-10-07 11:29:08.359712] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.241 [2024-10-07 11:29:08.359732] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.241 [2024-10-07 11:29:08.360026] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.241 [2024-10-07 11:29:08.360712] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.241 [2024-10-07 11:29:08.360751] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.241 [2024-10-07 11:29:08.360769] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.241 [2024-10-07 11:29:08.360919] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.241 [2024-10-07 11:29:08.369295] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.241 [2024-10-07 11:29:08.369435] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.241 [2024-10-07 11:29:08.369471] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.241 [2024-10-07 11:29:08.369494] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.241 [2024-10-07 11:29:08.369526] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.241 [2024-10-07 11:29:08.369554] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.241 [2024-10-07 11:29:08.369574] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.241 [2024-10-07 11:29:08.369594] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.241 [2024-10-07 11:29:08.369623] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.241 [2024-10-07 11:29:08.381329] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.241 [2024-10-07 11:29:08.381752] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.241 [2024-10-07 11:29:08.381796] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.241 [2024-10-07 11:29:08.381816] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.241 [2024-10-07 11:29:08.381881] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.241 [2024-10-07 11:29:08.381910] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.241 [2024-10-07 11:29:08.381926] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.241 [2024-10-07 11:29:08.381939] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.241 [2024-10-07 11:29:08.381974] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.241 [2024-10-07 11:29:08.391438] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.241 [2024-10-07 11:29:08.391556] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.241 [2024-10-07 11:29:08.391586] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.241 [2024-10-07 11:29:08.391604] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.241 [2024-10-07 11:29:08.392376] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.241 [2024-10-07 11:29:08.392790] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.241 [2024-10-07 11:29:08.392828] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.241 [2024-10-07 11:29:08.392845] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.241 [2024-10-07 11:29:08.392999] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.241 [2024-10-07 11:29:08.401743] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.241 [2024-10-07 11:29:08.401944] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.241 [2024-10-07 11:29:08.402030] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.241 [2024-10-07 11:29:08.402049] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.241 [2024-10-07 11:29:08.402846] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.241 [2024-10-07 11:29:08.402982] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.241 [2024-10-07 11:29:08.403005] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.241 [2024-10-07 11:29:08.403020] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.241 [2024-10-07 11:29:08.403044] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.241 8928.22 IOPS, 34.88 MiB/s [2024-10-07T11:29:15.952Z] [2024-10-07 11:29:08.411891] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.241 [2024-10-07 11:29:08.412154] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.241 [2024-10-07 11:29:08.412187] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.241 [2024-10-07 11:29:08.412204] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.241 [2024-10-07 11:29:08.412322] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.241 [2024-10-07 11:29:08.412443] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.241 [2024-10-07 11:29:08.412466] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.241 [2024-10-07 11:29:08.412480] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.241 [2024-10-07 11:29:08.412504] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.241 [2024-10-07 11:29:08.422162] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.241 [2024-10-07 11:29:08.422277] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.241 [2024-10-07 11:29:08.422308] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.241 [2024-10-07 11:29:08.422326] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.241 [2024-10-07 11:29:08.422350] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.241 [2024-10-07 11:29:08.422372] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.241 [2024-10-07 11:29:08.422387] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.241 [2024-10-07 11:29:08.422402] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.241 [2024-10-07 11:29:08.422464] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.241 [2024-10-07 11:29:08.432252] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.241 [2024-10-07 11:29:08.432376] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.241 [2024-10-07 11:29:08.432423] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.241 [2024-10-07 11:29:08.432444] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.241 [2024-10-07 11:29:08.432903] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.241 [2024-10-07 11:29:08.433153] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.241 [2024-10-07 11:29:08.433196] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.241 [2024-10-07 11:29:08.433218] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.241 [2024-10-07 11:29:08.433498] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.241 [2024-10-07 11:29:08.446958] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.241 [2024-10-07 11:29:08.447067] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.241 [2024-10-07 11:29:08.447097] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.241 [2024-10-07 11:29:08.447115] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.241 [2024-10-07 11:29:08.447140] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.241 [2024-10-07 11:29:08.447162] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.241 [2024-10-07 11:29:08.447178] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.242 [2024-10-07 11:29:08.447192] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.242 [2024-10-07 11:29:08.447215] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.242 [2024-10-07 11:29:08.460248] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.242 [2024-10-07 11:29:08.460599] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.242 [2024-10-07 11:29:08.460632] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.242 [2024-10-07 11:29:08.460649] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.242 [2024-10-07 11:29:08.460844] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.242 [2024-10-07 11:29:08.460910] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.242 [2024-10-07 11:29:08.460930] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.242 [2024-10-07 11:29:08.460944] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.242 [2024-10-07 11:29:08.460967] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.242 [2024-10-07 11:29:08.472314] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.242 [2024-10-07 11:29:08.472766] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.242 [2024-10-07 11:29:08.472828] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.242 [2024-10-07 11:29:08.472849] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.242 [2024-10-07 11:29:08.472916] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.242 [2024-10-07 11:29:08.472945] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.242 [2024-10-07 11:29:08.472961] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.242 [2024-10-07 11:29:08.472974] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.242 [2024-10-07 11:29:08.472997] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.242 [2024-10-07 11:29:08.485676] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.242 [2024-10-07 11:29:08.485956] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.242 [2024-10-07 11:29:08.486016] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.242 [2024-10-07 11:29:08.486034] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.242 [2024-10-07 11:29:08.486080] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.242 [2024-10-07 11:29:08.486106] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.242 [2024-10-07 11:29:08.486121] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.242 [2024-10-07 11:29:08.486135] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.242 [2024-10-07 11:29:08.486159] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.242 [2024-10-07 11:29:08.499419] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.242 [2024-10-07 11:29:08.499565] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.242 [2024-10-07 11:29:08.499595] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.242 [2024-10-07 11:29:08.499613] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.242 [2024-10-07 11:29:08.499636] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.242 [2024-10-07 11:29:08.499657] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.242 [2024-10-07 11:29:08.499673] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.242 [2024-10-07 11:29:08.499686] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.242 [2024-10-07 11:29:08.499709] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.242 [2024-10-07 11:29:08.513169] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.242 [2024-10-07 11:29:08.513274] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.242 [2024-10-07 11:29:08.513303] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.242 [2024-10-07 11:29:08.513321] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.242 [2024-10-07 11:29:08.513345] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.242 [2024-10-07 11:29:08.513385] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.242 [2024-10-07 11:29:08.513401] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.242 [2024-10-07 11:29:08.513430] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.242 [2024-10-07 11:29:08.513456] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.242 [2024-10-07 11:29:08.527386] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.242 [2024-10-07 11:29:08.527564] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.242 [2024-10-07 11:29:08.527596] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.242 [2024-10-07 11:29:08.527614] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.242 [2024-10-07 11:29:08.527638] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.242 [2024-10-07 11:29:08.527677] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.242 [2024-10-07 11:29:08.527692] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.242 [2024-10-07 11:29:08.527706] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.242 [2024-10-07 11:29:08.527728] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.242 [2024-10-07 11:29:08.542458] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.242 [2024-10-07 11:29:08.543219] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.242 [2024-10-07 11:29:08.543277] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.242 [2024-10-07 11:29:08.543296] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.242 [2024-10-07 11:29:08.543559] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.242 [2024-10-07 11:29:08.543624] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.242 [2024-10-07 11:29:08.543645] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.242 [2024-10-07 11:29:08.543659] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.242 [2024-10-07 11:29:08.543684] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.242 [2024-10-07 11:29:08.554059] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.242 [2024-10-07 11:29:08.554244] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.242 [2024-10-07 11:29:08.554275] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.242 [2024-10-07 11:29:08.554294] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.242 [2024-10-07 11:29:08.554409] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.242 [2024-10-07 11:29:08.555117] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.242 [2024-10-07 11:29:08.555152] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.242 [2024-10-07 11:29:08.555186] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.242 [2024-10-07 11:29:08.557247] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.242 [2024-10-07 11:29:08.564141] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.242 [2024-10-07 11:29:08.564254] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.242 [2024-10-07 11:29:08.564283] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.242 [2024-10-07 11:29:08.564316] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.242 [2024-10-07 11:29:08.566729] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.242 [2024-10-07 11:29:08.567347] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.242 [2024-10-07 11:29:08.567383] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.242 [2024-10-07 11:29:08.567417] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.242 [2024-10-07 11:29:08.567533] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.242 [2024-10-07 11:29:08.574232] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.242 [2024-10-07 11:29:08.574336] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.242 [2024-10-07 11:29:08.574372] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.242 [2024-10-07 11:29:08.574390] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.242 [2024-10-07 11:29:08.574427] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.242 [2024-10-07 11:29:08.574453] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.242 [2024-10-07 11:29:08.574468] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.242 [2024-10-07 11:29:08.574482] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.242 [2024-10-07 11:29:08.574505] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.242 [2024-10-07 11:29:08.584382] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.242 [2024-10-07 11:29:08.584515] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.242 [2024-10-07 11:29:08.584547] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.242 [2024-10-07 11:29:08.584564] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.242 [2024-10-07 11:29:08.584588] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.243 [2024-10-07 11:29:08.584611] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.243 [2024-10-07 11:29:08.584626] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.243 [2024-10-07 11:29:08.584639] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.243 [2024-10-07 11:29:08.584662] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.243 [2024-10-07 11:29:08.594770] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.243 [2024-10-07 11:29:08.594950] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.243 [2024-10-07 11:29:08.594979] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.243 [2024-10-07 11:29:08.595013] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.243 [2024-10-07 11:29:08.595040] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.243 [2024-10-07 11:29:08.595062] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.243 [2024-10-07 11:29:08.595076] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.243 [2024-10-07 11:29:08.595089] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.243 [2024-10-07 11:29:08.595112] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.243 [2024-10-07 11:29:08.605047] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.243 [2024-10-07 11:29:08.605163] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.243 [2024-10-07 11:29:08.605192] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.243 [2024-10-07 11:29:08.605209] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.243 [2024-10-07 11:29:08.605677] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.243 [2024-10-07 11:29:08.605927] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.243 [2024-10-07 11:29:08.605968] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.243 [2024-10-07 11:29:08.606001] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.243 [2024-10-07 11:29:08.606056] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.243 [2024-10-07 11:29:08.619358] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.243 [2024-10-07 11:29:08.619667] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.243 [2024-10-07 11:29:08.619710] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.243 [2024-10-07 11:29:08.619730] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.243 [2024-10-07 11:29:08.619850] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.243 [2024-10-07 11:29:08.619947] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.243 [2024-10-07 11:29:08.619967] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.243 [2024-10-07 11:29:08.619981] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.243 [2024-10-07 11:29:08.620006] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.243 [2024-10-07 11:29:08.629925] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.243 [2024-10-07 11:29:08.630050] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.243 [2024-10-07 11:29:08.630080] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.243 [2024-10-07 11:29:08.630097] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.243 [2024-10-07 11:29:08.630121] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.243 [2024-10-07 11:29:08.630143] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.243 [2024-10-07 11:29:08.630158] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.243 [2024-10-07 11:29:08.630190] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.243 [2024-10-07 11:29:08.630219] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.243 [2024-10-07 11:29:08.642787] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.243 [2024-10-07 11:29:08.642997] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.243 [2024-10-07 11:29:08.643027] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.243 [2024-10-07 11:29:08.643044] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.243 [2024-10-07 11:29:08.643140] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.243 [2024-10-07 11:29:08.643319] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.243 [2024-10-07 11:29:08.643353] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.243 [2024-10-07 11:29:08.643369] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.243 [2024-10-07 11:29:08.643457] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.243 [2024-10-07 11:29:08.656313] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.243 [2024-10-07 11:29:08.656518] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.243 [2024-10-07 11:29:08.656550] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.243 [2024-10-07 11:29:08.656568] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.243 [2024-10-07 11:29:08.656592] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.243 [2024-10-07 11:29:08.656614] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.243 [2024-10-07 11:29:08.656629] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.243 [2024-10-07 11:29:08.656642] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.243 [2024-10-07 11:29:08.656667] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.243 [2024-10-07 11:29:08.669215] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.243 [2024-10-07 11:29:08.669400] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.243 [2024-10-07 11:29:08.669461] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.243 [2024-10-07 11:29:08.669481] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.243 [2024-10-07 11:29:08.669506] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.243 [2024-10-07 11:29:08.669528] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.243 [2024-10-07 11:29:08.669543] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.243 [2024-10-07 11:29:08.669557] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.243 [2024-10-07 11:29:08.669580] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.243 [2024-10-07 11:29:08.679310] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.243 [2024-10-07 11:29:08.679743] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.243 [2024-10-07 11:29:08.679787] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.243 [2024-10-07 11:29:08.679822] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.243 [2024-10-07 11:29:08.679978] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.243 [2024-10-07 11:29:08.680082] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.243 [2024-10-07 11:29:08.680101] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.243 [2024-10-07 11:29:08.680114] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.243 [2024-10-07 11:29:08.680212] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.243 [2024-10-07 11:29:08.691774] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.243 [2024-10-07 11:29:08.692152] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.243 [2024-10-07 11:29:08.692196] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.243 [2024-10-07 11:29:08.692215] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.243 [2024-10-07 11:29:08.692270] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.243 [2024-10-07 11:29:08.692471] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.243 [2024-10-07 11:29:08.692496] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.243 [2024-10-07 11:29:08.692511] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.243 [2024-10-07 11:29:08.692574] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.243 [2024-10-07 11:29:08.705501] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.243 [2024-10-07 11:29:08.706793] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.243 [2024-10-07 11:29:08.706852] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.243 [2024-10-07 11:29:08.706871] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.244 [2024-10-07 11:29:08.707475] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.244 [2024-10-07 11:29:08.707871] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.244 [2024-10-07 11:29:08.707906] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.244 [2024-10-07 11:29:08.707922] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.244 [2024-10-07 11:29:08.707991] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.244 [2024-10-07 11:29:08.715749] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.244 [2024-10-07 11:29:08.715943] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.244 [2024-10-07 11:29:08.715973] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.244 [2024-10-07 11:29:08.715990] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.244 [2024-10-07 11:29:08.716686] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.244 [2024-10-07 11:29:08.719799] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.244 [2024-10-07 11:29:08.719838] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.244 [2024-10-07 11:29:08.719872] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.244 [2024-10-07 11:29:08.720242] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.244 [2024-10-07 11:29:08.725921] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.244 [2024-10-07 11:29:08.726059] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.244 [2024-10-07 11:29:08.726090] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.244 [2024-10-07 11:29:08.726107] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.244 [2024-10-07 11:29:08.726131] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.244 [2024-10-07 11:29:08.726154] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.244 [2024-10-07 11:29:08.726168] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.244 [2024-10-07 11:29:08.726181] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.244 [2024-10-07 11:29:08.726204] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.244 [2024-10-07 11:29:08.736244] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.244 [2024-10-07 11:29:08.736351] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.244 [2024-10-07 11:29:08.736380] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.244 [2024-10-07 11:29:08.736398] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.244 [2024-10-07 11:29:08.736435] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.244 [2024-10-07 11:29:08.736460] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.244 [2024-10-07 11:29:08.736475] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.244 [2024-10-07 11:29:08.736489] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.244 [2024-10-07 11:29:08.736511] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.244 [2024-10-07 11:29:08.746328] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.244 [2024-10-07 11:29:08.746476] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.244 [2024-10-07 11:29:08.746507] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.244 [2024-10-07 11:29:08.746524] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.244 [2024-10-07 11:29:08.746549] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.244 [2024-10-07 11:29:08.746571] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.244 [2024-10-07 11:29:08.746586] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.244 [2024-10-07 11:29:08.746599] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.244 [2024-10-07 11:29:08.746641] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.244 [2024-10-07 11:29:08.756882] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.244 [2024-10-07 11:29:08.757000] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.244 [2024-10-07 11:29:08.757029] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.244 [2024-10-07 11:29:08.757063] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.244 [2024-10-07 11:29:08.757245] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.244 [2024-10-07 11:29:08.757310] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.244 [2024-10-07 11:29:08.757331] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.244 [2024-10-07 11:29:08.757345] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.244 [2024-10-07 11:29:08.757369] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.244 [2024-10-07 11:29:08.769591] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.244 [2024-10-07 11:29:08.769698] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.244 [2024-10-07 11:29:08.769728] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.244 [2024-10-07 11:29:08.769745] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.244 [2024-10-07 11:29:08.769769] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.244 [2024-10-07 11:29:08.769791] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.244 [2024-10-07 11:29:08.769805] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.244 [2024-10-07 11:29:08.769818] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.244 [2024-10-07 11:29:08.769841] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.244 [2024-10-07 11:29:08.781683] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.244 [2024-10-07 11:29:08.781865] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.244 [2024-10-07 11:29:08.781895] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.244 [2024-10-07 11:29:08.781912] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.244 [2024-10-07 11:29:08.781936] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.244 [2024-10-07 11:29:08.781957] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.244 [2024-10-07 11:29:08.782001] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.244 [2024-10-07 11:29:08.782016] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.244 [2024-10-07 11:29:08.782039] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.244 [2024-10-07 11:29:08.795660] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.244 [2024-10-07 11:29:08.795777] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.244 [2024-10-07 11:29:08.795824] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.244 [2024-10-07 11:29:08.795843] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.244 [2024-10-07 11:29:08.795867] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.244 [2024-10-07 11:29:08.795889] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.244 [2024-10-07 11:29:08.795903] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.244 [2024-10-07 11:29:08.795917] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.244 [2024-10-07 11:29:08.795939] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.244 [2024-10-07 11:29:08.806900] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.244 [2024-10-07 11:29:08.807115] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.244 [2024-10-07 11:29:08.807146] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.244 [2024-10-07 11:29:08.807163] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.244 [2024-10-07 11:29:08.807289] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.244 [2024-10-07 11:29:08.807401] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.244 [2024-10-07 11:29:08.807422] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.244 [2024-10-07 11:29:08.807451] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.244 [2024-10-07 11:29:08.807551] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.244 [2024-10-07 11:29:08.817148] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.244 [2024-10-07 11:29:08.817266] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.244 [2024-10-07 11:29:08.817296] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.244 [2024-10-07 11:29:08.817314] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.244 [2024-10-07 11:29:08.817338] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.244 [2024-10-07 11:29:08.817360] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.244 [2024-10-07 11:29:08.817374] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.244 [2024-10-07 11:29:08.817388] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.244 [2024-10-07 11:29:08.817411] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.244 [2024-10-07 11:29:08.827240] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.244 [2024-10-07 11:29:08.827361] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.245 [2024-10-07 11:29:08.827408] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.245 [2024-10-07 11:29:08.827425] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.245 [2024-10-07 11:29:08.827461] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.245 [2024-10-07 11:29:08.827502] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.245 [2024-10-07 11:29:08.827519] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.245 [2024-10-07 11:29:08.827533] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.245 [2024-10-07 11:29:08.827556] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.245 [2024-10-07 11:29:08.839246] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.245 [2024-10-07 11:29:08.840213] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.245 [2024-10-07 11:29:08.840271] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.245 [2024-10-07 11:29:08.840291] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.245 [2024-10-07 11:29:08.841032] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.245 [2024-10-07 11:29:08.841640] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.245 [2024-10-07 11:29:08.841674] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.245 [2024-10-07 11:29:08.841691] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.245 [2024-10-07 11:29:08.841922] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.245 [2024-10-07 11:29:08.850134] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.245 [2024-10-07 11:29:08.850319] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.245 [2024-10-07 11:29:08.850350] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.245 [2024-10-07 11:29:08.850367] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.245 [2024-10-07 11:29:08.851647] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.245 [2024-10-07 11:29:08.853407] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.245 [2024-10-07 11:29:08.853468] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.245 [2024-10-07 11:29:08.853488] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.245 [2024-10-07 11:29:08.854060] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.245 [2024-10-07 11:29:08.863386] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.245 [2024-10-07 11:29:08.863623] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.245 [2024-10-07 11:29:08.863654] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.245 [2024-10-07 11:29:08.863672] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.245 [2024-10-07 11:29:08.863771] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.245 [2024-10-07 11:29:08.863882] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.245 [2024-10-07 11:29:08.863903] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.245 [2024-10-07 11:29:08.863916] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.245 [2024-10-07 11:29:08.864515] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.245 [2024-10-07 11:29:08.873492] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.245 [2024-10-07 11:29:08.873613] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.245 [2024-10-07 11:29:08.873643] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.245 [2024-10-07 11:29:08.873660] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.245 [2024-10-07 11:29:08.873683] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.245 [2024-10-07 11:29:08.873705] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.245 [2024-10-07 11:29:08.873719] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.245 [2024-10-07 11:29:08.873733] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.245 [2024-10-07 11:29:08.873755] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.245 [2024-10-07 11:29:08.886898] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.245 [2024-10-07 11:29:08.887103] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.245 [2024-10-07 11:29:08.887135] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.245 [2024-10-07 11:29:08.887152] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.245 [2024-10-07 11:29:08.887262] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.245 [2024-10-07 11:29:08.887504] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.245 [2024-10-07 11:29:08.887535] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.245 [2024-10-07 11:29:08.887551] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.245 [2024-10-07 11:29:08.887606] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.245 [2024-10-07 11:29:08.900212] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.245 [2024-10-07 11:29:08.900527] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.245 [2024-10-07 11:29:08.900571] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.245 [2024-10-07 11:29:08.900591] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.245 [2024-10-07 11:29:08.900797] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.245 [2024-10-07 11:29:08.900865] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.245 [2024-10-07 11:29:08.900887] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.245 [2024-10-07 11:29:08.900901] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.245 [2024-10-07 11:29:08.900926] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.245 [2024-10-07 11:29:08.914169] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.245 [2024-10-07 11:29:08.914277] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.245 [2024-10-07 11:29:08.914317] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.245 [2024-10-07 11:29:08.914355] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.245 [2024-10-07 11:29:08.914382] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.245 [2024-10-07 11:29:08.914405] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.245 [2024-10-07 11:29:08.914436] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.245 [2024-10-07 11:29:08.914451] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.245 [2024-10-07 11:29:08.914475] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.245 [2024-10-07 11:29:08.925078] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.245 [2024-10-07 11:29:08.925276] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.245 [2024-10-07 11:29:08.925308] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.245 [2024-10-07 11:29:08.925326] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.245 [2024-10-07 11:29:08.925442] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.245 [2024-10-07 11:29:08.925549] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.245 [2024-10-07 11:29:08.925569] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.245 [2024-10-07 11:29:08.925584] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.245 [2024-10-07 11:29:08.928121] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.245 [2024-10-07 11:29:08.935987] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.245 [2024-10-07 11:29:08.936092] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.245 [2024-10-07 11:29:08.936122] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.245 [2024-10-07 11:29:08.936140] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.245 [2024-10-07 11:29:08.936164] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.245 [2024-10-07 11:29:08.936186] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.245 [2024-10-07 11:29:08.936201] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.245 [2024-10-07 11:29:08.936215] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.246 [2024-10-07 11:29:08.936249] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.246 [2024-10-07 11:29:08.946539] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.246 [2024-10-07 11:29:08.946642] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.246 [2024-10-07 11:29:08.946673] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.246 [2024-10-07 11:29:08.946690] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.246 [2024-10-07 11:29:08.946714] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.246 [2024-10-07 11:29:08.946737] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.246 [2024-10-07 11:29:08.946752] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.246 [2024-10-07 11:29:08.946782] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.246 [2024-10-07 11:29:08.946807] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.246 [2024-10-07 11:29:08.956621] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.246 [2024-10-07 11:29:08.956726] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.246 [2024-10-07 11:29:08.956757] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.246 [2024-10-07 11:29:08.956774] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.246 [2024-10-07 11:29:08.956828] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.246 [2024-10-07 11:29:08.956850] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.246 [2024-10-07 11:29:08.956864] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.246 [2024-10-07 11:29:08.956879] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.246 [2024-10-07 11:29:08.956902] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.246 [2024-10-07 11:29:08.967054] bdev_nvme.c:1730:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x69dbb0 was disconnected and freed. reset controller. 00:18:34.246 [2024-10-07 11:29:08.967207] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:18:34.246 [2024-10-07 11:29:08.967235] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.246 [2024-10-07 11:29:08.967253] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:18:34.246 [2024-10-07 11:29:08.967267] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.246 [2024-10-07 11:29:08.967281] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:18:34.246 [2024-10-07 11:29:08.967294] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.246 [2024-10-07 11:29:08.967309] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:18:34.246 [2024-10-07 11:29:08.967323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:34.246 [2024-10-07 11:29:08.967335] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.246 [2024-10-07 11:29:08.969597] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.246 [2024-10-07 11:29:08.969643] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.246 [2024-10-07 11:29:08.970670] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.246 [2024-10-07 11:29:08.970892] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.246 [2024-10-07 11:29:08.970923] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.246 [2024-10-07 11:29:08.970940] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.246 [2024-10-07 11:29:08.970988] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.246 [2024-10-07 11:29:08.971028] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.246 [2024-10-07 11:29:08.971046] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.246 [2024-10-07 11:29:08.971211] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.246 [2024-10-07 11:29:08.971241] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.246 [2024-10-07 11:29:08.971473] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.246 [2024-10-07 11:29:08.971504] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.246 [2024-10-07 11:29:08.971519] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.246 [2024-10-07 11:29:08.971537] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.246 [2024-10-07 11:29:08.971551] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.246 [2024-10-07 11:29:08.971565] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.246 [2024-10-07 11:29:08.971616] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.246 [2024-10-07 11:29:08.971636] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.246 [2024-10-07 11:29:08.984944] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.246 [2024-10-07 11:29:08.984993] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.246 [2024-10-07 11:29:08.985314] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.246 [2024-10-07 11:29:08.985348] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.246 [2024-10-07 11:29:08.985366] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.246 [2024-10-07 11:29:08.985414] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.246 [2024-10-07 11:29:08.985437] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.246 [2024-10-07 11:29:08.985469] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.246 [2024-10-07 11:29:08.985910] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.246 [2024-10-07 11:29:08.985952] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.246 [2024-10-07 11:29:08.986178] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.246 [2024-10-07 11:29:08.986218] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.246 [2024-10-07 11:29:08.986235] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.246 [2024-10-07 11:29:08.986252] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.246 [2024-10-07 11:29:08.986277] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.246 [2024-10-07 11:29:08.986291] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.246 [2024-10-07 11:29:08.986343] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.246 [2024-10-07 11:29:08.986363] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.246 [2024-10-07 11:29:08.995929] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.246 [2024-10-07 11:29:08.995990] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.246 [2024-10-07 11:29:08.997162] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.246 [2024-10-07 11:29:08.997205] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.246 [2024-10-07 11:29:08.997224] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.246 [2024-10-07 11:29:08.997273] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.246 [2024-10-07 11:29:08.997296] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.246 [2024-10-07 11:29:08.997311] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.246 [2024-10-07 11:29:08.999139] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.246 [2024-10-07 11:29:08.999198] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.247 [2024-10-07 11:29:08.999789] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.247 [2024-10-07 11:29:08.999840] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.247 [2024-10-07 11:29:08.999855] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.247 [2024-10-07 11:29:08.999872] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.247 [2024-10-07 11:29:08.999886] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.247 [2024-10-07 11:29:08.999898] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.247 [2024-10-07 11:29:09.000032] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.247 [2024-10-07 11:29:09.000056] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.247 [2024-10-07 11:29:09.007022] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.247 [2024-10-07 11:29:09.007064] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.247 [2024-10-07 11:29:09.007236] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.247 [2024-10-07 11:29:09.007265] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.247 [2024-10-07 11:29:09.007281] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.247 [2024-10-07 11:29:09.007325] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.247 [2024-10-07 11:29:09.007346] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.247 [2024-10-07 11:29:09.007361] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.247 [2024-10-07 11:29:09.007535] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.247 [2024-10-07 11:29:09.007565] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.247 [2024-10-07 11:29:09.008109] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.247 [2024-10-07 11:29:09.008138] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.247 [2024-10-07 11:29:09.008170] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.247 [2024-10-07 11:29:09.008188] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.247 [2024-10-07 11:29:09.008202] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.247 [2024-10-07 11:29:09.008214] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.247 [2024-10-07 11:29:09.011050] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.247 [2024-10-07 11:29:09.011086] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.247 [2024-10-07 11:29:09.020686] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.247 [2024-10-07 11:29:09.020732] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.247 [2024-10-07 11:29:09.020926] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.247 [2024-10-07 11:29:09.020955] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.247 [2024-10-07 11:29:09.020972] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.247 [2024-10-07 11:29:09.021016] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.247 [2024-10-07 11:29:09.021038] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.247 [2024-10-07 11:29:09.021053] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.247 [2024-10-07 11:29:09.021149] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.247 [2024-10-07 11:29:09.021172] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.247 [2024-10-07 11:29:09.021213] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.247 [2024-10-07 11:29:09.021231] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.247 [2024-10-07 11:29:09.021244] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.247 [2024-10-07 11:29:09.021260] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.247 [2024-10-07 11:29:09.021273] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.247 [2024-10-07 11:29:09.021287] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.247 [2024-10-07 11:29:09.021309] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.247 [2024-10-07 11:29:09.021323] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.247 [2024-10-07 11:29:09.030835] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.247 [2024-10-07 11:29:09.030913] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.247 [2024-10-07 11:29:09.030987] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.247 [2024-10-07 11:29:09.031016] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.247 [2024-10-07 11:29:09.031032] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.247 [2024-10-07 11:29:09.031098] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.247 [2024-10-07 11:29:09.031121] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.247 [2024-10-07 11:29:09.031142] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.247 [2024-10-07 11:29:09.031169] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.247 [2024-10-07 11:29:09.031193] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.247 [2024-10-07 11:29:09.031209] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.247 [2024-10-07 11:29:09.031232] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.247 [2024-10-07 11:29:09.031245] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.247 [2024-10-07 11:29:09.031278] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.247 [2024-10-07 11:29:09.031295] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.247 [2024-10-07 11:29:09.031307] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.247 [2024-10-07 11:29:09.031319] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.247 [2024-10-07 11:29:09.031339] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.247 [2024-10-07 11:29:09.041369] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.247 [2024-10-07 11:29:09.041714] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.247 [2024-10-07 11:29:09.041826] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.247 [2024-10-07 11:29:09.041866] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.247 [2024-10-07 11:29:09.041882] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.247 [2024-10-07 11:29:09.041971] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.247 [2024-10-07 11:29:09.042015] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.247 [2024-10-07 11:29:09.042031] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.247 [2024-10-07 11:29:09.042050] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.247 [2024-10-07 11:29:09.042074] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.247 [2024-10-07 11:29:09.042092] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.247 [2024-10-07 11:29:09.042106] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.247 [2024-10-07 11:29:09.042119] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.247 [2024-10-07 11:29:09.042142] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.247 [2024-10-07 11:29:09.042157] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.247 [2024-10-07 11:29:09.042170] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.247 [2024-10-07 11:29:09.042183] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.247 [2024-10-07 11:29:09.042203] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.247 [2024-10-07 11:29:09.055139] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.247 [2024-10-07 11:29:09.055544] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.247 [2024-10-07 11:29:09.055654] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.247 [2024-10-07 11:29:09.055683] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.247 [2024-10-07 11:29:09.055714] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.247 [2024-10-07 11:29:09.055940] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.247 [2024-10-07 11:29:09.055975] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.247 [2024-10-07 11:29:09.055992] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.247 [2024-10-07 11:29:09.056010] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.247 [2024-10-07 11:29:09.056536] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.247 [2024-10-07 11:29:09.056574] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.247 [2024-10-07 11:29:09.056591] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.247 [2024-10-07 11:29:09.056605] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.248 [2024-10-07 11:29:09.056858] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.248 [2024-10-07 11:29:09.056882] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.248 [2024-10-07 11:29:09.056896] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.248 [2024-10-07 11:29:09.056909] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.248 [2024-10-07 11:29:09.057096] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.248 [2024-10-07 11:29:09.070380] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.248 [2024-10-07 11:29:09.070471] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.248 [2024-10-07 11:29:09.070563] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.248 [2024-10-07 11:29:09.070592] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.248 [2024-10-07 11:29:09.070609] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.248 [2024-10-07 11:29:09.070655] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.248 [2024-10-07 11:29:09.070677] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.248 [2024-10-07 11:29:09.070693] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.248 [2024-10-07 11:29:09.070716] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.248 [2024-10-07 11:29:09.070737] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.248 [2024-10-07 11:29:09.070757] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.248 [2024-10-07 11:29:09.070771] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.248 [2024-10-07 11:29:09.070784] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.248 [2024-10-07 11:29:09.070800] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.248 [2024-10-07 11:29:09.070830] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.248 [2024-10-07 11:29:09.070844] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.248 [2024-10-07 11:29:09.070868] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.248 [2024-10-07 11:29:09.070882] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.248 [2024-10-07 11:29:09.083765] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.248 [2024-10-07 11:29:09.083814] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.248 [2024-10-07 11:29:09.084120] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.248 [2024-10-07 11:29:09.084177] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.248 [2024-10-07 11:29:09.084195] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.248 [2024-10-07 11:29:09.084242] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.248 [2024-10-07 11:29:09.084263] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.248 [2024-10-07 11:29:09.084278] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.248 [2024-10-07 11:29:09.084481] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.248 [2024-10-07 11:29:09.084512] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.248 [2024-10-07 11:29:09.084696] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.248 [2024-10-07 11:29:09.084720] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.248 [2024-10-07 11:29:09.084734] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.248 [2024-10-07 11:29:09.084750] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.248 [2024-10-07 11:29:09.084764] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.248 [2024-10-07 11:29:09.084776] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.248 [2024-10-07 11:29:09.084829] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.248 [2024-10-07 11:29:09.084849] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.248 [2024-10-07 11:29:09.097393] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.248 [2024-10-07 11:29:09.097465] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.248 [2024-10-07 11:29:09.097565] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.248 [2024-10-07 11:29:09.097594] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.248 [2024-10-07 11:29:09.097611] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.248 [2024-10-07 11:29:09.097658] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.248 [2024-10-07 11:29:09.097680] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.248 [2024-10-07 11:29:09.097696] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.248 [2024-10-07 11:29:09.097737] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.248 [2024-10-07 11:29:09.097758] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.248 [2024-10-07 11:29:09.097778] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.248 [2024-10-07 11:29:09.097792] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.248 [2024-10-07 11:29:09.097805] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.248 [2024-10-07 11:29:09.097836] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.248 [2024-10-07 11:29:09.097850] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.248 [2024-10-07 11:29:09.097862] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.248 [2024-10-07 11:29:09.097885] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.248 [2024-10-07 11:29:09.097898] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.248 [2024-10-07 11:29:09.108787] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.248 [2024-10-07 11:29:09.108835] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.248 [2024-10-07 11:29:09.109018] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.248 [2024-10-07 11:29:09.109059] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.248 [2024-10-07 11:29:09.109076] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.248 [2024-10-07 11:29:09.109122] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.248 [2024-10-07 11:29:09.109145] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.248 [2024-10-07 11:29:09.109160] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.248 [2024-10-07 11:29:09.109262] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.248 [2024-10-07 11:29:09.109286] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.248 [2024-10-07 11:29:09.109385] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.248 [2024-10-07 11:29:09.109403] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.248 [2024-10-07 11:29:09.109417] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.248 [2024-10-07 11:29:09.109434] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.248 [2024-10-07 11:29:09.109463] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.248 [2024-10-07 11:29:09.109477] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.248 [2024-10-07 11:29:09.112029] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.248 [2024-10-07 11:29:09.112066] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.248 [2024-10-07 11:29:09.118908] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.248 [2024-10-07 11:29:09.118983] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.248 [2024-10-07 11:29:09.119054] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.248 [2024-10-07 11:29:09.119094] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.248 [2024-10-07 11:29:09.119112] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.248 [2024-10-07 11:29:09.119787] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.248 [2024-10-07 11:29:09.119842] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.248 [2024-10-07 11:29:09.119877] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.248 [2024-10-07 11:29:09.119894] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.248 [2024-10-07 11:29:09.120090] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.248 [2024-10-07 11:29:09.120116] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.248 [2024-10-07 11:29:09.120130] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.249 [2024-10-07 11:29:09.120143] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.249 [2024-10-07 11:29:09.120286] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.249 [2024-10-07 11:29:09.120309] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.249 [2024-10-07 11:29:09.120322] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.249 [2024-10-07 11:29:09.120336] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.249 [2024-10-07 11:29:09.120477] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.249 [2024-10-07 11:29:09.129122] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.249 [2024-10-07 11:29:09.129170] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.249 [2024-10-07 11:29:09.129254] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.249 [2024-10-07 11:29:09.129282] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.249 [2024-10-07 11:29:09.129300] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.249 [2024-10-07 11:29:09.129346] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.249 [2024-10-07 11:29:09.129369] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.249 [2024-10-07 11:29:09.129384] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.249 [2024-10-07 11:29:09.129407] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.249 [2024-10-07 11:29:09.129444] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.249 [2024-10-07 11:29:09.129464] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.249 [2024-10-07 11:29:09.129479] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.249 [2024-10-07 11:29:09.129493] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.249 [2024-10-07 11:29:09.129509] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.249 [2024-10-07 11:29:09.129523] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.249 [2024-10-07 11:29:09.129558] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.249 [2024-10-07 11:29:09.129583] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.249 [2024-10-07 11:29:09.129597] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.249 [2024-10-07 11:29:09.139899] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.249 [2024-10-07 11:29:09.139949] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.249 [2024-10-07 11:29:09.140180] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.249 [2024-10-07 11:29:09.140212] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.249 [2024-10-07 11:29:09.140229] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.249 [2024-10-07 11:29:09.140277] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.249 [2024-10-07 11:29:09.140300] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.249 [2024-10-07 11:29:09.140315] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.249 [2024-10-07 11:29:09.140366] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.249 [2024-10-07 11:29:09.140392] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.249 [2024-10-07 11:29:09.140428] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.249 [2024-10-07 11:29:09.140446] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.249 [2024-10-07 11:29:09.140460] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.249 [2024-10-07 11:29:09.140476] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.249 [2024-10-07 11:29:09.140491] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.249 [2024-10-07 11:29:09.140504] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.249 [2024-10-07 11:29:09.140527] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.249 [2024-10-07 11:29:09.140541] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.249 [2024-10-07 11:29:09.152784] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.249 [2024-10-07 11:29:09.152833] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.249 [2024-10-07 11:29:09.152917] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.249 [2024-10-07 11:29:09.152946] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.249 [2024-10-07 11:29:09.152963] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.249 [2024-10-07 11:29:09.153009] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.249 [2024-10-07 11:29:09.153032] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.249 [2024-10-07 11:29:09.153047] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.249 [2024-10-07 11:29:09.153077] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.249 [2024-10-07 11:29:09.153117] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.249 [2024-10-07 11:29:09.154003] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.249 [2024-10-07 11:29:09.154043] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.249 [2024-10-07 11:29:09.154060] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.249 [2024-10-07 11:29:09.154077] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.249 [2024-10-07 11:29:09.154092] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.249 [2024-10-07 11:29:09.154105] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.249 [2024-10-07 11:29:09.154827] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.249 [2024-10-07 11:29:09.154862] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.249 [2024-10-07 11:29:09.165878] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.249 [2024-10-07 11:29:09.165926] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.249 [2024-10-07 11:29:09.166650] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.249 [2024-10-07 11:29:09.166707] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.249 [2024-10-07 11:29:09.166726] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.249 [2024-10-07 11:29:09.166774] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.249 [2024-10-07 11:29:09.166797] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.249 [2024-10-07 11:29:09.166812] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.249 [2024-10-07 11:29:09.167003] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.249 [2024-10-07 11:29:09.167034] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.249 [2024-10-07 11:29:09.167283] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.249 [2024-10-07 11:29:09.167310] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.249 [2024-10-07 11:29:09.167324] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.249 [2024-10-07 11:29:09.167341] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.249 [2024-10-07 11:29:09.167355] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.249 [2024-10-07 11:29:09.167369] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.249 [2024-10-07 11:29:09.167438] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.249 [2024-10-07 11:29:09.167461] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.249 [2024-10-07 11:29:09.176904] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.249 [2024-10-07 11:29:09.176952] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.249 [2024-10-07 11:29:09.177035] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.249 [2024-10-07 11:29:09.177064] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.249 [2024-10-07 11:29:09.177095] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.249 [2024-10-07 11:29:09.177146] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.249 [2024-10-07 11:29:09.177170] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.249 [2024-10-07 11:29:09.177185] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.249 [2024-10-07 11:29:09.177348] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.249 [2024-10-07 11:29:09.177380] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.249 [2024-10-07 11:29:09.177512] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.249 [2024-10-07 11:29:09.177536] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.249 [2024-10-07 11:29:09.177551] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.249 [2024-10-07 11:29:09.177568] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.249 [2024-10-07 11:29:09.177583] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.250 [2024-10-07 11:29:09.177596] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.250 [2024-10-07 11:29:09.177812] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.250 [2024-10-07 11:29:09.177835] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.250 [2024-10-07 11:29:09.187811] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.250 [2024-10-07 11:29:09.187856] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.250 [2024-10-07 11:29:09.188016] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.250 [2024-10-07 11:29:09.188060] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.250 [2024-10-07 11:29:09.188076] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.250 [2024-10-07 11:29:09.188120] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.250 [2024-10-07 11:29:09.188142] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.250 [2024-10-07 11:29:09.188157] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.250 [2024-10-07 11:29:09.188180] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.250 [2024-10-07 11:29:09.188199] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.250 [2024-10-07 11:29:09.188219] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.250 [2024-10-07 11:29:09.188232] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.250 [2024-10-07 11:29:09.188246] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.250 [2024-10-07 11:29:09.188262] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.250 [2024-10-07 11:29:09.188275] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.250 [2024-10-07 11:29:09.188287] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.250 [2024-10-07 11:29:09.188325] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.250 [2024-10-07 11:29:09.188341] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.250 [2024-10-07 11:29:09.198510] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.250 [2024-10-07 11:29:09.198571] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.250 [2024-10-07 11:29:09.198667] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.250 [2024-10-07 11:29:09.198694] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.250 [2024-10-07 11:29:09.198710] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.250 [2024-10-07 11:29:09.198754] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.250 [2024-10-07 11:29:09.198775] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.250 [2024-10-07 11:29:09.198790] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.250 [2024-10-07 11:29:09.198813] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.250 [2024-10-07 11:29:09.198831] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.250 [2024-10-07 11:29:09.198850] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.250 [2024-10-07 11:29:09.198863] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.250 [2024-10-07 11:29:09.198876] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.250 [2024-10-07 11:29:09.198891] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.250 [2024-10-07 11:29:09.198904] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.250 [2024-10-07 11:29:09.198917] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.250 [2024-10-07 11:29:09.198953] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.250 [2024-10-07 11:29:09.198970] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.250 [2024-10-07 11:29:09.208646] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.250 [2024-10-07 11:29:09.208720] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.250 [2024-10-07 11:29:09.208791] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.250 [2024-10-07 11:29:09.208818] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.250 [2024-10-07 11:29:09.208833] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.250 [2024-10-07 11:29:09.208883] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.250 [2024-10-07 11:29:09.208906] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.250 [2024-10-07 11:29:09.208920] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.250 [2024-10-07 11:29:09.208937] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.250 [2024-10-07 11:29:09.208960] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.250 [2024-10-07 11:29:09.208991] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.250 [2024-10-07 11:29:09.209005] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.250 [2024-10-07 11:29:09.209018] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.250 [2024-10-07 11:29:09.209041] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.250 [2024-10-07 11:29:09.209054] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.250 [2024-10-07 11:29:09.209067] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.250 [2024-10-07 11:29:09.209080] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.250 [2024-10-07 11:29:09.209099] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.250 [2024-10-07 11:29:09.221850] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.250 [2024-10-07 11:29:09.221897] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.250 [2024-10-07 11:29:09.222120] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.250 [2024-10-07 11:29:09.222151] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.250 [2024-10-07 11:29:09.222167] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.250 [2024-10-07 11:29:09.222212] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.250 [2024-10-07 11:29:09.222234] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.250 [2024-10-07 11:29:09.222249] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.250 [2024-10-07 11:29:09.222737] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.250 [2024-10-07 11:29:09.222766] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.250 [2024-10-07 11:29:09.224025] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.250 [2024-10-07 11:29:09.224060] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.250 [2024-10-07 11:29:09.224092] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.250 [2024-10-07 11:29:09.224109] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.250 [2024-10-07 11:29:09.224122] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.250 [2024-10-07 11:29:09.224136] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.250 [2024-10-07 11:29:09.224399] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.250 [2024-10-07 11:29:09.224422] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.250 [2024-10-07 11:29:09.231971] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.250 [2024-10-07 11:29:09.232047] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.250 [2024-10-07 11:29:09.232118] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.250 [2024-10-07 11:29:09.232146] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.250 [2024-10-07 11:29:09.232162] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.250 [2024-10-07 11:29:09.232236] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.250 [2024-10-07 11:29:09.232260] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.250 [2024-10-07 11:29:09.232275] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.250 [2024-10-07 11:29:09.232292] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.250 [2024-10-07 11:29:09.232314] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.250 [2024-10-07 11:29:09.232330] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.251 [2024-10-07 11:29:09.232343] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.251 [2024-10-07 11:29:09.232355] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.251 [2024-10-07 11:29:09.232377] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.251 [2024-10-07 11:29:09.232390] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.251 [2024-10-07 11:29:09.232403] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.251 [2024-10-07 11:29:09.232415] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.251 [2024-10-07 11:29:09.232447] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.251 [2024-10-07 11:29:09.242062] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.251 [2024-10-07 11:29:09.242176] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.251 [2024-10-07 11:29:09.242204] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.251 [2024-10-07 11:29:09.242220] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.251 [2024-10-07 11:29:09.242255] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.251 [2024-10-07 11:29:09.242282] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.251 [2024-10-07 11:29:09.242308] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.251 [2024-10-07 11:29:09.242323] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.251 [2024-10-07 11:29:09.242336] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.251 [2024-10-07 11:29:09.244577] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.251 [2024-10-07 11:29:09.244668] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.251 [2024-10-07 11:29:09.244694] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.251 [2024-10-07 11:29:09.244709] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.251 [2024-10-07 11:29:09.245332] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.251 [2024-10-07 11:29:09.245504] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.251 [2024-10-07 11:29:09.245536] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.251 [2024-10-07 11:29:09.245552] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.251 [2024-10-07 11:29:09.245678] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.251 [2024-10-07 11:29:09.252152] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.251 [2024-10-07 11:29:09.252275] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.251 [2024-10-07 11:29:09.252304] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.251 [2024-10-07 11:29:09.252321] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.251 [2024-10-07 11:29:09.252343] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.251 [2024-10-07 11:29:09.252377] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.251 [2024-10-07 11:29:09.252394] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.251 [2024-10-07 11:29:09.252407] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.251 [2024-10-07 11:29:09.252442] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.251 [2024-10-07 11:29:09.252464] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.251 [2024-10-07 11:29:09.252523] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.251 [2024-10-07 11:29:09.252548] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.251 [2024-10-07 11:29:09.252563] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.251 [2024-10-07 11:29:09.252585] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.251 [2024-10-07 11:29:09.252605] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.251 [2024-10-07 11:29:09.252619] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.251 [2024-10-07 11:29:09.252631] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.251 [2024-10-07 11:29:09.252652] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.251 [2024-10-07 11:29:09.262243] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.251 [2024-10-07 11:29:09.262361] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.251 [2024-10-07 11:29:09.262389] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.251 [2024-10-07 11:29:09.262406] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.251 [2024-10-07 11:29:09.262442] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.251 [2024-10-07 11:29:09.262471] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.251 [2024-10-07 11:29:09.262485] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.251 [2024-10-07 11:29:09.262498] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.251 [2024-10-07 11:29:09.262520] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.251 [2024-10-07 11:29:09.262567] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.251 [2024-10-07 11:29:09.262638] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.251 [2024-10-07 11:29:09.262663] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.251 [2024-10-07 11:29:09.262696] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.251 [2024-10-07 11:29:09.262719] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.251 [2024-10-07 11:29:09.262740] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.251 [2024-10-07 11:29:09.262753] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.251 [2024-10-07 11:29:09.262766] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.251 [2024-10-07 11:29:09.262787] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.251 [2024-10-07 11:29:09.272318] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.251 [2024-10-07 11:29:09.272449] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.251 [2024-10-07 11:29:09.272478] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.251 [2024-10-07 11:29:09.272495] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.251 [2024-10-07 11:29:09.272518] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.251 [2024-10-07 11:29:09.272539] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.251 [2024-10-07 11:29:09.272553] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.251 [2024-10-07 11:29:09.272565] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.251 [2024-10-07 11:29:09.272589] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.251 [2024-10-07 11:29:09.272626] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.251 [2024-10-07 11:29:09.272693] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.251 [2024-10-07 11:29:09.272718] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.251 [2024-10-07 11:29:09.272733] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.251 [2024-10-07 11:29:09.272754] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.251 [2024-10-07 11:29:09.272774] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.251 [2024-10-07 11:29:09.272788] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.251 [2024-10-07 11:29:09.272800] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.251 [2024-10-07 11:29:09.272821] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.251 [2024-10-07 11:29:09.285034] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.251 [2024-10-07 11:29:09.285099] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.251 [2024-10-07 11:29:09.285399] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.251 [2024-10-07 11:29:09.285443] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.251 [2024-10-07 11:29:09.285477] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.251 [2024-10-07 11:29:09.285523] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.251 [2024-10-07 11:29:09.285566] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.251 [2024-10-07 11:29:09.285582] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.251 [2024-10-07 11:29:09.285634] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.251 [2024-10-07 11:29:09.285659] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.251 [2024-10-07 11:29:09.285678] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.251 [2024-10-07 11:29:09.285692] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.251 [2024-10-07 11:29:09.285705] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.251 [2024-10-07 11:29:09.285721] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.251 [2024-10-07 11:29:09.285734] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.251 [2024-10-07 11:29:09.285747] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.251 [2024-10-07 11:29:09.285769] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.251 [2024-10-07 11:29:09.285782] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.252 [2024-10-07 11:29:09.296062] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.252 [2024-10-07 11:29:09.296113] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.252 [2024-10-07 11:29:09.298021] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.252 [2024-10-07 11:29:09.298073] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.252 [2024-10-07 11:29:09.298092] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.252 [2024-10-07 11:29:09.298141] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.252 [2024-10-07 11:29:09.298165] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.252 [2024-10-07 11:29:09.298180] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.252 [2024-10-07 11:29:09.298848] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.252 [2024-10-07 11:29:09.298888] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.252 [2024-10-07 11:29:09.298995] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.252 [2024-10-07 11:29:09.299018] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.252 [2024-10-07 11:29:09.299031] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.252 [2024-10-07 11:29:09.299048] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.252 [2024-10-07 11:29:09.299063] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.252 [2024-10-07 11:29:09.299075] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.252 [2024-10-07 11:29:09.299098] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.252 [2024-10-07 11:29:09.299112] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.252 [2024-10-07 11:29:09.307364] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.252 [2024-10-07 11:29:09.307454] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.252 [2024-10-07 11:29:09.307541] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.252 [2024-10-07 11:29:09.307569] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.252 [2024-10-07 11:29:09.307586] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.252 [2024-10-07 11:29:09.307644] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.252 [2024-10-07 11:29:09.307667] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.252 [2024-10-07 11:29:09.307683] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.252 [2024-10-07 11:29:09.309922] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.252 [2024-10-07 11:29:09.309986] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.252 [2024-10-07 11:29:09.310105] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.252 [2024-10-07 11:29:09.310128] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.252 [2024-10-07 11:29:09.310143] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.252 [2024-10-07 11:29:09.310159] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.252 [2024-10-07 11:29:09.310173] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.252 [2024-10-07 11:29:09.310186] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.252 [2024-10-07 11:29:09.310510] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.252 [2024-10-07 11:29:09.310536] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.252 [2024-10-07 11:29:09.317517] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.252 [2024-10-07 11:29:09.317624] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.252 [2024-10-07 11:29:09.317724] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.252 [2024-10-07 11:29:09.317766] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.252 [2024-10-07 11:29:09.317782] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.252 [2024-10-07 11:29:09.317834] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.252 [2024-10-07 11:29:09.317857] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.252 [2024-10-07 11:29:09.317873] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.252 [2024-10-07 11:29:09.317890] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.252 [2024-10-07 11:29:09.317912] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.252 [2024-10-07 11:29:09.317929] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.252 [2024-10-07 11:29:09.317942] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.252 [2024-10-07 11:29:09.317999] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.252 [2024-10-07 11:29:09.318027] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.252 [2024-10-07 11:29:09.318042] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.252 [2024-10-07 11:29:09.318056] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.252 [2024-10-07 11:29:09.318069] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.252 [2024-10-07 11:29:09.318090] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.252 [2024-10-07 11:29:09.329382] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.252 [2024-10-07 11:29:09.329437] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.252 [2024-10-07 11:29:09.329537] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.252 [2024-10-07 11:29:09.329565] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.252 [2024-10-07 11:29:09.329581] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.252 [2024-10-07 11:29:09.329624] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.252 [2024-10-07 11:29:09.329646] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.252 [2024-10-07 11:29:09.329660] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.252 [2024-10-07 11:29:09.329683] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.252 [2024-10-07 11:29:09.329702] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.252 [2024-10-07 11:29:09.329721] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.252 [2024-10-07 11:29:09.329734] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.252 [2024-10-07 11:29:09.329747] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.252 [2024-10-07 11:29:09.329762] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.252 [2024-10-07 11:29:09.329775] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.252 [2024-10-07 11:29:09.329788] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.252 [2024-10-07 11:29:09.329809] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.252 [2024-10-07 11:29:09.329822] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.252 [2024-10-07 11:29:09.342640] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.252 [2024-10-07 11:29:09.342687] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.252 [2024-10-07 11:29:09.342838] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.252 [2024-10-07 11:29:09.342866] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.252 [2024-10-07 11:29:09.342882] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.252 [2024-10-07 11:29:09.342926] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.252 [2024-10-07 11:29:09.342948] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.252 [2024-10-07 11:29:09.342980] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.252 [2024-10-07 11:29:09.343005] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.252 [2024-10-07 11:29:09.343025] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.252 [2024-10-07 11:29:09.343044] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.252 [2024-10-07 11:29:09.343059] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.252 [2024-10-07 11:29:09.343072] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.252 [2024-10-07 11:29:09.343087] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.252 [2024-10-07 11:29:09.343101] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.252 [2024-10-07 11:29:09.343113] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.252 [2024-10-07 11:29:09.343135] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.252 [2024-10-07 11:29:09.343163] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.252 [2024-10-07 11:29:09.354466] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.252 [2024-10-07 11:29:09.354525] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.252 [2024-10-07 11:29:09.355291] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.252 [2024-10-07 11:29:09.355347] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.252 [2024-10-07 11:29:09.355365] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.252 [2024-10-07 11:29:09.355429] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.252 [2024-10-07 11:29:09.355466] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.253 [2024-10-07 11:29:09.355483] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.253 [2024-10-07 11:29:09.356944] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.253 [2024-10-07 11:29:09.356984] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.253 [2024-10-07 11:29:09.358055] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.253 [2024-10-07 11:29:09.358093] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.253 [2024-10-07 11:29:09.358110] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.253 [2024-10-07 11:29:09.358127] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.253 [2024-10-07 11:29:09.358142] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.253 [2024-10-07 11:29:09.358156] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.253 [2024-10-07 11:29:09.358593] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.253 [2024-10-07 11:29:09.358619] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.253 [2024-10-07 11:29:09.364600] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.253 [2024-10-07 11:29:09.364689] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.253 [2024-10-07 11:29:09.364763] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.253 [2024-10-07 11:29:09.364790] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.253 [2024-10-07 11:29:09.364806] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.253 [2024-10-07 11:29:09.364856] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.253 [2024-10-07 11:29:09.364878] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.253 [2024-10-07 11:29:09.364893] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.253 [2024-10-07 11:29:09.364910] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.253 [2024-10-07 11:29:09.367303] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.253 [2024-10-07 11:29:09.367343] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.253 [2024-10-07 11:29:09.367376] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.253 [2024-10-07 11:29:09.367389] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.253 [2024-10-07 11:29:09.367940] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.253 [2024-10-07 11:29:09.367974] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.253 [2024-10-07 11:29:09.367990] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.253 [2024-10-07 11:29:09.368003] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.253 [2024-10-07 11:29:09.368309] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.253 [2024-10-07 11:29:09.374704] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.253 [2024-10-07 11:29:09.374837] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.253 [2024-10-07 11:29:09.374865] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.253 [2024-10-07 11:29:09.374882] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.253 [2024-10-07 11:29:09.376884] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.253 [2024-10-07 11:29:09.377261] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.253 [2024-10-07 11:29:09.377314] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.253 [2024-10-07 11:29:09.377332] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.253 [2024-10-07 11:29:09.377345] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.253 [2024-10-07 11:29:09.377533] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.253 [2024-10-07 11:29:09.377596] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.253 [2024-10-07 11:29:09.377620] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.253 [2024-10-07 11:29:09.377636] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.253 [2024-10-07 11:29:09.377784] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.253 [2024-10-07 11:29:09.377929] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.253 [2024-10-07 11:29:09.377951] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.253 [2024-10-07 11:29:09.377994] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.253 [2024-10-07 11:29:09.378123] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.253 [2024-10-07 11:29:09.384795] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.253 [2024-10-07 11:29:09.384908] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.253 [2024-10-07 11:29:09.384935] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.253 [2024-10-07 11:29:09.384951] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.253 [2024-10-07 11:29:09.384973] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.253 [2024-10-07 11:29:09.385009] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.253 [2024-10-07 11:29:09.385027] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.253 [2024-10-07 11:29:09.385041] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.253 [2024-10-07 11:29:09.385062] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.253 [2024-10-07 11:29:09.387336] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.253 [2024-10-07 11:29:09.387468] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.253 [2024-10-07 11:29:09.387498] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.253 [2024-10-07 11:29:09.387514] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.253 [2024-10-07 11:29:09.387537] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.253 [2024-10-07 11:29:09.387557] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.253 [2024-10-07 11:29:09.387571] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.253 [2024-10-07 11:29:09.387584] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.253 [2024-10-07 11:29:09.387605] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.253 [2024-10-07 11:29:09.395075] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.253 [2024-10-07 11:29:09.395190] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.253 [2024-10-07 11:29:09.395218] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.253 [2024-10-07 11:29:09.395234] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.253 [2024-10-07 11:29:09.395569] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.253 [2024-10-07 11:29:09.395695] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.253 [2024-10-07 11:29:09.395753] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.253 [2024-10-07 11:29:09.395769] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.253 [2024-10-07 11:29:09.395810] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.253 [2024-10-07 11:29:09.399745] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.253 [2024-10-07 11:29:09.400103] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.253 [2024-10-07 11:29:09.400146] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.253 [2024-10-07 11:29:09.400169] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.253 [2024-10-07 11:29:09.400224] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.253 [2024-10-07 11:29:09.400872] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.253 [2024-10-07 11:29:09.400922] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.253 [2024-10-07 11:29:09.400954] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.253 [2024-10-07 11:29:09.401190] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.253 8963.30 IOPS, 35.01 MiB/s [2024-10-07T11:29:15.964Z] [2024-10-07 11:29:09.405864] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.253 [2024-10-07 11:29:09.406103] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.253 [2024-10-07 11:29:09.406143] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.253 [2024-10-07 11:29:09.406161] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.253 [2024-10-07 11:29:09.406304] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.253 [2024-10-07 11:29:09.406488] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.253 [2024-10-07 11:29:09.406512] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.253 [2024-10-07 11:29:09.406527] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.253 [2024-10-07 11:29:09.406625] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.253 [2024-10-07 11:29:09.414767] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.253 [2024-10-07 11:29:09.414897] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.253 [2024-10-07 11:29:09.414925] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.253 [2024-10-07 11:29:09.414941] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.254 [2024-10-07 11:29:09.414963] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.254 [2024-10-07 11:29:09.414984] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.254 [2024-10-07 11:29:09.414998] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.254 [2024-10-07 11:29:09.415011] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.254 [2024-10-07 11:29:09.415033] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.254 [2024-10-07 11:29:09.415932] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.254 [2024-10-07 11:29:09.416055] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.254 [2024-10-07 11:29:09.416082] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.254 [2024-10-07 11:29:09.416114] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.254 [2024-10-07 11:29:09.416138] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.254 [2024-10-07 11:29:09.416159] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.254 [2024-10-07 11:29:09.416174] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.254 [2024-10-07 11:29:09.416186] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.254 [2024-10-07 11:29:09.416207] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.254 [2024-10-07 11:29:09.428094] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.254 [2024-10-07 11:29:09.428172] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.254 [2024-10-07 11:29:09.428245] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.254 [2024-10-07 11:29:09.428271] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.254 [2024-10-07 11:29:09.428287] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.254 [2024-10-07 11:29:09.429413] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.254 [2024-10-07 11:29:09.429478] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.254 [2024-10-07 11:29:09.429511] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.254 [2024-10-07 11:29:09.429530] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.254 [2024-10-07 11:29:09.430250] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.254 [2024-10-07 11:29:09.430291] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.254 [2024-10-07 11:29:09.430308] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.254 [2024-10-07 11:29:09.430322] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.254 [2024-10-07 11:29:09.430748] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.254 [2024-10-07 11:29:09.430814] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.254 [2024-10-07 11:29:09.430829] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.254 [2024-10-07 11:29:09.430844] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.254 [2024-10-07 11:29:09.431061] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.254 [2024-10-07 11:29:09.441492] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.254 [2024-10-07 11:29:09.441548] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.254 [2024-10-07 11:29:09.441630] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.254 [2024-10-07 11:29:09.441658] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.254 [2024-10-07 11:29:09.441674] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.254 [2024-10-07 11:29:09.441718] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.254 [2024-10-07 11:29:09.441770] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.254 [2024-10-07 11:29:09.441786] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.254 [2024-10-07 11:29:09.441809] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.254 [2024-10-07 11:29:09.441828] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.254 [2024-10-07 11:29:09.441846] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.254 [2024-10-07 11:29:09.441860] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.254 [2024-10-07 11:29:09.441873] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.254 [2024-10-07 11:29:09.441888] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.254 [2024-10-07 11:29:09.441902] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.254 [2024-10-07 11:29:09.441914] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.254 [2024-10-07 11:29:09.441935] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.254 [2024-10-07 11:29:09.441949] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.254 [2024-10-07 11:29:09.451607] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.254 [2024-10-07 11:29:09.453805] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.254 [2024-10-07 11:29:09.453896] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.254 [2024-10-07 11:29:09.453924] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.254 [2024-10-07 11:29:09.453942] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.254 [2024-10-07 11:29:09.454445] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.254 [2024-10-07 11:29:09.454496] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.254 [2024-10-07 11:29:09.454517] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.254 [2024-10-07 11:29:09.454537] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.254 [2024-10-07 11:29:09.454691] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.254 [2024-10-07 11:29:09.454734] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.254 [2024-10-07 11:29:09.454748] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.254 [2024-10-07 11:29:09.454761] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.254 [2024-10-07 11:29:09.455558] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.254 [2024-10-07 11:29:09.455592] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.254 [2024-10-07 11:29:09.455624] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.254 [2024-10-07 11:29:09.455637] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.254 [2024-10-07 11:29:09.457432] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.254 [2024-10-07 11:29:09.463431] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.254 [2024-10-07 11:29:09.463558] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.254 [2024-10-07 11:29:09.463586] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.254 [2024-10-07 11:29:09.463602] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.254 [2024-10-07 11:29:09.463624] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.254 [2024-10-07 11:29:09.463645] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.254 [2024-10-07 11:29:09.463659] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.254 [2024-10-07 11:29:09.463671] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.254 [2024-10-07 11:29:09.463693] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.254 [2024-10-07 11:29:09.464268] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.254 [2024-10-07 11:29:09.464454] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.254 [2024-10-07 11:29:09.464482] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.254 [2024-10-07 11:29:09.464499] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.254 [2024-10-07 11:29:09.464616] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.254 [2024-10-07 11:29:09.464740] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.254 [2024-10-07 11:29:09.464758] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.254 [2024-10-07 11:29:09.464771] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.254 [2024-10-07 11:29:09.464793] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.254 [2024-10-07 11:29:09.473973] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.254 [2024-10-07 11:29:09.474113] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.254 [2024-10-07 11:29:09.474153] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.254 [2024-10-07 11:29:09.474171] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.254 [2024-10-07 11:29:09.474198] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.255 [2024-10-07 11:29:09.474222] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.255 [2024-10-07 11:29:09.474236] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.255 [2024-10-07 11:29:09.474250] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.255 [2024-10-07 11:29:09.474272] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.255 [2024-10-07 11:29:09.474347] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.255 [2024-10-07 11:29:09.474438] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.255 [2024-10-07 11:29:09.474477] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.255 [2024-10-07 11:29:09.474522] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.255 [2024-10-07 11:29:09.474548] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.255 [2024-10-07 11:29:09.474570] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.255 [2024-10-07 11:29:09.474584] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.255 [2024-10-07 11:29:09.474597] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.255 [2024-10-07 11:29:09.474620] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.255 [2024-10-07 11:29:09.486888] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.255 [2024-10-07 11:29:09.486935] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.255 [2024-10-07 11:29:09.487071] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.255 [2024-10-07 11:29:09.487099] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.255 [2024-10-07 11:29:09.487116] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.255 [2024-10-07 11:29:09.487160] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.255 [2024-10-07 11:29:09.487182] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.255 [2024-10-07 11:29:09.487197] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.255 [2024-10-07 11:29:09.487219] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.255 [2024-10-07 11:29:09.487238] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.255 [2024-10-07 11:29:09.487257] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.255 [2024-10-07 11:29:09.487270] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.255 [2024-10-07 11:29:09.487283] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.255 [2024-10-07 11:29:09.487298] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.255 [2024-10-07 11:29:09.487311] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.255 [2024-10-07 11:29:09.487325] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.255 [2024-10-07 11:29:09.487346] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.255 [2024-10-07 11:29:09.487359] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.255 [2024-10-07 11:29:09.498474] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.255 [2024-10-07 11:29:09.498520] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.255 [2024-10-07 11:29:09.498721] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.255 [2024-10-07 11:29:09.498750] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.255 [2024-10-07 11:29:09.498767] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.255 [2024-10-07 11:29:09.498812] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.255 [2024-10-07 11:29:09.498834] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.255 [2024-10-07 11:29:09.498865] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.255 [2024-10-07 11:29:09.499023] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.255 [2024-10-07 11:29:09.499050] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.255 [2024-10-07 11:29:09.499168] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.255 [2024-10-07 11:29:09.499190] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.255 [2024-10-07 11:29:09.499204] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.255 [2024-10-07 11:29:09.499236] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.255 [2024-10-07 11:29:09.499249] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.255 [2024-10-07 11:29:09.499262] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.255 [2024-10-07 11:29:09.499368] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.255 [2024-10-07 11:29:09.499404] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.255 [2024-10-07 11:29:09.508598] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.255 [2024-10-07 11:29:09.508663] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.255 [2024-10-07 11:29:09.508738] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.255 [2024-10-07 11:29:09.508767] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.255 [2024-10-07 11:29:09.508784] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.255 [2024-10-07 11:29:09.508848] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.255 [2024-10-07 11:29:09.508887] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.255 [2024-10-07 11:29:09.508902] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.255 [2024-10-07 11:29:09.508920] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.255 [2024-10-07 11:29:09.508943] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.255 [2024-10-07 11:29:09.508990] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.255 [2024-10-07 11:29:09.509004] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.255 [2024-10-07 11:29:09.509017] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.255 [2024-10-07 11:29:09.509038] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.255 [2024-10-07 11:29:09.509052] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.255 [2024-10-07 11:29:09.509064] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.255 [2024-10-07 11:29:09.509077] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.255 [2024-10-07 11:29:09.509097] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.255 [2024-10-07 11:29:09.522185] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.255 [2024-10-07 11:29:09.522248] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.255 [2024-10-07 11:29:09.522381] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.255 [2024-10-07 11:29:09.522409] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.255 [2024-10-07 11:29:09.522442] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.255 [2024-10-07 11:29:09.522501] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.255 [2024-10-07 11:29:09.522526] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.255 [2024-10-07 11:29:09.522542] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.255 [2024-10-07 11:29:09.522566] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.255 [2024-10-07 11:29:09.522585] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.255 [2024-10-07 11:29:09.522605] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.256 [2024-10-07 11:29:09.522619] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.256 [2024-10-07 11:29:09.522632] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.256 [2024-10-07 11:29:09.522648] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.256 [2024-10-07 11:29:09.522662] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.256 [2024-10-07 11:29:09.522691] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.256 [2024-10-07 11:29:09.522713] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.256 [2024-10-07 11:29:09.522727] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.256 [2024-10-07 11:29:09.535656] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.256 [2024-10-07 11:29:09.535703] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.256 [2024-10-07 11:29:09.536022] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.256 [2024-10-07 11:29:09.536062] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.256 [2024-10-07 11:29:09.536080] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.256 [2024-10-07 11:29:09.536126] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.256 [2024-10-07 11:29:09.536147] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.256 [2024-10-07 11:29:09.536161] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.256 [2024-10-07 11:29:09.536223] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.256 [2024-10-07 11:29:09.536249] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.256 [2024-10-07 11:29:09.536268] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.256 [2024-10-07 11:29:09.536283] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.256 [2024-10-07 11:29:09.536296] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.256 [2024-10-07 11:29:09.536328] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.256 [2024-10-07 11:29:09.536344] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.256 [2024-10-07 11:29:09.536357] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.256 [2024-10-07 11:29:09.536379] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.256 [2024-10-07 11:29:09.536392] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.256 [2024-10-07 11:29:09.548657] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.256 [2024-10-07 11:29:09.548704] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.256 [2024-10-07 11:29:09.549132] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.256 [2024-10-07 11:29:09.549188] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.256 [2024-10-07 11:29:09.549207] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.256 [2024-10-07 11:29:09.549254] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.256 [2024-10-07 11:29:09.549276] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.256 [2024-10-07 11:29:09.549291] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.256 [2024-10-07 11:29:09.549513] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.256 [2024-10-07 11:29:09.549545] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.256 [2024-10-07 11:29:09.549613] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.256 [2024-10-07 11:29:09.549633] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.256 [2024-10-07 11:29:09.549646] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.256 [2024-10-07 11:29:09.549662] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.256 [2024-10-07 11:29:09.549676] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.256 [2024-10-07 11:29:09.549688] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.256 [2024-10-07 11:29:09.549710] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.256 [2024-10-07 11:29:09.549724] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.256 [2024-10-07 11:29:09.562174] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.256 [2024-10-07 11:29:09.562223] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.256 [2024-10-07 11:29:09.562319] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.256 [2024-10-07 11:29:09.562347] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.256 [2024-10-07 11:29:09.562363] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.256 [2024-10-07 11:29:09.562408] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.256 [2024-10-07 11:29:09.562455] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.256 [2024-10-07 11:29:09.562473] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.256 [2024-10-07 11:29:09.562513] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.256 [2024-10-07 11:29:09.562541] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.256 [2024-10-07 11:29:09.562561] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.256 [2024-10-07 11:29:09.562576] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.256 [2024-10-07 11:29:09.562589] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.256 [2024-10-07 11:29:09.562605] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.256 [2024-10-07 11:29:09.562619] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.256 [2024-10-07 11:29:09.562632] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.256 [2024-10-07 11:29:09.562655] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.256 [2024-10-07 11:29:09.562669] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.256 [2024-10-07 11:29:09.576888] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.256 [2024-10-07 11:29:09.576938] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.256 [2024-10-07 11:29:09.577185] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.256 [2024-10-07 11:29:09.577216] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.256 [2024-10-07 11:29:09.577233] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.256 [2024-10-07 11:29:09.577280] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.256 [2024-10-07 11:29:09.577302] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.256 [2024-10-07 11:29:09.577317] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.256 [2024-10-07 11:29:09.577514] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.256 [2024-10-07 11:29:09.577556] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.256 [2024-10-07 11:29:09.577685] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.256 [2024-10-07 11:29:09.577709] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.256 [2024-10-07 11:29:09.577724] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.256 [2024-10-07 11:29:09.577740] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.256 [2024-10-07 11:29:09.577756] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.256 [2024-10-07 11:29:09.577769] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.256 [2024-10-07 11:29:09.579572] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.256 [2024-10-07 11:29:09.579610] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.256 [2024-10-07 11:29:09.588383] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.256 [2024-10-07 11:29:09.588439] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.256 [2024-10-07 11:29:09.588632] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.256 [2024-10-07 11:29:09.588663] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.256 [2024-10-07 11:29:09.588679] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.256 [2024-10-07 11:29:09.588725] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.256 [2024-10-07 11:29:09.588748] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.256 [2024-10-07 11:29:09.588774] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.256 [2024-10-07 11:29:09.591488] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.256 [2024-10-07 11:29:09.591532] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.256 [2024-10-07 11:29:09.593558] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.256 [2024-10-07 11:29:09.593613] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.256 [2024-10-07 11:29:09.593632] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.256 [2024-10-07 11:29:09.593650] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.256 [2024-10-07 11:29:09.593665] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.256 [2024-10-07 11:29:09.593678] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.256 [2024-10-07 11:29:09.593778] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.257 [2024-10-07 11:29:09.593798] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.257 [2024-10-07 11:29:09.598538] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.257 [2024-10-07 11:29:09.598583] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.257 [2024-10-07 11:29:09.598667] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.257 [2024-10-07 11:29:09.598695] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.257 [2024-10-07 11:29:09.598712] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.257 [2024-10-07 11:29:09.598758] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.257 [2024-10-07 11:29:09.598781] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.257 [2024-10-07 11:29:09.598812] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.257 [2024-10-07 11:29:09.598835] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.257 [2024-10-07 11:29:09.598854] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.257 [2024-10-07 11:29:09.598873] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.257 [2024-10-07 11:29:09.598887] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.257 [2024-10-07 11:29:09.598900] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.257 [2024-10-07 11:29:09.598915] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.257 [2024-10-07 11:29:09.598944] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.257 [2024-10-07 11:29:09.598958] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.257 [2024-10-07 11:29:09.598982] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.257 [2024-10-07 11:29:09.598996] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.257 [2024-10-07 11:29:09.608773] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.257 [2024-10-07 11:29:09.608820] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.257 [2024-10-07 11:29:09.608917] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.257 [2024-10-07 11:29:09.608945] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.257 [2024-10-07 11:29:09.608961] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.257 [2024-10-07 11:29:09.609006] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.257 [2024-10-07 11:29:09.609028] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.257 [2024-10-07 11:29:09.609043] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.257 [2024-10-07 11:29:09.609066] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.257 [2024-10-07 11:29:09.609085] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.257 [2024-10-07 11:29:09.609104] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.257 [2024-10-07 11:29:09.609118] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.257 [2024-10-07 11:29:09.609131] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.257 [2024-10-07 11:29:09.609146] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.257 [2024-10-07 11:29:09.609160] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.257 [2024-10-07 11:29:09.609173] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.257 [2024-10-07 11:29:09.609194] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.257 [2024-10-07 11:29:09.609208] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.257 [2024-10-07 11:29:09.619490] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.257 [2024-10-07 11:29:09.619539] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.257 [2024-10-07 11:29:09.619666] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.257 [2024-10-07 11:29:09.619696] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.257 [2024-10-07 11:29:09.619713] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.257 [2024-10-07 11:29:09.619760] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.257 [2024-10-07 11:29:09.619783] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.257 [2024-10-07 11:29:09.619799] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.257 [2024-10-07 11:29:09.619823] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.257 [2024-10-07 11:29:09.619861] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.257 [2024-10-07 11:29:09.619882] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.257 [2024-10-07 11:29:09.619897] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.257 [2024-10-07 11:29:09.619911] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.257 [2024-10-07 11:29:09.619927] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.257 [2024-10-07 11:29:09.619943] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.257 [2024-10-07 11:29:09.619956] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.257 [2024-10-07 11:29:09.619979] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.257 [2024-10-07 11:29:09.619993] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.257 [2024-10-07 11:29:09.629914] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.257 [2024-10-07 11:29:09.629987] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.257 [2024-10-07 11:29:09.630089] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.257 [2024-10-07 11:29:09.630118] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.257 [2024-10-07 11:29:09.630135] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.257 [2024-10-07 11:29:09.630181] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.257 [2024-10-07 11:29:09.630204] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.257 [2024-10-07 11:29:09.630220] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.257 [2024-10-07 11:29:09.630411] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.257 [2024-10-07 11:29:09.630438] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.257 [2024-10-07 11:29:09.630511] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.257 [2024-10-07 11:29:09.630532] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.257 [2024-10-07 11:29:09.630545] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.257 [2024-10-07 11:29:09.630561] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.257 [2024-10-07 11:29:09.630575] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.257 [2024-10-07 11:29:09.630588] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.257 [2024-10-07 11:29:09.630755] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.257 [2024-10-07 11:29:09.630776] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.257 [2024-10-07 11:29:09.644067] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.257 [2024-10-07 11:29:09.644115] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.257 [2024-10-07 11:29:09.644355] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.257 [2024-10-07 11:29:09.644385] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.257 [2024-10-07 11:29:09.644417] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.257 [2024-10-07 11:29:09.644483] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.257 [2024-10-07 11:29:09.644507] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.257 [2024-10-07 11:29:09.644522] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.257 [2024-10-07 11:29:09.644622] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.257 [2024-10-07 11:29:09.644646] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.257 [2024-10-07 11:29:09.644738] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.257 [2024-10-07 11:29:09.644757] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.257 [2024-10-07 11:29:09.644771] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.257 [2024-10-07 11:29:09.644787] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.257 [2024-10-07 11:29:09.644801] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.257 [2024-10-07 11:29:09.644813] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.257 [2024-10-07 11:29:09.646715] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.257 [2024-10-07 11:29:09.646753] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.258 [2024-10-07 11:29:09.655433] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.258 [2024-10-07 11:29:09.655479] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.258 [2024-10-07 11:29:09.657736] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.258 [2024-10-07 11:29:09.657793] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.258 [2024-10-07 11:29:09.657812] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.258 [2024-10-07 11:29:09.657859] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.258 [2024-10-07 11:29:09.657881] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.258 [2024-10-07 11:29:09.657896] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.258 [2024-10-07 11:29:09.658033] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.258 [2024-10-07 11:29:09.658063] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.258 [2024-10-07 11:29:09.658349] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.258 [2024-10-07 11:29:09.658375] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.258 [2024-10-07 11:29:09.658389] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.258 [2024-10-07 11:29:09.658406] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.258 [2024-10-07 11:29:09.658420] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.258 [2024-10-07 11:29:09.658467] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.258 [2024-10-07 11:29:09.658650] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.258 [2024-10-07 11:29:09.658674] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.258 [2024-10-07 11:29:09.666149] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.258 [2024-10-07 11:29:09.666195] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.258 [2024-10-07 11:29:09.666292] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.258 [2024-10-07 11:29:09.666320] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.258 [2024-10-07 11:29:09.666336] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.258 [2024-10-07 11:29:09.666380] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.258 [2024-10-07 11:29:09.666402] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.258 [2024-10-07 11:29:09.666417] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.258 [2024-10-07 11:29:09.666458] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.258 [2024-10-07 11:29:09.666478] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.258 [2024-10-07 11:29:09.666513] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.258 [2024-10-07 11:29:09.666531] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.258 [2024-10-07 11:29:09.666545] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.258 [2024-10-07 11:29:09.666560] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.258 [2024-10-07 11:29:09.666574] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.258 [2024-10-07 11:29:09.666586] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.258 [2024-10-07 11:29:09.666608] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.258 [2024-10-07 11:29:09.666622] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.258 [2024-10-07 11:29:09.678216] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.258 [2024-10-07 11:29:09.678265] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.258 [2024-10-07 11:29:09.678515] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.258 [2024-10-07 11:29:09.678548] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.258 [2024-10-07 11:29:09.678565] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.258 [2024-10-07 11:29:09.678612] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.258 [2024-10-07 11:29:09.678635] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.258 [2024-10-07 11:29:09.678651] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.258 [2024-10-07 11:29:09.678775] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.258 [2024-10-07 11:29:09.678804] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.258 [2024-10-07 11:29:09.679169] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.258 [2024-10-07 11:29:09.679195] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.258 [2024-10-07 11:29:09.679210] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.258 [2024-10-07 11:29:09.679227] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.258 [2024-10-07 11:29:09.679241] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.258 [2024-10-07 11:29:09.679255] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.258 [2024-10-07 11:29:09.681157] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.258 [2024-10-07 11:29:09.681194] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.258 [2024-10-07 11:29:09.690598] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.258 [2024-10-07 11:29:09.690644] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.258 [2024-10-07 11:29:09.690770] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.258 [2024-10-07 11:29:09.690800] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.258 [2024-10-07 11:29:09.690816] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.258 [2024-10-07 11:29:09.690862] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.258 [2024-10-07 11:29:09.690884] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.258 [2024-10-07 11:29:09.690899] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.258 [2024-10-07 11:29:09.690922] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.258 [2024-10-07 11:29:09.690941] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.258 [2024-10-07 11:29:09.690961] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.258 [2024-10-07 11:29:09.690975] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.258 [2024-10-07 11:29:09.690988] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.258 [2024-10-07 11:29:09.691005] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.258 [2024-10-07 11:29:09.691018] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.258 [2024-10-07 11:29:09.691030] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.258 [2024-10-07 11:29:09.691052] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.258 [2024-10-07 11:29:09.691066] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.258 [2024-10-07 11:29:09.701149] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.258 [2024-10-07 11:29:09.701513] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.258 [2024-10-07 11:29:09.701604] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.258 [2024-10-07 11:29:09.701632] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.258 [2024-10-07 11:29:09.701649] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.258 [2024-10-07 11:29:09.701736] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.258 [2024-10-07 11:29:09.701763] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.258 [2024-10-07 11:29:09.701779] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.258 [2024-10-07 11:29:09.701796] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.258 [2024-10-07 11:29:09.701819] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.258 [2024-10-07 11:29:09.701836] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.258 [2024-10-07 11:29:09.701849] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.258 [2024-10-07 11:29:09.701862] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.258 [2024-10-07 11:29:09.701885] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.258 [2024-10-07 11:29:09.701899] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.258 [2024-10-07 11:29:09.701912] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.258 [2024-10-07 11:29:09.701925] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.258 [2024-10-07 11:29:09.701944] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.258 [2024-10-07 11:29:09.711248] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.258 [2024-10-07 11:29:09.711351] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.258 [2024-10-07 11:29:09.711380] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.259 [2024-10-07 11:29:09.711397] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.259 [2024-10-07 11:29:09.711434] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.259 [2024-10-07 11:29:09.711458] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.259 [2024-10-07 11:29:09.711473] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.259 [2024-10-07 11:29:09.711486] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.259 [2024-10-07 11:29:09.711509] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.259 [2024-10-07 11:29:09.711579] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.259 [2024-10-07 11:29:09.711651] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.259 [2024-10-07 11:29:09.711677] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.259 [2024-10-07 11:29:09.711694] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.259 [2024-10-07 11:29:09.711716] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.259 [2024-10-07 11:29:09.711737] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.259 [2024-10-07 11:29:09.711752] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.259 [2024-10-07 11:29:09.711780] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.259 [2024-10-07 11:29:09.712015] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.259 [2024-10-07 11:29:09.723220] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.259 [2024-10-07 11:29:09.723268] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.259 [2024-10-07 11:29:09.723487] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.259 [2024-10-07 11:29:09.723518] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.259 [2024-10-07 11:29:09.723535] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.259 [2024-10-07 11:29:09.723580] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.259 [2024-10-07 11:29:09.723602] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.259 [2024-10-07 11:29:09.723617] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.259 [2024-10-07 11:29:09.723750] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.259 [2024-10-07 11:29:09.723778] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.259 [2024-10-07 11:29:09.723896] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.259 [2024-10-07 11:29:09.723918] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.259 [2024-10-07 11:29:09.723932] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.259 [2024-10-07 11:29:09.723948] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.259 [2024-10-07 11:29:09.723962] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.259 [2024-10-07 11:29:09.723975] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.259 [2024-10-07 11:29:09.724097] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.259 [2024-10-07 11:29:09.724118] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.259 [2024-10-07 11:29:09.733344] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.259 [2024-10-07 11:29:09.733421] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.259 [2024-10-07 11:29:09.733509] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.259 [2024-10-07 11:29:09.733536] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.259 [2024-10-07 11:29:09.733553] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.259 [2024-10-07 11:29:09.733743] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.259 [2024-10-07 11:29:09.733773] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.259 [2024-10-07 11:29:09.733790] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.259 [2024-10-07 11:29:09.733808] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.259 [2024-10-07 11:29:09.733943] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.259 [2024-10-07 11:29:09.733997] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.259 [2024-10-07 11:29:09.734030] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.259 [2024-10-07 11:29:09.734045] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.259 [2024-10-07 11:29:09.734148] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.259 [2024-10-07 11:29:09.734168] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.259 [2024-10-07 11:29:09.734181] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.259 [2024-10-07 11:29:09.734194] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.259 [2024-10-07 11:29:09.734382] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.259 [2024-10-07 11:29:09.743438] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.259 [2024-10-07 11:29:09.743555] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.259 [2024-10-07 11:29:09.743615] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.259 [2024-10-07 11:29:09.743648] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.259 [2024-10-07 11:29:09.743683] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.259 [2024-10-07 11:29:09.743728] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.259 [2024-10-07 11:29:09.743755] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.259 [2024-10-07 11:29:09.743771] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.259 [2024-10-07 11:29:09.743785] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.259 [2024-10-07 11:29:09.743805] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.259 [2024-10-07 11:29:09.743855] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.259 [2024-10-07 11:29:09.743879] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.259 [2024-10-07 11:29:09.743896] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.259 [2024-10-07 11:29:09.743919] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.259 [2024-10-07 11:29:09.743940] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.259 [2024-10-07 11:29:09.743954] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.259 [2024-10-07 11:29:09.743968] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.259 [2024-10-07 11:29:09.743990] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.259 [2024-10-07 11:29:09.754330] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.259 [2024-10-07 11:29:09.754590] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.259 [2024-10-07 11:29:09.754685] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.259 [2024-10-07 11:29:09.754719] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.259 [2024-10-07 11:29:09.754736] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.259 [2024-10-07 11:29:09.754998] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.259 [2024-10-07 11:29:09.755037] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.259 [2024-10-07 11:29:09.755056] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.259 [2024-10-07 11:29:09.755075] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.259 [2024-10-07 11:29:09.755136] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.259 [2024-10-07 11:29:09.755160] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.259 [2024-10-07 11:29:09.755174] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.259 [2024-10-07 11:29:09.755187] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.260 [2024-10-07 11:29:09.755360] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.260 [2024-10-07 11:29:09.755389] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.260 [2024-10-07 11:29:09.755404] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.260 [2024-10-07 11:29:09.755433] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.260 [2024-10-07 11:29:09.755492] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.260 [2024-10-07 11:29:09.768052] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.260 [2024-10-07 11:29:09.768328] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.260 [2024-10-07 11:29:09.768437] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.260 [2024-10-07 11:29:09.768467] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.260 [2024-10-07 11:29:09.768485] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.260 [2024-10-07 11:29:09.768645] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.260 [2024-10-07 11:29:09.768672] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.260 [2024-10-07 11:29:09.768688] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.260 [2024-10-07 11:29:09.768707] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.260 [2024-10-07 11:29:09.768810] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.260 [2024-10-07 11:29:09.768831] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.260 [2024-10-07 11:29:09.768846] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.260 [2024-10-07 11:29:09.768860] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.260 [2024-10-07 11:29:09.770939] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.260 [2024-10-07 11:29:09.770977] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.260 [2024-10-07 11:29:09.771011] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.260 [2024-10-07 11:29:09.771024] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.260 [2024-10-07 11:29:09.771682] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.260 [2024-10-07 11:29:09.778499] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.260 [2024-10-07 11:29:09.778545] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.260 [2024-10-07 11:29:09.778643] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.260 [2024-10-07 11:29:09.778670] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.260 [2024-10-07 11:29:09.778687] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.260 [2024-10-07 11:29:09.778747] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.260 [2024-10-07 11:29:09.778769] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.260 [2024-10-07 11:29:09.778784] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.260 [2024-10-07 11:29:09.778805] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.260 [2024-10-07 11:29:09.778824] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.260 [2024-10-07 11:29:09.778843] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.260 [2024-10-07 11:29:09.778856] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.260 [2024-10-07 11:29:09.778869] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.260 [2024-10-07 11:29:09.778884] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.260 [2024-10-07 11:29:09.778897] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.260 [2024-10-07 11:29:09.778909] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.260 [2024-10-07 11:29:09.778930] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.260 [2024-10-07 11:29:09.778943] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.260 [2024-10-07 11:29:09.788618] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.260 [2024-10-07 11:29:09.788694] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.260 [2024-10-07 11:29:09.788766] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.260 [2024-10-07 11:29:09.788792] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.260 [2024-10-07 11:29:09.788808] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.260 [2024-10-07 11:29:09.788975] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.260 [2024-10-07 11:29:09.789014] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.260 [2024-10-07 11:29:09.789031] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.260 [2024-10-07 11:29:09.789065] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.260 [2024-10-07 11:29:09.789315] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.260 [2024-10-07 11:29:09.789353] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.260 [2024-10-07 11:29:09.789370] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.260 [2024-10-07 11:29:09.789399] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.260 [2024-10-07 11:29:09.789485] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.260 [2024-10-07 11:29:09.789507] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.260 [2024-10-07 11:29:09.789521] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.260 [2024-10-07 11:29:09.789534] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.260 [2024-10-07 11:29:09.789573] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.260 [2024-10-07 11:29:09.798936] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.260 [2024-10-07 11:29:09.798983] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.260 [2024-10-07 11:29:09.799411] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.260 [2024-10-07 11:29:09.799492] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.260 [2024-10-07 11:29:09.799512] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.260 [2024-10-07 11:29:09.799562] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.260 [2024-10-07 11:29:09.799586] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.260 [2024-10-07 11:29:09.799600] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.260 [2024-10-07 11:29:09.801389] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.260 [2024-10-07 11:29:09.801487] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.260 [2024-10-07 11:29:09.801921] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.260 [2024-10-07 11:29:09.801998] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.260 [2024-10-07 11:29:09.802017] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.260 [2024-10-07 11:29:09.802035] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.260 [2024-10-07 11:29:09.802049] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.260 [2024-10-07 11:29:09.802062] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.260 [2024-10-07 11:29:09.802408] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.260 [2024-10-07 11:29:09.802457] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.260 [2024-10-07 11:29:09.809258] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.260 [2024-10-07 11:29:09.809302] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.260 [2024-10-07 11:29:09.809493] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.260 [2024-10-07 11:29:09.809522] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.260 [2024-10-07 11:29:09.809538] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.260 [2024-10-07 11:29:09.809582] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.260 [2024-10-07 11:29:09.809604] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.260 [2024-10-07 11:29:09.809634] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.260 [2024-10-07 11:29:09.809872] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.260 [2024-10-07 11:29:09.809900] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.260 [2024-10-07 11:29:09.810055] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.260 [2024-10-07 11:29:09.810080] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.260 [2024-10-07 11:29:09.810095] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.260 [2024-10-07 11:29:09.810111] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.260 [2024-10-07 11:29:09.810125] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.260 [2024-10-07 11:29:09.810139] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.260 [2024-10-07 11:29:09.812933] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.260 [2024-10-07 11:29:09.812969] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.260 [2024-10-07 11:29:09.821400] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.260 [2024-10-07 11:29:09.821461] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.261 [2024-10-07 11:29:09.821562] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.261 [2024-10-07 11:29:09.821589] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.261 [2024-10-07 11:29:09.821621] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.261 [2024-10-07 11:29:09.821664] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.261 [2024-10-07 11:29:09.821687] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.261 [2024-10-07 11:29:09.821701] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.261 [2024-10-07 11:29:09.821738] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.261 [2024-10-07 11:29:09.821760] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.261 [2024-10-07 11:29:09.821779] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.261 [2024-10-07 11:29:09.821793] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.261 [2024-10-07 11:29:09.821806] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.261 [2024-10-07 11:29:09.821821] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.261 [2024-10-07 11:29:09.821834] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.261 [2024-10-07 11:29:09.821852] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.261 [2024-10-07 11:29:09.821874] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.261 [2024-10-07 11:29:09.821887] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.261 [2024-10-07 11:29:09.831538] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.261 [2024-10-07 11:29:09.831634] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.261 [2024-10-07 11:29:09.831721] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.261 [2024-10-07 11:29:09.831749] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.261 [2024-10-07 11:29:09.831765] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.261 [2024-10-07 11:29:09.831833] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.261 [2024-10-07 11:29:09.831855] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.261 [2024-10-07 11:29:09.831870] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.261 [2024-10-07 11:29:09.831887] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.261 [2024-10-07 11:29:09.831910] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.261 [2024-10-07 11:29:09.831926] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.261 [2024-10-07 11:29:09.831938] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.261 [2024-10-07 11:29:09.831951] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.261 [2024-10-07 11:29:09.831972] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.261 [2024-10-07 11:29:09.831985] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.261 [2024-10-07 11:29:09.831998] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.261 [2024-10-07 11:29:09.832010] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.261 [2024-10-07 11:29:09.832029] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.261 [2024-10-07 11:29:09.843563] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.261 [2024-10-07 11:29:09.843611] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.261 [2024-10-07 11:29:09.843734] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.261 [2024-10-07 11:29:09.843762] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.261 [2024-10-07 11:29:09.843778] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.261 [2024-10-07 11:29:09.843837] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.261 [2024-10-07 11:29:09.843859] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.261 [2024-10-07 11:29:09.843873] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.261 [2024-10-07 11:29:09.844380] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.261 [2024-10-07 11:29:09.844432] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.261 [2024-10-07 11:29:09.844594] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.261 [2024-10-07 11:29:09.844628] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.261 [2024-10-07 11:29:09.844644] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.261 [2024-10-07 11:29:09.844675] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.261 [2024-10-07 11:29:09.844690] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.261 [2024-10-07 11:29:09.844703] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.261 [2024-10-07 11:29:09.844799] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.261 [2024-10-07 11:29:09.844817] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.261 [2024-10-07 11:29:09.855597] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.261 [2024-10-07 11:29:09.855644] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.261 [2024-10-07 11:29:09.855743] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.261 [2024-10-07 11:29:09.855770] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.261 [2024-10-07 11:29:09.855786] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.261 [2024-10-07 11:29:09.855845] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.261 [2024-10-07 11:29:09.855866] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.261 [2024-10-07 11:29:09.855880] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.261 [2024-10-07 11:29:09.855903] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.261 [2024-10-07 11:29:09.855921] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.261 [2024-10-07 11:29:09.856357] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.261 [2024-10-07 11:29:09.856383] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.261 [2024-10-07 11:29:09.856396] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.261 [2024-10-07 11:29:09.856412] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.261 [2024-10-07 11:29:09.856425] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.261 [2024-10-07 11:29:09.856437] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.261 [2024-10-07 11:29:09.856650] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.261 [2024-10-07 11:29:09.856673] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.261 [2024-10-07 11:29:09.868821] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.261 [2024-10-07 11:29:09.868868] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.261 [2024-10-07 11:29:09.869121] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.261 [2024-10-07 11:29:09.869152] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.261 [2024-10-07 11:29:09.869168] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.261 [2024-10-07 11:29:09.869212] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.261 [2024-10-07 11:29:09.869234] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.261 [2024-10-07 11:29:09.869248] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.261 [2024-10-07 11:29:09.869575] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.261 [2024-10-07 11:29:09.869605] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.261 [2024-10-07 11:29:09.869753] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.261 [2024-10-07 11:29:09.869783] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.261 [2024-10-07 11:29:09.869798] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.261 [2024-10-07 11:29:09.869814] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.261 [2024-10-07 11:29:09.869827] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.261 [2024-10-07 11:29:09.869839] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.261 [2024-10-07 11:29:09.871001] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.261 [2024-10-07 11:29:09.871035] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.261 [2024-10-07 11:29:09.881566] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.261 [2024-10-07 11:29:09.881612] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.261 [2024-10-07 11:29:09.881748] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.261 [2024-10-07 11:29:09.881776] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.261 [2024-10-07 11:29:09.881792] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.261 [2024-10-07 11:29:09.881837] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.261 [2024-10-07 11:29:09.881859] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.261 [2024-10-07 11:29:09.881873] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.261 [2024-10-07 11:29:09.881896] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.261 [2024-10-07 11:29:09.881914] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.262 [2024-10-07 11:29:09.881933] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.262 [2024-10-07 11:29:09.881947] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.262 [2024-10-07 11:29:09.881959] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.262 [2024-10-07 11:29:09.882005] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.262 [2024-10-07 11:29:09.882019] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.262 [2024-10-07 11:29:09.882033] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.262 [2024-10-07 11:29:09.882205] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.262 [2024-10-07 11:29:09.882230] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.262 [2024-10-07 11:29:09.896241] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.262 [2024-10-07 11:29:09.896289] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.262 [2024-10-07 11:29:09.896643] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.262 [2024-10-07 11:29:09.896686] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.262 [2024-10-07 11:29:09.896706] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.262 [2024-10-07 11:29:09.896754] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.262 [2024-10-07 11:29:09.896776] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.262 [2024-10-07 11:29:09.896792] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.262 [2024-10-07 11:29:09.897269] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.262 [2024-10-07 11:29:09.897308] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.262 [2024-10-07 11:29:09.897560] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.262 [2024-10-07 11:29:09.897591] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.262 [2024-10-07 11:29:09.897606] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.262 [2024-10-07 11:29:09.897624] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.262 [2024-10-07 11:29:09.897639] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.262 [2024-10-07 11:29:09.897651] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.262 [2024-10-07 11:29:09.897856] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.262 [2024-10-07 11:29:09.897880] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.262 [2024-10-07 11:29:09.909601] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.262 [2024-10-07 11:29:09.909650] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.262 [2024-10-07 11:29:09.910004] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.262 [2024-10-07 11:29:09.910048] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.262 [2024-10-07 11:29:09.910067] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.262 [2024-10-07 11:29:09.910116] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.262 [2024-10-07 11:29:09.910138] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.262 [2024-10-07 11:29:09.910154] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.262 [2024-10-07 11:29:09.910454] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.262 [2024-10-07 11:29:09.910486] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.262 [2024-10-07 11:29:09.910542] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.262 [2024-10-07 11:29:09.910563] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.262 [2024-10-07 11:29:09.910577] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.262 [2024-10-07 11:29:09.910594] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.262 [2024-10-07 11:29:09.910623] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.262 [2024-10-07 11:29:09.910637] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.262 [2024-10-07 11:29:09.910661] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.262 [2024-10-07 11:29:09.910675] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.262 [2024-10-07 11:29:09.923355] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.262 [2024-10-07 11:29:09.923403] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.262 [2024-10-07 11:29:09.923864] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.262 [2024-10-07 11:29:09.923904] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.262 [2024-10-07 11:29:09.923923] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.262 [2024-10-07 11:29:09.923969] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.262 [2024-10-07 11:29:09.923990] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.262 [2024-10-07 11:29:09.924005] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.262 [2024-10-07 11:29:09.924262] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.262 [2024-10-07 11:29:09.924292] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.262 [2024-10-07 11:29:09.924509] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.262 [2024-10-07 11:29:09.924543] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.262 [2024-10-07 11:29:09.924560] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.262 [2024-10-07 11:29:09.924577] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.262 [2024-10-07 11:29:09.924591] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.262 [2024-10-07 11:29:09.924604] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.262 [2024-10-07 11:29:09.924656] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.262 [2024-10-07 11:29:09.924677] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.262 [2024-10-07 11:29:09.935938] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.262 [2024-10-07 11:29:09.935983] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.262 [2024-10-07 11:29:09.936080] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.262 [2024-10-07 11:29:09.936107] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.262 [2024-10-07 11:29:09.936123] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.262 [2024-10-07 11:29:09.936166] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.262 [2024-10-07 11:29:09.936188] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.262 [2024-10-07 11:29:09.936202] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.262 [2024-10-07 11:29:09.936234] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.262 [2024-10-07 11:29:09.936273] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.262 [2024-10-07 11:29:09.936294] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.262 [2024-10-07 11:29:09.936308] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.262 [2024-10-07 11:29:09.936321] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.262 [2024-10-07 11:29:09.936336] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.262 [2024-10-07 11:29:09.936350] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.262 [2024-10-07 11:29:09.936362] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.262 [2024-10-07 11:29:09.936395] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.262 [2024-10-07 11:29:09.936411] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.262 [2024-10-07 11:29:09.946695] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.262 [2024-10-07 11:29:09.950079] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.262 [2024-10-07 11:29:09.950178] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.262 [2024-10-07 11:29:09.950208] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.262 [2024-10-07 11:29:09.950225] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.262 [2024-10-07 11:29:09.950809] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.262 [2024-10-07 11:29:09.950850] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.262 [2024-10-07 11:29:09.950868] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.262 [2024-10-07 11:29:09.950886] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.262 [2024-10-07 11:29:09.952023] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.262 [2024-10-07 11:29:09.952060] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.262 [2024-10-07 11:29:09.952092] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.262 [2024-10-07 11:29:09.952106] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.262 [2024-10-07 11:29:09.952705] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.262 [2024-10-07 11:29:09.952740] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.262 [2024-10-07 11:29:09.952757] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.262 [2024-10-07 11:29:09.952771] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.263 [2024-10-07 11:29:09.953139] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.263 [2024-10-07 11:29:09.956788] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.263 [2024-10-07 11:29:09.956915] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.263 [2024-10-07 11:29:09.956943] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.263 [2024-10-07 11:29:09.956973] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.263 [2024-10-07 11:29:09.956997] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.263 [2024-10-07 11:29:09.957017] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.263 [2024-10-07 11:29:09.957031] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.263 [2024-10-07 11:29:09.957044] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.263 [2024-10-07 11:29:09.957066] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.263 [2024-10-07 11:29:09.960333] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.263 [2024-10-07 11:29:09.960580] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.263 [2024-10-07 11:29:09.960624] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.263 [2024-10-07 11:29:09.960643] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.263 [2024-10-07 11:29:09.960763] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.263 [2024-10-07 11:29:09.960934] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.263 [2024-10-07 11:29:09.960956] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.263 [2024-10-07 11:29:09.960970] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.263 [2024-10-07 11:29:09.961066] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.263 [2024-10-07 11:29:09.967237] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.263 [2024-10-07 11:29:09.967352] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.263 [2024-10-07 11:29:09.967381] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.263 [2024-10-07 11:29:09.967396] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.263 [2024-10-07 11:29:09.967419] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.263 [2024-10-07 11:29:09.967456] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.263 [2024-10-07 11:29:09.967470] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.263 [2024-10-07 11:29:09.967483] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.263 [2024-10-07 11:29:09.967504] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.263 [2024-10-07 11:29:09.970840] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.263 [2024-10-07 11:29:09.970951] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.263 [2024-10-07 11:29:09.970979] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.263 [2024-10-07 11:29:09.970995] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.263 [2024-10-07 11:29:09.971018] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.263 [2024-10-07 11:29:09.971038] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.263 [2024-10-07 11:29:09.971067] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.263 [2024-10-07 11:29:09.971081] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.263 [2024-10-07 11:29:09.971103] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.263 [2024-10-07 11:29:09.980513] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.263 [2024-10-07 11:29:09.980872] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.263 [2024-10-07 11:29:09.980913] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.263 [2024-10-07 11:29:09.980932] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.263 [2024-10-07 11:29:09.981194] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.263 [2024-10-07 11:29:09.981299] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.263 [2024-10-07 11:29:09.981323] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.263 [2024-10-07 11:29:09.981336] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.263 [2024-10-07 11:29:09.981360] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.263 [2024-10-07 11:29:09.981378] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.263 [2024-10-07 11:29:09.981472] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.263 [2024-10-07 11:29:09.981500] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.263 [2024-10-07 11:29:09.981516] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.263 [2024-10-07 11:29:09.981539] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.263 [2024-10-07 11:29:09.981560] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.263 [2024-10-07 11:29:09.981574] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.263 [2024-10-07 11:29:09.981587] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.263 [2024-10-07 11:29:09.981609] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.263 [2024-10-07 11:29:09.994404] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.263 [2024-10-07 11:29:09.994931] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.263 [2024-10-07 11:29:09.995022] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.263 [2024-10-07 11:29:09.995049] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.263 [2024-10-07 11:29:09.995065] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.263 [2024-10-07 11:29:09.995324] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.263 [2024-10-07 11:29:09.995354] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.263 [2024-10-07 11:29:09.995370] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.263 [2024-10-07 11:29:09.995388] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.263 [2024-10-07 11:29:09.995591] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.263 [2024-10-07 11:29:09.995632] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.263 [2024-10-07 11:29:09.995647] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.263 [2024-10-07 11:29:09.995660] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.263 [2024-10-07 11:29:09.995852] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.263 [2024-10-07 11:29:09.995875] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.263 [2024-10-07 11:29:09.995888] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.263 [2024-10-07 11:29:09.995901] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.263 [2024-10-07 11:29:09.995956] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.263 [2024-10-07 11:29:10.008538] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.263 [2024-10-07 11:29:10.008589] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.263 [2024-10-07 11:29:10.008672] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.263 [2024-10-07 11:29:10.008708] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.263 [2024-10-07 11:29:10.008725] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.263 [2024-10-07 11:29:10.008771] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.263 [2024-10-07 11:29:10.008793] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.263 [2024-10-07 11:29:10.008809] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.263 [2024-10-07 11:29:10.008832] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.263 [2024-10-07 11:29:10.008852] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.263 [2024-10-07 11:29:10.008872] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.263 [2024-10-07 11:29:10.008886] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.263 [2024-10-07 11:29:10.008900] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.263 [2024-10-07 11:29:10.008916] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.264 [2024-10-07 11:29:10.008931] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.264 [2024-10-07 11:29:10.008944] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.264 [2024-10-07 11:29:10.008966] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.264 [2024-10-07 11:29:10.008980] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.264 [2024-10-07 11:29:10.023162] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.264 [2024-10-07 11:29:10.023212] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.264 [2024-10-07 11:29:10.023645] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.264 [2024-10-07 11:29:10.023688] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.264 [2024-10-07 11:29:10.023723] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.264 [2024-10-07 11:29:10.023782] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.264 [2024-10-07 11:29:10.023806] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.264 [2024-10-07 11:29:10.023822] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.264 [2024-10-07 11:29:10.023962] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.264 [2024-10-07 11:29:10.023991] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.264 [2024-10-07 11:29:10.024131] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.264 [2024-10-07 11:29:10.024155] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.264 [2024-10-07 11:29:10.024169] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.264 [2024-10-07 11:29:10.024187] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.264 [2024-10-07 11:29:10.024201] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.264 [2024-10-07 11:29:10.024214] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.264 [2024-10-07 11:29:10.024273] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.264 [2024-10-07 11:29:10.024293] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.264 [2024-10-07 11:29:10.034886] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.264 [2024-10-07 11:29:10.034937] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.264 [2024-10-07 11:29:10.035457] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.264 [2024-10-07 11:29:10.035499] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.264 [2024-10-07 11:29:10.035518] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.264 [2024-10-07 11:29:10.035567] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.264 [2024-10-07 11:29:10.035590] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.264 [2024-10-07 11:29:10.035606] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.264 [2024-10-07 11:29:10.037351] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.264 [2024-10-07 11:29:10.037424] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.264 [2024-10-07 11:29:10.038208] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.264 [2024-10-07 11:29:10.038247] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.264 [2024-10-07 11:29:10.038264] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.264 [2024-10-07 11:29:10.038282] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.264 [2024-10-07 11:29:10.038296] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.264 [2024-10-07 11:29:10.038309] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.264 [2024-10-07 11:29:10.038453] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.264 [2024-10-07 11:29:10.038477] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.264 [2024-10-07 11:29:10.049090] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.264 [2024-10-07 11:29:10.049138] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.264 [2024-10-07 11:29:10.049451] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.264 [2024-10-07 11:29:10.049492] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.264 [2024-10-07 11:29:10.049512] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.264 [2024-10-07 11:29:10.049562] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.264 [2024-10-07 11:29:10.049585] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.264 [2024-10-07 11:29:10.049609] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.264 [2024-10-07 11:29:10.049743] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.264 [2024-10-07 11:29:10.049771] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.264 [2024-10-07 11:29:10.049870] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.264 [2024-10-07 11:29:10.049888] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.264 [2024-10-07 11:29:10.049903] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.264 [2024-10-07 11:29:10.049921] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.264 [2024-10-07 11:29:10.049935] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.264 [2024-10-07 11:29:10.049948] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.264 [2024-10-07 11:29:10.050572] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.264 [2024-10-07 11:29:10.050606] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.264 [2024-10-07 11:29:10.059326] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.264 [2024-10-07 11:29:10.059374] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.264 [2024-10-07 11:29:10.059469] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.264 [2024-10-07 11:29:10.059499] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.264 [2024-10-07 11:29:10.059516] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.264 [2024-10-07 11:29:10.059563] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.264 [2024-10-07 11:29:10.059585] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.264 [2024-10-07 11:29:10.059600] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.264 [2024-10-07 11:29:10.059624] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.264 [2024-10-07 11:29:10.059644] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.264 [2024-10-07 11:29:10.062143] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.264 [2024-10-07 11:29:10.062199] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.264 [2024-10-07 11:29:10.062217] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.264 [2024-10-07 11:29:10.062235] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.264 [2024-10-07 11:29:10.062250] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.264 [2024-10-07 11:29:10.062263] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.264 [2024-10-07 11:29:10.063023] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.264 [2024-10-07 11:29:10.063057] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.264 [2024-10-07 11:29:10.069454] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.264 [2024-10-07 11:29:10.069553] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.264 [2024-10-07 11:29:10.069633] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.264 [2024-10-07 11:29:10.069661] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.264 [2024-10-07 11:29:10.069678] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.264 [2024-10-07 11:29:10.069743] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.264 [2024-10-07 11:29:10.069767] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.264 [2024-10-07 11:29:10.069782] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.264 [2024-10-07 11:29:10.069800] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.264 [2024-10-07 11:29:10.069825] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.264 [2024-10-07 11:29:10.069841] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.264 [2024-10-07 11:29:10.069855] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.264 [2024-10-07 11:29:10.069868] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.264 [2024-10-07 11:29:10.069892] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.264 [2024-10-07 11:29:10.069906] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.264 [2024-10-07 11:29:10.069919] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.264 [2024-10-07 11:29:10.069933] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.264 [2024-10-07 11:29:10.070387] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.264 [2024-10-07 11:29:10.079570] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.264 [2024-10-07 11:29:10.079675] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.264 [2024-10-07 11:29:10.079706] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.265 [2024-10-07 11:29:10.079723] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.265 [2024-10-07 11:29:10.079759] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.265 [2024-10-07 11:29:10.079808] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.265 [2024-10-07 11:29:10.079837] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.265 [2024-10-07 11:29:10.079854] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.265 [2024-10-07 11:29:10.079868] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.265 [2024-10-07 11:29:10.079889] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.265 [2024-10-07 11:29:10.079943] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.265 [2024-10-07 11:29:10.079968] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.265 [2024-10-07 11:29:10.079983] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.265 [2024-10-07 11:29:10.080006] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.265 [2024-10-07 11:29:10.080027] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.265 [2024-10-07 11:29:10.080042] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.265 [2024-10-07 11:29:10.080055] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.265 [2024-10-07 11:29:10.080076] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.265 [2024-10-07 11:29:10.091843] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.265 [2024-10-07 11:29:10.091892] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.265 [2024-10-07 11:29:10.091994] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.265 [2024-10-07 11:29:10.092023] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.265 [2024-10-07 11:29:10.092040] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.265 [2024-10-07 11:29:10.092089] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.265 [2024-10-07 11:29:10.092112] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.265 [2024-10-07 11:29:10.092127] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.265 [2024-10-07 11:29:10.092299] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.265 [2024-10-07 11:29:10.092328] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.265 [2024-10-07 11:29:10.092564] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.265 [2024-10-07 11:29:10.092591] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.265 [2024-10-07 11:29:10.092606] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.265 [2024-10-07 11:29:10.092623] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.265 [2024-10-07 11:29:10.092637] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.265 [2024-10-07 11:29:10.092651] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.265 [2024-10-07 11:29:10.092713] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.265 [2024-10-07 11:29:10.092735] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.265 [2024-10-07 11:29:10.106107] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.265 [2024-10-07 11:29:10.106155] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.265 [2024-10-07 11:29:10.106239] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.265 [2024-10-07 11:29:10.106267] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.265 [2024-10-07 11:29:10.106284] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.265 [2024-10-07 11:29:10.106344] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.265 [2024-10-07 11:29:10.106365] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.265 [2024-10-07 11:29:10.106392] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.265 [2024-10-07 11:29:10.106415] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.265 [2024-10-07 11:29:10.106447] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.265 [2024-10-07 11:29:10.106472] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.265 [2024-10-07 11:29:10.106487] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.265 [2024-10-07 11:29:10.106501] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.265 [2024-10-07 11:29:10.106517] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.265 [2024-10-07 11:29:10.106531] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.265 [2024-10-07 11:29:10.106544] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.265 [2024-10-07 11:29:10.106566] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.265 [2024-10-07 11:29:10.106580] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.265 [2024-10-07 11:29:10.122043] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.265 [2024-10-07 11:29:10.122095] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.265 [2024-10-07 11:29:10.122257] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.265 [2024-10-07 11:29:10.122287] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.265 [2024-10-07 11:29:10.122319] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.265 [2024-10-07 11:29:10.122366] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.265 [2024-10-07 11:29:10.122388] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.265 [2024-10-07 11:29:10.122403] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.265 [2024-10-07 11:29:10.122441] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.265 [2024-10-07 11:29:10.122464] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.265 [2024-10-07 11:29:10.122484] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.265 [2024-10-07 11:29:10.122498] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.265 [2024-10-07 11:29:10.122527] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.265 [2024-10-07 11:29:10.122545] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.265 [2024-10-07 11:29:10.122559] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.265 [2024-10-07 11:29:10.122572] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.265 [2024-10-07 11:29:10.122595] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.265 [2024-10-07 11:29:10.122626] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.265 [2024-10-07 11:29:10.134811] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.265 [2024-10-07 11:29:10.134861] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.265 [2024-10-07 11:29:10.134990] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.265 [2024-10-07 11:29:10.135020] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.265 [2024-10-07 11:29:10.135040] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.265 [2024-10-07 11:29:10.135086] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.265 [2024-10-07 11:29:10.135109] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.265 [2024-10-07 11:29:10.135124] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.265 [2024-10-07 11:29:10.135161] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.265 [2024-10-07 11:29:10.135184] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.265 [2024-10-07 11:29:10.135205] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.265 [2024-10-07 11:29:10.135219] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.265 [2024-10-07 11:29:10.135233] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.265 [2024-10-07 11:29:10.135250] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.265 [2024-10-07 11:29:10.135269] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.265 [2024-10-07 11:29:10.135282] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.265 [2024-10-07 11:29:10.135305] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.265 [2024-10-07 11:29:10.135319] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.265 [2024-10-07 11:29:10.148756] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.265 [2024-10-07 11:29:10.148802] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.265 [2024-10-07 11:29:10.148897] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.265 [2024-10-07 11:29:10.148924] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.265 [2024-10-07 11:29:10.148940] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.265 [2024-10-07 11:29:10.149001] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.265 [2024-10-07 11:29:10.149023] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.265 [2024-10-07 11:29:10.149071] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.265 [2024-10-07 11:29:10.149099] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.266 [2024-10-07 11:29:10.149118] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.266 [2024-10-07 11:29:10.149138] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.266 [2024-10-07 11:29:10.149153] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.266 [2024-10-07 11:29:10.149167] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.266 [2024-10-07 11:29:10.149183] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.266 [2024-10-07 11:29:10.149197] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.266 [2024-10-07 11:29:10.149211] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.266 [2024-10-07 11:29:10.149234] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.266 [2024-10-07 11:29:10.149247] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.266 [2024-10-07 11:29:10.162570] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.266 [2024-10-07 11:29:10.162617] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.266 [2024-10-07 11:29:10.162966] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.266 [2024-10-07 11:29:10.163007] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.266 [2024-10-07 11:29:10.163025] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.266 [2024-10-07 11:29:10.163071] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.266 [2024-10-07 11:29:10.163093] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.266 [2024-10-07 11:29:10.163108] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.266 [2024-10-07 11:29:10.163346] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.266 [2024-10-07 11:29:10.163392] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.266 [2024-10-07 11:29:10.163464] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.266 [2024-10-07 11:29:10.163487] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.266 [2024-10-07 11:29:10.163502] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.266 [2024-10-07 11:29:10.163518] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.266 [2024-10-07 11:29:10.163532] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.266 [2024-10-07 11:29:10.163545] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.266 [2024-10-07 11:29:10.163568] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.266 [2024-10-07 11:29:10.163581] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.266 [2024-10-07 11:29:10.176026] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.266 [2024-10-07 11:29:10.176088] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.266 [2024-10-07 11:29:10.176830] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.266 [2024-10-07 11:29:10.176870] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.266 [2024-10-07 11:29:10.176906] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.266 [2024-10-07 11:29:10.176952] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.266 [2024-10-07 11:29:10.176973] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.266 [2024-10-07 11:29:10.176988] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.266 [2024-10-07 11:29:10.177208] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.266 [2024-10-07 11:29:10.177237] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.266 [2024-10-07 11:29:10.177286] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.266 [2024-10-07 11:29:10.177306] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.266 [2024-10-07 11:29:10.177320] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.266 [2024-10-07 11:29:10.177336] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.266 [2024-10-07 11:29:10.177349] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.266 [2024-10-07 11:29:10.177362] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.266 [2024-10-07 11:29:10.177644] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.266 [2024-10-07 11:29:10.177669] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.266 [2024-10-07 11:29:10.186722] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.266 [2024-10-07 11:29:10.186772] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.266 [2024-10-07 11:29:10.186964] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.266 [2024-10-07 11:29:10.186994] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.266 [2024-10-07 11:29:10.187012] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.266 [2024-10-07 11:29:10.187058] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.266 [2024-10-07 11:29:10.187081] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.266 [2024-10-07 11:29:10.187097] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.266 [2024-10-07 11:29:10.187353] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.266 [2024-10-07 11:29:10.187385] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.266 [2024-10-07 11:29:10.187532] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.266 [2024-10-07 11:29:10.187557] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.266 [2024-10-07 11:29:10.187571] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.266 [2024-10-07 11:29:10.187609] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.266 [2024-10-07 11:29:10.187625] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.266 [2024-10-07 11:29:10.187639] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.266 [2024-10-07 11:29:10.187761] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.266 [2024-10-07 11:29:10.187782] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.266 [2024-10-07 11:29:10.198167] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.266 [2024-10-07 11:29:10.198216] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.266 [2024-10-07 11:29:10.198365] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.266 [2024-10-07 11:29:10.198397] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.266 [2024-10-07 11:29:10.198429] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.266 [2024-10-07 11:29:10.198481] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.266 [2024-10-07 11:29:10.198504] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.266 [2024-10-07 11:29:10.198520] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.266 [2024-10-07 11:29:10.198986] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.266 [2024-10-07 11:29:10.199028] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.266 [2024-10-07 11:29:10.199216] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.266 [2024-10-07 11:29:10.199247] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.266 [2024-10-07 11:29:10.199262] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.266 [2024-10-07 11:29:10.199280] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.266 [2024-10-07 11:29:10.199294] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.266 [2024-10-07 11:29:10.199307] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.266 [2024-10-07 11:29:10.199432] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.266 [2024-10-07 11:29:10.199455] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.266 [2024-10-07 11:29:10.208278] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.266 [2024-10-07 11:29:10.208341] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.266 [2024-10-07 11:29:10.208427] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.266 [2024-10-07 11:29:10.208456] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.266 [2024-10-07 11:29:10.208473] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.266 [2024-10-07 11:29:10.208534] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.266 [2024-10-07 11:29:10.208558] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.266 [2024-10-07 11:29:10.208573] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.266 [2024-10-07 11:29:10.208607] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.266 [2024-10-07 11:29:10.208791] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.266 [2024-10-07 11:29:10.208820] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.266 [2024-10-07 11:29:10.208835] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.266 [2024-10-07 11:29:10.208848] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.266 [2024-10-07 11:29:10.208992] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.266 [2024-10-07 11:29:10.209016] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.266 [2024-10-07 11:29:10.209030] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.267 [2024-10-07 11:29:10.209044] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.267 [2024-10-07 11:29:10.209144] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.267 [2024-10-07 11:29:10.218372] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.267 [2024-10-07 11:29:10.218551] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.267 [2024-10-07 11:29:10.218598] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.267 [2024-10-07 11:29:10.218615] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.267 [2024-10-07 11:29:10.218656] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.267 [2024-10-07 11:29:10.218685] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.267 [2024-10-07 11:29:10.218712] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.267 [2024-10-07 11:29:10.218728] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.267 [2024-10-07 11:29:10.218742] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.267 [2024-10-07 11:29:10.218763] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.267 [2024-10-07 11:29:10.218814] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.267 [2024-10-07 11:29:10.218837] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.267 [2024-10-07 11:29:10.218853] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.267 [2024-10-07 11:29:10.218876] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.267 [2024-10-07 11:29:10.218897] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.267 [2024-10-07 11:29:10.218911] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.267 [2024-10-07 11:29:10.218925] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.267 [2024-10-07 11:29:10.218947] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.267 [2024-10-07 11:29:10.232274] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.267 [2024-10-07 11:29:10.232857] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.267 [2024-10-07 11:29:10.232970] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.267 [2024-10-07 11:29:10.232999] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.267 [2024-10-07 11:29:10.233015] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.267 [2024-10-07 11:29:10.233995] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.267 [2024-10-07 11:29:10.234036] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.267 [2024-10-07 11:29:10.234055] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.267 [2024-10-07 11:29:10.234074] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.267 [2024-10-07 11:29:10.234503] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.267 [2024-10-07 11:29:10.234549] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.267 [2024-10-07 11:29:10.234566] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.267 [2024-10-07 11:29:10.234579] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.267 [2024-10-07 11:29:10.234788] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.267 [2024-10-07 11:29:10.234813] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.267 [2024-10-07 11:29:10.234826] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.267 [2024-10-07 11:29:10.234839] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.267 [2024-10-07 11:29:10.235030] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.267 [2024-10-07 11:29:10.242375] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.267 [2024-10-07 11:29:10.242521] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.267 [2024-10-07 11:29:10.242550] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.267 [2024-10-07 11:29:10.242567] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.267 [2024-10-07 11:29:10.242590] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.267 [2024-10-07 11:29:10.242610] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.267 [2024-10-07 11:29:10.242624] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.267 [2024-10-07 11:29:10.242637] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.267 [2024-10-07 11:29:10.242658] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.267 [2024-10-07 11:29:10.246899] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.267 [2024-10-07 11:29:10.247386] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.267 [2024-10-07 11:29:10.247437] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.267 [2024-10-07 11:29:10.247458] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.267 [2024-10-07 11:29:10.248027] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.267 [2024-10-07 11:29:10.248496] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.267 [2024-10-07 11:29:10.248531] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.267 [2024-10-07 11:29:10.248549] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.267 [2024-10-07 11:29:10.248774] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.267 [2024-10-07 11:29:10.252488] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.267 [2024-10-07 11:29:10.252588] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.267 [2024-10-07 11:29:10.252617] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.267 [2024-10-07 11:29:10.252633] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.267 [2024-10-07 11:29:10.252656] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.267 [2024-10-07 11:29:10.252677] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.267 [2024-10-07 11:29:10.252691] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.267 [2024-10-07 11:29:10.252704] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.267 [2024-10-07 11:29:10.252726] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.267 [2024-10-07 11:29:10.260756] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.267 [2024-10-07 11:29:10.261624] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.267 [2024-10-07 11:29:10.261667] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.267 [2024-10-07 11:29:10.261687] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.267 [2024-10-07 11:29:10.262076] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.267 [2024-10-07 11:29:10.262308] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.267 [2024-10-07 11:29:10.262343] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.267 [2024-10-07 11:29:10.262359] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.267 [2024-10-07 11:29:10.262597] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.267 [2024-10-07 11:29:10.262684] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.267 [2024-10-07 11:29:10.262796] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.267 [2024-10-07 11:29:10.262830] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.267 [2024-10-07 11:29:10.262847] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.267 [2024-10-07 11:29:10.262871] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.267 [2024-10-07 11:29:10.263044] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.267 [2024-10-07 11:29:10.263067] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.267 [2024-10-07 11:29:10.263081] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.267 [2024-10-07 11:29:10.263154] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.267 [2024-10-07 11:29:10.274252] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.267 [2024-10-07 11:29:10.274637] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.267 [2024-10-07 11:29:10.274729] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.267 [2024-10-07 11:29:10.274757] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.267 [2024-10-07 11:29:10.274774] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.267 [2024-10-07 11:29:10.275036] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.267 [2024-10-07 11:29:10.275074] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.267 [2024-10-07 11:29:10.275091] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.267 [2024-10-07 11:29:10.275109] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.267 [2024-10-07 11:29:10.275747] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.267 [2024-10-07 11:29:10.275786] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.267 [2024-10-07 11:29:10.275817] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.267 [2024-10-07 11:29:10.275831] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.268 [2024-10-07 11:29:10.276206] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.268 [2024-10-07 11:29:10.276231] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.268 [2024-10-07 11:29:10.276244] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.268 [2024-10-07 11:29:10.276257] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.268 [2024-10-07 11:29:10.276321] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.268 [2024-10-07 11:29:10.285682] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.268 [2024-10-07 11:29:10.285729] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.268 [2024-10-07 11:29:10.285891] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.268 [2024-10-07 11:29:10.285919] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.268 [2024-10-07 11:29:10.285936] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.268 [2024-10-07 11:29:10.286012] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.268 [2024-10-07 11:29:10.286037] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.268 [2024-10-07 11:29:10.286052] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.268 [2024-10-07 11:29:10.286170] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.268 [2024-10-07 11:29:10.286196] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.268 [2024-10-07 11:29:10.286994] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.268 [2024-10-07 11:29:10.287030] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.268 [2024-10-07 11:29:10.287060] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.268 [2024-10-07 11:29:10.287077] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.268 [2024-10-07 11:29:10.287091] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.268 [2024-10-07 11:29:10.287103] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.268 [2024-10-07 11:29:10.289734] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.268 [2024-10-07 11:29:10.289770] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.268 [2024-10-07 11:29:10.295803] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.268 [2024-10-07 11:29:10.295862] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.268 [2024-10-07 11:29:10.295936] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.268 [2024-10-07 11:29:10.295963] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.268 [2024-10-07 11:29:10.295979] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.268 [2024-10-07 11:29:10.296656] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.268 [2024-10-07 11:29:10.296695] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.268 [2024-10-07 11:29:10.296713] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.268 [2024-10-07 11:29:10.296731] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.268 [2024-10-07 11:29:10.298303] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.268 [2024-10-07 11:29:10.298374] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.268 [2024-10-07 11:29:10.298390] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.268 [2024-10-07 11:29:10.298402] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.268 [2024-10-07 11:29:10.298617] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.268 [2024-10-07 11:29:10.298642] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.268 [2024-10-07 11:29:10.298656] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.268 [2024-10-07 11:29:10.298668] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.268 [2024-10-07 11:29:10.298717] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.268 [2024-10-07 11:29:10.305891] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.268 [2024-10-07 11:29:10.306013] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.268 [2024-10-07 11:29:10.306044] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.268 [2024-10-07 11:29:10.306060] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.268 [2024-10-07 11:29:10.306097] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.268 [2024-10-07 11:29:10.306126] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.268 [2024-10-07 11:29:10.306173] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.268 [2024-10-07 11:29:10.306190] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.268 [2024-10-07 11:29:10.306204] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.268 [2024-10-07 11:29:10.306226] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.268 [2024-10-07 11:29:10.306279] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.268 [2024-10-07 11:29:10.306304] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.268 [2024-10-07 11:29:10.306320] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.268 [2024-10-07 11:29:10.306343] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.268 [2024-10-07 11:29:10.306364] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.268 [2024-10-07 11:29:10.306378] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.268 [2024-10-07 11:29:10.306392] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.268 [2024-10-07 11:29:10.306427] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.268 [2024-10-07 11:29:10.318767] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.268 [2024-10-07 11:29:10.318814] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.268 [2024-10-07 11:29:10.319674] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.268 [2024-10-07 11:29:10.319732] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.268 [2024-10-07 11:29:10.319752] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.268 [2024-10-07 11:29:10.319815] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.268 [2024-10-07 11:29:10.319837] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.268 [2024-10-07 11:29:10.319852] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.268 [2024-10-07 11:29:10.320214] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.268 [2024-10-07 11:29:10.320272] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.268 [2024-10-07 11:29:10.320519] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.268 [2024-10-07 11:29:10.320555] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.268 [2024-10-07 11:29:10.320571] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.268 [2024-10-07 11:29:10.320589] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.268 [2024-10-07 11:29:10.320603] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.268 [2024-10-07 11:29:10.320617] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.268 [2024-10-07 11:29:10.320831] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.268 [2024-10-07 11:29:10.320855] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.268 [2024-10-07 11:29:10.331883] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.268 [2024-10-07 11:29:10.331949] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.268 [2024-10-07 11:29:10.332310] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.268 [2024-10-07 11:29:10.332352] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.268 [2024-10-07 11:29:10.332370] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.268 [2024-10-07 11:29:10.332448] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.268 [2024-10-07 11:29:10.332474] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.268 [2024-10-07 11:29:10.332490] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.268 [2024-10-07 11:29:10.332703] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.268 [2024-10-07 11:29:10.332732] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.268 [2024-10-07 11:29:10.333328] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.268 [2024-10-07 11:29:10.333362] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.268 [2024-10-07 11:29:10.333395] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.268 [2024-10-07 11:29:10.333416] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.269 [2024-10-07 11:29:10.333467] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.269 [2024-10-07 11:29:10.333482] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.269 [2024-10-07 11:29:10.333741] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.269 [2024-10-07 11:29:10.333766] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.269 [2024-10-07 11:29:10.344026] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.269 [2024-10-07 11:29:10.344075] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.269 [2024-10-07 11:29:10.344160] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.269 [2024-10-07 11:29:10.344189] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.269 [2024-10-07 11:29:10.344206] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.269 [2024-10-07 11:29:10.344254] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.269 [2024-10-07 11:29:10.344277] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.269 [2024-10-07 11:29:10.344293] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.269 [2024-10-07 11:29:10.344316] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.269 [2024-10-07 11:29:10.344336] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.269 [2024-10-07 11:29:10.344355] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.269 [2024-10-07 11:29:10.344370] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.269 [2024-10-07 11:29:10.344384] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.269 [2024-10-07 11:29:10.344433] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.269 [2024-10-07 11:29:10.344453] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.269 [2024-10-07 11:29:10.344466] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.269 [2024-10-07 11:29:10.344490] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.269 [2024-10-07 11:29:10.344504] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.269 [2024-10-07 11:29:10.354407] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.269 [2024-10-07 11:29:10.354495] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.269 [2024-10-07 11:29:10.354581] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.269 [2024-10-07 11:29:10.354610] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.269 [2024-10-07 11:29:10.354627] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.269 [2024-10-07 11:29:10.354674] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.269 [2024-10-07 11:29:10.354697] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.269 [2024-10-07 11:29:10.354712] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.269 [2024-10-07 11:29:10.354735] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.269 [2024-10-07 11:29:10.354755] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.269 [2024-10-07 11:29:10.354775] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.269 [2024-10-07 11:29:10.354789] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.269 [2024-10-07 11:29:10.354818] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.269 [2024-10-07 11:29:10.354833] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.269 [2024-10-07 11:29:10.354847] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.269 [2024-10-07 11:29:10.354860] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.269 [2024-10-07 11:29:10.354881] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.269 [2024-10-07 11:29:10.354895] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.269 [2024-10-07 11:29:10.367663] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.269 [2024-10-07 11:29:10.367709] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.269 [2024-10-07 11:29:10.367806] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.269 [2024-10-07 11:29:10.367834] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.269 [2024-10-07 11:29:10.367851] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.269 [2024-10-07 11:29:10.367895] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.269 [2024-10-07 11:29:10.367917] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.269 [2024-10-07 11:29:10.367932] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.269 [2024-10-07 11:29:10.367973] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.269 [2024-10-07 11:29:10.367993] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.269 [2024-10-07 11:29:10.368012] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.269 [2024-10-07 11:29:10.368026] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.269 [2024-10-07 11:29:10.368040] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.269 [2024-10-07 11:29:10.368055] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.269 [2024-10-07 11:29:10.368069] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.269 [2024-10-07 11:29:10.368082] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.269 [2024-10-07 11:29:10.368104] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.269 [2024-10-07 11:29:10.368118] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.269 [2024-10-07 11:29:10.377952] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.269 [2024-10-07 11:29:10.378027] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.269 [2024-10-07 11:29:10.378193] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.269 [2024-10-07 11:29:10.378222] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.269 [2024-10-07 11:29:10.378239] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.269 [2024-10-07 11:29:10.378285] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.269 [2024-10-07 11:29:10.378323] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.269 [2024-10-07 11:29:10.378339] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.269 [2024-10-07 11:29:10.378462] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.269 [2024-10-07 11:29:10.378490] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.269 [2024-10-07 11:29:10.380952] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.269 [2024-10-07 11:29:10.380990] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.269 [2024-10-07 11:29:10.381022] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.269 [2024-10-07 11:29:10.381039] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.269 [2024-10-07 11:29:10.381054] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.269 [2024-10-07 11:29:10.381067] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.269 [2024-10-07 11:29:10.383482] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.269 [2024-10-07 11:29:10.383518] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.269 [2024-10-07 11:29:10.388088] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.269 [2024-10-07 11:29:10.388164] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.269 [2024-10-07 11:29:10.388254] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.269 [2024-10-07 11:29:10.388282] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.269 [2024-10-07 11:29:10.388298] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.269 [2024-10-07 11:29:10.388350] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.269 [2024-10-07 11:29:10.388373] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.269 [2024-10-07 11:29:10.388388] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.269 [2024-10-07 11:29:10.388406] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.269 [2024-10-07 11:29:10.388459] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.269 [2024-10-07 11:29:10.388480] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.269 [2024-10-07 11:29:10.388494] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.269 [2024-10-07 11:29:10.388507] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.269 [2024-10-07 11:29:10.388529] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.269 [2024-10-07 11:29:10.388544] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.269 [2024-10-07 11:29:10.388557] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.269 [2024-10-07 11:29:10.388570] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.269 [2024-10-07 11:29:10.388591] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.269 [2024-10-07 11:29:10.398182] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.269 [2024-10-07 11:29:10.398288] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.269 [2024-10-07 11:29:10.398317] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.269 [2024-10-07 11:29:10.398334] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.269 [2024-10-07 11:29:10.398400] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.269 [2024-10-07 11:29:10.398428] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.269 [2024-10-07 11:29:10.398469] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.269 [2024-10-07 11:29:10.398487] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.269 [2024-10-07 11:29:10.398500] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.269 [2024-10-07 11:29:10.398522] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.270 [2024-10-07 11:29:10.398576] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.270 [2024-10-07 11:29:10.398600] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.270 [2024-10-07 11:29:10.398616] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.270 [2024-10-07 11:29:10.398638] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.270 [2024-10-07 11:29:10.398675] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.270 [2024-10-07 11:29:10.398691] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.270 [2024-10-07 11:29:10.398720] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.270 [2024-10-07 11:29:10.398741] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.270 8993.55 IOPS, 35.13 MiB/s [2024-10-07T11:29:15.981Z] [2024-10-07 11:29:10.412244] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.270 [2024-10-07 11:29:10.412291] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.270 [2024-10-07 11:29:10.412515] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.270 [2024-10-07 11:29:10.412547] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.270 [2024-10-07 11:29:10.412564] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.270 [2024-10-07 11:29:10.412610] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.270 [2024-10-07 11:29:10.412633] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.270 [2024-10-07 11:29:10.412649] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.270 [2024-10-07 11:29:10.412850] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.270 [2024-10-07 11:29:10.412879] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.270 [2024-10-07 11:29:10.412996] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.270 [2024-10-07 11:29:10.413019] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.270 [2024-10-07 11:29:10.413034] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.270 [2024-10-07 11:29:10.413066] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.270 [2024-10-07 11:29:10.413081] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.270 [2024-10-07 11:29:10.413094] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.270 [2024-10-07 11:29:10.413203] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.270 [2024-10-07 11:29:10.413225] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.270 [2024-10-07 11:29:10.422464] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.270 [2024-10-07 11:29:10.422521] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.270 [2024-10-07 11:29:10.422619] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.270 [2024-10-07 11:29:10.422647] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.270 [2024-10-07 11:29:10.422663] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.270 [2024-10-07 11:29:10.422708] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.270 [2024-10-07 11:29:10.422730] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.270 [2024-10-07 11:29:10.422745] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.270 [2024-10-07 11:29:10.422785] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.270 [2024-10-07 11:29:10.422805] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.270 [2024-10-07 11:29:10.422825] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.270 [2024-10-07 11:29:10.422840] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.270 [2024-10-07 11:29:10.422853] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.270 [2024-10-07 11:29:10.422869] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.270 [2024-10-07 11:29:10.422883] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.270 [2024-10-07 11:29:10.422896] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.270 [2024-10-07 11:29:10.423128] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.270 [2024-10-07 11:29:10.423153] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.270 [2024-10-07 11:29:10.433340] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.270 [2024-10-07 11:29:10.433391] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.270 [2024-10-07 11:29:10.433596] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.270 [2024-10-07 11:29:10.433628] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.270 [2024-10-07 11:29:10.433647] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.270 [2024-10-07 11:29:10.433692] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.270 [2024-10-07 11:29:10.433714] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.270 [2024-10-07 11:29:10.433729] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.270 [2024-10-07 11:29:10.434122] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.270 [2024-10-07 11:29:10.434162] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.270 [2024-10-07 11:29:10.434342] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.270 [2024-10-07 11:29:10.434391] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.270 [2024-10-07 11:29:10.434408] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.270 [2024-10-07 11:29:10.434440] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.270 [2024-10-07 11:29:10.434455] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.270 [2024-10-07 11:29:10.434468] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.270 [2024-10-07 11:29:10.434698] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.270 [2024-10-07 11:29:10.434724] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.270 [2024-10-07 11:29:10.443682] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.270 [2024-10-07 11:29:10.443728] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.270 [2024-10-07 11:29:10.443901] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.270 [2024-10-07 11:29:10.443955] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.270 [2024-10-07 11:29:10.443974] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.270 [2024-10-07 11:29:10.444038] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.270 [2024-10-07 11:29:10.444061] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.270 [2024-10-07 11:29:10.444076] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.270 [2024-10-07 11:29:10.444512] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.270 [2024-10-07 11:29:10.444554] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.270 [2024-10-07 11:29:10.444705] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.270 [2024-10-07 11:29:10.444737] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.270 [2024-10-07 11:29:10.444754] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.270 [2024-10-07 11:29:10.444771] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.270 [2024-10-07 11:29:10.444787] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.270 [2024-10-07 11:29:10.444800] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.270 [2024-10-07 11:29:10.444943] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.270 [2024-10-07 11:29:10.444963] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.270 [2024-10-07 11:29:10.454295] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.270 [2024-10-07 11:29:10.454371] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.270 [2024-10-07 11:29:10.454495] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.270 [2024-10-07 11:29:10.454523] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.270 [2024-10-07 11:29:10.454539] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.270 [2024-10-07 11:29:10.454583] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.270 [2024-10-07 11:29:10.454605] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.270 [2024-10-07 11:29:10.454619] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.270 [2024-10-07 11:29:10.454642] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.270 [2024-10-07 11:29:10.454660] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.270 [2024-10-07 11:29:10.454679] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.270 [2024-10-07 11:29:10.454692] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.270 [2024-10-07 11:29:10.454705] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.270 [2024-10-07 11:29:10.454720] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.270 [2024-10-07 11:29:10.454733] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.270 [2024-10-07 11:29:10.454760] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.270 [2024-10-07 11:29:10.454784] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.270 [2024-10-07 11:29:10.454797] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.270 [2024-10-07 11:29:10.465904] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.270 [2024-10-07 11:29:10.465950] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.270 [2024-10-07 11:29:10.466284] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.270 [2024-10-07 11:29:10.466356] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.270 [2024-10-07 11:29:10.466375] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.270 [2024-10-07 11:29:10.466433] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.270 [2024-10-07 11:29:10.466458] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.271 [2024-10-07 11:29:10.466473] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.271 [2024-10-07 11:29:10.466539] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.271 [2024-10-07 11:29:10.466566] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.271 [2024-10-07 11:29:10.466586] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.271 [2024-10-07 11:29:10.466600] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.271 [2024-10-07 11:29:10.466612] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.271 [2024-10-07 11:29:10.466628] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.271 [2024-10-07 11:29:10.466641] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.271 [2024-10-07 11:29:10.466654] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.271 [2024-10-07 11:29:10.466675] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.271 [2024-10-07 11:29:10.466689] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.271 [2024-10-07 11:29:10.479476] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.271 [2024-10-07 11:29:10.479521] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.271 [2024-10-07 11:29:10.479616] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.271 [2024-10-07 11:29:10.479643] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.271 [2024-10-07 11:29:10.479659] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.271 [2024-10-07 11:29:10.479702] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.271 [2024-10-07 11:29:10.479723] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.271 [2024-10-07 11:29:10.479738] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.271 [2024-10-07 11:29:10.479760] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.271 [2024-10-07 11:29:10.479801] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.271 [2024-10-07 11:29:10.479821] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.271 [2024-10-07 11:29:10.479835] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.271 [2024-10-07 11:29:10.479848] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.271 [2024-10-07 11:29:10.479863] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.271 [2024-10-07 11:29:10.479877] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.271 [2024-10-07 11:29:10.479889] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.271 [2024-10-07 11:29:10.479911] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.271 [2024-10-07 11:29:10.479925] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.271 [2024-10-07 11:29:10.493472] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.271 [2024-10-07 11:29:10.493518] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.271 [2024-10-07 11:29:10.493617] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.271 [2024-10-07 11:29:10.493646] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.271 [2024-10-07 11:29:10.493663] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.271 [2024-10-07 11:29:10.493708] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.271 [2024-10-07 11:29:10.493729] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.271 [2024-10-07 11:29:10.493744] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.271 [2024-10-07 11:29:10.493766] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.271 [2024-10-07 11:29:10.493785] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.271 [2024-10-07 11:29:10.493805] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.271 [2024-10-07 11:29:10.493819] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.271 [2024-10-07 11:29:10.493832] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.271 [2024-10-07 11:29:10.493847] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.271 [2024-10-07 11:29:10.493861] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.271 [2024-10-07 11:29:10.493874] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.271 [2024-10-07 11:29:10.493896] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.271 [2024-10-07 11:29:10.493910] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.271 [2024-10-07 11:29:10.505017] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.271 [2024-10-07 11:29:10.505062] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.271 [2024-10-07 11:29:10.505327] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.271 [2024-10-07 11:29:10.505368] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.271 [2024-10-07 11:29:10.505401] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.271 [2024-10-07 11:29:10.505466] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.271 [2024-10-07 11:29:10.505490] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.271 [2024-10-07 11:29:10.505505] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.271 [2024-10-07 11:29:10.505560] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.271 [2024-10-07 11:29:10.505585] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.271 [2024-10-07 11:29:10.505617] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.271 [2024-10-07 11:29:10.505634] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.271 [2024-10-07 11:29:10.505647] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.271 [2024-10-07 11:29:10.505662] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.271 [2024-10-07 11:29:10.505676] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.271 [2024-10-07 11:29:10.505689] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.271 [2024-10-07 11:29:10.505710] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.271 [2024-10-07 11:29:10.505723] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.271 [2024-10-07 11:29:10.516091] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.271 [2024-10-07 11:29:10.516137] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.271 [2024-10-07 11:29:10.516328] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.271 [2024-10-07 11:29:10.516358] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.271 [2024-10-07 11:29:10.516374] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.271 [2024-10-07 11:29:10.516418] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.271 [2024-10-07 11:29:10.516473] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.271 [2024-10-07 11:29:10.516489] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.271 [2024-10-07 11:29:10.516608] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.271 [2024-10-07 11:29:10.516635] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.271 [2024-10-07 11:29:10.516741] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.271 [2024-10-07 11:29:10.516761] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.271 [2024-10-07 11:29:10.516790] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.271 [2024-10-07 11:29:10.516806] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.271 [2024-10-07 11:29:10.516819] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.271 [2024-10-07 11:29:10.516831] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.271 [2024-10-07 11:29:10.516941] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.271 [2024-10-07 11:29:10.516960] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.271 [2024-10-07 11:29:10.526548] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.271 [2024-10-07 11:29:10.526596] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.271 [2024-10-07 11:29:10.526766] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.271 [2024-10-07 11:29:10.526797] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.271 [2024-10-07 11:29:10.526814] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.271 [2024-10-07 11:29:10.526866] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.271 [2024-10-07 11:29:10.526889] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.271 [2024-10-07 11:29:10.526904] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.271 [2024-10-07 11:29:10.527010] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.271 [2024-10-07 11:29:10.527035] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.271 [2024-10-07 11:29:10.530190] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.271 [2024-10-07 11:29:10.530231] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.271 [2024-10-07 11:29:10.530248] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.271 [2024-10-07 11:29:10.530266] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.271 [2024-10-07 11:29:10.530280] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.271 [2024-10-07 11:29:10.530293] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.272 [2024-10-07 11:29:10.530523] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.272 [2024-10-07 11:29:10.530550] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.272 [2024-10-07 11:29:10.536656] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.272 [2024-10-07 11:29:10.536718] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.272 [2024-10-07 11:29:10.536796] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.272 [2024-10-07 11:29:10.536824] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.272 [2024-10-07 11:29:10.536840] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.272 [2024-10-07 11:29:10.536903] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.272 [2024-10-07 11:29:10.536927] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.272 [2024-10-07 11:29:10.536944] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.272 [2024-10-07 11:29:10.536962] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.272 [2024-10-07 11:29:10.536985] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.272 [2024-10-07 11:29:10.537021] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.272 [2024-10-07 11:29:10.537036] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.272 [2024-10-07 11:29:10.537050] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.272 [2024-10-07 11:29:10.537074] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.272 [2024-10-07 11:29:10.537089] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.272 [2024-10-07 11:29:10.537102] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.272 [2024-10-07 11:29:10.537116] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.272 [2024-10-07 11:29:10.537136] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.272 [2024-10-07 11:29:10.548102] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.272 [2024-10-07 11:29:10.548149] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.272 [2024-10-07 11:29:10.548245] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.272 [2024-10-07 11:29:10.548273] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.272 [2024-10-07 11:29:10.548289] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.272 [2024-10-07 11:29:10.548332] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.272 [2024-10-07 11:29:10.548353] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.272 [2024-10-07 11:29:10.548368] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.272 [2024-10-07 11:29:10.548390] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.272 [2024-10-07 11:29:10.548408] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.272 [2024-10-07 11:29:10.548440] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.272 [2024-10-07 11:29:10.548457] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.272 [2024-10-07 11:29:10.548470] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.272 [2024-10-07 11:29:10.548485] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.272 [2024-10-07 11:29:10.548498] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.272 [2024-10-07 11:29:10.548510] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.272 [2024-10-07 11:29:10.548531] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.272 [2024-10-07 11:29:10.548545] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.272 [2024-10-07 11:29:10.561867] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.272 [2024-10-07 11:29:10.561914] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.272 [2024-10-07 11:29:10.563222] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.272 [2024-10-07 11:29:10.563279] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.272 [2024-10-07 11:29:10.563298] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.272 [2024-10-07 11:29:10.563363] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.272 [2024-10-07 11:29:10.563387] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.272 [2024-10-07 11:29:10.563402] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.272 [2024-10-07 11:29:10.564113] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.272 [2024-10-07 11:29:10.564154] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.272 [2024-10-07 11:29:10.564387] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.272 [2024-10-07 11:29:10.564470] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.272 [2024-10-07 11:29:10.564489] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.272 [2024-10-07 11:29:10.564507] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.272 [2024-10-07 11:29:10.564521] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.272 [2024-10-07 11:29:10.564534] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.272 [2024-10-07 11:29:10.564733] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.272 [2024-10-07 11:29:10.564758] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.272 [2024-10-07 11:29:10.575706] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.272 [2024-10-07 11:29:10.575751] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.272 [2024-10-07 11:29:10.575921] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.272 [2024-10-07 11:29:10.575950] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.272 [2024-10-07 11:29:10.575966] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.272 [2024-10-07 11:29:10.576009] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.272 [2024-10-07 11:29:10.576031] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.272 [2024-10-07 11:29:10.576046] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.272 [2024-10-07 11:29:10.576363] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.272 [2024-10-07 11:29:10.576397] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.272 [2024-10-07 11:29:10.576480] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.272 [2024-10-07 11:29:10.576501] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.272 [2024-10-07 11:29:10.576515] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.272 [2024-10-07 11:29:10.576531] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.272 [2024-10-07 11:29:10.576544] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.272 [2024-10-07 11:29:10.576557] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.272 [2024-10-07 11:29:10.576578] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.272 [2024-10-07 11:29:10.576610] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.272 [2024-10-07 11:29:10.586065] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.272 [2024-10-07 11:29:10.586113] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.272 [2024-10-07 11:29:10.586276] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.272 [2024-10-07 11:29:10.586335] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.272 [2024-10-07 11:29:10.586351] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.272 [2024-10-07 11:29:10.586395] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.272 [2024-10-07 11:29:10.586416] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.272 [2024-10-07 11:29:10.586443] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.272 [2024-10-07 11:29:10.586674] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.272 [2024-10-07 11:29:10.586704] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.272 [2024-10-07 11:29:10.588289] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.272 [2024-10-07 11:29:10.588324] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.272 [2024-10-07 11:29:10.588356] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.272 [2024-10-07 11:29:10.588372] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.272 [2024-10-07 11:29:10.588386] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.272 [2024-10-07 11:29:10.588398] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.272 [2024-10-07 11:29:10.589035] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.272 [2024-10-07 11:29:10.589068] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.272 [2024-10-07 11:29:10.596172] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.272 [2024-10-07 11:29:10.596249] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.272 [2024-10-07 11:29:10.596322] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.272 [2024-10-07 11:29:10.596348] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.272 [2024-10-07 11:29:10.596365] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.272 [2024-10-07 11:29:10.596416] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.272 [2024-10-07 11:29:10.596470] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.272 [2024-10-07 11:29:10.596487] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.272 [2024-10-07 11:29:10.596506] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.273 [2024-10-07 11:29:10.596530] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.273 [2024-10-07 11:29:10.596547] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.273 [2024-10-07 11:29:10.596578] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.273 [2024-10-07 11:29:10.596594] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.273 [2024-10-07 11:29:10.596618] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.273 [2024-10-07 11:29:10.596633] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.273 [2024-10-07 11:29:10.596646] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.273 [2024-10-07 11:29:10.596659] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.273 [2024-10-07 11:29:10.599393] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.273 [2024-10-07 11:29:10.606815] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.273 [2024-10-07 11:29:10.606862] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.273 [2024-10-07 11:29:10.606943] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.273 [2024-10-07 11:29:10.606971] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.273 [2024-10-07 11:29:10.606987] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.273 [2024-10-07 11:29:10.607032] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.273 [2024-10-07 11:29:10.607071] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.273 [2024-10-07 11:29:10.607087] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.273 [2024-10-07 11:29:10.607111] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.273 [2024-10-07 11:29:10.607131] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.273 [2024-10-07 11:29:10.607150] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.273 [2024-10-07 11:29:10.607165] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.273 [2024-10-07 11:29:10.607178] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.273 [2024-10-07 11:29:10.607194] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.273 [2024-10-07 11:29:10.607208] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.273 [2024-10-07 11:29:10.607221] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.273 [2024-10-07 11:29:10.607244] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.273 [2024-10-07 11:29:10.607257] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.273 [2024-10-07 11:29:10.616921] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.273 [2024-10-07 11:29:10.616996] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.273 [2024-10-07 11:29:10.617071] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.273 [2024-10-07 11:29:10.617098] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.273 [2024-10-07 11:29:10.617114] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.273 [2024-10-07 11:29:10.617164] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.273 [2024-10-07 11:29:10.617200] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.273 [2024-10-07 11:29:10.617217] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.273 [2024-10-07 11:29:10.617235] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.273 [2024-10-07 11:29:10.617257] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.273 [2024-10-07 11:29:10.617273] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.273 [2024-10-07 11:29:10.617286] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.273 [2024-10-07 11:29:10.617298] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.273 [2024-10-07 11:29:10.617320] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.273 [2024-10-07 11:29:10.617334] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.273 [2024-10-07 11:29:10.617346] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.273 [2024-10-07 11:29:10.617358] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.273 [2024-10-07 11:29:10.617389] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.273 [2024-10-07 11:29:10.628856] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.273 [2024-10-07 11:29:10.628901] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.273 [2024-10-07 11:29:10.629022] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.273 [2024-10-07 11:29:10.629067] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.273 [2024-10-07 11:29:10.629084] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.273 [2024-10-07 11:29:10.629130] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.273 [2024-10-07 11:29:10.629152] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.273 [2024-10-07 11:29:10.629167] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.273 [2024-10-07 11:29:10.629190] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.273 [2024-10-07 11:29:10.629209] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.273 [2024-10-07 11:29:10.629228] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.273 [2024-10-07 11:29:10.629242] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.273 [2024-10-07 11:29:10.629256] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.273 [2024-10-07 11:29:10.629271] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.273 [2024-10-07 11:29:10.629285] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.273 [2024-10-07 11:29:10.629298] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.273 [2024-10-07 11:29:10.629320] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.273 [2024-10-07 11:29:10.629334] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.273 [2024-10-07 11:29:10.643727] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.273 [2024-10-07 11:29:10.643776] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.273 [2024-10-07 11:29:10.643926] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.273 [2024-10-07 11:29:10.643954] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.273 [2024-10-07 11:29:10.643970] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.273 [2024-10-07 11:29:10.644015] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.273 [2024-10-07 11:29:10.644037] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.273 [2024-10-07 11:29:10.644052] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.273 [2024-10-07 11:29:10.644529] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.273 [2024-10-07 11:29:10.644560] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.273 [2024-10-07 11:29:10.644650] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.273 [2024-10-07 11:29:10.644671] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.273 [2024-10-07 11:29:10.644685] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.273 [2024-10-07 11:29:10.644701] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.273 [2024-10-07 11:29:10.644715] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.273 [2024-10-07 11:29:10.644728] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.273 [2024-10-07 11:29:10.644901] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.273 [2024-10-07 11:29:10.644925] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.273 [2024-10-07 11:29:10.655585] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.273 [2024-10-07 11:29:10.655631] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.273 [2024-10-07 11:29:10.655729] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.273 [2024-10-07 11:29:10.655762] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.273 [2024-10-07 11:29:10.655779] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.273 [2024-10-07 11:29:10.655839] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.273 [2024-10-07 11:29:10.655861] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.273 [2024-10-07 11:29:10.655875] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.273 [2024-10-07 11:29:10.655898] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.273 [2024-10-07 11:29:10.655916] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.273 [2024-10-07 11:29:10.655935] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.273 [2024-10-07 11:29:10.655948] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.273 [2024-10-07 11:29:10.655978] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.273 [2024-10-07 11:29:10.655996] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.273 [2024-10-07 11:29:10.656009] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.273 [2024-10-07 11:29:10.656022] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.273 [2024-10-07 11:29:10.656043] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.273 [2024-10-07 11:29:10.656057] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.273 [2024-10-07 11:29:10.669483] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.273 [2024-10-07 11:29:10.669529] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.273 [2024-10-07 11:29:10.670612] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.273 [2024-10-07 11:29:10.670654] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.273 [2024-10-07 11:29:10.670688] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.274 [2024-10-07 11:29:10.670735] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.274 [2024-10-07 11:29:10.670757] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.274 [2024-10-07 11:29:10.670772] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.274 [2024-10-07 11:29:10.671149] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.274 [2024-10-07 11:29:10.671180] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.274 [2024-10-07 11:29:10.671461] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.274 [2024-10-07 11:29:10.671495] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.274 [2024-10-07 11:29:10.671512] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.274 [2024-10-07 11:29:10.671529] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.274 [2024-10-07 11:29:10.671543] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.274 [2024-10-07 11:29:10.671556] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.274 [2024-10-07 11:29:10.671614] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.274 [2024-10-07 11:29:10.671634] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.274 [2024-10-07 11:29:10.679806] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.274 [2024-10-07 11:29:10.679868] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.274 [2024-10-07 11:29:10.680056] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.274 [2024-10-07 11:29:10.680086] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.274 [2024-10-07 11:29:10.680104] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.274 [2024-10-07 11:29:10.680148] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.274 [2024-10-07 11:29:10.680170] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.274 [2024-10-07 11:29:10.680201] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.274 [2024-10-07 11:29:10.680311] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.274 [2024-10-07 11:29:10.680336] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.274 [2024-10-07 11:29:10.680459] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.274 [2024-10-07 11:29:10.680480] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.274 [2024-10-07 11:29:10.680494] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.274 [2024-10-07 11:29:10.680510] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.274 [2024-10-07 11:29:10.680524] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.274 [2024-10-07 11:29:10.680537] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.274 [2024-10-07 11:29:10.680889] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.274 [2024-10-07 11:29:10.680913] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.274 [2024-10-07 11:29:10.689943] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.274 [2024-10-07 11:29:10.690046] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.274 [2024-10-07 11:29:10.690120] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.274 [2024-10-07 11:29:10.690147] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.274 [2024-10-07 11:29:10.690164] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.274 [2024-10-07 11:29:10.690216] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.274 [2024-10-07 11:29:10.690238] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.274 [2024-10-07 11:29:10.690258] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.274 [2024-10-07 11:29:10.690276] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.274 [2024-10-07 11:29:10.690313] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.274 [2024-10-07 11:29:10.690329] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.274 [2024-10-07 11:29:10.690342] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.274 [2024-10-07 11:29:10.690354] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.274 [2024-10-07 11:29:10.690376] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.274 [2024-10-07 11:29:10.690390] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.274 [2024-10-07 11:29:10.690403] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.274 [2024-10-07 11:29:10.690415] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.274 [2024-10-07 11:29:10.690434] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.274 [2024-10-07 11:29:10.701832] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.274 [2024-10-07 11:29:10.701894] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.274 [2024-10-07 11:29:10.702064] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.274 [2024-10-07 11:29:10.702095] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.274 [2024-10-07 11:29:10.702112] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.274 [2024-10-07 11:29:10.702158] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.274 [2024-10-07 11:29:10.702181] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.274 [2024-10-07 11:29:10.702196] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.274 [2024-10-07 11:29:10.702219] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.274 [2024-10-07 11:29:10.702238] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.274 [2024-10-07 11:29:10.702258] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.274 [2024-10-07 11:29:10.702273] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.274 [2024-10-07 11:29:10.702286] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.274 [2024-10-07 11:29:10.702318] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.274 [2024-10-07 11:29:10.702346] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.274 [2024-10-07 11:29:10.702358] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.274 [2024-10-07 11:29:10.702394] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.274 [2024-10-07 11:29:10.702408] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.274 [2024-10-07 11:29:10.711988] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.274 [2024-10-07 11:29:10.712035] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.274 [2024-10-07 11:29:10.712132] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.274 [2024-10-07 11:29:10.712159] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.274 [2024-10-07 11:29:10.712175] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.274 [2024-10-07 11:29:10.712220] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.274 [2024-10-07 11:29:10.712242] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.274 [2024-10-07 11:29:10.712257] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.274 [2024-10-07 11:29:10.712279] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.274 [2024-10-07 11:29:10.712297] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.274 [2024-10-07 11:29:10.712317] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.274 [2024-10-07 11:29:10.712331] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.274 [2024-10-07 11:29:10.712344] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.274 [2024-10-07 11:29:10.712359] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.274 [2024-10-07 11:29:10.712420] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.274 [2024-10-07 11:29:10.712434] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.274 [2024-10-07 11:29:10.712473] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.274 [2024-10-07 11:29:10.712491] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.274 [2024-10-07 11:29:10.724453] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.274 [2024-10-07 11:29:10.724498] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.274 [2024-10-07 11:29:10.724799] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.274 [2024-10-07 11:29:10.724839] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.274 [2024-10-07 11:29:10.724857] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.274 [2024-10-07 11:29:10.724903] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.274 [2024-10-07 11:29:10.724925] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.274 [2024-10-07 11:29:10.724940] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.274 [2024-10-07 11:29:10.724990] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.274 [2024-10-07 11:29:10.725014] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.274 [2024-10-07 11:29:10.725035] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.274 [2024-10-07 11:29:10.725049] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.274 [2024-10-07 11:29:10.725062] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.274 [2024-10-07 11:29:10.725078] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.274 [2024-10-07 11:29:10.725092] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.274 [2024-10-07 11:29:10.725104] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.274 [2024-10-07 11:29:10.725125] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.274 [2024-10-07 11:29:10.725139] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.274 [2024-10-07 11:29:10.738447] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.274 [2024-10-07 11:29:10.738525] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.274 [2024-10-07 11:29:10.738626] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.274 [2024-10-07 11:29:10.738654] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.274 [2024-10-07 11:29:10.738671] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.274 [2024-10-07 11:29:10.738730] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.274 [2024-10-07 11:29:10.738752] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.274 [2024-10-07 11:29:10.738766] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.274 [2024-10-07 11:29:10.738806] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.275 [2024-10-07 11:29:10.738826] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.275 [2024-10-07 11:29:10.738857] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.275 [2024-10-07 11:29:10.738873] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.275 [2024-10-07 11:29:10.738886] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.275 [2024-10-07 11:29:10.738902] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.275 [2024-10-07 11:29:10.738916] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.275 [2024-10-07 11:29:10.738928] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.275 [2024-10-07 11:29:10.738949] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.275 [2024-10-07 11:29:10.738963] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.275 [2024-10-07 11:29:10.750976] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.275 [2024-10-07 11:29:10.751040] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.275 [2024-10-07 11:29:10.751524] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.275 [2024-10-07 11:29:10.751566] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.275 [2024-10-07 11:29:10.751585] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.275 [2024-10-07 11:29:10.751634] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.275 [2024-10-07 11:29:10.751657] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.275 [2024-10-07 11:29:10.751673] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.275 [2024-10-07 11:29:10.751759] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.275 [2024-10-07 11:29:10.751785] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.275 [2024-10-07 11:29:10.751837] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.275 [2024-10-07 11:29:10.751851] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.275 [2024-10-07 11:29:10.751873] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.275 [2024-10-07 11:29:10.751890] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.275 [2024-10-07 11:29:10.751904] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.275 [2024-10-07 11:29:10.751916] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.275 [2024-10-07 11:29:10.751938] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.275 [2024-10-07 11:29:10.751952] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.275 [2024-10-07 11:29:10.761189] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.275 [2024-10-07 11:29:10.761234] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.275 [2024-10-07 11:29:10.761329] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.275 [2024-10-07 11:29:10.761386] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.275 [2024-10-07 11:29:10.761405] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.275 [2024-10-07 11:29:10.761466] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.275 [2024-10-07 11:29:10.761491] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.275 [2024-10-07 11:29:10.761507] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.275 [2024-10-07 11:29:10.761531] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.275 [2024-10-07 11:29:10.761551] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.275 [2024-10-07 11:29:10.761810] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.275 [2024-10-07 11:29:10.761835] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.275 [2024-10-07 11:29:10.761849] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.275 [2024-10-07 11:29:10.761864] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.275 [2024-10-07 11:29:10.761878] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.275 [2024-10-07 11:29:10.761890] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.275 [2024-10-07 11:29:10.762033] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.275 [2024-10-07 11:29:10.762056] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.275 [2024-10-07 11:29:10.771310] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.275 [2024-10-07 11:29:10.771374] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.275 [2024-10-07 11:29:10.771461] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.275 [2024-10-07 11:29:10.771490] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.275 [2024-10-07 11:29:10.771512] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.275 [2024-10-07 11:29:10.771566] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.275 [2024-10-07 11:29:10.771589] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.275 [2024-10-07 11:29:10.771605] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.275 [2024-10-07 11:29:10.771623] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.275 [2024-10-07 11:29:10.771647] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.275 [2024-10-07 11:29:10.771664] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.275 [2024-10-07 11:29:10.771677] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.275 [2024-10-07 11:29:10.771691] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.275 [2024-10-07 11:29:10.771945] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.275 [2024-10-07 11:29:10.771971] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.275 [2024-10-07 11:29:10.772004] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.275 [2024-10-07 11:29:10.772018] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.275 [2024-10-07 11:29:10.772186] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.275 [2024-10-07 11:29:10.783212] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.275 [2024-10-07 11:29:10.783261] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.275 [2024-10-07 11:29:10.783567] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.275 [2024-10-07 11:29:10.783608] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.275 [2024-10-07 11:29:10.783628] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.275 [2024-10-07 11:29:10.783676] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.275 [2024-10-07 11:29:10.783699] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.275 [2024-10-07 11:29:10.783715] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.275 [2024-10-07 11:29:10.783769] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.275 [2024-10-07 11:29:10.783795] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.275 [2024-10-07 11:29:10.783816] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.275 [2024-10-07 11:29:10.783831] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.275 [2024-10-07 11:29:10.783845] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.275 [2024-10-07 11:29:10.783861] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.275 [2024-10-07 11:29:10.783876] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.275 [2024-10-07 11:29:10.783889] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.275 [2024-10-07 11:29:10.784061] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.275 [2024-10-07 11:29:10.784102] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.275 [2024-10-07 11:29:10.796689] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.275 [2024-10-07 11:29:10.796740] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.275 [2024-10-07 11:29:10.797535] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.275 [2024-10-07 11:29:10.797577] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.275 [2024-10-07 11:29:10.797597] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.275 [2024-10-07 11:29:10.797646] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.275 [2024-10-07 11:29:10.797669] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.275 [2024-10-07 11:29:10.797685] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.275 [2024-10-07 11:29:10.798104] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.275 [2024-10-07 11:29:10.798163] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.275 [2024-10-07 11:29:10.798236] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.275 [2024-10-07 11:29:10.798262] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.275 [2024-10-07 11:29:10.798278] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.275 [2024-10-07 11:29:10.798295] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.275 [2024-10-07 11:29:10.798309] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.275 [2024-10-07 11:29:10.798323] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.275 [2024-10-07 11:29:10.798513] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.275 [2024-10-07 11:29:10.798545] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.276 [2024-10-07 11:29:10.807408] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.276 [2024-10-07 11:29:10.807485] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.276 [2024-10-07 11:29:10.810644] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.276 [2024-10-07 11:29:10.810697] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.276 [2024-10-07 11:29:10.810716] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.276 [2024-10-07 11:29:10.810766] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.276 [2024-10-07 11:29:10.810789] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.276 [2024-10-07 11:29:10.810820] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.276 [2024-10-07 11:29:10.811254] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.276 [2024-10-07 11:29:10.811295] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.276 [2024-10-07 11:29:10.811489] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.276 [2024-10-07 11:29:10.811522] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.276 [2024-10-07 11:29:10.811539] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.276 [2024-10-07 11:29:10.811556] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.276 [2024-10-07 11:29:10.811571] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.276 [2024-10-07 11:29:10.811584] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.276 [2024-10-07 11:29:10.811696] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.276 [2024-10-07 11:29:10.811717] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.276 [2024-10-07 11:29:10.819982] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.276 [2024-10-07 11:29:10.820029] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.276 [2024-10-07 11:29:10.820129] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.276 [2024-10-07 11:29:10.820157] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.276 [2024-10-07 11:29:10.820192] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.276 [2024-10-07 11:29:10.820242] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.276 [2024-10-07 11:29:10.820265] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.276 [2024-10-07 11:29:10.820280] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.276 [2024-10-07 11:29:10.820304] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.276 [2024-10-07 11:29:10.820324] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.276 [2024-10-07 11:29:10.820344] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.276 [2024-10-07 11:29:10.820359] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.276 [2024-10-07 11:29:10.820373] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.276 [2024-10-07 11:29:10.820389] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.276 [2024-10-07 11:29:10.820403] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.276 [2024-10-07 11:29:10.820416] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.276 [2024-10-07 11:29:10.820711] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.276 [2024-10-07 11:29:10.820737] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.276 [2024-10-07 11:29:10.830935] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.276 [2024-10-07 11:29:10.831149] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.276 [2024-10-07 11:29:10.831229] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.276 [2024-10-07 11:29:10.831264] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.276 [2024-10-07 11:29:10.831282] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.276 [2024-10-07 11:29:10.831472] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.276 [2024-10-07 11:29:10.831529] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.276 [2024-10-07 11:29:10.831547] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.276 [2024-10-07 11:29:10.831566] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.276 [2024-10-07 11:29:10.831709] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.276 [2024-10-07 11:29:10.831737] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.276 [2024-10-07 11:29:10.831752] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.276 [2024-10-07 11:29:10.831766] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.276 [2024-10-07 11:29:10.831905] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.276 [2024-10-07 11:29:10.831927] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.276 [2024-10-07 11:29:10.831941] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.276 [2024-10-07 11:29:10.831970] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.276 [2024-10-07 11:29:10.834586] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.276 [2024-10-07 11:29:10.843173] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.276 [2024-10-07 11:29:10.843363] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.276 [2024-10-07 11:29:10.843474] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.276 [2024-10-07 11:29:10.843504] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.276 [2024-10-07 11:29:10.843520] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.276 [2024-10-07 11:29:10.843575] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.276 [2024-10-07 11:29:10.843599] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.276 [2024-10-07 11:29:10.843615] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.276 [2024-10-07 11:29:10.843633] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.276 [2024-10-07 11:29:10.843672] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.276 [2024-10-07 11:29:10.843693] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.276 [2024-10-07 11:29:10.843707] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.276 [2024-10-07 11:29:10.843721] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.276 [2024-10-07 11:29:10.843744] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.276 [2024-10-07 11:29:10.843759] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.276 [2024-10-07 11:29:10.843772] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.276 [2024-10-07 11:29:10.843785] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.276 [2024-10-07 11:29:10.843820] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.276 [2024-10-07 11:29:10.854263] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.276 [2024-10-07 11:29:10.854312] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.276 [2024-10-07 11:29:10.855434] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.276 [2024-10-07 11:29:10.855492] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.276 [2024-10-07 11:29:10.855512] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.276 [2024-10-07 11:29:10.855562] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.276 [2024-10-07 11:29:10.855585] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.276 [2024-10-07 11:29:10.855601] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.276 [2024-10-07 11:29:10.857065] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.276 [2024-10-07 11:29:10.857107] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.276 [2024-10-07 11:29:10.857419] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.276 [2024-10-07 11:29:10.857463] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.276 [2024-10-07 11:29:10.857478] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.276 [2024-10-07 11:29:10.857496] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.276 [2024-10-07 11:29:10.857510] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.276 [2024-10-07 11:29:10.857523] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.276 [2024-10-07 11:29:10.857661] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.276 [2024-10-07 11:29:10.857685] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.276 [2024-10-07 11:29:10.864409] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.276 [2024-10-07 11:29:10.864502] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.276 [2024-10-07 11:29:10.864588] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.276 [2024-10-07 11:29:10.864617] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.276 [2024-10-07 11:29:10.864634] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.276 [2024-10-07 11:29:10.864680] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.276 [2024-10-07 11:29:10.864702] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.276 [2024-10-07 11:29:10.864717] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.276 [2024-10-07 11:29:10.864741] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.276 [2024-10-07 11:29:10.864760] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.276 [2024-10-07 11:29:10.864780] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.276 [2024-10-07 11:29:10.864794] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.276 [2024-10-07 11:29:10.864808] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.276 [2024-10-07 11:29:10.864824] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.276 [2024-10-07 11:29:10.864838] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.277 [2024-10-07 11:29:10.864854] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.277 [2024-10-07 11:29:10.864877] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.277 [2024-10-07 11:29:10.864891] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.277 [2024-10-07 11:29:10.875038] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.277 [2024-10-07 11:29:10.875086] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.277 [2024-10-07 11:29:10.875184] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.277 [2024-10-07 11:29:10.875212] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.277 [2024-10-07 11:29:10.875229] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.277 [2024-10-07 11:29:10.875293] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.277 [2024-10-07 11:29:10.875317] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.277 [2024-10-07 11:29:10.875333] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.277 [2024-10-07 11:29:10.875357] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.277 [2024-10-07 11:29:10.875377] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.277 [2024-10-07 11:29:10.875396] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.277 [2024-10-07 11:29:10.875411] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.277 [2024-10-07 11:29:10.875438] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.277 [2024-10-07 11:29:10.875458] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.277 [2024-10-07 11:29:10.875472] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.277 [2024-10-07 11:29:10.875485] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.277 [2024-10-07 11:29:10.875523] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.277 [2024-10-07 11:29:10.875540] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.277 [2024-10-07 11:29:10.888061] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.277 [2024-10-07 11:29:10.888110] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.277 [2024-10-07 11:29:10.888267] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.277 [2024-10-07 11:29:10.888297] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.277 [2024-10-07 11:29:10.888315] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.277 [2024-10-07 11:29:10.888362] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.277 [2024-10-07 11:29:10.888385] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.277 [2024-10-07 11:29:10.888400] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.277 [2024-10-07 11:29:10.888439] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.277 [2024-10-07 11:29:10.888461] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.277 [2024-10-07 11:29:10.888481] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.277 [2024-10-07 11:29:10.888495] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.277 [2024-10-07 11:29:10.888509] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.277 [2024-10-07 11:29:10.888525] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.277 [2024-10-07 11:29:10.888539] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.277 [2024-10-07 11:29:10.888553] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.277 [2024-10-07 11:29:10.888576] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.277 [2024-10-07 11:29:10.888605] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.277 [2024-10-07 11:29:10.901053] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.277 [2024-10-07 11:29:10.901101] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.277 [2024-10-07 11:29:10.901252] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.277 [2024-10-07 11:29:10.901281] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.277 [2024-10-07 11:29:10.901297] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.277 [2024-10-07 11:29:10.901342] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.277 [2024-10-07 11:29:10.901364] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.277 [2024-10-07 11:29:10.901395] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.277 [2024-10-07 11:29:10.901419] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.277 [2024-10-07 11:29:10.901453] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.277 [2024-10-07 11:29:10.901478] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.277 [2024-10-07 11:29:10.901493] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.277 [2024-10-07 11:29:10.901506] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.277 [2024-10-07 11:29:10.901523] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.277 [2024-10-07 11:29:10.901538] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.277 [2024-10-07 11:29:10.901551] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.277 [2024-10-07 11:29:10.901574] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.277 [2024-10-07 11:29:10.901588] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.277 [2024-10-07 11:29:10.911563] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.277 [2024-10-07 11:29:10.911610] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.277 [2024-10-07 11:29:10.912754] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.277 [2024-10-07 11:29:10.912811] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.277 [2024-10-07 11:29:10.912846] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.277 [2024-10-07 11:29:10.912894] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.277 [2024-10-07 11:29:10.912917] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.277 [2024-10-07 11:29:10.912933] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.277 [2024-10-07 11:29:10.913122] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.277 [2024-10-07 11:29:10.913151] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.277 [2024-10-07 11:29:10.913248] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.277 [2024-10-07 11:29:10.913301] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.277 [2024-10-07 11:29:10.913317] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.277 [2024-10-07 11:29:10.913334] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.277 [2024-10-07 11:29:10.913349] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.277 [2024-10-07 11:29:10.913362] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.277 [2024-10-07 11:29:10.913541] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.277 [2024-10-07 11:29:10.913567] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.277 [2024-10-07 11:29:10.924214] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.277 [2024-10-07 11:29:10.924262] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.277 [2024-10-07 11:29:10.924501] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.277 [2024-10-07 11:29:10.924533] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.277 [2024-10-07 11:29:10.924550] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.277 [2024-10-07 11:29:10.924598] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.277 [2024-10-07 11:29:10.924620] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.277 [2024-10-07 11:29:10.924636] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.277 [2024-10-07 11:29:10.924747] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.277 [2024-10-07 11:29:10.924772] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.277 [2024-10-07 11:29:10.925117] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.277 [2024-10-07 11:29:10.925151] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.277 [2024-10-07 11:29:10.925167] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.277 [2024-10-07 11:29:10.925185] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.277 [2024-10-07 11:29:10.925199] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.277 [2024-10-07 11:29:10.925212] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.277 [2024-10-07 11:29:10.927013] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.277 [2024-10-07 11:29:10.927050] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.277 [2024-10-07 11:29:10.937015] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.277 [2024-10-07 11:29:10.937061] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.277 [2024-10-07 11:29:10.937190] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.277 [2024-10-07 11:29:10.937219] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.277 [2024-10-07 11:29:10.937236] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.277 [2024-10-07 11:29:10.937280] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.277 [2024-10-07 11:29:10.937318] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.277 [2024-10-07 11:29:10.937335] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.277 [2024-10-07 11:29:10.937359] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.277 [2024-10-07 11:29:10.937378] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.277 [2024-10-07 11:29:10.937397] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.277 [2024-10-07 11:29:10.937412] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.277 [2024-10-07 11:29:10.937439] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.277 [2024-10-07 11:29:10.937458] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.277 [2024-10-07 11:29:10.937472] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.277 [2024-10-07 11:29:10.937485] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.277 [2024-10-07 11:29:10.937664] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.277 [2024-10-07 11:29:10.937689] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.278 [2024-10-07 11:29:10.949668] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.278 [2024-10-07 11:29:10.949719] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.278 [2024-10-07 11:29:10.950175] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.278 [2024-10-07 11:29:10.950218] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.278 [2024-10-07 11:29:10.950238] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.278 [2024-10-07 11:29:10.950286] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.278 [2024-10-07 11:29:10.950308] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.278 [2024-10-07 11:29:10.950324] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.278 [2024-10-07 11:29:10.950407] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.278 [2024-10-07 11:29:10.950452] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.278 [2024-10-07 11:29:10.950474] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.278 [2024-10-07 11:29:10.950489] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.278 [2024-10-07 11:29:10.950503] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.278 [2024-10-07 11:29:10.950519] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.278 [2024-10-07 11:29:10.950534] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.278 [2024-10-07 11:29:10.950547] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.278 [2024-10-07 11:29:10.950570] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.278 [2024-10-07 11:29:10.950585] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.278 [2024-10-07 11:29:10.963197] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.278 [2024-10-07 11:29:10.963246] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.278 [2024-10-07 11:29:10.963613] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.278 [2024-10-07 11:29:10.963654] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.278 [2024-10-07 11:29:10.963673] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.278 [2024-10-07 11:29:10.963720] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.278 [2024-10-07 11:29:10.963742] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.278 [2024-10-07 11:29:10.963758] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.278 [2024-10-07 11:29:10.964012] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.278 [2024-10-07 11:29:10.964042] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.278 [2024-10-07 11:29:10.964096] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.278 [2024-10-07 11:29:10.964116] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.278 [2024-10-07 11:29:10.964131] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.278 [2024-10-07 11:29:10.964147] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.278 [2024-10-07 11:29:10.964161] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.278 [2024-10-07 11:29:10.964174] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.278 [2024-10-07 11:29:10.964340] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.278 [2024-10-07 11:29:10.964361] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.278 [2024-10-07 11:29:10.977407] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.278 [2024-10-07 11:29:10.977466] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.278 [2024-10-07 11:29:10.977564] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.278 [2024-10-07 11:29:10.977592] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.278 [2024-10-07 11:29:10.977609] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.278 [2024-10-07 11:29:10.977653] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.278 [2024-10-07 11:29:10.977675] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.278 [2024-10-07 11:29:10.977690] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.278 [2024-10-07 11:29:10.977713] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.278 [2024-10-07 11:29:10.977733] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.278 [2024-10-07 11:29:10.977753] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.278 [2024-10-07 11:29:10.977767] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.278 [2024-10-07 11:29:10.977798] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.278 [2024-10-07 11:29:10.977815] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.278 [2024-10-07 11:29:10.977829] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.278 [2024-10-07 11:29:10.977842] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.278 [2024-10-07 11:29:10.977865] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.278 [2024-10-07 11:29:10.977878] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.278 [2024-10-07 11:29:10.992331] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.278 [2024-10-07 11:29:10.992379] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.278 [2024-10-07 11:29:10.992504] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.278 [2024-10-07 11:29:10.992534] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.278 [2024-10-07 11:29:10.992551] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.278 [2024-10-07 11:29:10.992597] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.278 [2024-10-07 11:29:10.992620] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.278 [2024-10-07 11:29:10.992635] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.278 [2024-10-07 11:29:10.992659] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.278 [2024-10-07 11:29:10.992679] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.278 [2024-10-07 11:29:10.992698] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.278 [2024-10-07 11:29:10.992713] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.278 [2024-10-07 11:29:10.992727] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.278 [2024-10-07 11:29:10.992743] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.278 [2024-10-07 11:29:10.992757] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.278 [2024-10-07 11:29:10.992770] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.278 [2024-10-07 11:29:10.992792] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.278 [2024-10-07 11:29:10.992821] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.278 [2024-10-07 11:29:11.003506] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.278 [2024-10-07 11:29:11.003552] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.278 [2024-10-07 11:29:11.005316] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.278 [2024-10-07 11:29:11.005374] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.278 [2024-10-07 11:29:11.005393] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.278 [2024-10-07 11:29:11.005453] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.278 [2024-10-07 11:29:11.005478] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.278 [2024-10-07 11:29:11.005512] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.278 [2024-10-07 11:29:11.007048] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.278 [2024-10-07 11:29:11.007091] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.278 [2024-10-07 11:29:11.007303] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.278 [2024-10-07 11:29:11.007329] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.278 [2024-10-07 11:29:11.007342] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.278 [2024-10-07 11:29:11.007359] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.278 [2024-10-07 11:29:11.007372] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.278 [2024-10-07 11:29:11.007385] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.278 [2024-10-07 11:29:11.007531] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.278 [2024-10-07 11:29:11.007554] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.278 [2024-10-07 11:29:11.014074] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.278 [2024-10-07 11:29:11.014120] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.278 [2024-10-07 11:29:11.016299] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.278 [2024-10-07 11:29:11.016355] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.278 [2024-10-07 11:29:11.016374] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.278 [2024-10-07 11:29:11.016421] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.278 [2024-10-07 11:29:11.016473] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.278 [2024-10-07 11:29:11.016489] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.278 [2024-10-07 11:29:11.017786] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.278 [2024-10-07 11:29:11.017828] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.278 [2024-10-07 11:29:11.018161] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.278 [2024-10-07 11:29:11.018193] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.278 [2024-10-07 11:29:11.018209] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.278 [2024-10-07 11:29:11.018226] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.278 [2024-10-07 11:29:11.018241] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.278 [2024-10-07 11:29:11.018253] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.278 [2024-10-07 11:29:11.018317] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.278 [2024-10-07 11:29:11.018337] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.278 [2024-10-07 11:29:11.024195] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.278 [2024-10-07 11:29:11.024283] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.278 [2024-10-07 11:29:11.024355] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.278 [2024-10-07 11:29:11.024382] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.278 [2024-10-07 11:29:11.024398] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.278 [2024-10-07 11:29:11.024478] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.278 [2024-10-07 11:29:11.024503] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.278 [2024-10-07 11:29:11.024519] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.278 [2024-10-07 11:29:11.024536] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.278 [2024-10-07 11:29:11.024560] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.278 [2024-10-07 11:29:11.024577] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.278 [2024-10-07 11:29:11.024590] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.278 [2024-10-07 11:29:11.024603] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.278 [2024-10-07 11:29:11.027323] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.278 [2024-10-07 11:29:11.027361] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.278 [2024-10-07 11:29:11.027393] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.278 [2024-10-07 11:29:11.027407] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.278 [2024-10-07 11:29:11.028524] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.279 [2024-10-07 11:29:11.034312] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.279 [2024-10-07 11:29:11.034446] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.279 [2024-10-07 11:29:11.034475] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.279 [2024-10-07 11:29:11.034491] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.279 [2024-10-07 11:29:11.034527] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.279 [2024-10-07 11:29:11.034554] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.279 [2024-10-07 11:29:11.034580] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.279 [2024-10-07 11:29:11.034595] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.279 [2024-10-07 11:29:11.034608] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.279 [2024-10-07 11:29:11.034628] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.279 [2024-10-07 11:29:11.034677] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.279 [2024-10-07 11:29:11.034700] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.279 [2024-10-07 11:29:11.034715] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.279 [2024-10-07 11:29:11.034736] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.279 [2024-10-07 11:29:11.034774] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.279 [2024-10-07 11:29:11.034789] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.279 [2024-10-07 11:29:11.034802] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.279 [2024-10-07 11:29:11.034823] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.279 [2024-10-07 11:29:11.044397] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.279 [2024-10-07 11:29:11.044542] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.279 [2024-10-07 11:29:11.044572] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.279 [2024-10-07 11:29:11.044589] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.279 [2024-10-07 11:29:11.044612] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.279 [2024-10-07 11:29:11.044645] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.279 [2024-10-07 11:29:11.044663] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.279 [2024-10-07 11:29:11.044676] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.279 [2024-10-07 11:29:11.044699] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.279 [2024-10-07 11:29:11.044734] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.279 [2024-10-07 11:29:11.044795] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.279 [2024-10-07 11:29:11.044821] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.279 [2024-10-07 11:29:11.044837] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.279 [2024-10-07 11:29:11.044875] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.279 [2024-10-07 11:29:11.044896] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.279 [2024-10-07 11:29:11.044910] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.279 [2024-10-07 11:29:11.044923] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.279 [2024-10-07 11:29:11.044943] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.279 [2024-10-07 11:29:11.054518] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.279 [2024-10-07 11:29:11.054623] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.279 [2024-10-07 11:29:11.054653] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.279 [2024-10-07 11:29:11.054670] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.279 [2024-10-07 11:29:11.054695] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.279 [2024-10-07 11:29:11.054720] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.279 [2024-10-07 11:29:11.054735] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.279 [2024-10-07 11:29:11.054748] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.279 [2024-10-07 11:29:11.054790] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.279 [2024-10-07 11:29:11.054827] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.279 [2024-10-07 11:29:11.057266] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.279 [2024-10-07 11:29:11.057311] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.279 [2024-10-07 11:29:11.057330] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.279 [2024-10-07 11:29:11.057791] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.279 [2024-10-07 11:29:11.058851] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.279 [2024-10-07 11:29:11.058890] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.279 [2024-10-07 11:29:11.058907] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.279 [2024-10-07 11:29:11.060446] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.279 [2024-10-07 11:29:11.064727] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.279 [2024-10-07 11:29:11.064859] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.279 [2024-10-07 11:29:11.064888] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.279 [2024-10-07 11:29:11.064904] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.279 [2024-10-07 11:29:11.064930] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.279 [2024-10-07 11:29:11.064962] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.279 [2024-10-07 11:29:11.064978] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.279 [2024-10-07 11:29:11.064992] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.279 [2024-10-07 11:29:11.065014] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.279 [2024-10-07 11:29:11.065032] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.279 [2024-10-07 11:29:11.065090] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.279 [2024-10-07 11:29:11.065115] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.279 [2024-10-07 11:29:11.065130] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.279 [2024-10-07 11:29:11.065151] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.279 [2024-10-07 11:29:11.065172] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.279 [2024-10-07 11:29:11.065185] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.279 [2024-10-07 11:29:11.065198] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.279 [2024-10-07 11:29:11.065218] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.280 [2024-10-07 11:29:11.076342] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.280 [2024-10-07 11:29:11.076405] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.280 [2024-10-07 11:29:11.076555] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.280 [2024-10-07 11:29:11.076585] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.280 [2024-10-07 11:29:11.076602] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.280 [2024-10-07 11:29:11.076648] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.280 [2024-10-07 11:29:11.076672] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.280 [2024-10-07 11:29:11.076687] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.280 [2024-10-07 11:29:11.076711] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.280 [2024-10-07 11:29:11.076731] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.280 [2024-10-07 11:29:11.076751] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.280 [2024-10-07 11:29:11.076765] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.280 [2024-10-07 11:29:11.076779] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.280 [2024-10-07 11:29:11.076795] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.280 [2024-10-07 11:29:11.076824] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.280 [2024-10-07 11:29:11.076852] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.280 [2024-10-07 11:29:11.076873] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.280 [2024-10-07 11:29:11.076886] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.280 [2024-10-07 11:29:11.086530] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.280 [2024-10-07 11:29:11.086607] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.280 [2024-10-07 11:29:11.086683] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.280 [2024-10-07 11:29:11.086710] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.280 [2024-10-07 11:29:11.086742] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.280 [2024-10-07 11:29:11.086808] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.280 [2024-10-07 11:29:11.086830] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.280 [2024-10-07 11:29:11.086845] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.280 [2024-10-07 11:29:11.086862] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.280 [2024-10-07 11:29:11.086885] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.280 [2024-10-07 11:29:11.086902] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.280 [2024-10-07 11:29:11.086915] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.280 [2024-10-07 11:29:11.086928] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.280 [2024-10-07 11:29:11.086948] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.280 [2024-10-07 11:29:11.086962] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.280 [2024-10-07 11:29:11.086989] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.280 [2024-10-07 11:29:11.087003] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.280 [2024-10-07 11:29:11.087024] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.280 [2024-10-07 11:29:11.096888] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.280 [2024-10-07 11:29:11.096934] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.280 [2024-10-07 11:29:11.097045] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.280 [2024-10-07 11:29:11.097072] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.280 [2024-10-07 11:29:11.097088] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.280 [2024-10-07 11:29:11.097131] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.280 [2024-10-07 11:29:11.097153] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.280 [2024-10-07 11:29:11.097168] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.280 [2024-10-07 11:29:11.097190] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.280 [2024-10-07 11:29:11.097209] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.280 [2024-10-07 11:29:11.097227] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.280 [2024-10-07 11:29:11.097240] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.280 [2024-10-07 11:29:11.097253] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.280 [2024-10-07 11:29:11.097268] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.280 [2024-10-07 11:29:11.097281] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.280 [2024-10-07 11:29:11.097294] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.280 [2024-10-07 11:29:11.097315] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.280 [2024-10-07 11:29:11.097328] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.280 [2024-10-07 11:29:11.107595] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.280 [2024-10-07 11:29:11.107640] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.280 [2024-10-07 11:29:11.107734] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.280 [2024-10-07 11:29:11.107761] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.280 [2024-10-07 11:29:11.107777] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.280 [2024-10-07 11:29:11.107820] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.280 [2024-10-07 11:29:11.107842] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.280 [2024-10-07 11:29:11.107856] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.280 [2024-10-07 11:29:11.107879] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.280 [2024-10-07 11:29:11.107915] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.280 [2024-10-07 11:29:11.107936] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.280 [2024-10-07 11:29:11.107949] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.280 [2024-10-07 11:29:11.107962] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.280 [2024-10-07 11:29:11.107978] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.280 [2024-10-07 11:29:11.107991] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.280 [2024-10-07 11:29:11.108003] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.280 [2024-10-07 11:29:11.108024] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.280 [2024-10-07 11:29:11.108038] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.280 [2024-10-07 11:29:11.119548] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.280 [2024-10-07 11:29:11.119594] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.280 [2024-10-07 11:29:11.119689] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.280 [2024-10-07 11:29:11.119717] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.280 [2024-10-07 11:29:11.119733] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.280 [2024-10-07 11:29:11.119776] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.280 [2024-10-07 11:29:11.119797] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.280 [2024-10-07 11:29:11.119812] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.280 [2024-10-07 11:29:11.119834] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.280 [2024-10-07 11:29:11.119853] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.280 [2024-10-07 11:29:11.119872] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.280 [2024-10-07 11:29:11.119885] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.280 [2024-10-07 11:29:11.119898] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.280 [2024-10-07 11:29:11.119913] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.280 [2024-10-07 11:29:11.119926] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.280 [2024-10-07 11:29:11.119938] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.280 [2024-10-07 11:29:11.119975] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.280 [2024-10-07 11:29:11.119992] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.280 [2024-10-07 11:29:11.132390] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.281 [2024-10-07 11:29:11.132463] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.281 [2024-10-07 11:29:11.132561] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.281 [2024-10-07 11:29:11.132589] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.281 [2024-10-07 11:29:11.132620] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.281 [2024-10-07 11:29:11.132670] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.281 [2024-10-07 11:29:11.132693] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.281 [2024-10-07 11:29:11.132708] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.281 [2024-10-07 11:29:11.132730] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.281 [2024-10-07 11:29:11.132750] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.281 [2024-10-07 11:29:11.132769] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.281 [2024-10-07 11:29:11.132783] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.281 [2024-10-07 11:29:11.132796] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.281 [2024-10-07 11:29:11.132812] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.281 [2024-10-07 11:29:11.132825] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.281 [2024-10-07 11:29:11.132854] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.281 [2024-10-07 11:29:11.132875] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.281 [2024-10-07 11:29:11.132889] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.281 [2024-10-07 11:29:11.143936] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.281 [2024-10-07 11:29:11.143983] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.281 [2024-10-07 11:29:11.144162] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.281 [2024-10-07 11:29:11.144191] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.281 [2024-10-07 11:29:11.144207] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.281 [2024-10-07 11:29:11.144252] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.281 [2024-10-07 11:29:11.144274] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.281 [2024-10-07 11:29:11.144289] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.281 [2024-10-07 11:29:11.144453] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.281 [2024-10-07 11:29:11.144483] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.281 [2024-10-07 11:29:11.144593] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.281 [2024-10-07 11:29:11.144615] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.281 [2024-10-07 11:29:11.144629] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.281 [2024-10-07 11:29:11.144646] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.281 [2024-10-07 11:29:11.144660] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.281 [2024-10-07 11:29:11.144689] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.281 [2024-10-07 11:29:11.144801] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.281 [2024-10-07 11:29:11.144819] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.281 [2024-10-07 11:29:11.157917] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.281 [2024-10-07 11:29:11.158006] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.281 [2024-10-07 11:29:11.158107] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.281 [2024-10-07 11:29:11.158136] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.281 [2024-10-07 11:29:11.158153] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.281 [2024-10-07 11:29:11.158199] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.281 [2024-10-07 11:29:11.158222] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.281 [2024-10-07 11:29:11.158238] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.281 [2024-10-07 11:29:11.158276] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.281 [2024-10-07 11:29:11.158300] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.281 [2024-10-07 11:29:11.158320] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.281 [2024-10-07 11:29:11.158335] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.281 [2024-10-07 11:29:11.158348] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.281 [2024-10-07 11:29:11.158364] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.281 [2024-10-07 11:29:11.158378] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.281 [2024-10-07 11:29:11.158391] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.281 [2024-10-07 11:29:11.158414] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.281 [2024-10-07 11:29:11.158443] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.281 [2024-10-07 11:29:11.169772] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.281 [2024-10-07 11:29:11.169818] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.281 [2024-10-07 11:29:11.170017] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.281 [2024-10-07 11:29:11.170047] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.281 [2024-10-07 11:29:11.170064] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.281 [2024-10-07 11:29:11.170112] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.281 [2024-10-07 11:29:11.170134] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.281 [2024-10-07 11:29:11.170149] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.281 [2024-10-07 11:29:11.170262] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.281 [2024-10-07 11:29:11.170288] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.281 [2024-10-07 11:29:11.170707] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.281 [2024-10-07 11:29:11.170747] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.281 [2024-10-07 11:29:11.170764] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.281 [2024-10-07 11:29:11.170781] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.281 [2024-10-07 11:29:11.170810] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.281 [2024-10-07 11:29:11.170822] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.281 [2024-10-07 11:29:11.172762] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.281 [2024-10-07 11:29:11.172797] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.281 [2024-10-07 11:29:11.179895] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.281 [2024-10-07 11:29:11.180001] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.281 [2024-10-07 11:29:11.180073] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.281 [2024-10-07 11:29:11.180100] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.281 [2024-10-07 11:29:11.180117] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.281 [2024-10-07 11:29:11.182402] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.281 [2024-10-07 11:29:11.182458] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.281 [2024-10-07 11:29:11.182478] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.281 [2024-10-07 11:29:11.182497] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.281 [2024-10-07 11:29:11.183180] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.281 [2024-10-07 11:29:11.183219] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.281 [2024-10-07 11:29:11.183236] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.281 [2024-10-07 11:29:11.183249] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.281 [2024-10-07 11:29:11.183347] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.281 [2024-10-07 11:29:11.183369] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.281 [2024-10-07 11:29:11.183383] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.281 [2024-10-07 11:29:11.183396] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.281 [2024-10-07 11:29:11.183449] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.281 [2024-10-07 11:29:11.190019] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.281 [2024-10-07 11:29:11.190138] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.281 [2024-10-07 11:29:11.190167] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.281 [2024-10-07 11:29:11.190184] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.281 [2024-10-07 11:29:11.190221] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.281 [2024-10-07 11:29:11.190265] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.281 [2024-10-07 11:29:11.190295] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.281 [2024-10-07 11:29:11.190326] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.282 [2024-10-07 11:29:11.190339] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.282 [2024-10-07 11:29:11.190360] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.282 [2024-10-07 11:29:11.190444] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.282 [2024-10-07 11:29:11.190481] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.282 [2024-10-07 11:29:11.190500] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.282 [2024-10-07 11:29:11.190523] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.282 [2024-10-07 11:29:11.190544] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.282 [2024-10-07 11:29:11.190558] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.282 [2024-10-07 11:29:11.190571] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.282 [2024-10-07 11:29:11.190592] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.282 [2024-10-07 11:29:11.202838] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.282 [2024-10-07 11:29:11.202885] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.282 [2024-10-07 11:29:11.203014] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.282 [2024-10-07 11:29:11.203042] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.282 [2024-10-07 11:29:11.203058] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.282 [2024-10-07 11:29:11.203102] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.282 [2024-10-07 11:29:11.203124] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.282 [2024-10-07 11:29:11.203139] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.282 [2024-10-07 11:29:11.203388] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.282 [2024-10-07 11:29:11.203417] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.282 [2024-10-07 11:29:11.203552] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.282 [2024-10-07 11:29:11.203576] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.282 [2024-10-07 11:29:11.203591] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.282 [2024-10-07 11:29:11.203607] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.282 [2024-10-07 11:29:11.203621] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.282 [2024-10-07 11:29:11.203635] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.282 [2024-10-07 11:29:11.203685] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.282 [2024-10-07 11:29:11.203735] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.282 [2024-10-07 11:29:11.216620] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.282 [2024-10-07 11:29:11.216669] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.282 [2024-10-07 11:29:11.216753] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.282 [2024-10-07 11:29:11.216781] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.282 [2024-10-07 11:29:11.216798] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.282 [2024-10-07 11:29:11.216858] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.282 [2024-10-07 11:29:11.216880] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.282 [2024-10-07 11:29:11.216895] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.282 [2024-10-07 11:29:11.216918] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.282 [2024-10-07 11:29:11.216937] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.282 [2024-10-07 11:29:11.216957] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.282 [2024-10-07 11:29:11.216970] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.282 [2024-10-07 11:29:11.216984] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.282 [2024-10-07 11:29:11.217000] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.282 [2024-10-07 11:29:11.217013] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.282 [2024-10-07 11:29:11.217025] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.282 [2024-10-07 11:29:11.217047] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.282 [2024-10-07 11:29:11.217077] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.282 [2024-10-07 11:29:11.230801] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.282 [2024-10-07 11:29:11.230851] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.282 [2024-10-07 11:29:11.230935] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.282 [2024-10-07 11:29:11.230964] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.282 [2024-10-07 11:29:11.230996] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.282 [2024-10-07 11:29:11.231040] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.282 [2024-10-07 11:29:11.231079] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.282 [2024-10-07 11:29:11.231094] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.282 [2024-10-07 11:29:11.231118] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.282 [2024-10-07 11:29:11.231137] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.282 [2024-10-07 11:29:11.231157] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.282 [2024-10-07 11:29:11.231189] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.282 [2024-10-07 11:29:11.231205] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.282 [2024-10-07 11:29:11.231222] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.282 [2024-10-07 11:29:11.231236] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.282 [2024-10-07 11:29:11.231249] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.282 [2024-10-07 11:29:11.231272] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.282 [2024-10-07 11:29:11.231286] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.282 [2024-10-07 11:29:11.241169] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.282 [2024-10-07 11:29:11.241219] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.282 [2024-10-07 11:29:11.241394] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.282 [2024-10-07 11:29:11.241442] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.282 [2024-10-07 11:29:11.241461] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.282 [2024-10-07 11:29:11.241511] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.282 [2024-10-07 11:29:11.241534] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.282 [2024-10-07 11:29:11.241549] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.282 [2024-10-07 11:29:11.241655] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.282 [2024-10-07 11:29:11.241679] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.282 [2024-10-07 11:29:11.241786] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.282 [2024-10-07 11:29:11.241807] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.282 [2024-10-07 11:29:11.241821] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.282 [2024-10-07 11:29:11.241837] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.282 [2024-10-07 11:29:11.241852] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.282 [2024-10-07 11:29:11.241865] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.282 [2024-10-07 11:29:11.242570] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.282 [2024-10-07 11:29:11.242607] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.282 [2024-10-07 11:29:11.251278] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.282 [2024-10-07 11:29:11.251355] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.282 [2024-10-07 11:29:11.251470] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.282 [2024-10-07 11:29:11.251499] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.282 [2024-10-07 11:29:11.251514] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.282 [2024-10-07 11:29:11.251733] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.282 [2024-10-07 11:29:11.251776] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.282 [2024-10-07 11:29:11.251793] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.282 [2024-10-07 11:29:11.251811] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.282 [2024-10-07 11:29:11.251945] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.282 [2024-10-07 11:29:11.251971] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.282 [2024-10-07 11:29:11.251985] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.282 [2024-10-07 11:29:11.251998] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.282 [2024-10-07 11:29:11.252092] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.282 [2024-10-07 11:29:11.252110] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.283 [2024-10-07 11:29:11.252123] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.283 [2024-10-07 11:29:11.252136] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.283 [2024-10-07 11:29:11.252309] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.283 [2024-10-07 11:29:11.261562] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.283 [2024-10-07 11:29:11.261607] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.283 [2024-10-07 11:29:11.261704] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.283 [2024-10-07 11:29:11.261731] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.283 [2024-10-07 11:29:11.261747] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.283 [2024-10-07 11:29:11.261791] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.283 [2024-10-07 11:29:11.261812] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.283 [2024-10-07 11:29:11.261827] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.283 [2024-10-07 11:29:11.261849] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.283 [2024-10-07 11:29:11.261867] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.283 [2024-10-07 11:29:11.261886] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.283 [2024-10-07 11:29:11.261900] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.283 [2024-10-07 11:29:11.261913] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.283 [2024-10-07 11:29:11.261928] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.283 [2024-10-07 11:29:11.261941] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.283 [2024-10-07 11:29:11.261953] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.283 [2024-10-07 11:29:11.262003] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.283 [2024-10-07 11:29:11.262019] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.283 [2024-10-07 11:29:11.275101] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.283 [2024-10-07 11:29:11.275150] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.283 [2024-10-07 11:29:11.275251] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.283 [2024-10-07 11:29:11.275279] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.283 [2024-10-07 11:29:11.275296] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.283 [2024-10-07 11:29:11.275343] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.283 [2024-10-07 11:29:11.275366] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.283 [2024-10-07 11:29:11.275381] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.283 [2024-10-07 11:29:11.275887] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.283 [2024-10-07 11:29:11.275929] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.283 [2024-10-07 11:29:11.276157] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.283 [2024-10-07 11:29:11.276192] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.283 [2024-10-07 11:29:11.276209] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.283 [2024-10-07 11:29:11.276226] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.283 [2024-10-07 11:29:11.276241] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.283 [2024-10-07 11:29:11.276254] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.283 [2024-10-07 11:29:11.276742] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.283 [2024-10-07 11:29:11.276777] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.283 [2024-10-07 11:29:11.289158] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.283 [2024-10-07 11:29:11.289205] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.283 [2024-10-07 11:29:11.289303] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.283 [2024-10-07 11:29:11.289331] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.283 [2024-10-07 11:29:11.289347] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.283 [2024-10-07 11:29:11.289392] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.283 [2024-10-07 11:29:11.289414] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.283 [2024-10-07 11:29:11.289445] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.283 [2024-10-07 11:29:11.289470] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.283 [2024-10-07 11:29:11.289489] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.283 [2024-10-07 11:29:11.289509] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.283 [2024-10-07 11:29:11.289523] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.283 [2024-10-07 11:29:11.289555] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.283 [2024-10-07 11:29:11.289572] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.283 [2024-10-07 11:29:11.289586] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.283 [2024-10-07 11:29:11.289599] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.283 [2024-10-07 11:29:11.289621] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.283 [2024-10-07 11:29:11.289635] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.283 [2024-10-07 11:29:11.301809] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.283 [2024-10-07 11:29:11.301859] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.283 [2024-10-07 11:29:11.302000] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.283 [2024-10-07 11:29:11.302031] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.283 [2024-10-07 11:29:11.302048] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.283 [2024-10-07 11:29:11.302094] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.283 [2024-10-07 11:29:11.302117] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.283 [2024-10-07 11:29:11.302133] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.283 [2024-10-07 11:29:11.302157] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.283 [2024-10-07 11:29:11.302177] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.283 [2024-10-07 11:29:11.302212] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.283 [2024-10-07 11:29:11.302229] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.283 [2024-10-07 11:29:11.302244] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.283 [2024-10-07 11:29:11.302260] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.283 [2024-10-07 11:29:11.302274] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.283 [2024-10-07 11:29:11.302287] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.283 [2024-10-07 11:29:11.302310] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.283 [2024-10-07 11:29:11.302324] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.283 [2024-10-07 11:29:11.315799] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.283 [2024-10-07 11:29:11.315845] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.283 [2024-10-07 11:29:11.315939] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.283 [2024-10-07 11:29:11.315966] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.283 [2024-10-07 11:29:11.315982] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.283 [2024-10-07 11:29:11.316026] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.283 [2024-10-07 11:29:11.316047] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.283 [2024-10-07 11:29:11.316078] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.283 [2024-10-07 11:29:11.316102] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.283 [2024-10-07 11:29:11.316121] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.284 [2024-10-07 11:29:11.316140] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.284 [2024-10-07 11:29:11.316153] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.284 [2024-10-07 11:29:11.316166] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.284 [2024-10-07 11:29:11.316181] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.284 [2024-10-07 11:29:11.316195] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.284 [2024-10-07 11:29:11.316207] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.284 [2024-10-07 11:29:11.317142] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.284 [2024-10-07 11:29:11.317193] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.284 [2024-10-07 11:29:11.327188] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.284 [2024-10-07 11:29:11.327235] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.284 [2024-10-07 11:29:11.328580] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.284 [2024-10-07 11:29:11.328623] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.284 [2024-10-07 11:29:11.328642] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.284 [2024-10-07 11:29:11.328691] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.284 [2024-10-07 11:29:11.328714] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.284 [2024-10-07 11:29:11.328730] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.284 [2024-10-07 11:29:11.330458] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.284 [2024-10-07 11:29:11.330536] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.284 [2024-10-07 11:29:11.330793] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.284 [2024-10-07 11:29:11.330821] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.284 [2024-10-07 11:29:11.330835] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.284 [2024-10-07 11:29:11.330854] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.284 [2024-10-07 11:29:11.330868] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.284 [2024-10-07 11:29:11.330881] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.284 [2024-10-07 11:29:11.331104] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.284 [2024-10-07 11:29:11.331129] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.284 [2024-10-07 11:29:11.339023] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.284 [2024-10-07 11:29:11.339084] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.284 [2024-10-07 11:29:11.339184] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.284 [2024-10-07 11:29:11.339213] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.284 [2024-10-07 11:29:11.339229] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.284 [2024-10-07 11:29:11.339274] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.284 [2024-10-07 11:29:11.339296] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.284 [2024-10-07 11:29:11.339310] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.284 [2024-10-07 11:29:11.339333] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.284 [2024-10-07 11:29:11.339351] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.284 [2024-10-07 11:29:11.339371] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.284 [2024-10-07 11:29:11.339384] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.284 [2024-10-07 11:29:11.339397] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.284 [2024-10-07 11:29:11.339412] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.284 [2024-10-07 11:29:11.339438] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.284 [2024-10-07 11:29:11.339453] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.284 [2024-10-07 11:29:11.339476] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.284 [2024-10-07 11:29:11.339490] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.284 [2024-10-07 11:29:11.349158] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.284 [2024-10-07 11:29:11.349234] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.284 [2024-10-07 11:29:11.349307] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.284 [2024-10-07 11:29:11.349334] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.284 [2024-10-07 11:29:11.349350] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.284 [2024-10-07 11:29:11.349399] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.284 [2024-10-07 11:29:11.349421] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.284 [2024-10-07 11:29:11.349453] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.284 [2024-10-07 11:29:11.349471] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.284 [2024-10-07 11:29:11.349509] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.284 [2024-10-07 11:29:11.349529] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.284 [2024-10-07 11:29:11.349542] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.284 [2024-10-07 11:29:11.349555] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.284 [2024-10-07 11:29:11.349591] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.284 [2024-10-07 11:29:11.349607] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.284 [2024-10-07 11:29:11.349620] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.284 [2024-10-07 11:29:11.349632] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.284 [2024-10-07 11:29:11.349652] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.284 [2024-10-07 11:29:11.362014] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.284 [2024-10-07 11:29:11.362063] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.284 [2024-10-07 11:29:11.362555] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.284 [2024-10-07 11:29:11.362596] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.284 [2024-10-07 11:29:11.362615] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.284 [2024-10-07 11:29:11.362664] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.284 [2024-10-07 11:29:11.362686] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.284 [2024-10-07 11:29:11.362702] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.284 [2024-10-07 11:29:11.362925] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.284 [2024-10-07 11:29:11.362955] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.284 [2024-10-07 11:29:11.363005] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.284 [2024-10-07 11:29:11.363025] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.284 [2024-10-07 11:29:11.363039] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.284 [2024-10-07 11:29:11.363054] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.284 [2024-10-07 11:29:11.363068] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.284 [2024-10-07 11:29:11.363080] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.285 [2024-10-07 11:29:11.363102] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.285 [2024-10-07 11:29:11.363116] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.285 [2024-10-07 11:29:11.376398] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.285 [2024-10-07 11:29:11.376460] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.285 [2024-10-07 11:29:11.377436] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.285 [2024-10-07 11:29:11.377481] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.285 [2024-10-07 11:29:11.377500] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.285 [2024-10-07 11:29:11.377551] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.285 [2024-10-07 11:29:11.377574] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.285 [2024-10-07 11:29:11.377590] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.285 [2024-10-07 11:29:11.377736] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.285 [2024-10-07 11:29:11.377765] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.285 [2024-10-07 11:29:11.377786] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.285 [2024-10-07 11:29:11.377801] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.285 [2024-10-07 11:29:11.377815] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.285 [2024-10-07 11:29:11.377832] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.285 [2024-10-07 11:29:11.377862] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.285 [2024-10-07 11:29:11.377875] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.285 [2024-10-07 11:29:11.377897] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.285 [2024-10-07 11:29:11.377911] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.285 [2024-10-07 11:29:11.386992] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.285 [2024-10-07 11:29:11.387042] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.285 [2024-10-07 11:29:11.387126] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.285 [2024-10-07 11:29:11.387156] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.285 [2024-10-07 11:29:11.387174] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.285 [2024-10-07 11:29:11.387249] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.285 [2024-10-07 11:29:11.387274] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.285 [2024-10-07 11:29:11.387290] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.285 [2024-10-07 11:29:11.387315] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.285 [2024-10-07 11:29:11.387334] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.285 [2024-10-07 11:29:11.387354] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.285 [2024-10-07 11:29:11.387369] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.285 [2024-10-07 11:29:11.387382] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.285 [2024-10-07 11:29:11.387398] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.285 [2024-10-07 11:29:11.387429] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.285 [2024-10-07 11:29:11.387445] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.285 [2024-10-07 11:29:11.387469] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.285 [2024-10-07 11:29:11.387484] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.285 [2024-10-07 11:29:11.399367] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.285 [2024-10-07 11:29:11.399443] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.285 [2024-10-07 11:29:11.400011] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.285 [2024-10-07 11:29:11.400053] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.285 [2024-10-07 11:29:11.400072] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.285 [2024-10-07 11:29:11.400119] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.285 [2024-10-07 11:29:11.400142] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.285 [2024-10-07 11:29:11.400174] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.285 [2024-10-07 11:29:11.402405] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.285 [2024-10-07 11:29:11.402464] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.285 [2024-10-07 11:29:11.402730] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.285 [2024-10-07 11:29:11.402769] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.285 [2024-10-07 11:29:11.402786] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.285 [2024-10-07 11:29:11.402804] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.285 [2024-10-07 11:29:11.402819] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.285 [2024-10-07 11:29:11.402834] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.285 [2024-10-07 11:29:11.403040] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.285 [2024-10-07 11:29:11.403067] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.285 9024.83 IOPS, 35.25 MiB/s [2024-10-07T11:29:15.996Z] [2024-10-07 11:29:11.411531] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.285 [2024-10-07 11:29:11.411580] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.285 [2024-10-07 11:29:11.411891] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.285 [2024-10-07 11:29:11.411931] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.285 [2024-10-07 11:29:11.411950] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.285 [2024-10-07 11:29:11.411996] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.285 [2024-10-07 11:29:11.412018] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.285 [2024-10-07 11:29:11.412033] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.285 [2024-10-07 11:29:11.412084] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.285 [2024-10-07 11:29:11.412108] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.285 [2024-10-07 11:29:11.412128] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.285 [2024-10-07 11:29:11.412142] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.285 [2024-10-07 11:29:11.412155] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.285 [2024-10-07 11:29:11.412170] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.285 [2024-10-07 11:29:11.412199] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.285 [2024-10-07 11:29:11.412213] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.285 [2024-10-07 11:29:11.412236] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.285 [2024-10-07 11:29:11.412250] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.285 [2024-10-07 11:29:11.423404] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.285 [2024-10-07 11:29:11.423468] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.285 [2024-10-07 11:29:11.423555] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.285 [2024-10-07 11:29:11.423584] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.285 [2024-10-07 11:29:11.423601] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.285 [2024-10-07 11:29:11.423649] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.285 [2024-10-07 11:29:11.423687] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.285 [2024-10-07 11:29:11.423702] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.285 [2024-10-07 11:29:11.423725] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.285 [2024-10-07 11:29:11.423743] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.285 [2024-10-07 11:29:11.423763] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.285 [2024-10-07 11:29:11.423776] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.285 [2024-10-07 11:29:11.423789] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.285 [2024-10-07 11:29:11.423805] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.285 [2024-10-07 11:29:11.423818] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.285 [2024-10-07 11:29:11.423830] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.285 [2024-10-07 11:29:11.423851] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.285 [2024-10-07 11:29:11.423865] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.285 [2024-10-07 11:29:11.435265] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.285 [2024-10-07 11:29:11.435315] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.285 [2024-10-07 11:29:11.435400] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.285 [2024-10-07 11:29:11.435444] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.285 [2024-10-07 11:29:11.435462] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.286 [2024-10-07 11:29:11.435511] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.286 [2024-10-07 11:29:11.435534] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.286 [2024-10-07 11:29:11.435550] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.286 [2024-10-07 11:29:11.435573] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.286 [2024-10-07 11:29:11.435609] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.286 [2024-10-07 11:29:11.435631] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.286 [2024-10-07 11:29:11.435646] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.286 [2024-10-07 11:29:11.435660] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.286 [2024-10-07 11:29:11.435677] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.286 [2024-10-07 11:29:11.435691] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.286 [2024-10-07 11:29:11.435704] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.286 [2024-10-07 11:29:11.435865] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.286 [2024-10-07 11:29:11.435892] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.286 [2024-10-07 11:29:11.449335] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.286 [2024-10-07 11:29:11.449387] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.286 [2024-10-07 11:29:11.449684] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.286 [2024-10-07 11:29:11.449734] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.286 [2024-10-07 11:29:11.449754] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.286 [2024-10-07 11:29:11.449806] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.286 [2024-10-07 11:29:11.449830] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.286 [2024-10-07 11:29:11.449845] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.286 [2024-10-07 11:29:11.450082] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.286 [2024-10-07 11:29:11.450115] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.286 [2024-10-07 11:29:11.450178] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.286 [2024-10-07 11:29:11.450200] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.286 [2024-10-07 11:29:11.450215] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.286 [2024-10-07 11:29:11.450232] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.286 [2024-10-07 11:29:11.450246] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.286 [2024-10-07 11:29:11.450259] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.286 [2024-10-07 11:29:11.450283] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.286 [2024-10-07 11:29:11.450300] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.286 [2024-10-07 11:29:11.462563] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.286 [2024-10-07 11:29:11.462608] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.286 [2024-10-07 11:29:11.462705] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.286 [2024-10-07 11:29:11.462746] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.286 [2024-10-07 11:29:11.462764] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.286 [2024-10-07 11:29:11.462811] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.286 [2024-10-07 11:29:11.462833] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.286 [2024-10-07 11:29:11.462848] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.286 [2024-10-07 11:29:11.462871] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.286 [2024-10-07 11:29:11.462890] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.286 [2024-10-07 11:29:11.462908] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.286 [2024-10-07 11:29:11.462922] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.286 [2024-10-07 11:29:11.462934] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.286 [2024-10-07 11:29:11.462950] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.286 [2024-10-07 11:29:11.462963] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.286 [2024-10-07 11:29:11.462975] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.286 [2024-10-07 11:29:11.462997] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.286 [2024-10-07 11:29:11.463010] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.286 [2024-10-07 11:29:11.477241] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.286 [2024-10-07 11:29:11.477292] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.286 [2024-10-07 11:29:11.477390] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.286 [2024-10-07 11:29:11.477418] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.286 [2024-10-07 11:29:11.477449] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.286 [2024-10-07 11:29:11.477497] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.286 [2024-10-07 11:29:11.477519] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.286 [2024-10-07 11:29:11.477533] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.286 [2024-10-07 11:29:11.477556] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.286 [2024-10-07 11:29:11.477575] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.286 [2024-10-07 11:29:11.477593] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.286 [2024-10-07 11:29:11.477607] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.286 [2024-10-07 11:29:11.477620] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.286 [2024-10-07 11:29:11.477635] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.286 [2024-10-07 11:29:11.477648] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.286 [2024-10-07 11:29:11.477676] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.286 [2024-10-07 11:29:11.477700] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.286 [2024-10-07 11:29:11.477714] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.286 [2024-10-07 11:29:11.489312] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.286 [2024-10-07 11:29:11.489362] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.286 [2024-10-07 11:29:11.489460] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.286 [2024-10-07 11:29:11.489491] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.286 [2024-10-07 11:29:11.489508] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.286 [2024-10-07 11:29:11.489556] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.286 [2024-10-07 11:29:11.489579] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.286 [2024-10-07 11:29:11.489600] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.286 [2024-10-07 11:29:11.489623] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.286 [2024-10-07 11:29:11.489643] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.286 [2024-10-07 11:29:11.489663] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.287 [2024-10-07 11:29:11.489677] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.287 [2024-10-07 11:29:11.489691] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.287 [2024-10-07 11:29:11.489707] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.287 [2024-10-07 11:29:11.489721] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.287 [2024-10-07 11:29:11.489734] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.287 [2024-10-07 11:29:11.489757] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.287 [2024-10-07 11:29:11.489772] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.287 [2024-10-07 11:29:11.500946] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.287 [2024-10-07 11:29:11.500993] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.287 [2024-10-07 11:29:11.501282] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.287 [2024-10-07 11:29:11.501315] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.287 [2024-10-07 11:29:11.501332] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.287 [2024-10-07 11:29:11.501394] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.287 [2024-10-07 11:29:11.501416] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.287 [2024-10-07 11:29:11.501431] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.287 [2024-10-07 11:29:11.501641] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.287 [2024-10-07 11:29:11.501672] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.287 [2024-10-07 11:29:11.501895] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.287 [2024-10-07 11:29:11.501929] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.287 [2024-10-07 11:29:11.501945] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.287 [2024-10-07 11:29:11.501970] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.287 [2024-10-07 11:29:11.502003] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.287 [2024-10-07 11:29:11.502016] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.287 [2024-10-07 11:29:11.502076] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.287 [2024-10-07 11:29:11.502097] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.287 [2024-10-07 11:29:11.515159] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.287 [2024-10-07 11:29:11.515207] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.287 [2024-10-07 11:29:11.515547] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.287 [2024-10-07 11:29:11.515581] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.287 [2024-10-07 11:29:11.515599] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.287 [2024-10-07 11:29:11.515646] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.287 [2024-10-07 11:29:11.515670] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.287 [2024-10-07 11:29:11.515685] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.287 [2024-10-07 11:29:11.515765] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.287 [2024-10-07 11:29:11.515789] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.287 [2024-10-07 11:29:11.515808] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.287 [2024-10-07 11:29:11.515823] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.287 [2024-10-07 11:29:11.515835] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.287 [2024-10-07 11:29:11.515851] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.287 [2024-10-07 11:29:11.515865] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.287 [2024-10-07 11:29:11.515877] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.287 [2024-10-07 11:29:11.515899] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.287 [2024-10-07 11:29:11.515913] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.287 [2024-10-07 11:29:11.525830] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.287 [2024-10-07 11:29:11.525881] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.287 [2024-10-07 11:29:11.526016] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.287 [2024-10-07 11:29:11.526051] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.287 [2024-10-07 11:29:11.526101] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.287 [2024-10-07 11:29:11.526164] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.287 [2024-10-07 11:29:11.526189] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.287 [2024-10-07 11:29:11.526205] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.287 [2024-10-07 11:29:11.526231] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.287 [2024-10-07 11:29:11.526251] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.287 [2024-10-07 11:29:11.526272] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.287 [2024-10-07 11:29:11.526286] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.287 [2024-10-07 11:29:11.526300] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.287 [2024-10-07 11:29:11.526317] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.287 [2024-10-07 11:29:11.526332] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.287 [2024-10-07 11:29:11.526345] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.287 [2024-10-07 11:29:11.526368] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.287 [2024-10-07 11:29:11.526382] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.287 [2024-10-07 11:29:11.538134] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.287 [2024-10-07 11:29:11.538186] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.287 [2024-10-07 11:29:11.538326] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.287 [2024-10-07 11:29:11.538358] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.287 [2024-10-07 11:29:11.538376] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.287 [2024-10-07 11:29:11.538437] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.287 [2024-10-07 11:29:11.538463] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.287 [2024-10-07 11:29:11.538478] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.287 [2024-10-07 11:29:11.538522] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.287 [2024-10-07 11:29:11.538547] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.287 [2024-10-07 11:29:11.538568] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.287 [2024-10-07 11:29:11.538583] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.287 [2024-10-07 11:29:11.538597] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.287 [2024-10-07 11:29:11.538613] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.287 [2024-10-07 11:29:11.538627] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.287 [2024-10-07 11:29:11.538640] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.287 [2024-10-07 11:29:11.538681] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.287 [2024-10-07 11:29:11.538698] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.287 [2024-10-07 11:29:11.548506] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.287 [2024-10-07 11:29:11.548569] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.287 [2024-10-07 11:29:11.549231] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.287 [2024-10-07 11:29:11.549273] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.287 [2024-10-07 11:29:11.549308] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.287 [2024-10-07 11:29:11.549356] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.287 [2024-10-07 11:29:11.549378] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.287 [2024-10-07 11:29:11.549394] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.287 [2024-10-07 11:29:11.549553] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.287 [2024-10-07 11:29:11.549598] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.287 [2024-10-07 11:29:11.550418] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.287 [2024-10-07 11:29:11.550479] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.287 [2024-10-07 11:29:11.550515] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.287 [2024-10-07 11:29:11.550532] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.287 [2024-10-07 11:29:11.550547] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.287 [2024-10-07 11:29:11.550560] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.287 [2024-10-07 11:29:11.553509] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.288 [2024-10-07 11:29:11.553549] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.288 [2024-10-07 11:29:11.558652] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.288 [2024-10-07 11:29:11.558716] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.288 [2024-10-07 11:29:11.558793] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.288 [2024-10-07 11:29:11.558821] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.288 [2024-10-07 11:29:11.558838] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.288 [2024-10-07 11:29:11.558891] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.288 [2024-10-07 11:29:11.558915] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.288 [2024-10-07 11:29:11.558931] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.288 [2024-10-07 11:29:11.558949] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.288 [2024-10-07 11:29:11.558973] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.288 [2024-10-07 11:29:11.558996] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.288 [2024-10-07 11:29:11.559028] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.288 [2024-10-07 11:29:11.559043] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.288 [2024-10-07 11:29:11.559067] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.288 [2024-10-07 11:29:11.559082] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.288 [2024-10-07 11:29:11.559096] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.288 [2024-10-07 11:29:11.559110] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.288 [2024-10-07 11:29:11.559142] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.288 [2024-10-07 11:29:11.572095] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.288 [2024-10-07 11:29:11.572143] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.288 [2024-10-07 11:29:11.572473] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.288 [2024-10-07 11:29:11.572506] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.288 [2024-10-07 11:29:11.572523] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.288 [2024-10-07 11:29:11.572568] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.288 [2024-10-07 11:29:11.572590] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.288 [2024-10-07 11:29:11.572605] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.288 [2024-10-07 11:29:11.572656] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.288 [2024-10-07 11:29:11.572681] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.288 [2024-10-07 11:29:11.572701] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.288 [2024-10-07 11:29:11.572715] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.288 [2024-10-07 11:29:11.572728] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.288 [2024-10-07 11:29:11.572744] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.288 [2024-10-07 11:29:11.572757] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.288 [2024-10-07 11:29:11.572770] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.288 [2024-10-07 11:29:11.572792] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.288 [2024-10-07 11:29:11.572805] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.288 [2024-10-07 11:29:11.584149] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.288 [2024-10-07 11:29:11.584197] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.288 [2024-10-07 11:29:11.584406] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.288 [2024-10-07 11:29:11.584436] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.288 [2024-10-07 11:29:11.584470] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.288 [2024-10-07 11:29:11.584539] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.288 [2024-10-07 11:29:11.584564] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.288 [2024-10-07 11:29:11.584580] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.288 [2024-10-07 11:29:11.584693] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.288 [2024-10-07 11:29:11.584734] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.288 [2024-10-07 11:29:11.584824] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.288 [2024-10-07 11:29:11.584842] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.288 [2024-10-07 11:29:11.584856] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.288 [2024-10-07 11:29:11.584871] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.288 [2024-10-07 11:29:11.584885] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.288 [2024-10-07 11:29:11.584897] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.288 [2024-10-07 11:29:11.586180] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.288 [2024-10-07 11:29:11.586218] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.288 [2024-10-07 11:29:11.594838] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.288 [2024-10-07 11:29:11.594888] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.288 [2024-10-07 11:29:11.595675] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.288 [2024-10-07 11:29:11.595719] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.288 [2024-10-07 11:29:11.595739] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.288 [2024-10-07 11:29:11.595789] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.288 [2024-10-07 11:29:11.595812] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.288 [2024-10-07 11:29:11.595827] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.288 [2024-10-07 11:29:11.596018] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.288 [2024-10-07 11:29:11.596049] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.288 [2024-10-07 11:29:11.599984] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.288 [2024-10-07 11:29:11.600028] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.288 [2024-10-07 11:29:11.600048] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.288 [2024-10-07 11:29:11.600076] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.288 [2024-10-07 11:29:11.600095] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.288 [2024-10-07 11:29:11.600109] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.288 [2024-10-07 11:29:11.600310] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.288 [2024-10-07 11:29:11.600351] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.288 [2024-10-07 11:29:11.605307] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.288 [2024-10-07 11:29:11.605356] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.288 [2024-10-07 11:29:11.605534] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.288 [2024-10-07 11:29:11.605566] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.288 [2024-10-07 11:29:11.605583] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.288 [2024-10-07 11:29:11.605630] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.288 [2024-10-07 11:29:11.605653] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.289 [2024-10-07 11:29:11.605668] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.289 [2024-10-07 11:29:11.605780] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.289 [2024-10-07 11:29:11.605808] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.289 [2024-10-07 11:29:11.605889] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.289 [2024-10-07 11:29:11.605908] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.289 [2024-10-07 11:29:11.605922] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.289 [2024-10-07 11:29:11.605939] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.289 [2024-10-07 11:29:11.605953] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.289 [2024-10-07 11:29:11.605981] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.289 [2024-10-07 11:29:11.608621] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.289 [2024-10-07 11:29:11.608658] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.289 [2024-10-07 11:29:11.615418] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.289 [2024-10-07 11:29:11.615509] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.289 [2024-10-07 11:29:11.615595] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.289 [2024-10-07 11:29:11.615623] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.289 [2024-10-07 11:29:11.615640] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.289 [2024-10-07 11:29:11.615695] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.289 [2024-10-07 11:29:11.615718] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.289 [2024-10-07 11:29:11.615734] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.289 [2024-10-07 11:29:11.615752] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.289 [2024-10-07 11:29:11.615776] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.289 [2024-10-07 11:29:11.615793] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.289 [2024-10-07 11:29:11.615806] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.289 [2024-10-07 11:29:11.615838] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.289 [2024-10-07 11:29:11.615864] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.289 [2024-10-07 11:29:11.615880] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.289 [2024-10-07 11:29:11.615893] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.289 [2024-10-07 11:29:11.615907] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.289 [2024-10-07 11:29:11.615927] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.289 [2024-10-07 11:29:11.628132] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.289 [2024-10-07 11:29:11.628182] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.289 [2024-10-07 11:29:11.628283] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.289 [2024-10-07 11:29:11.628312] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.289 [2024-10-07 11:29:11.628329] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.289 [2024-10-07 11:29:11.628376] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.289 [2024-10-07 11:29:11.628398] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.289 [2024-10-07 11:29:11.628414] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.289 [2024-10-07 11:29:11.628452] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.289 [2024-10-07 11:29:11.628474] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.289 [2024-10-07 11:29:11.628494] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.289 [2024-10-07 11:29:11.628509] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.289 [2024-10-07 11:29:11.628522] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.289 [2024-10-07 11:29:11.628539] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.289 [2024-10-07 11:29:11.628553] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.289 [2024-10-07 11:29:11.628566] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.289 [2024-10-07 11:29:11.628589] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.289 [2024-10-07 11:29:11.628603] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.289 [2024-10-07 11:29:11.642204] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.289 [2024-10-07 11:29:11.642254] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.289 [2024-10-07 11:29:11.642591] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.289 [2024-10-07 11:29:11.642634] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.289 [2024-10-07 11:29:11.642653] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.289 [2024-10-07 11:29:11.642703] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.289 [2024-10-07 11:29:11.642726] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.289 [2024-10-07 11:29:11.642756] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.289 [2024-10-07 11:29:11.642812] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.289 [2024-10-07 11:29:11.642838] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.289 [2024-10-07 11:29:11.642859] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.289 [2024-10-07 11:29:11.642874] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.289 [2024-10-07 11:29:11.642888] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.289 [2024-10-07 11:29:11.642905] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.289 [2024-10-07 11:29:11.642919] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.289 [2024-10-07 11:29:11.642932] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.289 [2024-10-07 11:29:11.642956] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.289 [2024-10-07 11:29:11.642970] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.289 [2024-10-07 11:29:11.655621] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.289 [2024-10-07 11:29:11.655671] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.289 [2024-10-07 11:29:11.655756] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.289 [2024-10-07 11:29:11.655785] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.289 [2024-10-07 11:29:11.655802] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.289 [2024-10-07 11:29:11.655864] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.289 [2024-10-07 11:29:11.655886] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.289 [2024-10-07 11:29:11.655901] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.289 [2024-10-07 11:29:11.655924] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.290 [2024-10-07 11:29:11.655943] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.290 [2024-10-07 11:29:11.655962] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.290 [2024-10-07 11:29:11.655976] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.290 [2024-10-07 11:29:11.655989] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.290 [2024-10-07 11:29:11.656005] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.290 [2024-10-07 11:29:11.656019] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.290 [2024-10-07 11:29:11.656031] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.290 [2024-10-07 11:29:11.656062] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.290 [2024-10-07 11:29:11.656076] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.290 [2024-10-07 11:29:11.669619] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.290 [2024-10-07 11:29:11.669683] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.290 [2024-10-07 11:29:11.670010] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.290 [2024-10-07 11:29:11.670055] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.290 [2024-10-07 11:29:11.670074] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.290 [2024-10-07 11:29:11.670125] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.290 [2024-10-07 11:29:11.670148] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.290 [2024-10-07 11:29:11.670164] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.290 [2024-10-07 11:29:11.670297] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.290 [2024-10-07 11:29:11.670342] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.290 [2024-10-07 11:29:11.670461] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.290 [2024-10-07 11:29:11.670483] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.290 [2024-10-07 11:29:11.670498] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.290 [2024-10-07 11:29:11.670515] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.290 [2024-10-07 11:29:11.670529] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.290 [2024-10-07 11:29:11.670543] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.290 [2024-10-07 11:29:11.671004] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.290 [2024-10-07 11:29:11.671038] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.290 [2024-10-07 11:29:11.680637] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.290 [2024-10-07 11:29:11.680690] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.290 [2024-10-07 11:29:11.680891] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.290 [2024-10-07 11:29:11.680923] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.290 [2024-10-07 11:29:11.680941] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.290 [2024-10-07 11:29:11.680987] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.290 [2024-10-07 11:29:11.681011] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.290 [2024-10-07 11:29:11.681027] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.290 [2024-10-07 11:29:11.681139] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.290 [2024-10-07 11:29:11.681165] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.290 [2024-10-07 11:29:11.681262] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.290 [2024-10-07 11:29:11.681281] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.290 [2024-10-07 11:29:11.681296] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.290 [2024-10-07 11:29:11.681331] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.290 [2024-10-07 11:29:11.681348] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.290 [2024-10-07 11:29:11.681361] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.290 [2024-10-07 11:29:11.682584] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.290 [2024-10-07 11:29:11.682624] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.290 [2024-10-07 11:29:11.692858] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.290 [2024-10-07 11:29:11.695057] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.290 [2024-10-07 11:29:11.695160] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.290 [2024-10-07 11:29:11.695190] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.290 [2024-10-07 11:29:11.695207] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.290 [2024-10-07 11:29:11.695522] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.290 [2024-10-07 11:29:11.695577] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.290 [2024-10-07 11:29:11.695600] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.290 [2024-10-07 11:29:11.695630] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.290 [2024-10-07 11:29:11.695701] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.290 [2024-10-07 11:29:11.695726] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.290 [2024-10-07 11:29:11.695741] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.290 [2024-10-07 11:29:11.695755] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.290 [2024-10-07 11:29:11.695780] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.290 [2024-10-07 11:29:11.695796] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.290 [2024-10-07 11:29:11.695809] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.290 [2024-10-07 11:29:11.695822] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.290 [2024-10-07 11:29:11.696044] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.290 [2024-10-07 11:29:11.704680] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.290 [2024-10-07 11:29:11.704858] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.290 [2024-10-07 11:29:11.704889] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.290 [2024-10-07 11:29:11.704906] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.290 [2024-10-07 11:29:11.704929] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.290 [2024-10-07 11:29:11.704950] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.290 [2024-10-07 11:29:11.704964] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.290 [2024-10-07 11:29:11.704993] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.290 [2024-10-07 11:29:11.705034] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.290 [2024-10-07 11:29:11.705133] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.291 [2024-10-07 11:29:11.705205] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.291 [2024-10-07 11:29:11.705231] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.291 [2024-10-07 11:29:11.705248] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.291 [2024-10-07 11:29:11.705271] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.291 [2024-10-07 11:29:11.705292] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.291 [2024-10-07 11:29:11.705306] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.291 [2024-10-07 11:29:11.705320] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.291 [2024-10-07 11:29:11.705341] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.291 [2024-10-07 11:29:11.715529] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.291 [2024-10-07 11:29:11.715675] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.291 [2024-10-07 11:29:11.715759] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.291 [2024-10-07 11:29:11.715787] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.291 [2024-10-07 11:29:11.715804] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.291 [2024-10-07 11:29:11.715857] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.291 [2024-10-07 11:29:11.715880] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.291 [2024-10-07 11:29:11.715896] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.291 [2024-10-07 11:29:11.715914] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.291 [2024-10-07 11:29:11.715938] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.291 [2024-10-07 11:29:11.715955] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.291 [2024-10-07 11:29:11.715969] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.291 [2024-10-07 11:29:11.715983] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.291 [2024-10-07 11:29:11.716006] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.291 [2024-10-07 11:29:11.716021] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.291 [2024-10-07 11:29:11.716034] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.291 [2024-10-07 11:29:11.716047] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.291 [2024-10-07 11:29:11.716069] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.291 [2024-10-07 11:29:11.725606] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.291 [2024-10-07 11:29:11.725724] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.291 [2024-10-07 11:29:11.725770] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.291 [2024-10-07 11:29:11.725789] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.291 [2024-10-07 11:29:11.725813] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.291 [2024-10-07 11:29:11.725848] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.291 [2024-10-07 11:29:11.725865] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.291 [2024-10-07 11:29:11.725878] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.291 [2024-10-07 11:29:11.725902] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.291 [2024-10-07 11:29:11.725920] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.291 [2024-10-07 11:29:11.726011] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.291 [2024-10-07 11:29:11.726048] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.291 [2024-10-07 11:29:11.726064] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.291 [2024-10-07 11:29:11.726086] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.291 [2024-10-07 11:29:11.726108] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.291 [2024-10-07 11:29:11.726124] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.291 [2024-10-07 11:29:11.726137] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.291 [2024-10-07 11:29:11.726167] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.291 [2024-10-07 11:29:11.736279] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.291 [2024-10-07 11:29:11.736390] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.291 [2024-10-07 11:29:11.736483] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.291 [2024-10-07 11:29:11.736513] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.291 [2024-10-07 11:29:11.736530] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.291 [2024-10-07 11:29:11.736584] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.291 [2024-10-07 11:29:11.736608] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.291 [2024-10-07 11:29:11.736624] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.291 [2024-10-07 11:29:11.736642] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.291 [2024-10-07 11:29:11.736666] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.291 [2024-10-07 11:29:11.736683] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.291 [2024-10-07 11:29:11.736696] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.291 [2024-10-07 11:29:11.736710] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.291 [2024-10-07 11:29:11.736733] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.291 [2024-10-07 11:29:11.736763] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.291 [2024-10-07 11:29:11.736778] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.291 [2024-10-07 11:29:11.736791] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.291 [2024-10-07 11:29:11.736812] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.291 [2024-10-07 11:29:11.748903] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.291 [2024-10-07 11:29:11.748968] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.291 [2024-10-07 11:29:11.749268] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.291 [2024-10-07 11:29:11.749311] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.291 [2024-10-07 11:29:11.749330] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.291 [2024-10-07 11:29:11.749379] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.291 [2024-10-07 11:29:11.749402] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.291 [2024-10-07 11:29:11.749432] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.291 [2024-10-07 11:29:11.749502] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.291 [2024-10-07 11:29:11.749530] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.291 [2024-10-07 11:29:11.749566] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.291 [2024-10-07 11:29:11.749584] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.291 [2024-10-07 11:29:11.749598] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.291 [2024-10-07 11:29:11.749615] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.291 [2024-10-07 11:29:11.749630] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.291 [2024-10-07 11:29:11.749643] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.291 [2024-10-07 11:29:11.749666] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.291 [2024-10-07 11:29:11.749680] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.291 [2024-10-07 11:29:11.760204] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.291 [2024-10-07 11:29:11.760252] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.291 [2024-10-07 11:29:11.760464] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.291 [2024-10-07 11:29:11.760494] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.291 [2024-10-07 11:29:11.760511] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.291 [2024-10-07 11:29:11.760557] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.291 [2024-10-07 11:29:11.760595] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.291 [2024-10-07 11:29:11.760611] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.291 [2024-10-07 11:29:11.760716] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.291 [2024-10-07 11:29:11.760773] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.291 [2024-10-07 11:29:11.760889] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.291 [2024-10-07 11:29:11.760909] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.291 [2024-10-07 11:29:11.760923] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.292 [2024-10-07 11:29:11.760940] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.292 [2024-10-07 11:29:11.760954] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.292 [2024-10-07 11:29:11.760967] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.292 [2024-10-07 11:29:11.761067] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.292 [2024-10-07 11:29:11.761085] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.292 [2024-10-07 11:29:11.770345] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.292 [2024-10-07 11:29:11.770419] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.292 [2024-10-07 11:29:11.770517] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.292 [2024-10-07 11:29:11.770561] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.292 [2024-10-07 11:29:11.770578] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.292 [2024-10-07 11:29:11.770777] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.292 [2024-10-07 11:29:11.770808] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.292 [2024-10-07 11:29:11.770825] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.292 [2024-10-07 11:29:11.770843] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.292 [2024-10-07 11:29:11.770983] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.292 [2024-10-07 11:29:11.771018] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.292 [2024-10-07 11:29:11.771040] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.292 [2024-10-07 11:29:11.771058] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.292 [2024-10-07 11:29:11.771162] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.292 [2024-10-07 11:29:11.771181] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.292 [2024-10-07 11:29:11.771195] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.292 [2024-10-07 11:29:11.771209] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.292 [2024-10-07 11:29:11.771334] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.292 [2024-10-07 11:29:11.780452] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.292 [2024-10-07 11:29:11.780569] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.292 [2024-10-07 11:29:11.780601] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.292 [2024-10-07 11:29:11.780633] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.292 [2024-10-07 11:29:11.780673] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.292 [2024-10-07 11:29:11.781893] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.292 [2024-10-07 11:29:11.781946] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.292 [2024-10-07 11:29:11.781975] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.292 [2024-10-07 11:29:11.781991] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.292 [2024-10-07 11:29:11.782283] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.292 [2024-10-07 11:29:11.782356] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.292 [2024-10-07 11:29:11.782382] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.292 [2024-10-07 11:29:11.782399] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.292 [2024-10-07 11:29:11.782462] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.292 [2024-10-07 11:29:11.782491] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.292 [2024-10-07 11:29:11.782508] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.292 [2024-10-07 11:29:11.782521] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.292 [2024-10-07 11:29:11.782544] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.292 [2024-10-07 11:29:11.793326] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.292 [2024-10-07 11:29:11.793466] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.292 [2024-10-07 11:29:11.793548] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.292 [2024-10-07 11:29:11.793575] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.292 [2024-10-07 11:29:11.793592] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.292 [2024-10-07 11:29:11.793880] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.292 [2024-10-07 11:29:11.793921] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.292 [2024-10-07 11:29:11.793940] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.292 [2024-10-07 11:29:11.793959] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.292 [2024-10-07 11:29:11.794121] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.292 [2024-10-07 11:29:11.794147] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.292 [2024-10-07 11:29:11.794162] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.292 [2024-10-07 11:29:11.794176] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.292 [2024-10-07 11:29:11.794277] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.292 [2024-10-07 11:29:11.794296] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.292 [2024-10-07 11:29:11.794327] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.292 [2024-10-07 11:29:11.794342] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.292 [2024-10-07 11:29:11.794478] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.292 [2024-10-07 11:29:11.806195] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.292 [2024-10-07 11:29:11.806247] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.292 [2024-10-07 11:29:11.808634] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.292 [2024-10-07 11:29:11.808678] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.292 [2024-10-07 11:29:11.808697] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.292 [2024-10-07 11:29:11.808746] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.292 [2024-10-07 11:29:11.808770] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.292 [2024-10-07 11:29:11.808785] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.292 [2024-10-07 11:29:11.809063] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.292 [2024-10-07 11:29:11.809095] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.292 [2024-10-07 11:29:11.809144] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.292 [2024-10-07 11:29:11.809165] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.292 [2024-10-07 11:29:11.809179] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.292 [2024-10-07 11:29:11.809196] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.292 [2024-10-07 11:29:11.809211] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.292 [2024-10-07 11:29:11.809224] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.292 [2024-10-07 11:29:11.809373] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.292 [2024-10-07 11:29:11.809398] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.292 [2024-10-07 11:29:11.816311] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.292 [2024-10-07 11:29:11.816374] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.292 [2024-10-07 11:29:11.816470] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.292 [2024-10-07 11:29:11.816500] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.292 [2024-10-07 11:29:11.816524] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.292 [2024-10-07 11:29:11.816591] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.292 [2024-10-07 11:29:11.816622] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.292 [2024-10-07 11:29:11.816648] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.292 [2024-10-07 11:29:11.816666] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.292 [2024-10-07 11:29:11.816690] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.292 [2024-10-07 11:29:11.816727] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.292 [2024-10-07 11:29:11.816742] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.292 [2024-10-07 11:29:11.816756] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.292 [2024-10-07 11:29:11.816780] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.292 [2024-10-07 11:29:11.816795] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.292 [2024-10-07 11:29:11.816808] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.292 [2024-10-07 11:29:11.816823] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.292 [2024-10-07 11:29:11.816843] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.292 [2024-10-07 11:29:11.830116] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.292 [2024-10-07 11:29:11.830166] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.293 [2024-10-07 11:29:11.830252] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.293 [2024-10-07 11:29:11.830280] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.293 [2024-10-07 11:29:11.830297] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.293 [2024-10-07 11:29:11.830344] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.293 [2024-10-07 11:29:11.830366] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.293 [2024-10-07 11:29:11.830397] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.293 [2024-10-07 11:29:11.830436] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.293 [2024-10-07 11:29:11.830474] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.293 [2024-10-07 11:29:11.830496] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.293 [2024-10-07 11:29:11.830511] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.293 [2024-10-07 11:29:11.830524] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.293 [2024-10-07 11:29:11.830541] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.293 [2024-10-07 11:29:11.830555] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.293 [2024-10-07 11:29:11.830568] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.293 [2024-10-07 11:29:11.830591] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.293 [2024-10-07 11:29:11.830605] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.293 [2024-10-07 11:29:11.841640] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.293 [2024-10-07 11:29:11.841692] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.293 [2024-10-07 11:29:11.841890] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.293 [2024-10-07 11:29:11.841922] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.293 [2024-10-07 11:29:11.841956] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.293 [2024-10-07 11:29:11.842021] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.293 [2024-10-07 11:29:11.842045] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.293 [2024-10-07 11:29:11.842061] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.293 [2024-10-07 11:29:11.842203] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.293 [2024-10-07 11:29:11.842233] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.293 [2024-10-07 11:29:11.842369] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.293 [2024-10-07 11:29:11.842393] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.293 [2024-10-07 11:29:11.842408] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.293 [2024-10-07 11:29:11.842442] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.293 [2024-10-07 11:29:11.842457] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.293 [2024-10-07 11:29:11.842471] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.293 [2024-10-07 11:29:11.842890] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.293 [2024-10-07 11:29:11.842924] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.293 [2024-10-07 11:29:11.851755] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.293 [2024-10-07 11:29:11.851819] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.293 [2024-10-07 11:29:11.851895] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.293 [2024-10-07 11:29:11.851923] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.293 [2024-10-07 11:29:11.851940] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.293 [2024-10-07 11:29:11.851994] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.293 [2024-10-07 11:29:11.852017] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.293 [2024-10-07 11:29:11.852033] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.293 [2024-10-07 11:29:11.852051] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.293 [2024-10-07 11:29:11.852075] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.293 [2024-10-07 11:29:11.852092] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.293 [2024-10-07 11:29:11.852106] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.293 [2024-10-07 11:29:11.852119] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.293 [2024-10-07 11:29:11.852142] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.293 [2024-10-07 11:29:11.852156] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.293 [2024-10-07 11:29:11.852169] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.293 [2024-10-07 11:29:11.852203] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.293 [2024-10-07 11:29:11.852226] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.293 [2024-10-07 11:29:11.861851] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.293 [2024-10-07 11:29:11.862010] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.293 [2024-10-07 11:29:11.862042] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.293 [2024-10-07 11:29:11.862061] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.293 [2024-10-07 11:29:11.862086] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.293 [2024-10-07 11:29:11.862117] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.293 [2024-10-07 11:29:11.862179] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.293 [2024-10-07 11:29:11.862204] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.293 [2024-10-07 11:29:11.862219] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.293 [2024-10-07 11:29:11.862234] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.293 [2024-10-07 11:29:11.862247] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.293 [2024-10-07 11:29:11.862261] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.293 [2024-10-07 11:29:11.862283] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.293 [2024-10-07 11:29:11.862301] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.293 [2024-10-07 11:29:11.862337] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.293 [2024-10-07 11:29:11.862350] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.293 [2024-10-07 11:29:11.862363] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.293 [2024-10-07 11:29:11.862383] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.293 [2024-10-07 11:29:11.872288] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.293 [2024-10-07 11:29:11.872483] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.293 [2024-10-07 11:29:11.872574] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.293 [2024-10-07 11:29:11.872603] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.293 [2024-10-07 11:29:11.872620] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.293 [2024-10-07 11:29:11.872788] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.293 [2024-10-07 11:29:11.872816] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.293 [2024-10-07 11:29:11.872833] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.293 [2024-10-07 11:29:11.872851] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.293 [2024-10-07 11:29:11.872980] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.293 [2024-10-07 11:29:11.873006] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.293 [2024-10-07 11:29:11.873038] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.293 [2024-10-07 11:29:11.873053] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.293 [2024-10-07 11:29:11.873193] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.293 [2024-10-07 11:29:11.873226] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.294 [2024-10-07 11:29:11.873245] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.294 [2024-10-07 11:29:11.873259] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.294 [2024-10-07 11:29:11.873373] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.294 [2024-10-07 11:29:11.882766] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.294 [2024-10-07 11:29:11.882835] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.294 [2024-10-07 11:29:11.882914] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.294 [2024-10-07 11:29:11.882942] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.294 [2024-10-07 11:29:11.882959] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.294 [2024-10-07 11:29:11.883012] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.294 [2024-10-07 11:29:11.883036] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.294 [2024-10-07 11:29:11.883052] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.294 [2024-10-07 11:29:11.883070] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.294 [2024-10-07 11:29:11.883124] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.294 [2024-10-07 11:29:11.883140] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.294 [2024-10-07 11:29:11.883153] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.294 [2024-10-07 11:29:11.883165] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.294 [2024-10-07 11:29:11.883186] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.294 [2024-10-07 11:29:11.883200] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.294 [2024-10-07 11:29:11.883213] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.294 [2024-10-07 11:29:11.883225] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.294 [2024-10-07 11:29:11.883244] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.294 [2024-10-07 11:29:11.893871] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.294 [2024-10-07 11:29:11.893918] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.294 [2024-10-07 11:29:11.894182] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.294 [2024-10-07 11:29:11.894214] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.294 [2024-10-07 11:29:11.894232] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.294 [2024-10-07 11:29:11.894298] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.294 [2024-10-07 11:29:11.894338] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.294 [2024-10-07 11:29:11.894353] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.294 [2024-10-07 11:29:11.894473] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.294 [2024-10-07 11:29:11.894500] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.294 [2024-10-07 11:29:11.894613] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.294 [2024-10-07 11:29:11.894632] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.294 [2024-10-07 11:29:11.894646] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.294 [2024-10-07 11:29:11.894662] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.294 [2024-10-07 11:29:11.894675] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.294 [2024-10-07 11:29:11.894707] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.294 [2024-10-07 11:29:11.894830] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.294 [2024-10-07 11:29:11.894851] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.294 [2024-10-07 11:29:11.904327] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.294 [2024-10-07 11:29:11.904377] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.294 [2024-10-07 11:29:11.904556] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.294 [2024-10-07 11:29:11.904587] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.294 [2024-10-07 11:29:11.904603] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.294 [2024-10-07 11:29:11.904650] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.294 [2024-10-07 11:29:11.904672] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.294 [2024-10-07 11:29:11.904688] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.294 [2024-10-07 11:29:11.904803] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.294 [2024-10-07 11:29:11.904826] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.294 [2024-10-07 11:29:11.904934] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.294 [2024-10-07 11:29:11.904951] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.294 [2024-10-07 11:29:11.904964] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.294 [2024-10-07 11:29:11.904980] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.294 [2024-10-07 11:29:11.904993] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.294 [2024-10-07 11:29:11.905006] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.294 [2024-10-07 11:29:11.905038] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.294 [2024-10-07 11:29:11.905068] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.294 [2024-10-07 11:29:11.914436] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.294 [2024-10-07 11:29:11.914562] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.294 [2024-10-07 11:29:11.914591] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.294 [2024-10-07 11:29:11.914608] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.294 [2024-10-07 11:29:11.916182] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.294 [2024-10-07 11:29:11.916252] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.294 [2024-10-07 11:29:11.916963] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.294 [2024-10-07 11:29:11.917002] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.294 [2024-10-07 11:29:11.917036] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.294 [2024-10-07 11:29:11.917051] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.294 [2024-10-07 11:29:11.917063] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.294 [2024-10-07 11:29:11.917076] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.294 [2024-10-07 11:29:11.917334] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.294 [2024-10-07 11:29:11.917377] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.294 [2024-10-07 11:29:11.917512] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.294 [2024-10-07 11:29:11.917536] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.294 [2024-10-07 11:29:11.917551] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.294 [2024-10-07 11:29:11.917714] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.294 [2024-10-07 11:29:11.925604] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.294 [2024-10-07 11:29:11.927348] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.294 [2024-10-07 11:29:11.927393] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.294 [2024-10-07 11:29:11.927437] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.294 [2024-10-07 11:29:11.928061] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.294 [2024-10-07 11:29:11.928327] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.294 [2024-10-07 11:29:11.928376] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.294 [2024-10-07 11:29:11.928395] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.294 [2024-10-07 11:29:11.928421] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.294 [2024-10-07 11:29:11.928499] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.294 [2024-10-07 11:29:11.928575] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.294 [2024-10-07 11:29:11.928602] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.294 [2024-10-07 11:29:11.928636] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.294 [2024-10-07 11:29:11.928662] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.294 [2024-10-07 11:29:11.928685] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.294 [2024-10-07 11:29:11.928699] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.294 [2024-10-07 11:29:11.928713] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.294 [2024-10-07 11:29:11.928736] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.294 [2024-10-07 11:29:11.938388] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.294 [2024-10-07 11:29:11.938906] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.294 [2024-10-07 11:29:11.938949] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.295 [2024-10-07 11:29:11.938968] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.295 [2024-10-07 11:29:11.939020] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.295 [2024-10-07 11:29:11.939054] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.295 [2024-10-07 11:29:11.939115] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.295 [2024-10-07 11:29:11.939139] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.295 [2024-10-07 11:29:11.939154] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.295 [2024-10-07 11:29:11.939168] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.295 [2024-10-07 11:29:11.939180] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.295 [2024-10-07 11:29:11.939193] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.295 [2024-10-07 11:29:11.939215] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.295 [2024-10-07 11:29:11.939232] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.295 [2024-10-07 11:29:11.939253] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.295 [2024-10-07 11:29:11.939266] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.295 [2024-10-07 11:29:11.939279] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.295 [2024-10-07 11:29:11.939298] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.295 [2024-10-07 11:29:11.951965] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.295 [2024-10-07 11:29:11.952030] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.295 [2024-10-07 11:29:11.952130] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.295 [2024-10-07 11:29:11.952160] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.295 [2024-10-07 11:29:11.952177] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.295 [2024-10-07 11:29:11.952224] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.295 [2024-10-07 11:29:11.952264] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.295 [2024-10-07 11:29:11.952282] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.295 [2024-10-07 11:29:11.952307] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.295 [2024-10-07 11:29:11.952327] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.295 [2024-10-07 11:29:11.952347] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.295 [2024-10-07 11:29:11.952361] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.295 [2024-10-07 11:29:11.952374] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.295 [2024-10-07 11:29:11.952391] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.295 [2024-10-07 11:29:11.952405] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.295 [2024-10-07 11:29:11.952437] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.295 [2024-10-07 11:29:11.952462] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.295 [2024-10-07 11:29:11.952477] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.295 [2024-10-07 11:29:11.965940] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.295 [2024-10-07 11:29:11.966001] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.295 [2024-10-07 11:29:11.966087] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.295 [2024-10-07 11:29:11.966124] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.295 [2024-10-07 11:29:11.966141] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.295 [2024-10-07 11:29:11.966187] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.295 [2024-10-07 11:29:11.966209] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.295 [2024-10-07 11:29:11.966225] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.295 [2024-10-07 11:29:11.966249] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.295 [2024-10-07 11:29:11.966268] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.295 [2024-10-07 11:29:11.966288] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.295 [2024-10-07 11:29:11.966302] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.295 [2024-10-07 11:29:11.966316] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.295 [2024-10-07 11:29:11.966332] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.295 [2024-10-07 11:29:11.966347] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.295 [2024-10-07 11:29:11.966360] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.295 [2024-10-07 11:29:11.966383] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.295 [2024-10-07 11:29:11.966396] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.295 [2024-10-07 11:29:11.979446] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.295 [2024-10-07 11:29:11.979516] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.295 [2024-10-07 11:29:11.979604] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.295 [2024-10-07 11:29:11.979633] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.295 [2024-10-07 11:29:11.979651] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.295 [2024-10-07 11:29:11.979697] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.295 [2024-10-07 11:29:11.979720] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.295 [2024-10-07 11:29:11.979736] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.295 [2024-10-07 11:29:11.979760] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.295 [2024-10-07 11:29:11.979779] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.295 [2024-10-07 11:29:11.979799] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.295 [2024-10-07 11:29:11.979814] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.295 [2024-10-07 11:29:11.979827] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.295 [2024-10-07 11:29:11.979843] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.295 [2024-10-07 11:29:11.979858] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.295 [2024-10-07 11:29:11.979871] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.295 [2024-10-07 11:29:11.979894] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.295 [2024-10-07 11:29:11.979908] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.295 [2024-10-07 11:29:11.991266] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.295 [2024-10-07 11:29:11.991317] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.295 [2024-10-07 11:29:11.991514] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.295 [2024-10-07 11:29:11.991546] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.295 [2024-10-07 11:29:11.991564] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.295 [2024-10-07 11:29:11.991611] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.295 [2024-10-07 11:29:11.991634] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.295 [2024-10-07 11:29:11.991650] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.295 [2024-10-07 11:29:11.991893] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.295 [2024-10-07 11:29:11.991922] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.295 [2024-10-07 11:29:11.991970] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.295 [2024-10-07 11:29:11.992007] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.295 [2024-10-07 11:29:11.992022] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.295 [2024-10-07 11:29:11.992054] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.295 [2024-10-07 11:29:11.992071] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.295 [2024-10-07 11:29:11.992084] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.295 [2024-10-07 11:29:11.992108] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.295 [2024-10-07 11:29:11.992123] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.295 [2024-10-07 11:29:12.004879] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.295 [2024-10-07 11:29:12.004928] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.295 [2024-10-07 11:29:12.005239] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.295 [2024-10-07 11:29:12.005279] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.295 [2024-10-07 11:29:12.005297] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.295 [2024-10-07 11:29:12.005345] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.295 [2024-10-07 11:29:12.005376] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.296 [2024-10-07 11:29:12.005394] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.296 [2024-10-07 11:29:12.005533] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.296 [2024-10-07 11:29:12.005563] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.296 [2024-10-07 11:29:12.005763] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.296 [2024-10-07 11:29:12.005788] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.296 [2024-10-07 11:29:12.005806] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.296 [2024-10-07 11:29:12.005823] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.296 [2024-10-07 11:29:12.005838] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.296 [2024-10-07 11:29:12.005851] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.296 [2024-10-07 11:29:12.005904] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.296 [2024-10-07 11:29:12.005924] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.296 [2024-10-07 11:29:12.016073] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.296 [2024-10-07 11:29:12.016121] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.296 [2024-10-07 11:29:12.016323] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.296 [2024-10-07 11:29:12.016353] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.296 [2024-10-07 11:29:12.016370] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.296 [2024-10-07 11:29:12.016416] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.296 [2024-10-07 11:29:12.016470] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.296 [2024-10-07 11:29:12.016504] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.296 [2024-10-07 11:29:12.016655] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.296 [2024-10-07 11:29:12.016684] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.296 [2024-10-07 11:29:12.016818] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.296 [2024-10-07 11:29:12.016843] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.296 [2024-10-07 11:29:12.016857] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.296 [2024-10-07 11:29:12.016874] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.296 [2024-10-07 11:29:12.016889] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.296 [2024-10-07 11:29:12.016903] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.296 [2024-10-07 11:29:12.017026] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.296 [2024-10-07 11:29:12.017047] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.296 [2024-10-07 11:29:12.026375] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.296 [2024-10-07 11:29:12.026436] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.296 [2024-10-07 11:29:12.026524] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.296 [2024-10-07 11:29:12.026553] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.296 [2024-10-07 11:29:12.026571] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.296 [2024-10-07 11:29:12.026618] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.296 [2024-10-07 11:29:12.026640] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.296 [2024-10-07 11:29:12.026656] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.296 [2024-10-07 11:29:12.026679] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.296 [2024-10-07 11:29:12.026699] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.296 [2024-10-07 11:29:12.026719] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.296 [2024-10-07 11:29:12.026734] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.296 [2024-10-07 11:29:12.026747] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.296 [2024-10-07 11:29:12.026763] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.296 [2024-10-07 11:29:12.026778] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.296 [2024-10-07 11:29:12.026790] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.296 [2024-10-07 11:29:12.026813] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.296 [2024-10-07 11:29:12.026828] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.296 [2024-10-07 11:29:12.036974] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.296 [2024-10-07 11:29:12.037022] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.296 [2024-10-07 11:29:12.037934] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.296 [2024-10-07 11:29:12.037999] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.296 [2024-10-07 11:29:12.038021] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.296 [2024-10-07 11:29:12.038071] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.296 [2024-10-07 11:29:12.038094] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.296 [2024-10-07 11:29:12.038110] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.296 [2024-10-07 11:29:12.040235] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.296 [2024-10-07 11:29:12.040281] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.296 [2024-10-07 11:29:12.040810] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.296 [2024-10-07 11:29:12.040847] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.296 [2024-10-07 11:29:12.040864] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.296 [2024-10-07 11:29:12.040882] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.296 [2024-10-07 11:29:12.040897] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.296 [2024-10-07 11:29:12.040910] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.296 [2024-10-07 11:29:12.041207] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.296 [2024-10-07 11:29:12.041233] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.296 [2024-10-07 11:29:12.047356] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.296 [2024-10-07 11:29:12.047448] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.296 [2024-10-07 11:29:12.047635] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.296 [2024-10-07 11:29:12.047665] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.296 [2024-10-07 11:29:12.047682] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.296 [2024-10-07 11:29:12.047729] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.296 [2024-10-07 11:29:12.047751] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.296 [2024-10-07 11:29:12.047766] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.296 [2024-10-07 11:29:12.049167] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.296 [2024-10-07 11:29:12.049206] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.296 [2024-10-07 11:29:12.051763] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.296 [2024-10-07 11:29:12.051817] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.296 [2024-10-07 11:29:12.051837] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.296 [2024-10-07 11:29:12.051855] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.296 [2024-10-07 11:29:12.051885] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.296 [2024-10-07 11:29:12.051900] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.296 [2024-10-07 11:29:12.053096] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.296 [2024-10-07 11:29:12.053148] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.296 [2024-10-07 11:29:12.057524] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.296 [2024-10-07 11:29:12.057601] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.296 [2024-10-07 11:29:12.057676] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.296 [2024-10-07 11:29:12.057704] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.296 [2024-10-07 11:29:12.057720] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.296 [2024-10-07 11:29:12.057772] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.296 [2024-10-07 11:29:12.057795] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.296 [2024-10-07 11:29:12.057810] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.296 [2024-10-07 11:29:12.057828] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.296 [2024-10-07 11:29:12.059632] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.296 [2024-10-07 11:29:12.059675] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.296 [2024-10-07 11:29:12.059692] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.296 [2024-10-07 11:29:12.059706] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.296 [2024-10-07 11:29:12.060369] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.296 [2024-10-07 11:29:12.060405] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.297 [2024-10-07 11:29:12.060456] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.297 [2024-10-07 11:29:12.060471] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.297 [2024-10-07 11:29:12.060775] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.297 [2024-10-07 11:29:12.070028] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.297 [2024-10-07 11:29:12.070084] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.297 [2024-10-07 11:29:12.070198] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.297 [2024-10-07 11:29:12.070228] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.297 [2024-10-07 11:29:12.070245] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.297 [2024-10-07 11:29:12.070292] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.297 [2024-10-07 11:29:12.070315] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.297 [2024-10-07 11:29:12.070346] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.297 [2024-10-07 11:29:12.070387] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.297 [2024-10-07 11:29:12.070408] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.297 [2024-10-07 11:29:12.070444] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.297 [2024-10-07 11:29:12.070462] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.297 [2024-10-07 11:29:12.070476] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.297 [2024-10-07 11:29:12.070492] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.297 [2024-10-07 11:29:12.070506] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.297 [2024-10-07 11:29:12.070519] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.297 [2024-10-07 11:29:12.070542] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.297 [2024-10-07 11:29:12.070555] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.297 [2024-10-07 11:29:12.080630] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.297 [2024-10-07 11:29:12.080680] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.297 [2024-10-07 11:29:12.080765] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.297 [2024-10-07 11:29:12.080795] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.297 [2024-10-07 11:29:12.080812] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.297 [2024-10-07 11:29:12.080860] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.297 [2024-10-07 11:29:12.080883] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.297 [2024-10-07 11:29:12.080899] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.297 [2024-10-07 11:29:12.080922] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.297 [2024-10-07 11:29:12.080942] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.297 [2024-10-07 11:29:12.080961] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.297 [2024-10-07 11:29:12.080976] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.297 [2024-10-07 11:29:12.081005] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.297 [2024-10-07 11:29:12.081020] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.297 [2024-10-07 11:29:12.081034] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.297 [2024-10-07 11:29:12.081047] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.297 [2024-10-07 11:29:12.081069] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.297 [2024-10-07 11:29:12.081082] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.297 [2024-10-07 11:29:12.092948] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.297 [2024-10-07 11:29:12.093000] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.297 [2024-10-07 11:29:12.093116] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.297 [2024-10-07 11:29:12.093165] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.297 [2024-10-07 11:29:12.093185] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.297 [2024-10-07 11:29:12.093235] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.297 [2024-10-07 11:29:12.093258] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.297 [2024-10-07 11:29:12.093274] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.297 [2024-10-07 11:29:12.093299] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.297 [2024-10-07 11:29:12.093319] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.297 [2024-10-07 11:29:12.093339] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.297 [2024-10-07 11:29:12.093354] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.297 [2024-10-07 11:29:12.093367] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.297 [2024-10-07 11:29:12.093385] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.297 [2024-10-07 11:29:12.093429] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.297 [2024-10-07 11:29:12.093449] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.297 [2024-10-07 11:29:12.093475] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.297 [2024-10-07 11:29:12.093490] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.297 [2024-10-07 11:29:12.106049] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.297 [2024-10-07 11:29:12.106102] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.297 [2024-10-07 11:29:12.106405] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.297 [2024-10-07 11:29:12.106472] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.297 [2024-10-07 11:29:12.106493] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.297 [2024-10-07 11:29:12.106547] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.297 [2024-10-07 11:29:12.106570] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.297 [2024-10-07 11:29:12.106586] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.297 [2024-10-07 11:29:12.106656] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.297 [2024-10-07 11:29:12.106685] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.297 [2024-10-07 11:29:12.106717] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.297 [2024-10-07 11:29:12.106731] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.297 [2024-10-07 11:29:12.106745] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.297 [2024-10-07 11:29:12.106762] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.297 [2024-10-07 11:29:12.106776] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.297 [2024-10-07 11:29:12.106806] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.297 [2024-10-07 11:29:12.106832] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.297 [2024-10-07 11:29:12.106846] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.297 [2024-10-07 11:29:12.118851] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.297 [2024-10-07 11:29:12.118900] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.297 [2024-10-07 11:29:12.119534] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.297 [2024-10-07 11:29:12.119577] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.297 [2024-10-07 11:29:12.119597] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.297 [2024-10-07 11:29:12.119645] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.297 [2024-10-07 11:29:12.119668] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.297 [2024-10-07 11:29:12.119684] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.297 [2024-10-07 11:29:12.119927] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.297 [2024-10-07 11:29:12.119971] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.297 [2024-10-07 11:29:12.120026] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.297 [2024-10-07 11:29:12.120047] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.297 [2024-10-07 11:29:12.120062] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.297 [2024-10-07 11:29:12.120080] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.297 [2024-10-07 11:29:12.120095] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.297 [2024-10-07 11:29:12.120108] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.297 [2024-10-07 11:29:12.120132] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.297 [2024-10-07 11:29:12.120146] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.297 [2024-10-07 11:29:12.130359] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.297 [2024-10-07 11:29:12.130431] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.297 [2024-10-07 11:29:12.130551] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.297 [2024-10-07 11:29:12.130581] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.297 [2024-10-07 11:29:12.130598] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.298 [2024-10-07 11:29:12.130646] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.298 [2024-10-07 11:29:12.130668] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.298 [2024-10-07 11:29:12.130684] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.298 [2024-10-07 11:29:12.131752] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.298 [2024-10-07 11:29:12.131807] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.298 [2024-10-07 11:29:12.132024] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.298 [2024-10-07 11:29:12.132066] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.298 [2024-10-07 11:29:12.132081] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.298 [2024-10-07 11:29:12.132098] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.298 [2024-10-07 11:29:12.132112] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.298 [2024-10-07 11:29:12.132125] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.298 [2024-10-07 11:29:12.132242] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.298 [2024-10-07 11:29:12.132263] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.298 [2024-10-07 11:29:12.143715] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.298 [2024-10-07 11:29:12.143765] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.298 [2024-10-07 11:29:12.143998] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.298 [2024-10-07 11:29:12.144038] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.298 [2024-10-07 11:29:12.144063] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.298 [2024-10-07 11:29:12.144125] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.298 [2024-10-07 11:29:12.144149] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.298 [2024-10-07 11:29:12.144165] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.298 [2024-10-07 11:29:12.144269] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.298 [2024-10-07 11:29:12.144292] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.298 [2024-10-07 11:29:12.144405] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.298 [2024-10-07 11:29:12.144445] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.298 [2024-10-07 11:29:12.144460] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.298 [2024-10-07 11:29:12.144477] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.298 [2024-10-07 11:29:12.144492] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.298 [2024-10-07 11:29:12.144505] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.298 [2024-10-07 11:29:12.144545] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.298 [2024-10-07 11:29:12.144562] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.298 [2024-10-07 11:29:12.154109] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.298 [2024-10-07 11:29:12.154159] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.298 [2024-10-07 11:29:12.154361] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.298 [2024-10-07 11:29:12.154394] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.298 [2024-10-07 11:29:12.154443] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.298 [2024-10-07 11:29:12.154498] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.298 [2024-10-07 11:29:12.154522] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.298 [2024-10-07 11:29:12.154538] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.298 [2024-10-07 11:29:12.154653] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.298 [2024-10-07 11:29:12.154678] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.298 [2024-10-07 11:29:12.154915] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.298 [2024-10-07 11:29:12.154947] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.298 [2024-10-07 11:29:12.154963] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.298 [2024-10-07 11:29:12.154980] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.298 [2024-10-07 11:29:12.154995] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.298 [2024-10-07 11:29:12.155008] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.298 [2024-10-07 11:29:12.155143] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.298 [2024-10-07 11:29:12.155166] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.298 [2024-10-07 11:29:12.164288] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.298 [2024-10-07 11:29:12.164338] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.298 [2024-10-07 11:29:12.164445] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.298 [2024-10-07 11:29:12.164479] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.298 [2024-10-07 11:29:12.164497] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.298 [2024-10-07 11:29:12.164548] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.298 [2024-10-07 11:29:12.164571] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.298 [2024-10-07 11:29:12.164587] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.298 [2024-10-07 11:29:12.164611] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.298 [2024-10-07 11:29:12.164631] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.298 [2024-10-07 11:29:12.164668] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.298 [2024-10-07 11:29:12.164686] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.298 [2024-10-07 11:29:12.164700] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.298 [2024-10-07 11:29:12.164716] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.298 [2024-10-07 11:29:12.164731] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.298 [2024-10-07 11:29:12.164744] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.298 [2024-10-07 11:29:12.164782] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.298 [2024-10-07 11:29:12.164799] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.298 [2024-10-07 11:29:12.174402] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.298 [2024-10-07 11:29:12.174483] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.298 [2024-10-07 11:29:12.174559] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.298 [2024-10-07 11:29:12.174588] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.298 [2024-10-07 11:29:12.174604] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.298 [2024-10-07 11:29:12.174657] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.298 [2024-10-07 11:29:12.174681] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.298 [2024-10-07 11:29:12.174696] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.298 [2024-10-07 11:29:12.174714] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.298 [2024-10-07 11:29:12.174738] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.298 [2024-10-07 11:29:12.174755] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.298 [2024-10-07 11:29:12.174768] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.298 [2024-10-07 11:29:12.174782] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.298 [2024-10-07 11:29:12.174805] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.298 [2024-10-07 11:29:12.174820] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.298 [2024-10-07 11:29:12.174832] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.298 [2024-10-07 11:29:12.174845] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.299 [2024-10-07 11:29:12.177099] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.299 [2024-10-07 11:29:12.184497] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.299 [2024-10-07 11:29:12.184625] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.299 [2024-10-07 11:29:12.184655] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.299 [2024-10-07 11:29:12.184672] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.299 [2024-10-07 11:29:12.184710] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.299 [2024-10-07 11:29:12.184740] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.299 [2024-10-07 11:29:12.184767] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.299 [2024-10-07 11:29:12.184782] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.299 [2024-10-07 11:29:12.184796] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.299 [2024-10-07 11:29:12.184817] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.299 [2024-10-07 11:29:12.184868] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.299 [2024-10-07 11:29:12.184909] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.299 [2024-10-07 11:29:12.184927] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.299 [2024-10-07 11:29:12.184951] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.299 [2024-10-07 11:29:12.184973] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.299 [2024-10-07 11:29:12.184987] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.299 [2024-10-07 11:29:12.185001] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.299 [2024-10-07 11:29:12.185023] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.299 [2024-10-07 11:29:12.199020] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.299 [2024-10-07 11:29:12.199072] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.299 [2024-10-07 11:29:12.199175] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.299 [2024-10-07 11:29:12.199220] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.299 [2024-10-07 11:29:12.199237] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.299 [2024-10-07 11:29:12.199282] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.299 [2024-10-07 11:29:12.199303] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.299 [2024-10-07 11:29:12.199318] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.299 [2024-10-07 11:29:12.199341] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.299 [2024-10-07 11:29:12.199360] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.299 [2024-10-07 11:29:12.199379] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.299 [2024-10-07 11:29:12.199393] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.299 [2024-10-07 11:29:12.199406] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.299 [2024-10-07 11:29:12.199422] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.299 [2024-10-07 11:29:12.199435] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.299 [2024-10-07 11:29:12.199465] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.299 [2024-10-07 11:29:12.199490] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.299 [2024-10-07 11:29:12.199504] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.299 [2024-10-07 11:29:12.210517] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.299 [2024-10-07 11:29:12.210567] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.299 [2024-10-07 11:29:12.210751] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.299 [2024-10-07 11:29:12.210782] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.299 [2024-10-07 11:29:12.210799] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.299 [2024-10-07 11:29:12.210866] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.299 [2024-10-07 11:29:12.210891] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.299 [2024-10-07 11:29:12.210906] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.299 [2024-10-07 11:29:12.211049] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.299 [2024-10-07 11:29:12.211075] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.299 [2024-10-07 11:29:12.211272] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.299 [2024-10-07 11:29:12.211296] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.299 [2024-10-07 11:29:12.211310] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.299 [2024-10-07 11:29:12.211327] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.299 [2024-10-07 11:29:12.211342] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.299 [2024-10-07 11:29:12.211354] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.299 [2024-10-07 11:29:12.213870] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.299 [2024-10-07 11:29:12.213908] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.299 [2024-10-07 11:29:12.220629] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.299 [2024-10-07 11:29:12.220708] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.299 [2024-10-07 11:29:12.220797] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.299 [2024-10-07 11:29:12.220824] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.299 [2024-10-07 11:29:12.220840] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.299 [2024-10-07 11:29:12.220892] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.299 [2024-10-07 11:29:12.220914] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.299 [2024-10-07 11:29:12.220929] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.299 [2024-10-07 11:29:12.220947] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.299 [2024-10-07 11:29:12.220970] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.299 [2024-10-07 11:29:12.220987] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.299 [2024-10-07 11:29:12.221000] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.299 [2024-10-07 11:29:12.221013] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.299 [2024-10-07 11:29:12.221035] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.299 [2024-10-07 11:29:12.221049] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.299 [2024-10-07 11:29:12.221062] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.299 [2024-10-07 11:29:12.221075] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.299 [2024-10-07 11:29:12.221111] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.299 [2024-10-07 11:29:12.230723] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.299 [2024-10-07 11:29:12.230857] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.299 [2024-10-07 11:29:12.230886] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.299 [2024-10-07 11:29:12.230903] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.299 [2024-10-07 11:29:12.230938] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.299 [2024-10-07 11:29:12.230965] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.299 [2024-10-07 11:29:12.230991] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.299 [2024-10-07 11:29:12.231006] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.299 [2024-10-07 11:29:12.231019] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.299 [2024-10-07 11:29:12.231220] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.299 [2024-10-07 11:29:12.231284] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.299 [2024-10-07 11:29:12.231310] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.299 [2024-10-07 11:29:12.231326] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.299 [2024-10-07 11:29:12.231721] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.299 [2024-10-07 11:29:12.231783] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.299 [2024-10-07 11:29:12.231804] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.299 [2024-10-07 11:29:12.231819] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.299 [2024-10-07 11:29:12.231843] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.299 [2024-10-07 11:29:12.242094] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.299 [2024-10-07 11:29:12.242554] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.299 [2024-10-07 11:29:12.242650] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.299 [2024-10-07 11:29:12.242679] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.299 [2024-10-07 11:29:12.242696] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.300 [2024-10-07 11:29:12.242957] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.300 [2024-10-07 11:29:12.242996] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.300 [2024-10-07 11:29:12.243014] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.300 [2024-10-07 11:29:12.243033] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.300 [2024-10-07 11:29:12.243229] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.300 [2024-10-07 11:29:12.243257] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.300 [2024-10-07 11:29:12.243288] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.300 [2024-10-07 11:29:12.243304] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.300 [2024-10-07 11:29:12.243364] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.300 [2024-10-07 11:29:12.243385] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.300 [2024-10-07 11:29:12.243398] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.300 [2024-10-07 11:29:12.243425] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.300 [2024-10-07 11:29:12.243597] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.300 [2024-10-07 11:29:12.256045] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.300 [2024-10-07 11:29:12.256096] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.300 [2024-10-07 11:29:12.256550] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.300 [2024-10-07 11:29:12.256592] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.300 [2024-10-07 11:29:12.256611] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.300 [2024-10-07 11:29:12.256661] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.300 [2024-10-07 11:29:12.256684] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.300 [2024-10-07 11:29:12.256700] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.300 [2024-10-07 11:29:12.256915] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.300 [2024-10-07 11:29:12.256946] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.300 [2024-10-07 11:29:12.257153] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.300 [2024-10-07 11:29:12.257180] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.300 [2024-10-07 11:29:12.257194] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.300 [2024-10-07 11:29:12.257211] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.300 [2024-10-07 11:29:12.257225] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.300 [2024-10-07 11:29:12.257239] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.300 [2024-10-07 11:29:12.257296] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.300 [2024-10-07 11:29:12.257316] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.300 [2024-10-07 11:29:12.269240] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.300 [2024-10-07 11:29:12.269300] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.300 [2024-10-07 11:29:12.270102] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.300 [2024-10-07 11:29:12.270147] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.300 [2024-10-07 11:29:12.270166] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.300 [2024-10-07 11:29:12.270215] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.300 [2024-10-07 11:29:12.270256] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.300 [2024-10-07 11:29:12.270274] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.300 [2024-10-07 11:29:12.270667] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.300 [2024-10-07 11:29:12.270708] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.300 [2024-10-07 11:29:12.270922] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.300 [2024-10-07 11:29:12.270955] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.300 [2024-10-07 11:29:12.270972] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.300 [2024-10-07 11:29:12.270989] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.300 [2024-10-07 11:29:12.271005] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.300 [2024-10-07 11:29:12.271018] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.300 [2024-10-07 11:29:12.271217] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.300 [2024-10-07 11:29:12.271241] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.300 [2024-10-07 11:29:12.283195] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.300 [2024-10-07 11:29:12.283245] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.300 [2024-10-07 11:29:12.284080] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.300 [2024-10-07 11:29:12.284123] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.300 [2024-10-07 11:29:12.284143] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.300 [2024-10-07 11:29:12.284192] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.300 [2024-10-07 11:29:12.284215] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.300 [2024-10-07 11:29:12.284231] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.300 [2024-10-07 11:29:12.284622] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.300 [2024-10-07 11:29:12.284653] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.300 [2024-10-07 11:29:12.284875] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.300 [2024-10-07 11:29:12.284909] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.300 [2024-10-07 11:29:12.284925] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.300 [2024-10-07 11:29:12.284942] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.300 [2024-10-07 11:29:12.284956] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.300 [2024-10-07 11:29:12.284969] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.300 [2024-10-07 11:29:12.285183] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.300 [2024-10-07 11:29:12.285207] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.300 [2024-10-07 11:29:12.297426] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.300 [2024-10-07 11:29:12.297469] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.300 [2024-10-07 11:29:12.298345] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.300 [2024-10-07 11:29:12.298394] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.300 [2024-10-07 11:29:12.298428] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.300 [2024-10-07 11:29:12.298482] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.300 [2024-10-07 11:29:12.298506] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.300 [2024-10-07 11:29:12.298521] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.300 [2024-10-07 11:29:12.299027] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.300 [2024-10-07 11:29:12.299070] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.300 [2024-10-07 11:29:12.299316] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.300 [2024-10-07 11:29:12.299351] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.300 [2024-10-07 11:29:12.299367] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.300 [2024-10-07 11:29:12.299384] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.300 [2024-10-07 11:29:12.299400] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.300 [2024-10-07 11:29:12.299429] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.300 [2024-10-07 11:29:12.299635] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.300 [2024-10-07 11:29:12.299660] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.300 [2024-10-07 11:29:12.311519] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.300 [2024-10-07 11:29:12.311568] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.300 [2024-10-07 11:29:12.312373] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.300 [2024-10-07 11:29:12.312428] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.300 [2024-10-07 11:29:12.312449] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.300 [2024-10-07 11:29:12.312500] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.300 [2024-10-07 11:29:12.312523] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.300 [2024-10-07 11:29:12.312539] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.300 [2024-10-07 11:29:12.312926] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.300 [2024-10-07 11:29:12.312966] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.300 [2024-10-07 11:29:12.313179] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.301 [2024-10-07 11:29:12.313213] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.301 [2024-10-07 11:29:12.313245] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.301 [2024-10-07 11:29:12.313266] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.301 [2024-10-07 11:29:12.313280] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.301 [2024-10-07 11:29:12.313293] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.301 [2024-10-07 11:29:12.313511] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.301 [2024-10-07 11:29:12.313538] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.301 [2024-10-07 11:29:12.325364] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.301 [2024-10-07 11:29:12.325439] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.301 [2024-10-07 11:29:12.326239] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.301 [2024-10-07 11:29:12.326290] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.301 [2024-10-07 11:29:12.326309] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.301 [2024-10-07 11:29:12.326358] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.301 [2024-10-07 11:29:12.326381] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.301 [2024-10-07 11:29:12.326397] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.301 [2024-10-07 11:29:12.326784] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.301 [2024-10-07 11:29:12.326833] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.301 [2024-10-07 11:29:12.327046] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.301 [2024-10-07 11:29:12.327080] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.301 [2024-10-07 11:29:12.327097] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.301 [2024-10-07 11:29:12.327114] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.301 [2024-10-07 11:29:12.327129] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.301 [2024-10-07 11:29:12.327143] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.301 [2024-10-07 11:29:12.327342] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.301 [2024-10-07 11:29:12.327367] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.301 [2024-10-07 11:29:12.339587] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.301 [2024-10-07 11:29:12.339638] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.301 [2024-10-07 11:29:12.340460] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.301 [2024-10-07 11:29:12.340516] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.301 [2024-10-07 11:29:12.340535] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.301 [2024-10-07 11:29:12.340586] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.301 [2024-10-07 11:29:12.340610] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.301 [2024-10-07 11:29:12.340641] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.301 [2024-10-07 11:29:12.341047] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.301 [2024-10-07 11:29:12.341082] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.301 [2024-10-07 11:29:12.341293] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.301 [2024-10-07 11:29:12.341327] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.301 [2024-10-07 11:29:12.341343] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.301 [2024-10-07 11:29:12.341360] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.301 [2024-10-07 11:29:12.341390] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.301 [2024-10-07 11:29:12.341420] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.301 [2024-10-07 11:29:12.341657] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.301 [2024-10-07 11:29:12.341684] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.301 [2024-10-07 11:29:12.353717] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.301 [2024-10-07 11:29:12.353766] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.301 [2024-10-07 11:29:12.354641] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.301 [2024-10-07 11:29:12.354698] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.301 [2024-10-07 11:29:12.354717] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.301 [2024-10-07 11:29:12.354766] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.301 [2024-10-07 11:29:12.354821] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.301 [2024-10-07 11:29:12.354836] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.301 [2024-10-07 11:29:12.355252] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.301 [2024-10-07 11:29:12.355310] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.301 [2024-10-07 11:29:12.355538] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.301 [2024-10-07 11:29:12.355573] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.301 [2024-10-07 11:29:12.355589] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.301 [2024-10-07 11:29:12.355607] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.301 [2024-10-07 11:29:12.355621] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.301 [2024-10-07 11:29:12.355635] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.301 [2024-10-07 11:29:12.355860] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.301 [2024-10-07 11:29:12.355883] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.301 [2024-10-07 11:29:12.367699] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.301 [2024-10-07 11:29:12.367749] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.301 [2024-10-07 11:29:12.368596] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.301 [2024-10-07 11:29:12.368640] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.301 [2024-10-07 11:29:12.368660] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.301 [2024-10-07 11:29:12.368710] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.301 [2024-10-07 11:29:12.368733] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.301 [2024-10-07 11:29:12.368748] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.301 [2024-10-07 11:29:12.369122] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.301 [2024-10-07 11:29:12.369164] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.301 [2024-10-07 11:29:12.369376] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.301 [2024-10-07 11:29:12.369422] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.301 [2024-10-07 11:29:12.369442] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.301 [2024-10-07 11:29:12.369460] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.301 [2024-10-07 11:29:12.369475] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.301 [2024-10-07 11:29:12.369488] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.301 [2024-10-07 11:29:12.369690] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.301 [2024-10-07 11:29:12.369714] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.301 [2024-10-07 11:29:12.381170] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.301 [2024-10-07 11:29:12.381229] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.301 [2024-10-07 11:29:12.382038] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.301 [2024-10-07 11:29:12.382083] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.301 [2024-10-07 11:29:12.382102] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.301 [2024-10-07 11:29:12.382152] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.301 [2024-10-07 11:29:12.382175] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.301 [2024-10-07 11:29:12.382191] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.301 [2024-10-07 11:29:12.382595] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.301 [2024-10-07 11:29:12.382627] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.301 [2024-10-07 11:29:12.382836] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.301 [2024-10-07 11:29:12.382872] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.301 [2024-10-07 11:29:12.382889] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.301 [2024-10-07 11:29:12.382912] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.301 [2024-10-07 11:29:12.382945] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.301 [2024-10-07 11:29:12.382961] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.301 [2024-10-07 11:29:12.383178] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.301 [2024-10-07 11:29:12.383202] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.301 [2024-10-07 11:29:12.394511] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.302 [2024-10-07 11:29:12.394557] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.302 [2024-10-07 11:29:12.395313] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.302 [2024-10-07 11:29:12.395368] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.302 [2024-10-07 11:29:12.395386] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.302 [2024-10-07 11:29:12.395460] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.302 [2024-10-07 11:29:12.395486] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.302 [2024-10-07 11:29:12.395501] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.302 [2024-10-07 11:29:12.395876] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.302 [2024-10-07 11:29:12.395906] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.302 [2024-10-07 11:29:12.396100] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.302 [2024-10-07 11:29:12.396133] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.302 [2024-10-07 11:29:12.396149] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.302 [2024-10-07 11:29:12.396165] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.302 [2024-10-07 11:29:12.396180] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.302 [2024-10-07 11:29:12.396192] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.302 [2024-10-07 11:29:12.396379] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.302 [2024-10-07 11:29:12.396402] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.302 9035.08 IOPS, 35.29 MiB/s [2024-10-07T11:29:16.013Z] [2024-10-07 11:29:12.410069] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.302 [2024-10-07 11:29:12.410113] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.302 [2024-10-07 11:29:12.410212] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.302 [2024-10-07 11:29:12.410240] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.302 [2024-10-07 11:29:12.410256] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.302 [2024-10-07 11:29:12.410316] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.302 [2024-10-07 11:29:12.410337] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.302 [2024-10-07 11:29:12.410351] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.302 [2024-10-07 11:29:12.410389] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.302 [2024-10-07 11:29:12.410407] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.302 [2024-10-07 11:29:12.410426] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.302 [2024-10-07 11:29:12.410461] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.302 [2024-10-07 11:29:12.410483] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.302 [2024-10-07 11:29:12.410501] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.302 [2024-10-07 11:29:12.410515] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.302 [2024-10-07 11:29:12.410527] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.302 [2024-10-07 11:29:12.410550] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.302 [2024-10-07 11:29:12.410563] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.302 [2024-10-07 11:29:12.422714] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.302 [2024-10-07 11:29:12.422761] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.302 [2024-10-07 11:29:12.422956] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.302 [2024-10-07 11:29:12.422985] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.302 [2024-10-07 11:29:12.423001] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.302 [2024-10-07 11:29:12.423045] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.302 [2024-10-07 11:29:12.423066] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.302 [2024-10-07 11:29:12.423082] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.302 [2024-10-07 11:29:12.423708] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.302 [2024-10-07 11:29:12.423749] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.302 [2024-10-07 11:29:12.425033] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.302 [2024-10-07 11:29:12.425074] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.302 [2024-10-07 11:29:12.425106] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.302 [2024-10-07 11:29:12.425123] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.302 [2024-10-07 11:29:12.425137] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.302 [2024-10-07 11:29:12.425150] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.302 [2024-10-07 11:29:12.425436] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.302 [2024-10-07 11:29:12.425475] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.302 [2024-10-07 11:29:12.435006] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.302 [2024-10-07 11:29:12.435055] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.302 [2024-10-07 11:29:12.435199] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.302 [2024-10-07 11:29:12.435230] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.302 [2024-10-07 11:29:12.435247] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.302 [2024-10-07 11:29:12.435293] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.302 [2024-10-07 11:29:12.435316] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.302 [2024-10-07 11:29:12.435331] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.302 [2024-10-07 11:29:12.435371] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.302 [2024-10-07 11:29:12.435395] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.302 [2024-10-07 11:29:12.435431] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.302 [2024-10-07 11:29:12.435450] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.302 [2024-10-07 11:29:12.435464] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.302 [2024-10-07 11:29:12.435481] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.302 [2024-10-07 11:29:12.435495] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.302 [2024-10-07 11:29:12.435508] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.302 [2024-10-07 11:29:12.435531] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.302 [2024-10-07 11:29:12.435545] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.302 [2024-10-07 11:29:12.446385] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.302 [2024-10-07 11:29:12.446449] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.302 [2024-10-07 11:29:12.448395] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.302 [2024-10-07 11:29:12.448451] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.302 [2024-10-07 11:29:12.448471] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.302 [2024-10-07 11:29:12.448522] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.302 [2024-10-07 11:29:12.448545] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.302 [2024-10-07 11:29:12.448570] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.302 [2024-10-07 11:29:12.449134] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.302 [2024-10-07 11:29:12.449176] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.302 [2024-10-07 11:29:12.449837] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.302 [2024-10-07 11:29:12.449872] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.302 [2024-10-07 11:29:12.449889] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.302 [2024-10-07 11:29:12.449906] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.302 [2024-10-07 11:29:12.449936] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.303 [2024-10-07 11:29:12.449951] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.303 [2024-10-07 11:29:12.450201] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.303 [2024-10-07 11:29:12.450227] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.303 [2024-10-07 11:29:12.458220] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.303 [2024-10-07 11:29:12.458270] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.303 [2024-10-07 11:29:12.458355] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.303 [2024-10-07 11:29:12.458384] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.303 [2024-10-07 11:29:12.458401] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.303 [2024-10-07 11:29:12.458465] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.303 [2024-10-07 11:29:12.458489] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.303 [2024-10-07 11:29:12.458505] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.303 [2024-10-07 11:29:12.463009] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.303 [2024-10-07 11:29:12.463056] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.303 [2024-10-07 11:29:12.463820] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.303 [2024-10-07 11:29:12.463856] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.303 [2024-10-07 11:29:12.463874] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.303 [2024-10-07 11:29:12.463891] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.303 [2024-10-07 11:29:12.463905] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.303 [2024-10-07 11:29:12.463918] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.303 [2024-10-07 11:29:12.464342] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.303 [2024-10-07 11:29:12.464377] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.303 [2024-10-07 11:29:12.468332] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.303 [2024-10-07 11:29:12.468390] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.303 [2024-10-07 11:29:12.468478] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.303 [2024-10-07 11:29:12.468506] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.303 [2024-10-07 11:29:12.468522] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.303 [2024-10-07 11:29:12.468575] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.303 [2024-10-07 11:29:12.468599] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.303 [2024-10-07 11:29:12.468615] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.303 [2024-10-07 11:29:12.468633] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.303 [2024-10-07 11:29:12.468673] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.303 [2024-10-07 11:29:12.468691] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.303 [2024-10-07 11:29:12.468705] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.303 [2024-10-07 11:29:12.468718] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.303 [2024-10-07 11:29:12.468740] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.303 [2024-10-07 11:29:12.468755] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.303 [2024-10-07 11:29:12.468768] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.303 [2024-10-07 11:29:12.468782] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.303 [2024-10-07 11:29:12.468803] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.303 [2024-10-07 11:29:12.478405] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.303 [2024-10-07 11:29:12.478562] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.303 [2024-10-07 11:29:12.478592] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.303 [2024-10-07 11:29:12.478609] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.303 [2024-10-07 11:29:12.478645] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.303 [2024-10-07 11:29:12.478673] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.303 [2024-10-07 11:29:12.478699] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.303 [2024-10-07 11:29:12.478715] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.303 [2024-10-07 11:29:12.478728] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.303 [2024-10-07 11:29:12.478748] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.303 [2024-10-07 11:29:12.478798] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.303 [2024-10-07 11:29:12.478838] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.303 [2024-10-07 11:29:12.478869] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.303 [2024-10-07 11:29:12.478891] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.303 [2024-10-07 11:29:12.478911] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.303 [2024-10-07 11:29:12.478925] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.303 [2024-10-07 11:29:12.478938] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.303 [2024-10-07 11:29:12.478959] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.303 [2024-10-07 11:29:12.489461] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.303 [2024-10-07 11:29:12.489507] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.303 [2024-10-07 11:29:12.489629] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.303 [2024-10-07 11:29:12.489658] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.303 [2024-10-07 11:29:12.489688] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.303 [2024-10-07 11:29:12.489736] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.303 [2024-10-07 11:29:12.489758] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.303 [2024-10-07 11:29:12.489773] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.303 [2024-10-07 11:29:12.489939] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.303 [2024-10-07 11:29:12.489976] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.303 [2024-10-07 11:29:12.490065] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.303 [2024-10-07 11:29:12.490088] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.303 [2024-10-07 11:29:12.490102] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.303 [2024-10-07 11:29:12.490118] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.303 [2024-10-07 11:29:12.490132] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.303 [2024-10-07 11:29:12.490145] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.303 [2024-10-07 11:29:12.490168] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.303 [2024-10-07 11:29:12.490182] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.303 [2024-10-07 11:29:12.501163] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.303 [2024-10-07 11:29:12.501208] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.303 [2024-10-07 11:29:12.502694] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.303 [2024-10-07 11:29:12.502738] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.303 [2024-10-07 11:29:12.502773] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.303 [2024-10-07 11:29:12.502837] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.303 [2024-10-07 11:29:12.502860] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.303 [2024-10-07 11:29:12.502875] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.303 [2024-10-07 11:29:12.503632] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.303 [2024-10-07 11:29:12.503671] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.303 [2024-10-07 11:29:12.504045] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.303 [2024-10-07 11:29:12.504078] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.303 [2024-10-07 11:29:12.504094] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.303 [2024-10-07 11:29:12.504110] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.303 [2024-10-07 11:29:12.504124] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.303 [2024-10-07 11:29:12.504155] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.303 [2024-10-07 11:29:12.504360] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.303 [2024-10-07 11:29:12.504384] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.303 [2024-10-07 11:29:12.514220] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.303 [2024-10-07 11:29:12.514267] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.303 [2024-10-07 11:29:12.514613] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.303 [2024-10-07 11:29:12.514654] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.304 [2024-10-07 11:29:12.514673] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.304 [2024-10-07 11:29:12.514720] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.304 [2024-10-07 11:29:12.514742] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.304 [2024-10-07 11:29:12.514757] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.304 [2024-10-07 11:29:12.514889] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.304 [2024-10-07 11:29:12.514916] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.304 [2024-10-07 11:29:12.515063] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.304 [2024-10-07 11:29:12.515086] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.304 [2024-10-07 11:29:12.515100] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.304 [2024-10-07 11:29:12.515115] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.304 [2024-10-07 11:29:12.515129] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.304 [2024-10-07 11:29:12.515141] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.304 [2024-10-07 11:29:12.515186] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.304 [2024-10-07 11:29:12.515206] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.304 [2024-10-07 11:29:12.527081] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.304 [2024-10-07 11:29:12.527125] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.304 [2024-10-07 11:29:12.527220] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.304 [2024-10-07 11:29:12.527247] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.304 [2024-10-07 11:29:12.527263] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.304 [2024-10-07 11:29:12.527307] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.304 [2024-10-07 11:29:12.527328] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.304 [2024-10-07 11:29:12.527343] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.304 [2024-10-07 11:29:12.527365] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.304 [2024-10-07 11:29:12.527383] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.304 [2024-10-07 11:29:12.527419] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.304 [2024-10-07 11:29:12.527451] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.304 [2024-10-07 11:29:12.527467] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.304 [2024-10-07 11:29:12.527483] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.304 [2024-10-07 11:29:12.527497] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.304 [2024-10-07 11:29:12.527509] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.304 [2024-10-07 11:29:12.527530] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.304 [2024-10-07 11:29:12.527544] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.304 [2024-10-07 11:29:12.539275] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.304 [2024-10-07 11:29:12.539321] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.304 [2024-10-07 11:29:12.539494] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.304 [2024-10-07 11:29:12.539523] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.304 [2024-10-07 11:29:12.539540] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.304 [2024-10-07 11:29:12.539584] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.304 [2024-10-07 11:29:12.539606] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.304 [2024-10-07 11:29:12.539620] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.304 [2024-10-07 11:29:12.539643] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.304 [2024-10-07 11:29:12.539661] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.304 [2024-10-07 11:29:12.539680] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.304 [2024-10-07 11:29:12.539693] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.304 [2024-10-07 11:29:12.539706] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.304 [2024-10-07 11:29:12.539721] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.304 [2024-10-07 11:29:12.539734] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.304 [2024-10-07 11:29:12.539747] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.304 [2024-10-07 11:29:12.539768] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.304 [2024-10-07 11:29:12.539782] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.304 [2024-10-07 11:29:12.549413] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.304 [2024-10-07 11:29:12.549486] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.304 [2024-10-07 11:29:12.549571] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.304 [2024-10-07 11:29:12.549599] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.304 [2024-10-07 11:29:12.549616] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.304 [2024-10-07 11:29:12.549691] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.304 [2024-10-07 11:29:12.549716] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.304 [2024-10-07 11:29:12.549732] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.304 [2024-10-07 11:29:12.549750] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.304 [2024-10-07 11:29:12.549774] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.304 [2024-10-07 11:29:12.549790] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.304 [2024-10-07 11:29:12.549804] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.304 [2024-10-07 11:29:12.549818] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.304 [2024-10-07 11:29:12.549841] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.304 [2024-10-07 11:29:12.549855] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.304 [2024-10-07 11:29:12.549868] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.304 [2024-10-07 11:29:12.549881] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.304 [2024-10-07 11:29:12.549901] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.304 [2024-10-07 11:29:12.561437] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.304 [2024-10-07 11:29:12.561502] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.304 [2024-10-07 11:29:12.561602] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.304 [2024-10-07 11:29:12.561637] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.304 [2024-10-07 11:29:12.561654] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.304 [2024-10-07 11:29:12.561700] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.304 [2024-10-07 11:29:12.561723] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.304 [2024-10-07 11:29:12.561738] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.304 [2024-10-07 11:29:12.561762] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.304 [2024-10-07 11:29:12.561782] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.304 [2024-10-07 11:29:12.561801] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.304 [2024-10-07 11:29:12.561816] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.304 [2024-10-07 11:29:12.561830] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.304 [2024-10-07 11:29:12.561845] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.304 [2024-10-07 11:29:12.561859] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.304 [2024-10-07 11:29:12.561872] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.304 [2024-10-07 11:29:12.561895] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.304 [2024-10-07 11:29:12.561923] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.304 [2024-10-07 11:29:12.573382] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.304 [2024-10-07 11:29:12.573457] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.304 [2024-10-07 11:29:12.573658] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.304 [2024-10-07 11:29:12.573687] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.304 [2024-10-07 11:29:12.573703] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.304 [2024-10-07 11:29:12.573747] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.304 [2024-10-07 11:29:12.573769] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.304 [2024-10-07 11:29:12.573783] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.304 [2024-10-07 11:29:12.573879] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.304 [2024-10-07 11:29:12.573902] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.304 [2024-10-07 11:29:12.574030] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.305 [2024-10-07 11:29:12.574052] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.305 [2024-10-07 11:29:12.574067] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.305 [2024-10-07 11:29:12.574083] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.305 [2024-10-07 11:29:12.574097] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.305 [2024-10-07 11:29:12.574110] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.305 [2024-10-07 11:29:12.577886] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.305 [2024-10-07 11:29:12.577922] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.305 [2024-10-07 11:29:12.583520] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.305 [2024-10-07 11:29:12.583594] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.305 [2024-10-07 11:29:12.583665] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.305 [2024-10-07 11:29:12.583692] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.305 [2024-10-07 11:29:12.583708] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.305 [2024-10-07 11:29:12.585522] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.305 [2024-10-07 11:29:12.585578] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.305 [2024-10-07 11:29:12.585596] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.305 [2024-10-07 11:29:12.585614] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.305 [2024-10-07 11:29:12.585804] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.305 [2024-10-07 11:29:12.585834] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.305 [2024-10-07 11:29:12.585870] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.305 [2024-10-07 11:29:12.585884] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.305 [2024-10-07 11:29:12.585937] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.305 [2024-10-07 11:29:12.585957] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.305 [2024-10-07 11:29:12.585999] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.305 [2024-10-07 11:29:12.586013] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.305 [2024-10-07 11:29:12.586053] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.305 [2024-10-07 11:29:12.593612] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.305 [2024-10-07 11:29:12.593726] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.305 [2024-10-07 11:29:12.593756] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.305 [2024-10-07 11:29:12.593774] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.305 [2024-10-07 11:29:12.593811] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.305 [2024-10-07 11:29:12.593840] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.305 [2024-10-07 11:29:12.593879] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.305 [2024-10-07 11:29:12.593909] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.305 [2024-10-07 11:29:12.593923] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.305 [2024-10-07 11:29:12.593943] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.305 [2024-10-07 11:29:12.594021] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.305 [2024-10-07 11:29:12.594046] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.305 [2024-10-07 11:29:12.594062] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.305 [2024-10-07 11:29:12.594093] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.305 [2024-10-07 11:29:12.594114] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.305 [2024-10-07 11:29:12.594129] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.305 [2024-10-07 11:29:12.594142] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.305 [2024-10-07 11:29:12.594164] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.305 [2024-10-07 11:29:12.606251] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.305 [2024-10-07 11:29:12.606299] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.305 [2024-10-07 11:29:12.606384] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.305 [2024-10-07 11:29:12.606425] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.305 [2024-10-07 11:29:12.606445] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.305 [2024-10-07 11:29:12.606494] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.305 [2024-10-07 11:29:12.606533] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.305 [2024-10-07 11:29:12.606551] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.305 [2024-10-07 11:29:12.606575] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.305 [2024-10-07 11:29:12.606595] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.305 [2024-10-07 11:29:12.606615] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.305 [2024-10-07 11:29:12.606629] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.305 [2024-10-07 11:29:12.606643] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.305 [2024-10-07 11:29:12.606660] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.305 [2024-10-07 11:29:12.606674] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.305 [2024-10-07 11:29:12.606687] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.305 [2024-10-07 11:29:12.606726] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.305 [2024-10-07 11:29:12.606739] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.305 [2024-10-07 11:29:12.621259] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.305 [2024-10-07 11:29:12.621309] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.305 [2024-10-07 11:29:12.621954] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.305 [2024-10-07 11:29:12.622036] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.305 [2024-10-07 11:29:12.622071] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.305 [2024-10-07 11:29:12.622119] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.305 [2024-10-07 11:29:12.622141] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.305 [2024-10-07 11:29:12.622156] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.305 [2024-10-07 11:29:12.622392] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.305 [2024-10-07 11:29:12.622421] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.305 [2024-10-07 11:29:12.622482] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.305 [2024-10-07 11:29:12.622504] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.305 [2024-10-07 11:29:12.622519] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.305 [2024-10-07 11:29:12.622535] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.305 [2024-10-07 11:29:12.622548] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.305 [2024-10-07 11:29:12.622560] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.305 [2024-10-07 11:29:12.622678] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.305 [2024-10-07 11:29:12.622700] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.305 [2024-10-07 11:29:12.631701] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.305 [2024-10-07 11:29:12.631747] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.305 [2024-10-07 11:29:12.631843] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.305 [2024-10-07 11:29:12.631886] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.305 [2024-10-07 11:29:12.631901] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.305 [2024-10-07 11:29:12.631945] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.305 [2024-10-07 11:29:12.631966] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.305 [2024-10-07 11:29:12.631981] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.305 [2024-10-07 11:29:12.632003] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.305 [2024-10-07 11:29:12.632021] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.305 [2024-10-07 11:29:12.632039] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.305 [2024-10-07 11:29:12.632053] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.305 [2024-10-07 11:29:12.632066] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.305 [2024-10-07 11:29:12.632081] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.305 [2024-10-07 11:29:12.632094] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.305 [2024-10-07 11:29:12.632106] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.305 [2024-10-07 11:29:12.632127] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.305 [2024-10-07 11:29:12.632140] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.305 [2024-10-07 11:29:12.642195] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.306 [2024-10-07 11:29:12.642243] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.306 [2024-10-07 11:29:12.642532] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.306 [2024-10-07 11:29:12.642570] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.306 [2024-10-07 11:29:12.642588] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.306 [2024-10-07 11:29:12.642634] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.306 [2024-10-07 11:29:12.642657] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.306 [2024-10-07 11:29:12.642673] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.306 [2024-10-07 11:29:12.642728] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.306 [2024-10-07 11:29:12.642768] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.306 [2024-10-07 11:29:12.642788] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.306 [2024-10-07 11:29:12.642802] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.306 [2024-10-07 11:29:12.642833] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.306 [2024-10-07 11:29:12.642850] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.306 [2024-10-07 11:29:12.642864] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.306 [2024-10-07 11:29:12.642877] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.306 [2024-10-07 11:29:12.642900] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.306 [2024-10-07 11:29:12.642913] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.306 [2024-10-07 11:29:12.652755] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.306 [2024-10-07 11:29:12.652819] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.306 [2024-10-07 11:29:12.652990] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.306 [2024-10-07 11:29:12.653019] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.306 [2024-10-07 11:29:12.653034] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.306 [2024-10-07 11:29:12.653079] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.306 [2024-10-07 11:29:12.653101] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.306 [2024-10-07 11:29:12.653115] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.306 [2024-10-07 11:29:12.654783] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.306 [2024-10-07 11:29:12.654828] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.306 [2024-10-07 11:29:12.656821] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.306 [2024-10-07 11:29:12.656873] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.306 [2024-10-07 11:29:12.656889] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.306 [2024-10-07 11:29:12.656906] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.306 [2024-10-07 11:29:12.656920] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.306 [2024-10-07 11:29:12.656933] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.306 [2024-10-07 11:29:12.657293] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.306 [2024-10-07 11:29:12.657319] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.306 [2024-10-07 11:29:12.662914] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.306 [2024-10-07 11:29:12.662956] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.306 [2024-10-07 11:29:12.663058] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.306 [2024-10-07 11:29:12.663086] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.306 [2024-10-07 11:29:12.663102] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.306 [2024-10-07 11:29:12.663148] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.306 [2024-10-07 11:29:12.663170] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.306 [2024-10-07 11:29:12.663201] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.306 [2024-10-07 11:29:12.663225] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.306 [2024-10-07 11:29:12.663244] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.306 [2024-10-07 11:29:12.663262] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.306 [2024-10-07 11:29:12.663276] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.306 [2024-10-07 11:29:12.663289] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.306 [2024-10-07 11:29:12.663304] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.306 [2024-10-07 11:29:12.663318] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.306 [2024-10-07 11:29:12.663330] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.306 [2024-10-07 11:29:12.663351] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.306 [2024-10-07 11:29:12.663364] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.306 [2024-10-07 11:29:12.673028] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.306 [2024-10-07 11:29:12.673105] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.306 [2024-10-07 11:29:12.673176] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.306 [2024-10-07 11:29:12.673203] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.306 [2024-10-07 11:29:12.673218] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.306 [2024-10-07 11:29:12.673269] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.306 [2024-10-07 11:29:12.673291] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.306 [2024-10-07 11:29:12.673306] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.306 [2024-10-07 11:29:12.673323] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.306 [2024-10-07 11:29:12.673345] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.306 [2024-10-07 11:29:12.673361] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.306 [2024-10-07 11:29:12.673374] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.306 [2024-10-07 11:29:12.673387] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.306 [2024-10-07 11:29:12.673408] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.306 [2024-10-07 11:29:12.673438] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.306 [2024-10-07 11:29:12.673482] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.306 [2024-10-07 11:29:12.673496] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.306 [2024-10-07 11:29:12.673518] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.306 [2024-10-07 11:29:12.686255] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.306 [2024-10-07 11:29:12.686347] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.306 [2024-10-07 11:29:12.686727] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.306 [2024-10-07 11:29:12.686770] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.306 [2024-10-07 11:29:12.686819] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.306 [2024-10-07 11:29:12.686869] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.306 [2024-10-07 11:29:12.686891] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.306 [2024-10-07 11:29:12.686906] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.306 [2024-10-07 11:29:12.687094] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.306 [2024-10-07 11:29:12.687124] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.306 [2024-10-07 11:29:12.687176] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.306 [2024-10-07 11:29:12.687196] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.306 [2024-10-07 11:29:12.687209] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.306 [2024-10-07 11:29:12.687225] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.307 [2024-10-07 11:29:12.687239] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.307 [2024-10-07 11:29:12.687251] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.307 [2024-10-07 11:29:12.687273] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.307 [2024-10-07 11:29:12.687287] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.307 [2024-10-07 11:29:12.697758] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.307 [2024-10-07 11:29:12.697803] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.307 [2024-10-07 11:29:12.697898] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.307 [2024-10-07 11:29:12.697926] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.307 [2024-10-07 11:29:12.697942] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.307 [2024-10-07 11:29:12.698015] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.307 [2024-10-07 11:29:12.698039] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.307 [2024-10-07 11:29:12.698055] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.307 [2024-10-07 11:29:12.698079] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.307 [2024-10-07 11:29:12.698099] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.307 [2024-10-07 11:29:12.698119] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.307 [2024-10-07 11:29:12.698133] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.307 [2024-10-07 11:29:12.698147] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.307 [2024-10-07 11:29:12.698178] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.307 [2024-10-07 11:29:12.698194] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.307 [2024-10-07 11:29:12.698208] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.307 [2024-10-07 11:29:12.698231] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.307 [2024-10-07 11:29:12.698245] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.307 [2024-10-07 11:29:12.710409] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.307 [2024-10-07 11:29:12.710467] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.307 [2024-10-07 11:29:12.710567] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.307 [2024-10-07 11:29:12.710595] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.307 [2024-10-07 11:29:12.710611] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.307 [2024-10-07 11:29:12.710655] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.307 [2024-10-07 11:29:12.710678] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.307 [2024-10-07 11:29:12.710693] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.307 [2024-10-07 11:29:12.710730] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.307 [2024-10-07 11:29:12.710753] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.307 [2024-10-07 11:29:12.710773] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.307 [2024-10-07 11:29:12.710787] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.307 [2024-10-07 11:29:12.710800] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.307 [2024-10-07 11:29:12.710815] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.307 [2024-10-07 11:29:12.710845] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.307 [2024-10-07 11:29:12.710857] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.307 [2024-10-07 11:29:12.710879] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.307 [2024-10-07 11:29:12.710892] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.307 [2024-10-07 11:29:12.720544] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.307 [2024-10-07 11:29:12.720622] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.307 [2024-10-07 11:29:12.720695] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.307 [2024-10-07 11:29:12.720721] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.307 [2024-10-07 11:29:12.720738] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.307 [2024-10-07 11:29:12.721355] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.307 [2024-10-07 11:29:12.721408] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.307 [2024-10-07 11:29:12.721469] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.307 [2024-10-07 11:29:12.721505] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.307 [2024-10-07 11:29:12.721603] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.307 [2024-10-07 11:29:12.721627] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.307 [2024-10-07 11:29:12.721640] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.307 [2024-10-07 11:29:12.721653] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.307 [2024-10-07 11:29:12.721676] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.307 [2024-10-07 11:29:12.721691] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.307 [2024-10-07 11:29:12.721703] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.307 [2024-10-07 11:29:12.721716] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.307 [2024-10-07 11:29:12.721736] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.307 [2024-10-07 11:29:12.731223] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.307 [2024-10-07 11:29:12.731270] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.307 [2024-10-07 11:29:12.731571] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.307 [2024-10-07 11:29:12.731612] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.307 [2024-10-07 11:29:12.731630] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.307 [2024-10-07 11:29:12.731677] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.307 [2024-10-07 11:29:12.731698] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.307 [2024-10-07 11:29:12.731713] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.307 [2024-10-07 11:29:12.731762] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.307 [2024-10-07 11:29:12.731786] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.307 [2024-10-07 11:29:12.731805] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.307 [2024-10-07 11:29:12.731820] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.307 [2024-10-07 11:29:12.731833] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.307 [2024-10-07 11:29:12.731848] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.307 [2024-10-07 11:29:12.731861] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.307 [2024-10-07 11:29:12.731873] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.307 [2024-10-07 11:29:12.731895] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.307 [2024-10-07 11:29:12.731908] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.307 [2024-10-07 11:29:12.741597] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.307 [2024-10-07 11:29:12.741643] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.307 [2024-10-07 11:29:12.741776] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.307 [2024-10-07 11:29:12.741805] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.307 [2024-10-07 11:29:12.741822] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.307 [2024-10-07 11:29:12.741880] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.307 [2024-10-07 11:29:12.741902] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.307 [2024-10-07 11:29:12.741917] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.307 [2024-10-07 11:29:12.741940] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.307 [2024-10-07 11:29:12.741959] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.307 [2024-10-07 11:29:12.742005] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.307 [2024-10-07 11:29:12.742020] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.307 [2024-10-07 11:29:12.742034] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.307 [2024-10-07 11:29:12.742050] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.307 [2024-10-07 11:29:12.742064] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.307 [2024-10-07 11:29:12.742091] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.307 [2024-10-07 11:29:12.742113] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.307 [2024-10-07 11:29:12.742127] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.307 [2024-10-07 11:29:12.754141] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.307 [2024-10-07 11:29:12.754191] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.307 [2024-10-07 11:29:12.754605] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.308 [2024-10-07 11:29:12.754645] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.308 [2024-10-07 11:29:12.754664] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.308 [2024-10-07 11:29:12.754709] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.308 [2024-10-07 11:29:12.754731] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.308 [2024-10-07 11:29:12.754745] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.308 [2024-10-07 11:29:12.754935] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.308 [2024-10-07 11:29:12.754964] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.308 [2024-10-07 11:29:12.755016] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.308 [2024-10-07 11:29:12.755036] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.308 [2024-10-07 11:29:12.755050] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.308 [2024-10-07 11:29:12.755065] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.308 [2024-10-07 11:29:12.755095] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.308 [2024-10-07 11:29:12.755109] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.308 [2024-10-07 11:29:12.755133] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.308 [2024-10-07 11:29:12.755146] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.308 [2024-10-07 11:29:12.766816] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.308 [2024-10-07 11:29:12.766862] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.308 [2024-10-07 11:29:12.767167] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.308 [2024-10-07 11:29:12.767207] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.308 [2024-10-07 11:29:12.767225] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.308 [2024-10-07 11:29:12.767271] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.308 [2024-10-07 11:29:12.767292] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.308 [2024-10-07 11:29:12.767307] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.308 [2024-10-07 11:29:12.767357] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.308 [2024-10-07 11:29:12.767381] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.308 [2024-10-07 11:29:12.767400] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.308 [2024-10-07 11:29:12.767428] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.308 [2024-10-07 11:29:12.767443] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.308 [2024-10-07 11:29:12.767459] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.308 [2024-10-07 11:29:12.767472] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.308 [2024-10-07 11:29:12.767485] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.308 [2024-10-07 11:29:12.767507] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.308 [2024-10-07 11:29:12.767520] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.308 [2024-10-07 11:29:12.777705] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.308 [2024-10-07 11:29:12.777752] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.308 [2024-10-07 11:29:12.777956] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.308 [2024-10-07 11:29:12.778119] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.308 [2024-10-07 11:29:12.778138] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.308 [2024-10-07 11:29:12.778187] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.308 [2024-10-07 11:29:12.778209] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.308 [2024-10-07 11:29:12.778224] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.308 [2024-10-07 11:29:12.778346] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.308 [2024-10-07 11:29:12.778387] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.308 [2024-10-07 11:29:12.778506] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.308 [2024-10-07 11:29:12.778529] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.308 [2024-10-07 11:29:12.778542] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.308 [2024-10-07 11:29:12.778558] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.308 [2024-10-07 11:29:12.778571] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.308 [2024-10-07 11:29:12.778584] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.308 [2024-10-07 11:29:12.778678] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.308 [2024-10-07 11:29:12.778695] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.308 [2024-10-07 11:29:12.787943] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.308 [2024-10-07 11:29:12.787988] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.308 [2024-10-07 11:29:12.788081] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.308 [2024-10-07 11:29:12.788108] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.308 [2024-10-07 11:29:12.788124] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.308 [2024-10-07 11:29:12.788168] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.308 [2024-10-07 11:29:12.788189] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.308 [2024-10-07 11:29:12.788204] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.308 [2024-10-07 11:29:12.790670] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.308 [2024-10-07 11:29:12.790713] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.308 [2024-10-07 11:29:12.791004] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.308 [2024-10-07 11:29:12.791032] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.308 [2024-10-07 11:29:12.791046] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.308 [2024-10-07 11:29:12.791062] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.308 [2024-10-07 11:29:12.791076] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.308 [2024-10-07 11:29:12.791088] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.308 [2024-10-07 11:29:12.791204] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.308 [2024-10-07 11:29:12.791225] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.308 [2024-10-07 11:29:12.798401] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.308 [2024-10-07 11:29:12.798472] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.308 [2024-10-07 11:29:12.798553] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.308 [2024-10-07 11:29:12.798580] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.308 [2024-10-07 11:29:12.798610] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.308 [2024-10-07 11:29:12.798659] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.308 [2024-10-07 11:29:12.798682] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.308 [2024-10-07 11:29:12.798697] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.308 [2024-10-07 11:29:12.798720] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.308 [2024-10-07 11:29:12.798738] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.308 [2024-10-07 11:29:12.798756] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.308 [2024-10-07 11:29:12.798771] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.308 [2024-10-07 11:29:12.798783] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.308 [2024-10-07 11:29:12.798798] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.308 [2024-10-07 11:29:12.798811] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.308 [2024-10-07 11:29:12.798823] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.308 [2024-10-07 11:29:12.798845] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.308 [2024-10-07 11:29:12.798858] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.308 [2024-10-07 11:29:12.808532] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.308 [2024-10-07 11:29:12.808608] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.308 [2024-10-07 11:29:12.808685] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.308 [2024-10-07 11:29:12.808712] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.308 [2024-10-07 11:29:12.808729] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.308 [2024-10-07 11:29:12.808779] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.308 [2024-10-07 11:29:12.808802] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.308 [2024-10-07 11:29:12.808817] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.309 [2024-10-07 11:29:12.808834] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.309 [2024-10-07 11:29:12.808857] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.309 [2024-10-07 11:29:12.808873] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.309 [2024-10-07 11:29:12.808886] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.309 [2024-10-07 11:29:12.808899] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.309 [2024-10-07 11:29:12.808921] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.309 [2024-10-07 11:29:12.808934] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.309 [2024-10-07 11:29:12.808947] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.309 [2024-10-07 11:29:12.808977] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.309 [2024-10-07 11:29:12.808999] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.309 [2024-10-07 11:29:12.821440] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.309 [2024-10-07 11:29:12.821515] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.309 [2024-10-07 11:29:12.821913] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.309 [2024-10-07 11:29:12.821954] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.309 [2024-10-07 11:29:12.822000] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.309 [2024-10-07 11:29:12.822051] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.309 [2024-10-07 11:29:12.822073] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.309 [2024-10-07 11:29:12.822088] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.309 [2024-10-07 11:29:12.822229] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.309 [2024-10-07 11:29:12.822258] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.309 [2024-10-07 11:29:12.822355] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.309 [2024-10-07 11:29:12.822388] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.309 [2024-10-07 11:29:12.822401] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.309 [2024-10-07 11:29:12.822417] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.309 [2024-10-07 11:29:12.822430] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.309 [2024-10-07 11:29:12.822475] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.309 [2024-10-07 11:29:12.822513] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.309 [2024-10-07 11:29:12.822531] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.309 [2024-10-07 11:29:12.835807] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.309 [2024-10-07 11:29:12.835855] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.309 [2024-10-07 11:29:12.836026] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.309 [2024-10-07 11:29:12.836072] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.309 [2024-10-07 11:29:12.836090] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.309 [2024-10-07 11:29:12.836136] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.309 [2024-10-07 11:29:12.836159] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.309 [2024-10-07 11:29:12.836175] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.309 [2024-10-07 11:29:12.836198] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.309 [2024-10-07 11:29:12.836218] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.309 [2024-10-07 11:29:12.836255] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.309 [2024-10-07 11:29:12.836270] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.309 [2024-10-07 11:29:12.836284] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.309 [2024-10-07 11:29:12.836300] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.309 [2024-10-07 11:29:12.836315] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.309 [2024-10-07 11:29:12.836328] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.309 [2024-10-07 11:29:12.836350] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.309 [2024-10-07 11:29:12.836364] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.309 [2024-10-07 11:29:12.848788] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.309 [2024-10-07 11:29:12.848837] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.309 [2024-10-07 11:29:12.848919] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.309 [2024-10-07 11:29:12.848948] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.309 [2024-10-07 11:29:12.848965] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.309 [2024-10-07 11:29:12.849011] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.309 [2024-10-07 11:29:12.849033] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.309 [2024-10-07 11:29:12.849049] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.309 [2024-10-07 11:29:12.849635] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.309 [2024-10-07 11:29:12.849676] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.309 [2024-10-07 11:29:12.849763] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.309 [2024-10-07 11:29:12.849784] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.309 [2024-10-07 11:29:12.849799] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.309 [2024-10-07 11:29:12.849815] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.309 [2024-10-07 11:29:12.849830] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.309 [2024-10-07 11:29:12.849843] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.309 [2024-10-07 11:29:12.849866] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.309 [2024-10-07 11:29:12.849880] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.309 [2024-10-07 11:29:12.859375] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.309 [2024-10-07 11:29:12.859478] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.309 [2024-10-07 11:29:12.859633] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.309 [2024-10-07 11:29:12.859662] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.309 [2024-10-07 11:29:12.859678] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.309 [2024-10-07 11:29:12.859738] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.309 [2024-10-07 11:29:12.859761] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.309 [2024-10-07 11:29:12.859776] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.309 [2024-10-07 11:29:12.859874] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.309 [2024-10-07 11:29:12.859897] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.309 [2024-10-07 11:29:12.859987] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.309 [2024-10-07 11:29:12.860005] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.309 [2024-10-07 11:29:12.860018] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.309 [2024-10-07 11:29:12.860034] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.309 [2024-10-07 11:29:12.860047] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.309 [2024-10-07 11:29:12.860076] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.309 [2024-10-07 11:29:12.860455] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.309 [2024-10-07 11:29:12.860493] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.309 [2024-10-07 11:29:12.870271] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.309 [2024-10-07 11:29:12.870363] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.309 [2024-10-07 11:29:12.870567] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.309 [2024-10-07 11:29:12.870597] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.309 [2024-10-07 11:29:12.870613] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.309 [2024-10-07 11:29:12.870657] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.309 [2024-10-07 11:29:12.870679] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.309 [2024-10-07 11:29:12.870693] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.309 [2024-10-07 11:29:12.870801] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.309 [2024-10-07 11:29:12.870825] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.309 [2024-10-07 11:29:12.870924] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.309 [2024-10-07 11:29:12.870944] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.309 [2024-10-07 11:29:12.870957] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.309 [2024-10-07 11:29:12.870973] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.309 [2024-10-07 11:29:12.870986] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.310 [2024-10-07 11:29:12.870999] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.310 [2024-10-07 11:29:12.871110] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.310 [2024-10-07 11:29:12.871129] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.310 [2024-10-07 11:29:12.880447] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.310 [2024-10-07 11:29:12.880505] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.310 [2024-10-07 11:29:12.880603] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.310 [2024-10-07 11:29:12.880631] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.310 [2024-10-07 11:29:12.880647] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.310 [2024-10-07 11:29:12.880692] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.310 [2024-10-07 11:29:12.880715] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.310 [2024-10-07 11:29:12.880730] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.310 [2024-10-07 11:29:12.880752] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.310 [2024-10-07 11:29:12.880771] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.310 [2024-10-07 11:29:12.880791] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.310 [2024-10-07 11:29:12.880805] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.310 [2024-10-07 11:29:12.880834] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.310 [2024-10-07 11:29:12.880849] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.310 [2024-10-07 11:29:12.880861] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.310 [2024-10-07 11:29:12.880874] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.310 [2024-10-07 11:29:12.880895] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.310 [2024-10-07 11:29:12.880908] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.310 [2024-10-07 11:29:12.892246] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.310 [2024-10-07 11:29:12.892294] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.310 [2024-10-07 11:29:12.892446] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.310 [2024-10-07 11:29:12.892476] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.310 [2024-10-07 11:29:12.892492] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.310 [2024-10-07 11:29:12.892537] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.310 [2024-10-07 11:29:12.892559] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.310 [2024-10-07 11:29:12.892573] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.310 [2024-10-07 11:29:12.892596] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.310 [2024-10-07 11:29:12.892614] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.310 [2024-10-07 11:29:12.892634] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.310 [2024-10-07 11:29:12.892665] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.310 [2024-10-07 11:29:12.892679] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.310 [2024-10-07 11:29:12.892695] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.310 [2024-10-07 11:29:12.892709] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.310 [2024-10-07 11:29:12.892721] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.310 [2024-10-07 11:29:12.892743] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.310 [2024-10-07 11:29:12.892756] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.310 [2024-10-07 11:29:12.905940] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.310 [2024-10-07 11:29:12.906014] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.310 [2024-10-07 11:29:12.906116] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.310 [2024-10-07 11:29:12.906145] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.310 [2024-10-07 11:29:12.906161] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.310 [2024-10-07 11:29:12.906206] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.310 [2024-10-07 11:29:12.906229] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.310 [2024-10-07 11:29:12.906244] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.310 [2024-10-07 11:29:12.907669] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.310 [2024-10-07 11:29:12.907711] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.310 [2024-10-07 11:29:12.908296] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.310 [2024-10-07 11:29:12.908331] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.310 [2024-10-07 11:29:12.908346] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.310 [2024-10-07 11:29:12.908363] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.310 [2024-10-07 11:29:12.908376] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.310 [2024-10-07 11:29:12.908389] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.310 [2024-10-07 11:29:12.908792] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.310 [2024-10-07 11:29:12.908818] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.310 [2024-10-07 11:29:12.916599] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.310 [2024-10-07 11:29:12.916644] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.310 [2024-10-07 11:29:12.916836] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.310 [2024-10-07 11:29:12.916879] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.310 [2024-10-07 11:29:12.916896] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.310 [2024-10-07 11:29:12.916941] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.310 [2024-10-07 11:29:12.916971] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.310 [2024-10-07 11:29:12.916994] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.310 [2024-10-07 11:29:12.917105] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.310 [2024-10-07 11:29:12.917129] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.310 [2024-10-07 11:29:12.918489] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.310 [2024-10-07 11:29:12.918525] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.310 [2024-10-07 11:29:12.918558] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.310 [2024-10-07 11:29:12.918575] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.310 [2024-10-07 11:29:12.918588] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.310 [2024-10-07 11:29:12.918601] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.310 [2024-10-07 11:29:12.921399] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.310 [2024-10-07 11:29:12.921459] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.310 [2024-10-07 11:29:12.927507] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.310 [2024-10-07 11:29:12.927554] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.310 [2024-10-07 11:29:12.927734] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.310 [2024-10-07 11:29:12.927764] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.310 [2024-10-07 11:29:12.927780] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.310 [2024-10-07 11:29:12.927824] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.310 [2024-10-07 11:29:12.927845] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.310 [2024-10-07 11:29:12.927860] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.310 [2024-10-07 11:29:12.927956] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.310 [2024-10-07 11:29:12.927978] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.310 [2024-10-07 11:29:12.928068] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.310 [2024-10-07 11:29:12.928086] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.310 [2024-10-07 11:29:12.928099] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.310 [2024-10-07 11:29:12.928114] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.310 [2024-10-07 11:29:12.928127] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.310 [2024-10-07 11:29:12.928139] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.310 [2024-10-07 11:29:12.928201] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.310 [2024-10-07 11:29:12.928218] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.310 [2024-10-07 11:29:12.937630] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.310 [2024-10-07 11:29:12.937707] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.310 [2024-10-07 11:29:12.937780] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.311 [2024-10-07 11:29:12.937807] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.311 [2024-10-07 11:29:12.937838] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.311 [2024-10-07 11:29:12.938557] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.311 [2024-10-07 11:29:12.938595] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.311 [2024-10-07 11:29:12.938629] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.311 [2024-10-07 11:29:12.938646] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.311 [2024-10-07 11:29:12.938823] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.311 [2024-10-07 11:29:12.938848] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.311 [2024-10-07 11:29:12.938862] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.311 [2024-10-07 11:29:12.938875] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.311 [2024-10-07 11:29:12.938971] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.311 [2024-10-07 11:29:12.938989] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.311 [2024-10-07 11:29:12.939002] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.311 [2024-10-07 11:29:12.939014] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.311 [2024-10-07 11:29:12.939085] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.311 [2024-10-07 11:29:12.948409] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.311 [2024-10-07 11:29:12.948530] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.311 [2024-10-07 11:29:12.948610] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.311 [2024-10-07 11:29:12.948637] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.311 [2024-10-07 11:29:12.948653] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.311 [2024-10-07 11:29:12.948947] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.311 [2024-10-07 11:29:12.948979] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.311 [2024-10-07 11:29:12.948996] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.311 [2024-10-07 11:29:12.949015] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.311 [2024-10-07 11:29:12.949069] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.311 [2024-10-07 11:29:12.949092] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.311 [2024-10-07 11:29:12.949106] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.311 [2024-10-07 11:29:12.949135] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.311 [2024-10-07 11:29:12.949177] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.311 [2024-10-07 11:29:12.949195] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.311 [2024-10-07 11:29:12.949209] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.311 [2024-10-07 11:29:12.949222] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.311 [2024-10-07 11:29:12.949243] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.311 [2024-10-07 11:29:12.961624] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.311 [2024-10-07 11:29:12.961672] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.311 [2024-10-07 11:29:12.962089] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.311 [2024-10-07 11:29:12.962145] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.311 [2024-10-07 11:29:12.962164] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.311 [2024-10-07 11:29:12.962213] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.311 [2024-10-07 11:29:12.962236] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.311 [2024-10-07 11:29:12.962251] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.311 [2024-10-07 11:29:12.962441] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.311 [2024-10-07 11:29:12.962501] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.311 [2024-10-07 11:29:12.962606] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.311 [2024-10-07 11:29:12.962628] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.311 [2024-10-07 11:29:12.962641] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.311 [2024-10-07 11:29:12.962657] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.311 [2024-10-07 11:29:12.962671] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.311 [2024-10-07 11:29:12.962684] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.311 [2024-10-07 11:29:12.962788] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.311 [2024-10-07 11:29:12.962807] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.311 [2024-10-07 11:29:12.972025] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.311 [2024-10-07 11:29:12.972081] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.311 [2024-10-07 11:29:12.972177] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.311 [2024-10-07 11:29:12.972204] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.311 [2024-10-07 11:29:12.972220] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.311 [2024-10-07 11:29:12.972267] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.311 [2024-10-07 11:29:12.972288] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.311 [2024-10-07 11:29:12.972318] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.311 [2024-10-07 11:29:12.972342] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.311 [2024-10-07 11:29:12.972361] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.311 [2024-10-07 11:29:12.972380] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.311 [2024-10-07 11:29:12.972394] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.311 [2024-10-07 11:29:12.972407] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.311 [2024-10-07 11:29:12.972422] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.311 [2024-10-07 11:29:12.972451] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.311 [2024-10-07 11:29:12.972464] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.311 [2024-10-07 11:29:12.972487] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.311 [2024-10-07 11:29:12.972500] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.311 [2024-10-07 11:29:12.982155] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.311 [2024-10-07 11:29:12.982232] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.311 [2024-10-07 11:29:12.982322] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.311 [2024-10-07 11:29:12.982349] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.311 [2024-10-07 11:29:12.982365] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.311 [2024-10-07 11:29:12.982415] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.311 [2024-10-07 11:29:12.982437] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.311 [2024-10-07 11:29:12.982469] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.311 [2024-10-07 11:29:12.982487] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.311 [2024-10-07 11:29:12.982510] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.311 [2024-10-07 11:29:12.982527] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.311 [2024-10-07 11:29:12.982539] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.311 [2024-10-07 11:29:12.982552] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.311 [2024-10-07 11:29:12.982574] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.311 [2024-10-07 11:29:12.982588] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.311 [2024-10-07 11:29:12.982602] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.311 [2024-10-07 11:29:12.982614] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.312 [2024-10-07 11:29:12.982633] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.312 [2024-10-07 11:29:12.993664] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.312 [2024-10-07 11:29:12.993728] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.312 [2024-10-07 11:29:12.993913] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.312 [2024-10-07 11:29:12.993945] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.312 [2024-10-07 11:29:12.993962] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.312 [2024-10-07 11:29:12.994023] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.312 [2024-10-07 11:29:12.994047] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.312 [2024-10-07 11:29:12.994062] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.312 [2024-10-07 11:29:12.994199] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.312 [2024-10-07 11:29:12.994228] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.312 [2024-10-07 11:29:12.994336] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.312 [2024-10-07 11:29:12.994357] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.312 [2024-10-07 11:29:12.994371] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.312 [2024-10-07 11:29:12.994388] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.312 [2024-10-07 11:29:12.994402] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.312 [2024-10-07 11:29:12.994433] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.312 [2024-10-07 11:29:12.994538] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.312 [2024-10-07 11:29:12.994556] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.312 [2024-10-07 11:29:13.004560] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.312 [2024-10-07 11:29:13.004604] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.312 [2024-10-07 11:29:13.004700] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.312 [2024-10-07 11:29:13.004728] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.312 [2024-10-07 11:29:13.004744] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.312 [2024-10-07 11:29:13.004787] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.312 [2024-10-07 11:29:13.004809] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.312 [2024-10-07 11:29:13.004823] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.312 [2024-10-07 11:29:13.007331] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.312 [2024-10-07 11:29:13.007375] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.312 [2024-10-07 11:29:13.007674] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.312 [2024-10-07 11:29:13.007710] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.312 [2024-10-07 11:29:13.007727] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.312 [2024-10-07 11:29:13.007757] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.312 [2024-10-07 11:29:13.007773] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.312 [2024-10-07 11:29:13.007786] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.312 [2024-10-07 11:29:13.007904] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.312 [2024-10-07 11:29:13.007926] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.312 [2024-10-07 11:29:13.015783] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.312 [2024-10-07 11:29:13.019384] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.312 [2024-10-07 11:29:13.019994] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.312 [2024-10-07 11:29:13.020039] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.312 [2024-10-07 11:29:13.020059] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.312 [2024-10-07 11:29:13.020110] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.312 [2024-10-07 11:29:13.020134] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.312 [2024-10-07 11:29:13.020150] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.312 [2024-10-07 11:29:13.020355] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.312 [2024-10-07 11:29:13.020396] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.312 [2024-10-07 11:29:13.020543] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.312 [2024-10-07 11:29:13.020568] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.312 [2024-10-07 11:29:13.020589] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.312 [2024-10-07 11:29:13.020619] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.312 [2024-10-07 11:29:13.020643] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.312 [2024-10-07 11:29:13.020657] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.312 [2024-10-07 11:29:13.020826] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.312 [2024-10-07 11:29:13.020849] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.312 [2024-10-07 11:29:13.029507] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.312 [2024-10-07 11:29:13.029619] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.312 [2024-10-07 11:29:13.029727] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.312 [2024-10-07 11:29:13.029755] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.312 [2024-10-07 11:29:13.029787] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.312 [2024-10-07 11:29:13.029841] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.312 [2024-10-07 11:29:13.029864] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.312 [2024-10-07 11:29:13.029880] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.312 [2024-10-07 11:29:13.029918] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.312 [2024-10-07 11:29:13.029943] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.312 [2024-10-07 11:29:13.029960] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.312 [2024-10-07 11:29:13.029987] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.312 [2024-10-07 11:29:13.030002] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.312 [2024-10-07 11:29:13.030026] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.312 [2024-10-07 11:29:13.030040] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.312 [2024-10-07 11:29:13.030053] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.312 [2024-10-07 11:29:13.030066] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.312 [2024-10-07 11:29:13.030086] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.312 [2024-10-07 11:29:13.042217] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.312 [2024-10-07 11:29:13.042267] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.312 [2024-10-07 11:29:13.042950] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.312 [2024-10-07 11:29:13.043006] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.312 [2024-10-07 11:29:13.043040] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.312 [2024-10-07 11:29:13.043087] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.312 [2024-10-07 11:29:13.043109] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.312 [2024-10-07 11:29:13.043123] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.312 [2024-10-07 11:29:13.043211] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.312 [2024-10-07 11:29:13.043235] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.312 [2024-10-07 11:29:13.043254] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.313 [2024-10-07 11:29:13.043268] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.313 [2024-10-07 11:29:13.043282] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.313 [2024-10-07 11:29:13.043298] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.313 [2024-10-07 11:29:13.043311] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.313 [2024-10-07 11:29:13.043324] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.313 [2024-10-07 11:29:13.043345] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.313 [2024-10-07 11:29:13.043358] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.313 [2024-10-07 11:29:13.052326] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.313 [2024-10-07 11:29:13.052419] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.313 [2024-10-07 11:29:13.052544] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.313 [2024-10-07 11:29:13.052574] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.313 [2024-10-07 11:29:13.052591] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.313 [2024-10-07 11:29:13.052644] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.313 [2024-10-07 11:29:13.052668] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.313 [2024-10-07 11:29:13.052684] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.313 [2024-10-07 11:29:13.052701] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.313 [2024-10-07 11:29:13.052725] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.313 [2024-10-07 11:29:13.052742] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.313 [2024-10-07 11:29:13.052755] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.313 [2024-10-07 11:29:13.052769] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.313 [2024-10-07 11:29:13.052792] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.313 [2024-10-07 11:29:13.052821] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.313 [2024-10-07 11:29:13.052849] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.313 [2024-10-07 11:29:13.052861] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.313 [2024-10-07 11:29:13.052880] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.313 [2024-10-07 11:29:13.065076] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.313 [2024-10-07 11:29:13.065174] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.313 [2024-10-07 11:29:13.065648] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.313 [2024-10-07 11:29:13.065691] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.313 [2024-10-07 11:29:13.065710] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.313 [2024-10-07 11:29:13.065760] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.313 [2024-10-07 11:29:13.065783] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.313 [2024-10-07 11:29:13.065798] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.313 [2024-10-07 11:29:13.065882] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.313 [2024-10-07 11:29:13.065911] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.313 [2024-10-07 11:29:13.065931] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.313 [2024-10-07 11:29:13.065946] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.313 [2024-10-07 11:29:13.065960] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.313 [2024-10-07 11:29:13.065990] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.313 [2024-10-07 11:29:13.066022] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.313 [2024-10-07 11:29:13.066037] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.313 [2024-10-07 11:29:13.066062] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.313 [2024-10-07 11:29:13.066077] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.313 [2024-10-07 11:29:13.075861] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.313 [2024-10-07 11:29:13.075908] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.313 [2024-10-07 11:29:13.076078] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.313 [2024-10-07 11:29:13.076106] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.313 [2024-10-07 11:29:13.076123] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.313 [2024-10-07 11:29:13.076168] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.313 [2024-10-07 11:29:13.076189] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.313 [2024-10-07 11:29:13.076204] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.313 [2024-10-07 11:29:13.076254] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.313 [2024-10-07 11:29:13.076277] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.313 [2024-10-07 11:29:13.076297] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.313 [2024-10-07 11:29:13.076311] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.313 [2024-10-07 11:29:13.076324] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.313 [2024-10-07 11:29:13.076340] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.313 [2024-10-07 11:29:13.076353] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.313 [2024-10-07 11:29:13.076365] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.313 [2024-10-07 11:29:13.076758] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.313 [2024-10-07 11:29:13.076784] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.313 [2024-10-07 11:29:13.087501] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.313 [2024-10-07 11:29:13.087547] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.313 [2024-10-07 11:29:13.089695] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.313 [2024-10-07 11:29:13.089753] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.313 [2024-10-07 11:29:13.089772] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.313 [2024-10-07 11:29:13.089820] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.313 [2024-10-07 11:29:13.089842] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.313 [2024-10-07 11:29:13.089857] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.313 [2024-10-07 11:29:13.090205] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.313 [2024-10-07 11:29:13.090253] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.313 [2024-10-07 11:29:13.090499] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.313 [2024-10-07 11:29:13.090536] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.313 [2024-10-07 11:29:13.090552] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.313 [2024-10-07 11:29:13.090568] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.313 [2024-10-07 11:29:13.090583] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.313 [2024-10-07 11:29:13.090595] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.313 [2024-10-07 11:29:13.090716] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.313 [2024-10-07 11:29:13.090738] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.313 [2024-10-07 11:29:13.097621] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.313 [2024-10-07 11:29:13.097695] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.313 [2024-10-07 11:29:13.097777] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.313 [2024-10-07 11:29:13.097803] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.313 [2024-10-07 11:29:13.097819] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.313 [2024-10-07 11:29:13.097870] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.313 [2024-10-07 11:29:13.097892] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.313 [2024-10-07 11:29:13.097907] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.313 [2024-10-07 11:29:13.097925] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.313 [2024-10-07 11:29:13.097947] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.313 [2024-10-07 11:29:13.097974] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.313 [2024-10-07 11:29:13.098006] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.313 [2024-10-07 11:29:13.098020] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.313 [2024-10-07 11:29:13.098043] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.313 [2024-10-07 11:29:13.098057] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.313 [2024-10-07 11:29:13.098070] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.313 [2024-10-07 11:29:13.098083] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.313 [2024-10-07 11:29:13.098103] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.314 [2024-10-07 11:29:13.109326] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.314 [2024-10-07 11:29:13.109374] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.314 [2024-10-07 11:29:13.109488] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.314 [2024-10-07 11:29:13.109549] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.314 [2024-10-07 11:29:13.109567] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.314 [2024-10-07 11:29:13.109615] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.314 [2024-10-07 11:29:13.109638] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.314 [2024-10-07 11:29:13.109652] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.314 [2024-10-07 11:29:13.109675] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.314 [2024-10-07 11:29:13.109710] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.314 [2024-10-07 11:29:13.109729] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.314 [2024-10-07 11:29:13.109742] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.314 [2024-10-07 11:29:13.109755] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.314 [2024-10-07 11:29:13.109769] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.314 [2024-10-07 11:29:13.109782] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.314 [2024-10-07 11:29:13.109795] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.314 [2024-10-07 11:29:13.109817] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.314 [2024-10-07 11:29:13.109829] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.314 [2024-10-07 11:29:13.119459] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.314 [2024-10-07 11:29:13.119536] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.314 [2024-10-07 11:29:13.119608] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.314 [2024-10-07 11:29:13.119635] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.314 [2024-10-07 11:29:13.119651] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.314 [2024-10-07 11:29:13.119717] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.314 [2024-10-07 11:29:13.119739] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.314 [2024-10-07 11:29:13.119753] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.314 [2024-10-07 11:29:13.119770] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.314 [2024-10-07 11:29:13.122626] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.314 [2024-10-07 11:29:13.122667] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.314 [2024-10-07 11:29:13.122701] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.314 [2024-10-07 11:29:13.122714] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.314 [2024-10-07 11:29:13.125689] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.314 [2024-10-07 11:29:13.125727] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.314 [2024-10-07 11:29:13.125774] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.314 [2024-10-07 11:29:13.125803] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.314 [2024-10-07 11:29:13.126494] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.314 [2024-10-07 11:29:13.129550] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.314 [2024-10-07 11:29:13.129671] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.314 [2024-10-07 11:29:13.129699] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.314 [2024-10-07 11:29:13.129715] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.314 [2024-10-07 11:29:13.129750] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.314 [2024-10-07 11:29:13.129777] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.314 [2024-10-07 11:29:13.129803] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.314 [2024-10-07 11:29:13.129817] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.314 [2024-10-07 11:29:13.129830] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.314 [2024-10-07 11:29:13.129850] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.314 [2024-10-07 11:29:13.129898] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.314 [2024-10-07 11:29:13.129921] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.314 [2024-10-07 11:29:13.129936] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.314 [2024-10-07 11:29:13.129957] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.314 [2024-10-07 11:29:13.130006] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.314 [2024-10-07 11:29:13.130021] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.314 [2024-10-07 11:29:13.130034] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.314 [2024-10-07 11:29:13.130055] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.314 [2024-10-07 11:29:13.139739] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.314 [2024-10-07 11:29:13.139853] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.314 [2024-10-07 11:29:13.139881] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.314 [2024-10-07 11:29:13.139898] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.314 [2024-10-07 11:29:13.139932] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.314 [2024-10-07 11:29:13.139959] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.314 [2024-10-07 11:29:13.139985] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.314 [2024-10-07 11:29:13.140000] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.314 [2024-10-07 11:29:13.140013] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.314 [2024-10-07 11:29:13.140033] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.314 [2024-10-07 11:29:13.140116] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.314 [2024-10-07 11:29:13.140141] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.314 [2024-10-07 11:29:13.140156] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.314 [2024-10-07 11:29:13.140179] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.314 [2024-10-07 11:29:13.140199] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.314 [2024-10-07 11:29:13.140213] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.314 [2024-10-07 11:29:13.140225] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.314 [2024-10-07 11:29:13.140246] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.314 [2024-10-07 11:29:13.151749] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.314 [2024-10-07 11:29:13.151795] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.314 [2024-10-07 11:29:13.151890] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.314 [2024-10-07 11:29:13.151918] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.314 [2024-10-07 11:29:13.151935] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.314 [2024-10-07 11:29:13.151980] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.314 [2024-10-07 11:29:13.152001] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.314 [2024-10-07 11:29:13.152016] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.314 [2024-10-07 11:29:13.152038] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.314 [2024-10-07 11:29:13.152056] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.314 [2024-10-07 11:29:13.152075] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.314 [2024-10-07 11:29:13.152088] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.314 [2024-10-07 11:29:13.152101] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.314 [2024-10-07 11:29:13.152116] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.314 [2024-10-07 11:29:13.152129] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.314 [2024-10-07 11:29:13.152141] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.314 [2024-10-07 11:29:13.152162] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.314 [2024-10-07 11:29:13.152175] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.314 [2024-10-07 11:29:13.163387] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.314 [2024-10-07 11:29:13.163443] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.314 [2024-10-07 11:29:13.165373] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.314 [2024-10-07 11:29:13.165443] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.314 [2024-10-07 11:29:13.165482] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.314 [2024-10-07 11:29:13.165534] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.315 [2024-10-07 11:29:13.165557] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.315 [2024-10-07 11:29:13.165572] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.315 [2024-10-07 11:29:13.166240] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.315 [2024-10-07 11:29:13.166282] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.315 [2024-10-07 11:29:13.166558] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.315 [2024-10-07 11:29:13.166588] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.315 [2024-10-07 11:29:13.166603] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.315 [2024-10-07 11:29:13.166619] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.315 [2024-10-07 11:29:13.166633] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.315 [2024-10-07 11:29:13.166646] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.315 [2024-10-07 11:29:13.166698] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.315 [2024-10-07 11:29:13.166717] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.315 [2024-10-07 11:29:13.174060] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.315 [2024-10-07 11:29:13.174105] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.315 [2024-10-07 11:29:13.174202] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.315 [2024-10-07 11:29:13.174229] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.315 [2024-10-07 11:29:13.174246] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.315 [2024-10-07 11:29:13.174290] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.315 [2024-10-07 11:29:13.174326] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.315 [2024-10-07 11:29:13.174341] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.315 [2024-10-07 11:29:13.174362] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.315 [2024-10-07 11:29:13.174381] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.315 [2024-10-07 11:29:13.174399] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.315 [2024-10-07 11:29:13.174412] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.315 [2024-10-07 11:29:13.174425] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.315 [2024-10-07 11:29:13.174453] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.315 [2024-10-07 11:29:13.174470] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.315 [2024-10-07 11:29:13.174483] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.315 [2024-10-07 11:29:13.174519] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.315 [2024-10-07 11:29:13.174534] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.315 [2024-10-07 11:29:13.184194] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.315 [2024-10-07 11:29:13.184241] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.315 [2024-10-07 11:29:13.184352] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.315 [2024-10-07 11:29:13.184381] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.315 [2024-10-07 11:29:13.184398] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.315 [2024-10-07 11:29:13.184458] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.315 [2024-10-07 11:29:13.184483] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.315 [2024-10-07 11:29:13.184499] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.315 [2024-10-07 11:29:13.184523] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.315 [2024-10-07 11:29:13.184543] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.315 [2024-10-07 11:29:13.184563] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.315 [2024-10-07 11:29:13.184577] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.315 [2024-10-07 11:29:13.184591] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.315 [2024-10-07 11:29:13.184607] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.315 [2024-10-07 11:29:13.184620] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.315 [2024-10-07 11:29:13.184633] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.315 [2024-10-07 11:29:13.184656] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.315 [2024-10-07 11:29:13.184669] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.315 [2024-10-07 11:29:13.195708] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.315 [2024-10-07 11:29:13.195754] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.315 [2024-10-07 11:29:13.196643] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.315 [2024-10-07 11:29:13.196698] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.315 [2024-10-07 11:29:13.196716] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.315 [2024-10-07 11:29:13.196762] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.315 [2024-10-07 11:29:13.196783] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.315 [2024-10-07 11:29:13.196798] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.315 [2024-10-07 11:29:13.198513] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.315 [2024-10-07 11:29:13.198555] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.315 [2024-10-07 11:29:13.198634] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.315 [2024-10-07 11:29:13.198672] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.315 [2024-10-07 11:29:13.198687] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.315 [2024-10-07 11:29:13.198704] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.315 [2024-10-07 11:29:13.198718] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.315 [2024-10-07 11:29:13.198730] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.315 [2024-10-07 11:29:13.198753] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.315 [2024-10-07 11:29:13.198766] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.315 [2024-10-07 11:29:13.205859] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.315 [2024-10-07 11:29:13.205934] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.315 [2024-10-07 11:29:13.206032] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.315 [2024-10-07 11:29:13.206060] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.315 [2024-10-07 11:29:13.206077] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.315 [2024-10-07 11:29:13.208854] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.315 [2024-10-07 11:29:13.208897] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.315 [2024-10-07 11:29:13.208916] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.315 [2024-10-07 11:29:13.208936] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.315 [2024-10-07 11:29:13.209678] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.315 [2024-10-07 11:29:13.209717] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.315 [2024-10-07 11:29:13.209734] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.315 [2024-10-07 11:29:13.209748] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.315 [2024-10-07 11:29:13.210012] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.315 [2024-10-07 11:29:13.210039] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.315 [2024-10-07 11:29:13.210053] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.315 [2024-10-07 11:29:13.210066] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.315 [2024-10-07 11:29:13.210186] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.315 [2024-10-07 11:29:13.215950] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.315 [2024-10-07 11:29:13.216056] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.315 [2024-10-07 11:29:13.216086] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.315 [2024-10-07 11:29:13.216103] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.315 [2024-10-07 11:29:13.216140] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.315 [2024-10-07 11:29:13.216184] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.315 [2024-10-07 11:29:13.216213] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.315 [2024-10-07 11:29:13.216229] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.315 [2024-10-07 11:29:13.216242] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.316 [2024-10-07 11:29:13.216263] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.316 [2024-10-07 11:29:13.216317] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.316 [2024-10-07 11:29:13.216342] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.316 [2024-10-07 11:29:13.216357] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.316 [2024-10-07 11:29:13.216380] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.316 [2024-10-07 11:29:13.216401] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.316 [2024-10-07 11:29:13.216462] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.316 [2024-10-07 11:29:13.216477] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.316 [2024-10-07 11:29:13.216500] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.316 [2024-10-07 11:29:13.228489] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.316 [2024-10-07 11:29:13.228539] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.316 [2024-10-07 11:29:13.228830] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.316 [2024-10-07 11:29:13.228886] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.316 [2024-10-07 11:29:13.228905] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.316 [2024-10-07 11:29:13.228952] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.316 [2024-10-07 11:29:13.228973] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.316 [2024-10-07 11:29:13.228988] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.316 [2024-10-07 11:29:13.229183] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.316 [2024-10-07 11:29:13.229212] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.316 [2024-10-07 11:29:13.229284] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.316 [2024-10-07 11:29:13.229306] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.316 [2024-10-07 11:29:13.229320] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.316 [2024-10-07 11:29:13.229336] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.316 [2024-10-07 11:29:13.229350] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.316 [2024-10-07 11:29:13.229362] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.316 [2024-10-07 11:29:13.229385] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.316 [2024-10-07 11:29:13.229399] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.316 [2024-10-07 11:29:13.240578] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.316 [2024-10-07 11:29:13.240644] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.316 [2024-10-07 11:29:13.240869] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.316 [2024-10-07 11:29:13.240899] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.316 [2024-10-07 11:29:13.240916] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.316 [2024-10-07 11:29:13.240962] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.316 [2024-10-07 11:29:13.240983] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.316 [2024-10-07 11:29:13.240998] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.316 [2024-10-07 11:29:13.241110] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.316 [2024-10-07 11:29:13.241135] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.316 [2024-10-07 11:29:13.241229] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.316 [2024-10-07 11:29:13.241247] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.316 [2024-10-07 11:29:13.241260] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.316 [2024-10-07 11:29:13.241276] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.316 [2024-10-07 11:29:13.241290] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.316 [2024-10-07 11:29:13.241302] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.316 [2024-10-07 11:29:13.241417] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.316 [2024-10-07 11:29:13.241470] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.316 [2024-10-07 11:29:13.252513] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.316 [2024-10-07 11:29:13.252560] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.316 [2024-10-07 11:29:13.252886] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.316 [2024-10-07 11:29:13.252927] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.316 [2024-10-07 11:29:13.252947] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.316 [2024-10-07 11:29:13.252994] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.316 [2024-10-07 11:29:13.253016] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.316 [2024-10-07 11:29:13.253031] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.316 [2024-10-07 11:29:13.253195] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.316 [2024-10-07 11:29:13.253233] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.316 [2024-10-07 11:29:13.253363] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.316 [2024-10-07 11:29:13.253393] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.316 [2024-10-07 11:29:13.253453] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.316 [2024-10-07 11:29:13.253473] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.316 [2024-10-07 11:29:13.253487] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.316 [2024-10-07 11:29:13.253500] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.316 [2024-10-07 11:29:13.253613] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.316 [2024-10-07 11:29:13.253633] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.316 [2024-10-07 11:29:13.262620] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.316 [2024-10-07 11:29:13.262682] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.316 [2024-10-07 11:29:13.262772] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.316 [2024-10-07 11:29:13.262799] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.316 [2024-10-07 11:29:13.262815] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.316 [2024-10-07 11:29:13.263118] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.316 [2024-10-07 11:29:13.263158] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.316 [2024-10-07 11:29:13.263176] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.316 [2024-10-07 11:29:13.263194] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.316 [2024-10-07 11:29:13.263346] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.316 [2024-10-07 11:29:13.263376] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.316 [2024-10-07 11:29:13.263392] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.316 [2024-10-07 11:29:13.263405] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.316 [2024-10-07 11:29:13.263520] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.316 [2024-10-07 11:29:13.263538] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.316 [2024-10-07 11:29:13.263551] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.316 [2024-10-07 11:29:13.263565] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.316 [2024-10-07 11:29:13.263659] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.316 [2024-10-07 11:29:13.272698] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.316 [2024-10-07 11:29:13.272801] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.316 [2024-10-07 11:29:13.272831] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.316 [2024-10-07 11:29:13.272849] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.316 [2024-10-07 11:29:13.272886] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.316 [2024-10-07 11:29:13.272915] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.316 [2024-10-07 11:29:13.272959] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.316 [2024-10-07 11:29:13.272976] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.316 [2024-10-07 11:29:13.272990] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.316 [2024-10-07 11:29:13.273012] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.316 [2024-10-07 11:29:13.273065] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.316 [2024-10-07 11:29:13.273090] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.316 [2024-10-07 11:29:13.273105] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.316 [2024-10-07 11:29:13.273128] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.316 [2024-10-07 11:29:13.273149] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.317 [2024-10-07 11:29:13.273163] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.317 [2024-10-07 11:29:13.273176] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.317 [2024-10-07 11:29:13.273197] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.317 [2024-10-07 11:29:13.286491] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.317 [2024-10-07 11:29:13.286540] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.317 [2024-10-07 11:29:13.286654] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.317 [2024-10-07 11:29:13.286685] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.317 [2024-10-07 11:29:13.286702] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.317 [2024-10-07 11:29:13.286749] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.317 [2024-10-07 11:29:13.286778] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.317 [2024-10-07 11:29:13.286794] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.317 [2024-10-07 11:29:13.286818] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.317 [2024-10-07 11:29:13.286837] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.317 [2024-10-07 11:29:13.286858] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.317 [2024-10-07 11:29:13.286872] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.317 [2024-10-07 11:29:13.286886] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.317 [2024-10-07 11:29:13.286902] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.317 [2024-10-07 11:29:13.286916] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.317 [2024-10-07 11:29:13.286928] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.317 [2024-10-07 11:29:13.286951] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.317 [2024-10-07 11:29:13.286965] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.317 [2024-10-07 11:29:13.299105] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.317 [2024-10-07 11:29:13.299168] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.317 [2024-10-07 11:29:13.299345] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.317 [2024-10-07 11:29:13.299376] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.317 [2024-10-07 11:29:13.299393] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.317 [2024-10-07 11:29:13.299457] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.317 [2024-10-07 11:29:13.299482] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.317 [2024-10-07 11:29:13.299498] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.317 [2024-10-07 11:29:13.299522] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.317 [2024-10-07 11:29:13.299543] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.317 [2024-10-07 11:29:13.299562] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.317 [2024-10-07 11:29:13.299584] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.317 [2024-10-07 11:29:13.299598] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.317 [2024-10-07 11:29:13.299615] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.317 [2024-10-07 11:29:13.299629] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.317 [2024-10-07 11:29:13.299642] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.317 [2024-10-07 11:29:13.299665] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.317 [2024-10-07 11:29:13.299678] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.317 [2024-10-07 11:29:13.312346] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.317 [2024-10-07 11:29:13.312396] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.317 [2024-10-07 11:29:13.313604] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.317 [2024-10-07 11:29:13.313644] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.317 [2024-10-07 11:29:13.313679] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.317 [2024-10-07 11:29:13.313726] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.317 [2024-10-07 11:29:13.313749] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.317 [2024-10-07 11:29:13.313763] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.317 [2024-10-07 11:29:13.315350] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.317 [2024-10-07 11:29:13.315393] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.317 [2024-10-07 11:29:13.315738] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.317 [2024-10-07 11:29:13.315772] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.317 [2024-10-07 11:29:13.315788] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.317 [2024-10-07 11:29:13.315820] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.317 [2024-10-07 11:29:13.315836] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.317 [2024-10-07 11:29:13.315849] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.317 [2024-10-07 11:29:13.315919] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.317 [2024-10-07 11:29:13.315939] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.317 [2024-10-07 11:29:13.324226] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.317 [2024-10-07 11:29:13.324272] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.317 [2024-10-07 11:29:13.324386] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.317 [2024-10-07 11:29:13.324414] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.317 [2024-10-07 11:29:13.324444] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.317 [2024-10-07 11:29:13.324494] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.317 [2024-10-07 11:29:13.324516] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.317 [2024-10-07 11:29:13.324531] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.317 [2024-10-07 11:29:13.324554] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.317 [2024-10-07 11:29:13.324573] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.317 [2024-10-07 11:29:13.324592] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.317 [2024-10-07 11:29:13.324608] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.317 [2024-10-07 11:29:13.324621] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.317 [2024-10-07 11:29:13.324637] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.317 [2024-10-07 11:29:13.324650] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.317 [2024-10-07 11:29:13.324663] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.317 [2024-10-07 11:29:13.324685] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.317 [2024-10-07 11:29:13.324698] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.317 [2024-10-07 11:29:13.334346] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.317 [2024-10-07 11:29:13.334422] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.317 [2024-10-07 11:29:13.334512] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.317 [2024-10-07 11:29:13.334539] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.317 [2024-10-07 11:29:13.334555] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.317 [2024-10-07 11:29:13.334607] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.317 [2024-10-07 11:29:13.334628] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.317 [2024-10-07 11:29:13.334643] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.317 [2024-10-07 11:29:13.334678] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.317 [2024-10-07 11:29:13.334703] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.317 [2024-10-07 11:29:13.334719] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.317 [2024-10-07 11:29:13.334732] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.317 [2024-10-07 11:29:13.334745] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.317 [2024-10-07 11:29:13.334768] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.317 [2024-10-07 11:29:13.334782] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.317 [2024-10-07 11:29:13.334794] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.317 [2024-10-07 11:29:13.334806] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.317 [2024-10-07 11:29:13.334826] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.317 [2024-10-07 11:29:13.347352] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.317 [2024-10-07 11:29:13.347403] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.317 [2024-10-07 11:29:13.347841] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.317 [2024-10-07 11:29:13.347882] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.317 [2024-10-07 11:29:13.347901] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.317 [2024-10-07 11:29:13.347951] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.317 [2024-10-07 11:29:13.347974] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.317 [2024-10-07 11:29:13.347989] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.317 [2024-10-07 11:29:13.348140] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.317 [2024-10-07 11:29:13.348168] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.317 [2024-10-07 11:29:13.348272] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.317 [2024-10-07 11:29:13.348292] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.317 [2024-10-07 11:29:13.348306] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.318 [2024-10-07 11:29:13.348322] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.318 [2024-10-07 11:29:13.348335] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.318 [2024-10-07 11:29:13.348348] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.318 [2024-10-07 11:29:13.348459] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.318 [2024-10-07 11:29:13.348480] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.318 [2024-10-07 11:29:13.359482] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.318 [2024-10-07 11:29:13.359532] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.318 [2024-10-07 11:29:13.361778] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.318 [2024-10-07 11:29:13.361837] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.318 [2024-10-07 11:29:13.361856] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.318 [2024-10-07 11:29:13.361903] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.318 [2024-10-07 11:29:13.361925] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.318 [2024-10-07 11:29:13.361940] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.318 [2024-10-07 11:29:13.362081] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.318 [2024-10-07 11:29:13.362110] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.318 [2024-10-07 11:29:13.362394] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.318 [2024-10-07 11:29:13.362421] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.318 [2024-10-07 11:29:13.362435] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.318 [2024-10-07 11:29:13.362468] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.318 [2024-10-07 11:29:13.362483] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.318 [2024-10-07 11:29:13.362495] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.318 [2024-10-07 11:29:13.362672] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.318 [2024-10-07 11:29:13.362695] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.318 [2024-10-07 11:29:13.369611] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.318 [2024-10-07 11:29:13.369688] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.318 [2024-10-07 11:29:13.369768] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.318 [2024-10-07 11:29:13.369795] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.318 [2024-10-07 11:29:13.369810] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.318 [2024-10-07 11:29:13.369861] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.318 [2024-10-07 11:29:13.369884] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.318 [2024-10-07 11:29:13.369898] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.318 [2024-10-07 11:29:13.369915] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.318 [2024-10-07 11:29:13.369938] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.318 [2024-10-07 11:29:13.369955] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.318 [2024-10-07 11:29:13.369981] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.318 [2024-10-07 11:29:13.369995] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.318 [2024-10-07 11:29:13.370017] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.318 [2024-10-07 11:29:13.370047] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.318 [2024-10-07 11:29:13.370062] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.318 [2024-10-07 11:29:13.370075] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.318 [2024-10-07 11:29:13.370096] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.318 [2024-10-07 11:29:13.380137] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.318 [2024-10-07 11:29:13.380184] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.318 [2024-10-07 11:29:13.380281] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.318 [2024-10-07 11:29:13.380308] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.318 [2024-10-07 11:29:13.380324] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.318 [2024-10-07 11:29:13.380369] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.318 [2024-10-07 11:29:13.380390] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.318 [2024-10-07 11:29:13.380405] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.318 [2024-10-07 11:29:13.380441] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.318 [2024-10-07 11:29:13.380463] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.318 [2024-10-07 11:29:13.380482] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.318 [2024-10-07 11:29:13.380496] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.318 [2024-10-07 11:29:13.380510] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.318 [2024-10-07 11:29:13.380525] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.318 [2024-10-07 11:29:13.380538] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.318 [2024-10-07 11:29:13.380551] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.318 [2024-10-07 11:29:13.380572] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.318 [2024-10-07 11:29:13.380586] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.318 [2024-10-07 11:29:13.391249] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.318 [2024-10-07 11:29:13.391296] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.318 [2024-10-07 11:29:13.391394] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.318 [2024-10-07 11:29:13.391422] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.318 [2024-10-07 11:29:13.391454] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.318 [2024-10-07 11:29:13.391502] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.318 [2024-10-07 11:29:13.391524] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.318 [2024-10-07 11:29:13.391540] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.318 [2024-10-07 11:29:13.391563] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.318 [2024-10-07 11:29:13.391598] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.318 [2024-10-07 11:29:13.391618] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.318 [2024-10-07 11:29:13.391633] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.318 [2024-10-07 11:29:13.391646] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.318 [2024-10-07 11:29:13.391662] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.318 [2024-10-07 11:29:13.391675] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.318 [2024-10-07 11:29:13.391688] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.318 [2024-10-07 11:29:13.391710] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.318 [2024-10-07 11:29:13.391723] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.318 [2024-10-07 11:29:13.401371] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.318 [2024-10-07 11:29:13.401459] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.318 [2024-10-07 11:29:13.401534] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.318 [2024-10-07 11:29:13.401561] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.318 [2024-10-07 11:29:13.401577] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.318 [2024-10-07 11:29:13.402011] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.318 [2024-10-07 11:29:13.402053] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.318 [2024-10-07 11:29:13.402072] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.318 [2024-10-07 11:29:13.402091] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.318 [2024-10-07 11:29:13.402159] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.318 [2024-10-07 11:29:13.402182] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.318 [2024-10-07 11:29:13.402196] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.318 [2024-10-07 11:29:13.402210] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.318 [2024-10-07 11:29:13.403231] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.318 [2024-10-07 11:29:13.403265] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.318 [2024-10-07 11:29:13.403297] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.318 [2024-10-07 11:29:13.403311] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.318 [2024-10-07 11:29:13.403735] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.318 9064.71 IOPS, 35.41 MiB/s [2024-10-07T11:29:16.030Z] [2024-10-07 11:29:13.411800] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.319 [2024-10-07 11:29:13.411847] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.319 [2024-10-07 11:29:13.411944] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.319 [2024-10-07 11:29:13.411985] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.319 [2024-10-07 11:29:13.412003] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.319 [2024-10-07 11:29:13.412050] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.319 [2024-10-07 11:29:13.412072] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.319 [2024-10-07 11:29:13.412087] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.319 [2024-10-07 11:29:13.414569] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.319 [2024-10-07 11:29:13.414612] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.319 [2024-10-07 11:29:13.415428] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.319 [2024-10-07 11:29:13.415475] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.319 [2024-10-07 11:29:13.415508] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.319 [2024-10-07 11:29:13.415524] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.319 [2024-10-07 11:29:13.415538] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.319 [2024-10-07 11:29:13.415551] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.319 [2024-10-07 11:29:13.415654] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.319 [2024-10-07 11:29:13.415675] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.319 [2024-10-07 11:29:13.425466] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.319 [2024-10-07 11:29:13.428358] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.319 [2024-10-07 11:29:13.428478] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.319 [2024-10-07 11:29:13.428507] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.319 [2024-10-07 11:29:13.428524] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.319 [2024-10-07 11:29:13.429338] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.319 [2024-10-07 11:29:13.429393] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.319 [2024-10-07 11:29:13.429411] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.319 [2024-10-07 11:29:13.429441] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.319 [2024-10-07 11:29:13.430004] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.319 [2024-10-07 11:29:13.430057] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.319 [2024-10-07 11:29:13.430074] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.319 [2024-10-07 11:29:13.430088] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.319 [2024-10-07 11:29:13.430318] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.319 [2024-10-07 11:29:13.430352] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.319 [2024-10-07 11:29:13.430384] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.319 [2024-10-07 11:29:13.430399] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.319 [2024-10-07 11:29:13.430894] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.319 [2024-10-07 11:29:13.436018] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.319 [2024-10-07 11:29:13.436148] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.319 [2024-10-07 11:29:13.436177] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.319 [2024-10-07 11:29:13.436193] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.319 [2024-10-07 11:29:13.436215] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.319 [2024-10-07 11:29:13.436236] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.319 [2024-10-07 11:29:13.436249] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.319 [2024-10-07 11:29:13.436262] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.319 [2024-10-07 11:29:13.436283] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.319 [2024-10-07 11:29:13.443953] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.319 [2024-10-07 11:29:13.444465] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.319 [2024-10-07 11:29:13.444507] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.319 [2024-10-07 11:29:13.444527] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.319 [2024-10-07 11:29:13.444742] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.319 [2024-10-07 11:29:13.444994] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.319 [2024-10-07 11:29:13.445027] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.319 [2024-10-07 11:29:13.445042] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.319 [2024-10-07 11:29:13.445098] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.319 [2024-10-07 11:29:13.446121] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.319 [2024-10-07 11:29:13.446217] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.319 [2024-10-07 11:29:13.446246] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.319 [2024-10-07 11:29:13.446262] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.319 [2024-10-07 11:29:13.446286] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.319 [2024-10-07 11:29:13.446322] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.319 [2024-10-07 11:29:13.446351] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.319 [2024-10-07 11:29:13.446363] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.319 [2024-10-07 11:29:13.446384] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.319 [2024-10-07 11:29:13.457959] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.319 [2024-10-07 11:29:13.458035] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.319 [2024-10-07 11:29:13.458190] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.319 [2024-10-07 11:29:13.458220] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.319 [2024-10-07 11:29:13.458237] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.319 [2024-10-07 11:29:13.458283] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.319 [2024-10-07 11:29:13.458316] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.319 [2024-10-07 11:29:13.458331] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.319 [2024-10-07 11:29:13.458354] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.319 [2024-10-07 11:29:13.458385] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.319 [2024-10-07 11:29:13.458416] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.319 [2024-10-07 11:29:13.458480] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.319 [2024-10-07 11:29:13.458498] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.319 [2024-10-07 11:29:13.458515] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.319 [2024-10-07 11:29:13.458529] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.319 [2024-10-07 11:29:13.458542] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.319 [2024-10-07 11:29:13.458565] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.319 [2024-10-07 11:29:13.458579] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.319 [2024-10-07 11:29:13.469763] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.319 [2024-10-07 11:29:13.469811] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.319 [2024-10-07 11:29:13.469894] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.319 [2024-10-07 11:29:13.469923] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.319 [2024-10-07 11:29:13.469940] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.319 [2024-10-07 11:29:13.469999] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.319 [2024-10-07 11:29:13.470023] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.319 [2024-10-07 11:29:13.470038] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.319 [2024-10-07 11:29:13.470077] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.319 [2024-10-07 11:29:13.470100] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.319 [2024-10-07 11:29:13.470120] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.319 [2024-10-07 11:29:13.470134] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.319 [2024-10-07 11:29:13.470162] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.319 [2024-10-07 11:29:13.470181] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.319 [2024-10-07 11:29:13.470207] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.319 [2024-10-07 11:29:13.470220] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.319 [2024-10-07 11:29:13.470243] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.319 [2024-10-07 11:29:13.470257] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.319 [2024-10-07 11:29:13.484117] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.319 [2024-10-07 11:29:13.484181] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.319 [2024-10-07 11:29:13.484265] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.320 [2024-10-07 11:29:13.484293] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.320 [2024-10-07 11:29:13.484310] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.320 [2024-10-07 11:29:13.484356] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.320 [2024-10-07 11:29:13.484393] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.320 [2024-10-07 11:29:13.484425] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.320 [2024-10-07 11:29:13.484461] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.320 [2024-10-07 11:29:13.484484] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.320 [2024-10-07 11:29:13.484504] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.320 [2024-10-07 11:29:13.484534] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.320 [2024-10-07 11:29:13.484547] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.320 [2024-10-07 11:29:13.484563] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.320 [2024-10-07 11:29:13.484577] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.320 [2024-10-07 11:29:13.484589] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.320 [2024-10-07 11:29:13.485527] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.320 [2024-10-07 11:29:13.485573] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.320 [2024-10-07 11:29:13.495016] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.320 [2024-10-07 11:29:13.495061] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.320 [2024-10-07 11:29:13.496256] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.320 [2024-10-07 11:29:13.496310] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.320 [2024-10-07 11:29:13.496329] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.320 [2024-10-07 11:29:13.496375] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.320 [2024-10-07 11:29:13.496396] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.320 [2024-10-07 11:29:13.496436] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.320 [2024-10-07 11:29:13.498153] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.320 [2024-10-07 11:29:13.498207] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.320 [2024-10-07 11:29:13.498627] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.320 [2024-10-07 11:29:13.498663] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.320 [2024-10-07 11:29:13.498680] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.320 [2024-10-07 11:29:13.498697] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.320 [2024-10-07 11:29:13.498711] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.320 [2024-10-07 11:29:13.498724] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.320 [2024-10-07 11:29:13.498933] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.320 [2024-10-07 11:29:13.498957] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.320 [2024-10-07 11:29:13.506239] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.320 [2024-10-07 11:29:13.506287] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.320 [2024-10-07 11:29:13.506571] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.320 [2024-10-07 11:29:13.506603] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.320 [2024-10-07 11:29:13.506620] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.320 [2024-10-07 11:29:13.506667] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.320 [2024-10-07 11:29:13.506690] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.320 [2024-10-07 11:29:13.506705] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.320 [2024-10-07 11:29:13.506839] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.320 [2024-10-07 11:29:13.506863] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.320 [2024-10-07 11:29:13.506956] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.320 [2024-10-07 11:29:13.506985] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.320 [2024-10-07 11:29:13.506999] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.320 [2024-10-07 11:29:13.507015] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.320 [2024-10-07 11:29:13.507028] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.320 [2024-10-07 11:29:13.507041] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.320 [2024-10-07 11:29:13.507138] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.320 [2024-10-07 11:29:13.507172] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.320 [2024-10-07 11:29:13.517129] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.320 [2024-10-07 11:29:13.518369] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.320 [2024-10-07 11:29:13.518525] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.320 [2024-10-07 11:29:13.518555] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.320 [2024-10-07 11:29:13.518572] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.320 [2024-10-07 11:29:13.519172] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.320 [2024-10-07 11:29:13.519210] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.320 [2024-10-07 11:29:13.519244] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.320 [2024-10-07 11:29:13.519262] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.320 [2024-10-07 11:29:13.519342] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.320 [2024-10-07 11:29:13.519365] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.320 [2024-10-07 11:29:13.519379] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.320 [2024-10-07 11:29:13.519392] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.320 [2024-10-07 11:29:13.519415] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.320 [2024-10-07 11:29:13.519444] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.320 [2024-10-07 11:29:13.519474] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.320 [2024-10-07 11:29:13.519487] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.320 [2024-10-07 11:29:13.519507] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.320 [2024-10-07 11:29:13.528874] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.320 [2024-10-07 11:29:13.528919] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.320 [2024-10-07 11:29:13.529014] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.320 [2024-10-07 11:29:13.529041] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.320 [2024-10-07 11:29:13.529074] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.320 [2024-10-07 11:29:13.529118] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.320 [2024-10-07 11:29:13.529140] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.320 [2024-10-07 11:29:13.529156] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.320 [2024-10-07 11:29:13.529178] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.320 [2024-10-07 11:29:13.529197] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.320 [2024-10-07 11:29:13.529216] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.320 [2024-10-07 11:29:13.529230] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.320 [2024-10-07 11:29:13.529246] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.320 [2024-10-07 11:29:13.529262] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.320 [2024-10-07 11:29:13.529291] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.320 [2024-10-07 11:29:13.529305] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.320 [2024-10-07 11:29:13.529516] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.320 [2024-10-07 11:29:13.529542] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.320 [2024-10-07 11:29:13.542515] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.320 [2024-10-07 11:29:13.542560] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.320 [2024-10-07 11:29:13.542869] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.320 [2024-10-07 11:29:13.542909] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.320 [2024-10-07 11:29:13.542927] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.320 [2024-10-07 11:29:13.542973] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.320 [2024-10-07 11:29:13.542994] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.320 [2024-10-07 11:29:13.543009] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.320 [2024-10-07 11:29:13.543468] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.320 [2024-10-07 11:29:13.543508] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.320 [2024-10-07 11:29:13.543717] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.320 [2024-10-07 11:29:13.543750] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.320 [2024-10-07 11:29:13.543765] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.320 [2024-10-07 11:29:13.543781] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.320 [2024-10-07 11:29:13.543795] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.320 [2024-10-07 11:29:13.543807] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.320 [2024-10-07 11:29:13.543858] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.320 [2024-10-07 11:29:13.543877] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.320 [2024-10-07 11:29:13.553934] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.320 [2024-10-07 11:29:13.554006] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.320 [2024-10-07 11:29:13.554107] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.320 [2024-10-07 11:29:13.554137] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.320 [2024-10-07 11:29:13.554154] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.320 [2024-10-07 11:29:13.554199] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.320 [2024-10-07 11:29:13.554221] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.320 [2024-10-07 11:29:13.554236] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.321 [2024-10-07 11:29:13.554274] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.321 [2024-10-07 11:29:13.554294] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.321 [2024-10-07 11:29:13.554328] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.321 [2024-10-07 11:29:13.554341] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.321 [2024-10-07 11:29:13.554354] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.321 [2024-10-07 11:29:13.554369] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.321 [2024-10-07 11:29:13.554382] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.321 [2024-10-07 11:29:13.554394] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.321 [2024-10-07 11:29:13.554415] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.321 [2024-10-07 11:29:13.554428] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.321 [2024-10-07 11:29:13.568835] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.321 [2024-10-07 11:29:13.568883] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.321 [2024-10-07 11:29:13.569300] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.321 [2024-10-07 11:29:13.569341] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.321 [2024-10-07 11:29:13.569360] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.321 [2024-10-07 11:29:13.569407] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.321 [2024-10-07 11:29:13.569459] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.321 [2024-10-07 11:29:13.569474] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.321 [2024-10-07 11:29:13.569741] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.321 [2024-10-07 11:29:13.569777] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.321 [2024-10-07 11:29:13.569846] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.321 [2024-10-07 11:29:13.569866] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.321 [2024-10-07 11:29:13.569879] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.321 [2024-10-07 11:29:13.569895] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.321 [2024-10-07 11:29:13.569909] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.321 [2024-10-07 11:29:13.569921] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.321 [2024-10-07 11:29:13.569943] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.321 [2024-10-07 11:29:13.569956] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.321 [2024-10-07 11:29:13.581616] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.321 [2024-10-07 11:29:13.581663] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.321 [2024-10-07 11:29:13.581762] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.321 [2024-10-07 11:29:13.581834] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.321 [2024-10-07 11:29:13.581852] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.321 [2024-10-07 11:29:13.581899] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.321 [2024-10-07 11:29:13.581921] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.321 [2024-10-07 11:29:13.581936] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.321 [2024-10-07 11:29:13.581959] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.321 [2024-10-07 11:29:13.582008] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.321 [2024-10-07 11:29:13.582028] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.321 [2024-10-07 11:29:13.582042] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.321 [2024-10-07 11:29:13.582055] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.321 [2024-10-07 11:29:13.582071] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.321 [2024-10-07 11:29:13.582084] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.321 [2024-10-07 11:29:13.582097] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.321 [2024-10-07 11:29:13.582119] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.321 [2024-10-07 11:29:13.582132] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.321 [2024-10-07 11:29:13.594977] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.321 [2024-10-07 11:29:13.595023] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.321 [2024-10-07 11:29:13.595119] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.321 [2024-10-07 11:29:13.595146] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.321 [2024-10-07 11:29:13.595162] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.321 [2024-10-07 11:29:13.595206] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.321 [2024-10-07 11:29:13.595227] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.321 [2024-10-07 11:29:13.595242] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.321 [2024-10-07 11:29:13.595710] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.321 [2024-10-07 11:29:13.595748] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.321 [2024-10-07 11:29:13.595965] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.321 [2024-10-07 11:29:13.595998] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.321 [2024-10-07 11:29:13.596013] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.321 [2024-10-07 11:29:13.596029] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.321 [2024-10-07 11:29:13.596042] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.321 [2024-10-07 11:29:13.596070] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.321 [2024-10-07 11:29:13.596304] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.321 [2024-10-07 11:29:13.596329] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.321 [2024-10-07 11:29:13.608876] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.321 [2024-10-07 11:29:13.608924] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.321 [2024-10-07 11:29:13.609007] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.321 [2024-10-07 11:29:13.609034] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.321 [2024-10-07 11:29:13.609051] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.321 [2024-10-07 11:29:13.609096] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.321 [2024-10-07 11:29:13.609118] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.321 [2024-10-07 11:29:13.609133] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.321 [2024-10-07 11:29:13.609156] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.321 [2024-10-07 11:29:13.609175] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.321 [2024-10-07 11:29:13.609195] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.321 [2024-10-07 11:29:13.609209] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.321 [2024-10-07 11:29:13.609223] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.321 [2024-10-07 11:29:13.609238] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.321 [2024-10-07 11:29:13.609252] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.321 [2024-10-07 11:29:13.609265] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.321 [2024-10-07 11:29:13.609288] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.322 [2024-10-07 11:29:13.609302] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.322 [2024-10-07 11:29:13.619442] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.322 [2024-10-07 11:29:13.619488] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.322 [2024-10-07 11:29:13.619584] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.322 [2024-10-07 11:29:13.619611] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.322 [2024-10-07 11:29:13.619627] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.322 [2024-10-07 11:29:13.619671] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.322 [2024-10-07 11:29:13.619692] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.322 [2024-10-07 11:29:13.619707] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.322 [2024-10-07 11:29:13.622415] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.322 [2024-10-07 11:29:13.622501] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.322 [2024-10-07 11:29:13.622929] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.322 [2024-10-07 11:29:13.622965] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.322 [2024-10-07 11:29:13.622981] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.322 [2024-10-07 11:29:13.622998] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.322 [2024-10-07 11:29:13.623011] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.322 [2024-10-07 11:29:13.623023] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.322 [2024-10-07 11:29:13.623189] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.322 [2024-10-07 11:29:13.623211] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.322 [2024-10-07 11:29:13.629562] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.322 [2024-10-07 11:29:13.629638] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.322 [2024-10-07 11:29:13.629725] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.322 [2024-10-07 11:29:13.629752] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.322 [2024-10-07 11:29:13.629768] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.322 [2024-10-07 11:29:13.629817] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.322 [2024-10-07 11:29:13.629839] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.322 [2024-10-07 11:29:13.629853] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.322 [2024-10-07 11:29:13.629870] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.322 [2024-10-07 11:29:13.629892] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.322 [2024-10-07 11:29:13.629908] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.322 [2024-10-07 11:29:13.629920] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.322 [2024-10-07 11:29:13.629933] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.322 [2024-10-07 11:29:13.629954] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.322 [2024-10-07 11:29:13.629997] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.322 [2024-10-07 11:29:13.630011] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.322 [2024-10-07 11:29:13.630024] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.322 [2024-10-07 11:29:13.630046] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.322 [2024-10-07 11:29:13.639764] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.322 [2024-10-07 11:29:13.639810] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.322 [2024-10-07 11:29:13.639906] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.322 [2024-10-07 11:29:13.639933] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.322 [2024-10-07 11:29:13.639963] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.322 [2024-10-07 11:29:13.640011] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.322 [2024-10-07 11:29:13.640033] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.322 [2024-10-07 11:29:13.640048] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.322 [2024-10-07 11:29:13.640287] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.322 [2024-10-07 11:29:13.640315] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.322 [2024-10-07 11:29:13.640585] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.322 [2024-10-07 11:29:13.640623] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.322 [2024-10-07 11:29:13.640640] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.322 [2024-10-07 11:29:13.640657] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.322 [2024-10-07 11:29:13.640670] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.322 [2024-10-07 11:29:13.640683] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.322 [2024-10-07 11:29:13.640744] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.322 [2024-10-07 11:29:13.640766] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.322 [2024-10-07 11:29:13.652889] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.322 [2024-10-07 11:29:13.652937] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.322 [2024-10-07 11:29:13.653642] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.322 [2024-10-07 11:29:13.653698] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.322 [2024-10-07 11:29:13.653716] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.322 [2024-10-07 11:29:13.653778] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.322 [2024-10-07 11:29:13.653800] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.322 [2024-10-07 11:29:13.653814] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.322 [2024-10-07 11:29:13.654156] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.322 [2024-10-07 11:29:13.654188] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.322 [2024-10-07 11:29:13.654258] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.322 [2024-10-07 11:29:13.654280] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.322 [2024-10-07 11:29:13.654295] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.322 [2024-10-07 11:29:13.654312] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.322 [2024-10-07 11:29:13.654326] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.322 [2024-10-07 11:29:13.654339] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.322 [2024-10-07 11:29:13.654379] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.322 [2024-10-07 11:29:13.654394] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.322 [2024-10-07 11:29:13.666972] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.322 [2024-10-07 11:29:13.667020] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.322 [2024-10-07 11:29:13.667950] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.322 [2024-10-07 11:29:13.667982] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.322 [2024-10-07 11:29:13.667998] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.322 [2024-10-07 11:29:13.668043] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.322 [2024-10-07 11:29:13.668064] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.322 [2024-10-07 11:29:13.668095] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.322 [2024-10-07 11:29:13.668334] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.322 [2024-10-07 11:29:13.668364] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.322 [2024-10-07 11:29:13.668658] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.322 [2024-10-07 11:29:13.668686] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.322 [2024-10-07 11:29:13.668701] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.322 [2024-10-07 11:29:13.668718] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.322 [2024-10-07 11:29:13.668732] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.322 [2024-10-07 11:29:13.668745] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.322 [2024-10-07 11:29:13.668868] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.322 [2024-10-07 11:29:13.668891] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.322 [2024-10-07 11:29:13.679497] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.322 [2024-10-07 11:29:13.679543] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.322 [2024-10-07 11:29:13.679724] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.323 [2024-10-07 11:29:13.679764] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.323 [2024-10-07 11:29:13.679783] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.323 [2024-10-07 11:29:13.679846] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.323 [2024-10-07 11:29:13.679869] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.323 [2024-10-07 11:29:13.679884] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.323 [2024-10-07 11:29:13.680082] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.323 [2024-10-07 11:29:13.680119] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.323 [2024-10-07 11:29:13.680186] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.323 [2024-10-07 11:29:13.680208] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.323 [2024-10-07 11:29:13.680222] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.323 [2024-10-07 11:29:13.680238] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.323 [2024-10-07 11:29:13.680252] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.323 [2024-10-07 11:29:13.680265] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.323 [2024-10-07 11:29:13.680287] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.323 [2024-10-07 11:29:13.680301] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.323 [2024-10-07 11:29:13.697040] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.323 [2024-10-07 11:29:13.697086] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.323 [2024-10-07 11:29:13.697247] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.323 [2024-10-07 11:29:13.697276] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.323 [2024-10-07 11:29:13.697293] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.323 [2024-10-07 11:29:13.697337] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.323 [2024-10-07 11:29:13.697358] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.323 [2024-10-07 11:29:13.697373] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.323 [2024-10-07 11:29:13.697395] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.323 [2024-10-07 11:29:13.697413] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.323 [2024-10-07 11:29:13.697463] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.323 [2024-10-07 11:29:13.697480] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.323 [2024-10-07 11:29:13.697494] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.323 [2024-10-07 11:29:13.697510] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.323 [2024-10-07 11:29:13.697524] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.323 [2024-10-07 11:29:13.697537] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.323 [2024-10-07 11:29:13.697560] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.323 [2024-10-07 11:29:13.697574] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.323 [2024-10-07 11:29:13.711238] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.323 [2024-10-07 11:29:13.711285] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.323 [2024-10-07 11:29:13.711686] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.323 [2024-10-07 11:29:13.711728] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.323 [2024-10-07 11:29:13.711746] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.323 [2024-10-07 11:29:13.711830] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.323 [2024-10-07 11:29:13.711853] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.323 [2024-10-07 11:29:13.711868] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.323 [2024-10-07 11:29:13.712060] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.323 [2024-10-07 11:29:13.712118] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.323 [2024-10-07 11:29:13.712172] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.323 [2024-10-07 11:29:13.712193] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.323 [2024-10-07 11:29:13.712207] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.323 [2024-10-07 11:29:13.712223] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.323 [2024-10-07 11:29:13.712236] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.323 [2024-10-07 11:29:13.712248] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.323 [2024-10-07 11:29:13.712271] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.323 [2024-10-07 11:29:13.712284] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.323 [2024-10-07 11:29:13.723479] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.323 [2024-10-07 11:29:13.723525] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.323 [2024-10-07 11:29:13.723622] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.323 [2024-10-07 11:29:13.723648] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.323 [2024-10-07 11:29:13.723664] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.323 [2024-10-07 11:29:13.723707] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.323 [2024-10-07 11:29:13.723738] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.323 [2024-10-07 11:29:13.723753] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.323 [2024-10-07 11:29:13.723775] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.323 [2024-10-07 11:29:13.723793] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.323 [2024-10-07 11:29:13.723812] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.323 [2024-10-07 11:29:13.723825] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.323 [2024-10-07 11:29:13.723838] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.323 [2024-10-07 11:29:13.723852] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.323 [2024-10-07 11:29:13.723866] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.323 [2024-10-07 11:29:13.723878] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.323 [2024-10-07 11:29:13.723899] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.323 [2024-10-07 11:29:13.723925] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.323 [2024-10-07 11:29:13.735581] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.323 [2024-10-07 11:29:13.735627] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.323 [2024-10-07 11:29:13.736923] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.323 [2024-10-07 11:29:13.736979] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.323 [2024-10-07 11:29:13.736997] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.323 [2024-10-07 11:29:13.737044] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.323 [2024-10-07 11:29:13.737065] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.323 [2024-10-07 11:29:13.737079] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.323 [2024-10-07 11:29:13.737192] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.323 [2024-10-07 11:29:13.737217] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.323 [2024-10-07 11:29:13.737237] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.323 [2024-10-07 11:29:13.737251] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.324 [2024-10-07 11:29:13.737263] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.324 [2024-10-07 11:29:13.737279] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.324 [2024-10-07 11:29:13.737292] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.324 [2024-10-07 11:29:13.737304] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.324 [2024-10-07 11:29:13.737337] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.324 [2024-10-07 11:29:13.737352] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.324 [2024-10-07 11:29:13.749336] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.324 [2024-10-07 11:29:13.749382] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.324 [2024-10-07 11:29:13.749586] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.324 [2024-10-07 11:29:13.749616] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.324 [2024-10-07 11:29:13.749633] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.324 [2024-10-07 11:29:13.749677] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.324 [2024-10-07 11:29:13.749698] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.324 [2024-10-07 11:29:13.749713] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.324 [2024-10-07 11:29:13.749873] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.324 [2024-10-07 11:29:13.749900] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.324 [2024-10-07 11:29:13.749947] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.324 [2024-10-07 11:29:13.750027] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.324 [2024-10-07 11:29:13.750050] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.324 [2024-10-07 11:29:13.750067] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.324 [2024-10-07 11:29:13.750081] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.324 [2024-10-07 11:29:13.750094] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.324 [2024-10-07 11:29:13.750118] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.324 [2024-10-07 11:29:13.750132] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.324 [2024-10-07 11:29:13.762251] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.324 [2024-10-07 11:29:13.762316] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.324 [2024-10-07 11:29:13.762401] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.324 [2024-10-07 11:29:13.762453] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.324 [2024-10-07 11:29:13.762474] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.324 [2024-10-07 11:29:13.762525] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.324 [2024-10-07 11:29:13.762548] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.324 [2024-10-07 11:29:13.762564] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.324 [2024-10-07 11:29:13.763413] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.324 [2024-10-07 11:29:13.763463] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.324 [2024-10-07 11:29:13.764266] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.324 [2024-10-07 11:29:13.764302] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.324 [2024-10-07 11:29:13.764319] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.324 [2024-10-07 11:29:13.764336] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.324 [2024-10-07 11:29:13.764351] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.324 [2024-10-07 11:29:13.764364] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.324 [2024-10-07 11:29:13.764916] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.324 [2024-10-07 11:29:13.764952] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.324 [2024-10-07 11:29:13.775914] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.324 [2024-10-07 11:29:13.775960] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.324 [2024-10-07 11:29:13.776232] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.324 [2024-10-07 11:29:13.776273] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.324 [2024-10-07 11:29:13.776292] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.324 [2024-10-07 11:29:13.776339] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.324 [2024-10-07 11:29:13.776379] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.324 [2024-10-07 11:29:13.776396] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.324 [2024-10-07 11:29:13.776656] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.324 [2024-10-07 11:29:13.776686] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.324 [2024-10-07 11:29:13.776754] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.324 [2024-10-07 11:29:13.776776] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.324 [2024-10-07 11:29:13.776790] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.324 [2024-10-07 11:29:13.776805] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.324 [2024-10-07 11:29:13.776819] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.324 [2024-10-07 11:29:13.776831] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.324 [2024-10-07 11:29:13.776853] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.324 [2024-10-07 11:29:13.776866] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.324 [2024-10-07 11:29:13.786074] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.324 [2024-10-07 11:29:13.786121] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.324 [2024-10-07 11:29:13.786206] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.324 [2024-10-07 11:29:13.786234] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.324 [2024-10-07 11:29:13.786251] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.324 [2024-10-07 11:29:13.786309] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.324 [2024-10-07 11:29:13.786330] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.324 [2024-10-07 11:29:13.786345] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.324 [2024-10-07 11:29:13.786368] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.324 [2024-10-07 11:29:13.786386] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.324 [2024-10-07 11:29:13.788671] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.324 [2024-10-07 11:29:13.788709] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.324 [2024-10-07 11:29:13.788726] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.324 [2024-10-07 11:29:13.788743] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.324 [2024-10-07 11:29:13.788758] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.324 [2024-10-07 11:29:13.788770] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.324 [2024-10-07 11:29:13.789590] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.324 [2024-10-07 11:29:13.789623] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.324 [2024-10-07 11:29:13.796212] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.324 [2024-10-07 11:29:13.796289] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.324 [2024-10-07 11:29:13.796365] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.324 [2024-10-07 11:29:13.796393] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.324 [2024-10-07 11:29:13.796410] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.324 [2024-10-07 11:29:13.796480] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.324 [2024-10-07 11:29:13.796505] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.324 [2024-10-07 11:29:13.796520] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.324 [2024-10-07 11:29:13.796538] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.324 [2024-10-07 11:29:13.796562] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.324 [2024-10-07 11:29:13.796579] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.324 [2024-10-07 11:29:13.796593] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.324 [2024-10-07 11:29:13.796606] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.324 [2024-10-07 11:29:13.796629] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.324 [2024-10-07 11:29:13.796643] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.325 [2024-10-07 11:29:13.796656] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.325 [2024-10-07 11:29:13.796669] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.325 [2024-10-07 11:29:13.796690] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.325 [2024-10-07 11:29:13.806305] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.325 [2024-10-07 11:29:13.806422] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.325 [2024-10-07 11:29:13.806452] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.325 [2024-10-07 11:29:13.806470] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.325 [2024-10-07 11:29:13.806507] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.325 [2024-10-07 11:29:13.806536] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.325 [2024-10-07 11:29:13.806563] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.325 [2024-10-07 11:29:13.806579] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.325 [2024-10-07 11:29:13.806593] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.325 [2024-10-07 11:29:13.806614] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.325 [2024-10-07 11:29:13.806665] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.325 [2024-10-07 11:29:13.806688] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.325 [2024-10-07 11:29:13.806704] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.325 [2024-10-07 11:29:13.806743] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.325 [2024-10-07 11:29:13.806780] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.325 [2024-10-07 11:29:13.806795] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.325 [2024-10-07 11:29:13.806808] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.325 [2024-10-07 11:29:13.806829] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.325 [2024-10-07 11:29:13.816386] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.325 [2024-10-07 11:29:13.816502] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.325 [2024-10-07 11:29:13.816533] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.325 [2024-10-07 11:29:13.816550] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.325 [2024-10-07 11:29:13.816573] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.325 [2024-10-07 11:29:13.816608] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.325 [2024-10-07 11:29:13.816626] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.325 [2024-10-07 11:29:13.816640] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.325 [2024-10-07 11:29:13.816663] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.325 [2024-10-07 11:29:13.816682] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.325 [2024-10-07 11:29:13.816743] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.325 [2024-10-07 11:29:13.816769] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.325 [2024-10-07 11:29:13.816800] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.325 [2024-10-07 11:29:13.816821] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.325 [2024-10-07 11:29:13.816842] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.325 [2024-10-07 11:29:13.816856] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.325 [2024-10-07 11:29:13.816869] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.325 [2024-10-07 11:29:13.816890] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.325 [2024-10-07 11:29:13.828104] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.325 [2024-10-07 11:29:13.828150] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.325 [2024-10-07 11:29:13.828284] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.325 [2024-10-07 11:29:13.828312] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.325 [2024-10-07 11:29:13.828328] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.325 [2024-10-07 11:29:13.828372] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.325 [2024-10-07 11:29:13.828393] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.325 [2024-10-07 11:29:13.828422] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.325 [2024-10-07 11:29:13.828464] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.325 [2024-10-07 11:29:13.828483] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.325 [2024-10-07 11:29:13.828502] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.325 [2024-10-07 11:29:13.828515] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.325 [2024-10-07 11:29:13.828528] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.325 [2024-10-07 11:29:13.828543] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.325 [2024-10-07 11:29:13.828557] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.325 [2024-10-07 11:29:13.828569] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.325 [2024-10-07 11:29:13.828827] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.325 [2024-10-07 11:29:13.828850] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.325 [2024-10-07 11:29:13.838226] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.325 [2024-10-07 11:29:13.838289] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.325 [2024-10-07 11:29:13.838368] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.325 [2024-10-07 11:29:13.838396] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.325 [2024-10-07 11:29:13.838426] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.325 [2024-10-07 11:29:13.838484] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.325 [2024-10-07 11:29:13.838508] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.325 [2024-10-07 11:29:13.838523] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.325 [2024-10-07 11:29:13.838541] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.325 [2024-10-07 11:29:13.838579] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.325 [2024-10-07 11:29:13.838595] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.325 [2024-10-07 11:29:13.838609] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.325 [2024-10-07 11:29:13.838621] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.325 [2024-10-07 11:29:13.838644] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.325 [2024-10-07 11:29:13.838658] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.325 [2024-10-07 11:29:13.838670] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.325 [2024-10-07 11:29:13.838683] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.325 [2024-10-07 11:29:13.838702] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.325 [2024-10-07 11:29:13.850437] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.325 [2024-10-07 11:29:13.850500] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.325 [2024-10-07 11:29:13.850772] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.325 [2024-10-07 11:29:13.850806] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.325 [2024-10-07 11:29:13.850824] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.325 [2024-10-07 11:29:13.850870] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.325 [2024-10-07 11:29:13.850893] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.325 [2024-10-07 11:29:13.850908] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.325 [2024-10-07 11:29:13.850966] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.325 [2024-10-07 11:29:13.850991] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.325 [2024-10-07 11:29:13.851160] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.325 [2024-10-07 11:29:13.851183] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.325 [2024-10-07 11:29:13.851197] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.325 [2024-10-07 11:29:13.851214] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.325 [2024-10-07 11:29:13.851228] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.325 [2024-10-07 11:29:13.851241] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.325 [2024-10-07 11:29:13.851295] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.325 [2024-10-07 11:29:13.851316] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.325 [2024-10-07 11:29:13.864916] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.326 [2024-10-07 11:29:13.864965] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.326 [2024-10-07 11:29:13.865598] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.326 [2024-10-07 11:29:13.865655] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.326 [2024-10-07 11:29:13.865689] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.326 [2024-10-07 11:29:13.865735] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.326 [2024-10-07 11:29:13.865763] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.326 [2024-10-07 11:29:13.865778] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.326 [2024-10-07 11:29:13.866013] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.326 [2024-10-07 11:29:13.866050] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.326 [2024-10-07 11:29:13.866560] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.326 [2024-10-07 11:29:13.866597] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.326 [2024-10-07 11:29:13.866614] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.326 [2024-10-07 11:29:13.866631] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.326 [2024-10-07 11:29:13.866660] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.326 [2024-10-07 11:29:13.866674] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.326 [2024-10-07 11:29:13.866910] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.326 [2024-10-07 11:29:13.866936] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.326 [2024-10-07 11:29:13.878250] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.326 [2024-10-07 11:29:13.878300] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.326 [2024-10-07 11:29:13.878398] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.326 [2024-10-07 11:29:13.878438] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.326 [2024-10-07 11:29:13.878457] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.326 [2024-10-07 11:29:13.878505] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.326 [2024-10-07 11:29:13.878542] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.326 [2024-10-07 11:29:13.878557] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.326 [2024-10-07 11:29:13.878579] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.326 [2024-10-07 11:29:13.878598] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.326 [2024-10-07 11:29:13.878617] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.326 [2024-10-07 11:29:13.878630] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.326 [2024-10-07 11:29:13.878643] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.326 [2024-10-07 11:29:13.878658] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.326 [2024-10-07 11:29:13.878671] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.326 [2024-10-07 11:29:13.878685] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.326 [2024-10-07 11:29:13.878706] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.326 [2024-10-07 11:29:13.878719] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.326 [2024-10-07 11:29:13.888478] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.326 [2024-10-07 11:29:13.888523] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.326 [2024-10-07 11:29:13.888618] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.326 [2024-10-07 11:29:13.888645] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.326 [2024-10-07 11:29:13.888661] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.326 [2024-10-07 11:29:13.888705] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.326 [2024-10-07 11:29:13.888727] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.326 [2024-10-07 11:29:13.888741] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.326 [2024-10-07 11:29:13.891490] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.326 [2024-10-07 11:29:13.891535] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.326 [2024-10-07 11:29:13.893115] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.326 [2024-10-07 11:29:13.893152] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.326 [2024-10-07 11:29:13.893185] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.326 [2024-10-07 11:29:13.893203] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.326 [2024-10-07 11:29:13.893217] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.326 [2024-10-07 11:29:13.893229] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.326 [2024-10-07 11:29:13.893307] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.326 [2024-10-07 11:29:13.893329] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.326 [2024-10-07 11:29:13.899081] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.326 [2024-10-07 11:29:13.899126] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.326 [2024-10-07 11:29:13.899298] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.326 [2024-10-07 11:29:13.899327] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.326 [2024-10-07 11:29:13.899343] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.326 [2024-10-07 11:29:13.899387] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.326 [2024-10-07 11:29:13.899409] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.326 [2024-10-07 11:29:13.899437] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.326 [2024-10-07 11:29:13.899476] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.326 [2024-10-07 11:29:13.899498] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.326 [2024-10-07 11:29:13.899518] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.326 [2024-10-07 11:29:13.899532] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.326 [2024-10-07 11:29:13.899545] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.326 [2024-10-07 11:29:13.899561] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.326 [2024-10-07 11:29:13.899575] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.326 [2024-10-07 11:29:13.899587] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.326 [2024-10-07 11:29:13.899609] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.326 [2024-10-07 11:29:13.899623] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.326 [2024-10-07 11:29:13.909236] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.326 [2024-10-07 11:29:13.909281] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.326 [2024-10-07 11:29:13.909391] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.326 [2024-10-07 11:29:13.909450] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.326 [2024-10-07 11:29:13.909483] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.326 [2024-10-07 11:29:13.909535] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.326 [2024-10-07 11:29:13.909558] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.326 [2024-10-07 11:29:13.909574] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.326 [2024-10-07 11:29:13.909598] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.326 [2024-10-07 11:29:13.909617] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.326 [2024-10-07 11:29:13.909637] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.326 [2024-10-07 11:29:13.909651] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.326 [2024-10-07 11:29:13.909665] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.326 [2024-10-07 11:29:13.909680] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.326 [2024-10-07 11:29:13.909699] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.326 [2024-10-07 11:29:13.909712] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.326 [2024-10-07 11:29:13.909750] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.326 [2024-10-07 11:29:13.909763] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.326 [2024-10-07 11:29:13.921024] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.326 [2024-10-07 11:29:13.921070] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.326 [2024-10-07 11:29:13.921265] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.326 [2024-10-07 11:29:13.921300] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.327 [2024-10-07 11:29:13.921316] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.327 [2024-10-07 11:29:13.921360] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.327 [2024-10-07 11:29:13.921381] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.327 [2024-10-07 11:29:13.921396] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.327 [2024-10-07 11:29:13.921506] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.327 [2024-10-07 11:29:13.921531] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.327 [2024-10-07 11:29:13.921621] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.327 [2024-10-07 11:29:13.921639] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.327 [2024-10-07 11:29:13.921652] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.327 [2024-10-07 11:29:13.921667] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.327 [2024-10-07 11:29:13.921681] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.327 [2024-10-07 11:29:13.921707] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.327 [2024-10-07 11:29:13.922055] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.327 [2024-10-07 11:29:13.922079] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.327 [2024-10-07 11:29:13.933430] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.327 [2024-10-07 11:29:13.933487] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.327 [2024-10-07 11:29:13.933689] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.327 [2024-10-07 11:29:13.933718] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.327 [2024-10-07 11:29:13.933735] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.327 [2024-10-07 11:29:13.933779] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.327 [2024-10-07 11:29:13.933800] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.327 [2024-10-07 11:29:13.933814] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.327 [2024-10-07 11:29:13.933921] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.327 [2024-10-07 11:29:13.933945] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.327 [2024-10-07 11:29:13.934067] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.327 [2024-10-07 11:29:13.934088] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.327 [2024-10-07 11:29:13.934102] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.327 [2024-10-07 11:29:13.934118] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.327 [2024-10-07 11:29:13.934132] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.327 [2024-10-07 11:29:13.934145] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.327 [2024-10-07 11:29:13.935386] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.327 [2024-10-07 11:29:13.935451] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.327 [2024-10-07 11:29:13.947277] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.327 [2024-10-07 11:29:13.947324] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.327 [2024-10-07 11:29:13.947528] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.327 [2024-10-07 11:29:13.947557] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.327 [2024-10-07 11:29:13.947573] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.327 [2024-10-07 11:29:13.947618] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.327 [2024-10-07 11:29:13.947639] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.327 [2024-10-07 11:29:13.947653] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.327 [2024-10-07 11:29:13.949018] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.327 [2024-10-07 11:29:13.949089] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.327 [2024-10-07 11:29:13.950629] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.327 [2024-10-07 11:29:13.950666] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.327 [2024-10-07 11:29:13.950699] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.327 [2024-10-07 11:29:13.950716] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.327 [2024-10-07 11:29:13.950729] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.327 [2024-10-07 11:29:13.950742] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.327 [2024-10-07 11:29:13.951372] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.327 [2024-10-07 11:29:13.951406] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.327 [2024-10-07 11:29:13.957660] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.327 [2024-10-07 11:29:13.957705] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.327 [2024-10-07 11:29:13.957899] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.327 [2024-10-07 11:29:13.957928] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.327 [2024-10-07 11:29:13.957951] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.327 [2024-10-07 11:29:13.958026] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.327 [2024-10-07 11:29:13.958049] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.327 [2024-10-07 11:29:13.958065] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.327 [2024-10-07 11:29:13.958276] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.327 [2024-10-07 11:29:13.958334] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.327 [2024-10-07 11:29:13.958479] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.327 [2024-10-07 11:29:13.958503] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.327 [2024-10-07 11:29:13.958517] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.327 [2024-10-07 11:29:13.958533] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.327 [2024-10-07 11:29:13.958547] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.327 [2024-10-07 11:29:13.958559] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.327 [2024-10-07 11:29:13.958682] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.327 [2024-10-07 11:29:13.958704] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.327 [2024-10-07 11:29:13.967777] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.327 [2024-10-07 11:29:13.967852] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.327 [2024-10-07 11:29:13.967924] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.327 [2024-10-07 11:29:13.967950] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.327 [2024-10-07 11:29:13.967985] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.327 [2024-10-07 11:29:13.968039] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.327 [2024-10-07 11:29:13.968063] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.327 [2024-10-07 11:29:13.968078] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.327 [2024-10-07 11:29:13.968095] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.327 [2024-10-07 11:29:13.968118] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.327 [2024-10-07 11:29:13.968133] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.327 [2024-10-07 11:29:13.968146] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.327 [2024-10-07 11:29:13.968158] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.327 [2024-10-07 11:29:13.968197] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.327 [2024-10-07 11:29:13.968211] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.327 [2024-10-07 11:29:13.968223] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.327 [2024-10-07 11:29:13.968235] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.327 [2024-10-07 11:29:13.968255] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.327 [2024-10-07 11:29:13.981401] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.327 [2024-10-07 11:29:13.981475] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.327 [2024-10-07 11:29:13.981963] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.327 [2024-10-07 11:29:13.982063] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.327 [2024-10-07 11:29:13.982082] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.327 [2024-10-07 11:29:13.982130] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.327 [2024-10-07 11:29:13.982153] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.327 [2024-10-07 11:29:13.982168] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.327 [2024-10-07 11:29:13.982446] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.327 [2024-10-07 11:29:13.982489] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.327 [2024-10-07 11:29:13.982536] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.328 [2024-10-07 11:29:13.982555] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.328 [2024-10-07 11:29:13.982569] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.328 [2024-10-07 11:29:13.982585] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.328 [2024-10-07 11:29:13.982599] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.328 [2024-10-07 11:29:13.982612] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.328 [2024-10-07 11:29:13.982651] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.328 [2024-10-07 11:29:13.982667] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.328 [2024-10-07 11:29:13.995074] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.328 [2024-10-07 11:29:13.995121] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.328 [2024-10-07 11:29:13.995452] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.328 [2024-10-07 11:29:13.995491] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.328 [2024-10-07 11:29:13.995509] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.328 [2024-10-07 11:29:13.995558] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.328 [2024-10-07 11:29:13.995580] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.328 [2024-10-07 11:29:13.995595] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.328 [2024-10-07 11:29:13.995807] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.328 [2024-10-07 11:29:13.995837] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.328 [2024-10-07 11:29:13.996063] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.328 [2024-10-07 11:29:13.996096] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.328 [2024-10-07 11:29:13.996113] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.328 [2024-10-07 11:29:13.996129] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.328 [2024-10-07 11:29:13.996143] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.328 [2024-10-07 11:29:13.996155] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.328 [2024-10-07 11:29:13.996212] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.328 [2024-10-07 11:29:13.996231] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.328 [2024-10-07 11:29:14.007560] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.328 [2024-10-07 11:29:14.007606] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.328 [2024-10-07 11:29:14.007700] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.328 [2024-10-07 11:29:14.007727] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.328 [2024-10-07 11:29:14.007743] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.328 [2024-10-07 11:29:14.007786] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.328 [2024-10-07 11:29:14.007807] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.328 [2024-10-07 11:29:14.007822] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.328 [2024-10-07 11:29:14.007844] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.328 [2024-10-07 11:29:14.007862] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.328 [2024-10-07 11:29:14.007897] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.328 [2024-10-07 11:29:14.007911] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.328 [2024-10-07 11:29:14.007924] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.328 [2024-10-07 11:29:14.007940] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.328 [2024-10-07 11:29:14.007953] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.328 [2024-10-07 11:29:14.007965] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.328 [2024-10-07 11:29:14.008212] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.328 [2024-10-07 11:29:14.008236] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.328 [2024-10-07 11:29:14.020566] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.328 [2024-10-07 11:29:14.020613] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.328 [2024-10-07 11:29:14.020793] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.328 [2024-10-07 11:29:14.020822] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.328 [2024-10-07 11:29:14.020838] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.328 [2024-10-07 11:29:14.020881] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.328 [2024-10-07 11:29:14.020903] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.328 [2024-10-07 11:29:14.020918] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.328 [2024-10-07 11:29:14.021024] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.328 [2024-10-07 11:29:14.021049] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.328 [2024-10-07 11:29:14.021140] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.328 [2024-10-07 11:29:14.021157] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.328 [2024-10-07 11:29:14.021170] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.328 [2024-10-07 11:29:14.021202] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.328 [2024-10-07 11:29:14.021216] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.328 [2024-10-07 11:29:14.021229] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.328 [2024-10-07 11:29:14.022342] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.328 [2024-10-07 11:29:14.022378] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.328 [2024-10-07 11:29:14.030868] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.328 [2024-10-07 11:29:14.030916] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.328 [2024-10-07 11:29:14.030997] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.328 [2024-10-07 11:29:14.031026] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.328 [2024-10-07 11:29:14.031042] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.328 [2024-10-07 11:29:14.031109] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.328 [2024-10-07 11:29:14.031133] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.328 [2024-10-07 11:29:14.031149] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.328 [2024-10-07 11:29:14.031173] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.328 [2024-10-07 11:29:14.031192] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.328 [2024-10-07 11:29:14.031212] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.328 [2024-10-07 11:29:14.031226] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.328 [2024-10-07 11:29:14.031240] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.328 [2024-10-07 11:29:14.031257] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.328 [2024-10-07 11:29:14.031271] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.328 [2024-10-07 11:29:14.031284] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.328 [2024-10-07 11:29:14.031306] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.328 [2024-10-07 11:29:14.031320] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.328 [2024-10-07 11:29:14.043060] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.328 [2024-10-07 11:29:14.043107] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.328 [2024-10-07 11:29:14.043213] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.328 [2024-10-07 11:29:14.043241] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.328 [2024-10-07 11:29:14.043257] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.328 [2024-10-07 11:29:14.043301] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.328 [2024-10-07 11:29:14.043322] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.329 [2024-10-07 11:29:14.043336] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.329 [2024-10-07 11:29:14.043359] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.329 [2024-10-07 11:29:14.043377] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.329 [2024-10-07 11:29:14.043396] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.329 [2024-10-07 11:29:14.043421] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.329 [2024-10-07 11:29:14.043437] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.329 [2024-10-07 11:29:14.043452] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.329 [2024-10-07 11:29:14.043466] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.329 [2024-10-07 11:29:14.043478] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.329 [2024-10-07 11:29:14.043500] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.329 [2024-10-07 11:29:14.043528] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.329 [2024-10-07 11:29:14.053475] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.329 [2024-10-07 11:29:14.053521] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.329 [2024-10-07 11:29:14.053702] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.329 [2024-10-07 11:29:14.053732] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.329 [2024-10-07 11:29:14.053748] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.329 [2024-10-07 11:29:14.053793] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.329 [2024-10-07 11:29:14.053815] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.329 [2024-10-07 11:29:14.053846] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.329 [2024-10-07 11:29:14.055411] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.329 [2024-10-07 11:29:14.055478] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.329 [2024-10-07 11:29:14.056124] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.329 [2024-10-07 11:29:14.056157] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.329 [2024-10-07 11:29:14.056188] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.329 [2024-10-07 11:29:14.056205] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.329 [2024-10-07 11:29:14.056218] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.329 [2024-10-07 11:29:14.056231] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.329 [2024-10-07 11:29:14.056254] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.329 [2024-10-07 11:29:14.056268] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.329 [2024-10-07 11:29:14.063595] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.329 [2024-10-07 11:29:14.063657] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.329 [2024-10-07 11:29:14.063737] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.329 [2024-10-07 11:29:14.063764] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.329 [2024-10-07 11:29:14.063781] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.329 [2024-10-07 11:29:14.063834] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.329 [2024-10-07 11:29:14.063857] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.329 [2024-10-07 11:29:14.063873] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.329 [2024-10-07 11:29:14.063891] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.329 [2024-10-07 11:29:14.063915] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.329 [2024-10-07 11:29:14.063932] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.329 [2024-10-07 11:29:14.063967] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.329 [2024-10-07 11:29:14.063981] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.329 [2024-10-07 11:29:14.065289] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.329 [2024-10-07 11:29:14.065328] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.329 [2024-10-07 11:29:14.065345] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.329 [2024-10-07 11:29:14.065358] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.329 [2024-10-07 11:29:14.066101] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.329 [2024-10-07 11:29:14.074559] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.329 [2024-10-07 11:29:14.074604] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.329 [2024-10-07 11:29:14.075229] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.329 [2024-10-07 11:29:14.075284] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.329 [2024-10-07 11:29:14.075303] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.329 [2024-10-07 11:29:14.075351] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.329 [2024-10-07 11:29:14.075372] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.329 [2024-10-07 11:29:14.075402] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.329 [2024-10-07 11:29:14.075503] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.329 [2024-10-07 11:29:14.075531] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.329 [2024-10-07 11:29:14.075551] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.329 [2024-10-07 11:29:14.075566] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.329 [2024-10-07 11:29:14.075579] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.329 [2024-10-07 11:29:14.075595] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.329 [2024-10-07 11:29:14.075608] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.329 [2024-10-07 11:29:14.075621] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.329 [2024-10-07 11:29:14.075643] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.329 [2024-10-07 11:29:14.075657] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.329 [2024-10-07 11:29:14.086015] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.329 [2024-10-07 11:29:14.086070] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.329 [2024-10-07 11:29:14.086346] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.329 [2024-10-07 11:29:14.086429] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.329 [2024-10-07 11:29:14.086449] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.329 [2024-10-07 11:29:14.086496] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.329 [2024-10-07 11:29:14.086533] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.329 [2024-10-07 11:29:14.086549] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.329 [2024-10-07 11:29:14.086754] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.329 [2024-10-07 11:29:14.086784] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.329 [2024-10-07 11:29:14.086836] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.329 [2024-10-07 11:29:14.086856] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.329 [2024-10-07 11:29:14.086869] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.329 [2024-10-07 11:29:14.086885] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.329 [2024-10-07 11:29:14.086899] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.329 [2024-10-07 11:29:14.086911] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.329 [2024-10-07 11:29:14.087071] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.329 [2024-10-07 11:29:14.087092] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.329 [2024-10-07 11:29:14.096619] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.329 [2024-10-07 11:29:14.096665] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.329 [2024-10-07 11:29:14.096771] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.329 [2024-10-07 11:29:14.096799] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.329 [2024-10-07 11:29:14.096815] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.329 [2024-10-07 11:29:14.096860] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.329 [2024-10-07 11:29:14.096881] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.329 [2024-10-07 11:29:14.096896] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.329 [2024-10-07 11:29:14.099651] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.329 [2024-10-07 11:29:14.099694] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.329 [2024-10-07 11:29:14.100419] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.329 [2024-10-07 11:29:14.100462] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.329 [2024-10-07 11:29:14.100496] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.329 [2024-10-07 11:29:14.100512] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.330 [2024-10-07 11:29:14.100525] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.330 [2024-10-07 11:29:14.100537] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.330 [2024-10-07 11:29:14.100718] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.330 [2024-10-07 11:29:14.100741] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.330 [2024-10-07 11:29:14.106752] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.330 [2024-10-07 11:29:14.106828] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.330 [2024-10-07 11:29:14.106899] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.330 [2024-10-07 11:29:14.106926] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.330 [2024-10-07 11:29:14.106942] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.330 [2024-10-07 11:29:14.106992] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.330 [2024-10-07 11:29:14.107014] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.330 [2024-10-07 11:29:14.107028] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.330 [2024-10-07 11:29:14.107045] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.330 [2024-10-07 11:29:14.107067] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.330 [2024-10-07 11:29:14.107083] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.330 [2024-10-07 11:29:14.107096] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.330 [2024-10-07 11:29:14.107108] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.330 [2024-10-07 11:29:14.107130] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.330 [2024-10-07 11:29:14.107143] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.330 [2024-10-07 11:29:14.107156] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.330 [2024-10-07 11:29:14.107168] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.330 [2024-10-07 11:29:14.107187] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.330 [2024-10-07 11:29:14.118742] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.330 [2024-10-07 11:29:14.118803] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.330 [2024-10-07 11:29:14.118897] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.330 [2024-10-07 11:29:14.118924] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.330 [2024-10-07 11:29:14.118940] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.330 [2024-10-07 11:29:14.118983] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.330 [2024-10-07 11:29:14.119003] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.330 [2024-10-07 11:29:14.119018] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.330 [2024-10-07 11:29:14.119040] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.330 [2024-10-07 11:29:14.119059] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.330 [2024-10-07 11:29:14.119078] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.330 [2024-10-07 11:29:14.119092] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.330 [2024-10-07 11:29:14.119120] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.330 [2024-10-07 11:29:14.119137] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.330 [2024-10-07 11:29:14.119151] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.330 [2024-10-07 11:29:14.119163] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.330 [2024-10-07 11:29:14.119184] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.330 [2024-10-07 11:29:14.119198] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.330 [2024-10-07 11:29:14.132010] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.330 [2024-10-07 11:29:14.132056] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.330 [2024-10-07 11:29:14.132168] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.330 [2024-10-07 11:29:14.132211] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.330 [2024-10-07 11:29:14.132228] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.330 [2024-10-07 11:29:14.132274] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.330 [2024-10-07 11:29:14.132296] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.330 [2024-10-07 11:29:14.132311] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.330 [2024-10-07 11:29:14.132335] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.330 [2024-10-07 11:29:14.132354] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.330 [2024-10-07 11:29:14.132374] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.330 [2024-10-07 11:29:14.132387] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.330 [2024-10-07 11:29:14.132401] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.330 [2024-10-07 11:29:14.132416] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.330 [2024-10-07 11:29:14.132429] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.330 [2024-10-07 11:29:14.132442] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.330 [2024-10-07 11:29:14.132479] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.330 [2024-10-07 11:29:14.132496] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.330 [2024-10-07 11:29:14.145472] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.330 [2024-10-07 11:29:14.145519] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.330 [2024-10-07 11:29:14.145617] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.330 [2024-10-07 11:29:14.145645] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.330 [2024-10-07 11:29:14.145661] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.330 [2024-10-07 11:29:14.145705] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.330 [2024-10-07 11:29:14.145726] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.330 [2024-10-07 11:29:14.145758] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.330 [2024-10-07 11:29:14.145784] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.330 [2024-10-07 11:29:14.145803] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.330 [2024-10-07 11:29:14.145822] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.330 [2024-10-07 11:29:14.145836] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.330 [2024-10-07 11:29:14.145864] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.330 [2024-10-07 11:29:14.145880] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.330 [2024-10-07 11:29:14.145893] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.330 [2024-10-07 11:29:14.145905] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.330 [2024-10-07 11:29:14.145927] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.330 [2024-10-07 11:29:14.145940] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.330 [2024-10-07 11:29:14.157157] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.330 [2024-10-07 11:29:14.157203] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.330 [2024-10-07 11:29:14.157299] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.330 [2024-10-07 11:29:14.157326] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.330 [2024-10-07 11:29:14.157341] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.330 [2024-10-07 11:29:14.157385] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.330 [2024-10-07 11:29:14.157406] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.330 [2024-10-07 11:29:14.157437] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.330 [2024-10-07 11:29:14.157475] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.330 [2024-10-07 11:29:14.157495] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.330 [2024-10-07 11:29:14.157515] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.330 [2024-10-07 11:29:14.157528] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.330 [2024-10-07 11:29:14.157542] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.330 [2024-10-07 11:29:14.157557] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.330 [2024-10-07 11:29:14.157570] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.330 [2024-10-07 11:29:14.157583] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.330 [2024-10-07 11:29:14.157605] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.330 [2024-10-07 11:29:14.157619] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.330 [2024-10-07 11:29:14.168301] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.330 [2024-10-07 11:29:14.168360] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.330 [2024-10-07 11:29:14.168655] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.331 [2024-10-07 11:29:14.168695] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.331 [2024-10-07 11:29:14.168713] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.331 [2024-10-07 11:29:14.168759] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.331 [2024-10-07 11:29:14.168781] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.331 [2024-10-07 11:29:14.168795] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.331 [2024-10-07 11:29:14.168858] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.331 [2024-10-07 11:29:14.168883] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.331 [2024-10-07 11:29:14.168903] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.331 [2024-10-07 11:29:14.168916] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.331 [2024-10-07 11:29:14.168930] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.331 [2024-10-07 11:29:14.168945] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.331 [2024-10-07 11:29:14.168958] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.331 [2024-10-07 11:29:14.168971] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.331 [2024-10-07 11:29:14.168992] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.331 [2024-10-07 11:29:14.169005] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.331 [2024-10-07 11:29:14.179736] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.331 [2024-10-07 11:29:14.179785] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.331 [2024-10-07 11:29:14.180555] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.331 [2024-10-07 11:29:14.180594] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.331 [2024-10-07 11:29:14.180629] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.331 [2024-10-07 11:29:14.180675] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.331 [2024-10-07 11:29:14.180696] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.331 [2024-10-07 11:29:14.180711] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.331 [2024-10-07 11:29:14.181055] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.331 [2024-10-07 11:29:14.181090] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.331 [2024-10-07 11:29:14.181159] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.331 [2024-10-07 11:29:14.181179] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.331 [2024-10-07 11:29:14.181192] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.331 [2024-10-07 11:29:14.181224] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.331 [2024-10-07 11:29:14.181239] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.331 [2024-10-07 11:29:14.181251] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.331 [2024-10-07 11:29:14.181274] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.331 [2024-10-07 11:29:14.181288] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.331 [2024-10-07 11:29:14.193514] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.331 [2024-10-07 11:29:14.193560] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.331 [2024-10-07 11:29:14.194404] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.331 [2024-10-07 11:29:14.194483] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.331 [2024-10-07 11:29:14.194503] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.331 [2024-10-07 11:29:14.194552] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.331 [2024-10-07 11:29:14.194575] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.331 [2024-10-07 11:29:14.194590] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.331 [2024-10-07 11:29:14.195226] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.331 [2024-10-07 11:29:14.195265] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.331 [2024-10-07 11:29:14.195357] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.331 [2024-10-07 11:29:14.195377] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.331 [2024-10-07 11:29:14.195390] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.331 [2024-10-07 11:29:14.195406] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.331 [2024-10-07 11:29:14.195437] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.331 [2024-10-07 11:29:14.195450] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.331 [2024-10-07 11:29:14.195473] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.331 [2024-10-07 11:29:14.195487] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.331 [2024-10-07 11:29:14.204914] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.331 [2024-10-07 11:29:14.204960] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.331 [2024-10-07 11:29:14.205324] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.331 [2024-10-07 11:29:14.205363] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.331 [2024-10-07 11:29:14.205381] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.331 [2024-10-07 11:29:14.205439] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.331 [2024-10-07 11:29:14.205463] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.331 [2024-10-07 11:29:14.205478] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.331 [2024-10-07 11:29:14.205559] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.331 [2024-10-07 11:29:14.205584] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.331 [2024-10-07 11:29:14.205603] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.331 [2024-10-07 11:29:14.205617] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.331 [2024-10-07 11:29:14.205630] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.331 [2024-10-07 11:29:14.205646] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.331 [2024-10-07 11:29:14.205659] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.331 [2024-10-07 11:29:14.205671] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.331 [2024-10-07 11:29:14.205692] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.331 [2024-10-07 11:29:14.205705] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.331 [2024-10-07 11:29:14.218603] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.331 [2024-10-07 11:29:14.218652] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.331 [2024-10-07 11:29:14.219070] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.331 [2024-10-07 11:29:14.219128] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.331 [2024-10-07 11:29:14.219147] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.331 [2024-10-07 11:29:14.219196] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.331 [2024-10-07 11:29:14.219219] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.331 [2024-10-07 11:29:14.219234] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.331 [2024-10-07 11:29:14.219982] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.331 [2024-10-07 11:29:14.220024] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.331 [2024-10-07 11:29:14.220304] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.331 [2024-10-07 11:29:14.220339] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.331 [2024-10-07 11:29:14.220356] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.331 [2024-10-07 11:29:14.220373] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.331 [2024-10-07 11:29:14.220387] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.331 [2024-10-07 11:29:14.220400] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.331 [2024-10-07 11:29:14.220623] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.331 [2024-10-07 11:29:14.220648] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.331 [2024-10-07 11:29:14.232572] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.331 [2024-10-07 11:29:14.232634] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.331 [2024-10-07 11:29:14.233441] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.331 [2024-10-07 11:29:14.233493] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.331 [2024-10-07 11:29:14.233513] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.331 [2024-10-07 11:29:14.233577] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.331 [2024-10-07 11:29:14.233599] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.331 [2024-10-07 11:29:14.233613] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.331 [2024-10-07 11:29:14.234122] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.331 [2024-10-07 11:29:14.234165] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.332 [2024-10-07 11:29:14.234405] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.332 [2024-10-07 11:29:14.234462] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.332 [2024-10-07 11:29:14.234495] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.332 [2024-10-07 11:29:14.234513] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.332 [2024-10-07 11:29:14.234526] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.332 [2024-10-07 11:29:14.234539] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.332 [2024-10-07 11:29:14.234731] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.332 [2024-10-07 11:29:14.234754] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.332 [2024-10-07 11:29:14.245694] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.332 [2024-10-07 11:29:14.245739] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.332 [2024-10-07 11:29:14.246193] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.332 [2024-10-07 11:29:14.246235] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.332 [2024-10-07 11:29:14.246254] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.332 [2024-10-07 11:29:14.246305] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.332 [2024-10-07 11:29:14.246342] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.332 [2024-10-07 11:29:14.246373] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.332 [2024-10-07 11:29:14.247107] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.332 [2024-10-07 11:29:14.247146] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.332 [2024-10-07 11:29:14.247411] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.332 [2024-10-07 11:29:14.247435] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.332 [2024-10-07 11:29:14.247497] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.332 [2024-10-07 11:29:14.247517] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.332 [2024-10-07 11:29:14.247531] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.332 [2024-10-07 11:29:14.247558] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.332 [2024-10-07 11:29:14.247763] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.332 [2024-10-07 11:29:14.247789] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.332 [2024-10-07 11:29:14.259129] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.332 [2024-10-07 11:29:14.259176] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.332 [2024-10-07 11:29:14.260041] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.332 [2024-10-07 11:29:14.260081] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.332 [2024-10-07 11:29:14.260116] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.332 [2024-10-07 11:29:14.260164] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.332 [2024-10-07 11:29:14.260202] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.332 [2024-10-07 11:29:14.260217] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.332 [2024-10-07 11:29:14.260734] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.332 [2024-10-07 11:29:14.260775] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.332 [2024-10-07 11:29:14.261014] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.332 [2024-10-07 11:29:14.261047] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.332 [2024-10-07 11:29:14.261063] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.332 [2024-10-07 11:29:14.261080] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.332 [2024-10-07 11:29:14.261094] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.332 [2024-10-07 11:29:14.261106] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.332 [2024-10-07 11:29:14.261158] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.332 [2024-10-07 11:29:14.261178] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.332 [2024-10-07 11:29:14.272529] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.332 [2024-10-07 11:29:14.272575] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.332 [2024-10-07 11:29:14.273352] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.332 [2024-10-07 11:29:14.273390] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.332 [2024-10-07 11:29:14.273432] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.332 [2024-10-07 11:29:14.273484] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.332 [2024-10-07 11:29:14.273505] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.332 [2024-10-07 11:29:14.273520] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.332 [2024-10-07 11:29:14.273869] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.332 [2024-10-07 11:29:14.273922] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.332 [2024-10-07 11:29:14.274162] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.332 [2024-10-07 11:29:14.274199] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.332 [2024-10-07 11:29:14.274216] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.332 [2024-10-07 11:29:14.274233] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.332 [2024-10-07 11:29:14.274247] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.332 [2024-10-07 11:29:14.274260] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.332 [2024-10-07 11:29:14.274519] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.332 [2024-10-07 11:29:14.274563] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.332 [2024-10-07 11:29:14.286181] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.332 [2024-10-07 11:29:14.286231] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.332 [2024-10-07 11:29:14.286708] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.332 [2024-10-07 11:29:14.286748] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.332 [2024-10-07 11:29:14.286767] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.332 [2024-10-07 11:29:14.286813] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.332 [2024-10-07 11:29:14.286834] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.332 [2024-10-07 11:29:14.286849] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.332 [2024-10-07 11:29:14.287050] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.332 [2024-10-07 11:29:14.287079] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.332 [2024-10-07 11:29:14.287262] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.332 [2024-10-07 11:29:14.287295] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.332 [2024-10-07 11:29:14.287310] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.332 [2024-10-07 11:29:14.287326] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.332 [2024-10-07 11:29:14.287340] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.332 [2024-10-07 11:29:14.287352] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.332 [2024-10-07 11:29:14.287406] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.332 [2024-10-07 11:29:14.287455] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.332 [2024-10-07 11:29:14.299098] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.332 [2024-10-07 11:29:14.299145] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.332 [2024-10-07 11:29:14.299584] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.332 [2024-10-07 11:29:14.299624] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.332 [2024-10-07 11:29:14.299658] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.332 [2024-10-07 11:29:14.299707] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.332 [2024-10-07 11:29:14.299729] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.332 [2024-10-07 11:29:14.299743] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.333 [2024-10-07 11:29:14.299945] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.333 [2024-10-07 11:29:14.299974] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.333 [2024-10-07 11:29:14.300156] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.333 [2024-10-07 11:29:14.300189] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.333 [2024-10-07 11:29:14.300205] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.333 [2024-10-07 11:29:14.300221] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.333 [2024-10-07 11:29:14.300234] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.333 [2024-10-07 11:29:14.300246] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.333 [2024-10-07 11:29:14.300466] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.333 [2024-10-07 11:29:14.300490] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.333 [2024-10-07 11:29:14.312080] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.333 [2024-10-07 11:29:14.312130] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.333 [2024-10-07 11:29:14.312635] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.333 [2024-10-07 11:29:14.312677] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.333 [2024-10-07 11:29:14.312697] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.333 [2024-10-07 11:29:14.312746] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.333 [2024-10-07 11:29:14.312768] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.333 [2024-10-07 11:29:14.312784] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.333 [2024-10-07 11:29:14.312998] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.333 [2024-10-07 11:29:14.313029] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.333 [2024-10-07 11:29:14.313223] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.333 [2024-10-07 11:29:14.313248] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.333 [2024-10-07 11:29:14.313264] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.333 [2024-10-07 11:29:14.313280] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.333 [2024-10-07 11:29:14.313295] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.333 [2024-10-07 11:29:14.313323] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.333 [2024-10-07 11:29:14.313399] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.333 [2024-10-07 11:29:14.313419] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.333 [2024-10-07 11:29:14.326052] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.333 [2024-10-07 11:29:14.326101] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.333 [2024-10-07 11:29:14.326565] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.333 [2024-10-07 11:29:14.326605] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.333 [2024-10-07 11:29:14.326624] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.333 [2024-10-07 11:29:14.326672] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.333 [2024-10-07 11:29:14.326694] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.333 [2024-10-07 11:29:14.326709] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.333 [2024-10-07 11:29:14.326930] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.333 [2024-10-07 11:29:14.326960] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.333 [2024-10-07 11:29:14.327169] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.333 [2024-10-07 11:29:14.327204] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.333 [2024-10-07 11:29:14.327220] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.333 [2024-10-07 11:29:14.327239] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.333 [2024-10-07 11:29:14.327253] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.333 [2024-10-07 11:29:14.327266] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.333 [2024-10-07 11:29:14.327325] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.333 [2024-10-07 11:29:14.327345] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.333 [2024-10-07 11:29:14.339143] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.333 [2024-10-07 11:29:14.339211] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.333 [2024-10-07 11:29:14.339642] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.333 [2024-10-07 11:29:14.339693] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.333 [2024-10-07 11:29:14.339713] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.333 [2024-10-07 11:29:14.339763] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.333 [2024-10-07 11:29:14.339786] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.333 [2024-10-07 11:29:14.339801] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.333 [2024-10-07 11:29:14.340515] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.333 [2024-10-07 11:29:14.340557] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.333 [2024-10-07 11:29:14.340817] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.333 [2024-10-07 11:29:14.340843] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.333 [2024-10-07 11:29:14.340858] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.333 [2024-10-07 11:29:14.340875] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.333 [2024-10-07 11:29:14.340890] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.333 [2024-10-07 11:29:14.340903] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.333 [2024-10-07 11:29:14.341102] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.333 [2024-10-07 11:29:14.341126] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.333 [2024-10-07 11:29:14.352689] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.333 [2024-10-07 11:29:14.352735] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.333 [2024-10-07 11:29:14.353580] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.333 [2024-10-07 11:29:14.353637] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.333 [2024-10-07 11:29:14.353657] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.333 [2024-10-07 11:29:14.353706] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.333 [2024-10-07 11:29:14.353729] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.333 [2024-10-07 11:29:14.353745] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.333 [2024-10-07 11:29:14.354173] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.333 [2024-10-07 11:29:14.354207] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.333 [2024-10-07 11:29:14.354430] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.333 [2024-10-07 11:29:14.354478] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.333 [2024-10-07 11:29:14.354510] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.333 [2024-10-07 11:29:14.354527] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.333 [2024-10-07 11:29:14.354541] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.333 [2024-10-07 11:29:14.354554] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.333 [2024-10-07 11:29:14.354744] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.333 [2024-10-07 11:29:14.354767] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.333 [2024-10-07 11:29:14.365607] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.333 [2024-10-07 11:29:14.365654] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.333 [2024-10-07 11:29:14.366124] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.333 [2024-10-07 11:29:14.366167] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.333 [2024-10-07 11:29:14.366187] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.333 [2024-10-07 11:29:14.366253] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.333 [2024-10-07 11:29:14.366278] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.333 [2024-10-07 11:29:14.366293] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.333 [2024-10-07 11:29:14.367008] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.333 [2024-10-07 11:29:14.367047] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.333 [2024-10-07 11:29:14.367291] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.333 [2024-10-07 11:29:14.367317] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.333 [2024-10-07 11:29:14.367332] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.333 [2024-10-07 11:29:14.367348] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.333 [2024-10-07 11:29:14.367361] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.334 [2024-10-07 11:29:14.367373] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.334 [2024-10-07 11:29:14.367594] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.334 [2024-10-07 11:29:14.367619] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.334 [2024-10-07 11:29:14.378771] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.334 [2024-10-07 11:29:14.378817] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.334 [2024-10-07 11:29:14.379573] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.334 [2024-10-07 11:29:14.379629] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.334 [2024-10-07 11:29:14.379648] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.334 [2024-10-07 11:29:14.379695] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.334 [2024-10-07 11:29:14.379716] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.334 [2024-10-07 11:29:14.379731] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.334 [2024-10-07 11:29:14.380079] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.334 [2024-10-07 11:29:14.380124] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.334 [2024-10-07 11:29:14.380359] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.334 [2024-10-07 11:29:14.380394] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.334 [2024-10-07 11:29:14.380420] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.334 [2024-10-07 11:29:14.380441] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.334 [2024-10-07 11:29:14.380455] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.334 [2024-10-07 11:29:14.380467] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.334 [2024-10-07 11:29:14.380675] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.334 [2024-10-07 11:29:14.380716] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.334 [2024-10-07 11:29:14.392538] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.334 [2024-10-07 11:29:14.392584] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.334 [2024-10-07 11:29:14.393411] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.334 [2024-10-07 11:29:14.393510] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.334 [2024-10-07 11:29:14.393531] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.334 [2024-10-07 11:29:14.393581] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.334 [2024-10-07 11:29:14.393604] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.334 [2024-10-07 11:29:14.393620] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.334 [2024-10-07 11:29:14.394162] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.334 [2024-10-07 11:29:14.394205] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.334 [2024-10-07 11:29:14.394459] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.334 [2024-10-07 11:29:14.394492] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.334 [2024-10-07 11:29:14.394508] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.334 [2024-10-07 11:29:14.394525] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.334 [2024-10-07 11:29:14.394539] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.334 [2024-10-07 11:29:14.394551] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.334 [2024-10-07 11:29:14.394747] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.334 [2024-10-07 11:29:14.394770] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.334 [2024-10-07 11:29:14.402825] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.334 [2024-10-07 11:29:14.402870] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.334 [2024-10-07 11:29:14.402967] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.334 [2024-10-07 11:29:14.402995] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.334 [2024-10-07 11:29:14.403011] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.334 [2024-10-07 11:29:14.403058] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.334 [2024-10-07 11:29:14.403080] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.334 [2024-10-07 11:29:14.403095] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.334 [2024-10-07 11:29:14.403272] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.334 [2024-10-07 11:29:14.403299] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.334 [2024-10-07 11:29:14.403349] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.334 [2024-10-07 11:29:14.403382] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.334 [2024-10-07 11:29:14.403397] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.334 [2024-10-07 11:29:14.403413] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.334 [2024-10-07 11:29:14.403442] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.334 [2024-10-07 11:29:14.403457] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.334 [2024-10-07 11:29:14.403624] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.334 [2024-10-07 11:29:14.403645] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.334 9097.33 IOPS, 35.54 MiB/s 00:18:34.334 Latency(us) 00:18:34.334 [2024-10-07T11:29:16.045Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:34.334 Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:18:34.334 Verification LBA range: start 0x0 length 0x4000 00:18:34.334 NVMe0n1 : 15.01 9096.08 35.53 0.00 0.00 14038.91 711.21 33363.78 00:18:34.334 [2024-10-07T11:29:16.045Z] =================================================================================================================== 00:18:34.334 [2024-10-07T11:29:16.045Z] Total : 9096.08 35.53 0.00 0.00 14038.91 711.21 33363.78 00:18:34.334 [2024-10-07 11:29:14.412925] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.334 [2024-10-07 11:29:14.413084] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.334 [2024-10-07 11:29:14.413114] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.334 [2024-10-07 11:29:14.413131] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.334 [2024-10-07 11:29:14.413149] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.334 [2024-10-07 11:29:14.413176] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.334 [2024-10-07 11:29:14.413233] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.334 [2024-10-07 11:29:14.413257] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.334 [2024-10-07 11:29:14.413273] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.334 [2024-10-07 11:29:14.413287] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.334 [2024-10-07 11:29:14.413300] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.334 [2024-10-07 11:29:14.413313] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.334 [2024-10-07 11:29:14.413330] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.334 [2024-10-07 11:29:14.413346] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.334 [2024-10-07 11:29:14.413364] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.334 [2024-10-07 11:29:14.413393] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.334 [2024-10-07 11:29:14.413406] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.334 [2024-10-07 11:29:14.413420] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.334 [2024-10-07 11:29:14.423020] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.334 [2024-10-07 11:29:14.423109] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.334 [2024-10-07 11:29:14.423136] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.334 [2024-10-07 11:29:14.423152] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.334 [2024-10-07 11:29:14.423172] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.334 [2024-10-07 11:29:14.423190] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.334 [2024-10-07 11:29:14.423204] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.334 [2024-10-07 11:29:14.423217] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.334 [2024-10-07 11:29:14.423241] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.334 [2024-10-07 11:29:14.423260] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.334 [2024-10-07 11:29:14.423320] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.334 [2024-10-07 11:29:14.423344] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.334 [2024-10-07 11:29:14.423360] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.334 [2024-10-07 11:29:14.423378] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.334 [2024-10-07 11:29:14.423396] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.335 [2024-10-07 11:29:14.423422] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.335 [2024-10-07 11:29:14.423438] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.335 [2024-10-07 11:29:14.423455] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.335 [2024-10-07 11:29:14.433075] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.335 [2024-10-07 11:29:14.433176] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.335 [2024-10-07 11:29:14.433203] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.335 [2024-10-07 11:29:14.433219] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.335 [2024-10-07 11:29:14.433238] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.335 [2024-10-07 11:29:14.433257] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.335 [2024-10-07 11:29:14.433271] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.335 [2024-10-07 11:29:14.433284] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.335 [2024-10-07 11:29:14.433299] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.335 [2024-10-07 11:29:14.433323] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.335 [2024-10-07 11:29:14.433382] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.335 [2024-10-07 11:29:14.433406] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.335 [2024-10-07 11:29:14.433437] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.335 [2024-10-07 11:29:14.433484] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.335 [2024-10-07 11:29:14.433504] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.335 [2024-10-07 11:29:14.433518] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.335 [2024-10-07 11:29:14.433531] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.335 [2024-10-07 11:29:14.433547] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.335 [2024-10-07 11:29:14.443130] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.335 [2024-10-07 11:29:14.443230] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.335 [2024-10-07 11:29:14.443257] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.335 [2024-10-07 11:29:14.443273] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.335 [2024-10-07 11:29:14.443293] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.335 [2024-10-07 11:29:14.443311] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.335 [2024-10-07 11:29:14.443324] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.335 [2024-10-07 11:29:14.443337] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.335 [2024-10-07 11:29:14.443356] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.335 [2024-10-07 11:29:14.443381] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.335 [2024-10-07 11:29:14.443454] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.335 [2024-10-07 11:29:14.443481] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.335 [2024-10-07 11:29:14.443497] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.335 [2024-10-07 11:29:14.443516] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.335 [2024-10-07 11:29:14.443537] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.335 [2024-10-07 11:29:14.443550] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.335 [2024-10-07 11:29:14.443563] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.335 [2024-10-07 11:29:14.443579] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.335 [2024-10-07 11:29:14.453183] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.335 [2024-10-07 11:29:14.453266] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.335 [2024-10-07 11:29:14.453293] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.335 [2024-10-07 11:29:14.453309] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.335 [2024-10-07 11:29:14.453328] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.335 [2024-10-07 11:29:14.453346] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.335 [2024-10-07 11:29:14.453360] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.335 [2024-10-07 11:29:14.453386] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.335 [2024-10-07 11:29:14.453403] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.335 [2024-10-07 11:29:14.453446] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.335 [2024-10-07 11:29:14.453523] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.335 [2024-10-07 11:29:14.453549] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.335 [2024-10-07 11:29:14.453565] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.335 [2024-10-07 11:29:14.453583] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.335 [2024-10-07 11:29:14.453601] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.335 [2024-10-07 11:29:14.453615] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.335 [2024-10-07 11:29:14.453628] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.335 [2024-10-07 11:29:14.453644] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.335 [2024-10-07 11:29:14.463234] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.335 [2024-10-07 11:29:14.463331] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.335 [2024-10-07 11:29:14.463357] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.335 [2024-10-07 11:29:14.463373] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.335 [2024-10-07 11:29:14.463391] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.335 [2024-10-07 11:29:14.463408] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.335 [2024-10-07 11:29:14.463438] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.335 [2024-10-07 11:29:14.463465] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.335 [2024-10-07 11:29:14.463483] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.335 [2024-10-07 11:29:14.463516] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.335 [2024-10-07 11:29:14.463579] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.335 [2024-10-07 11:29:14.463603] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.335 [2024-10-07 11:29:14.463619] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.335 [2024-10-07 11:29:14.463638] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.335 [2024-10-07 11:29:14.463655] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.335 [2024-10-07 11:29:14.463669] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.335 [2024-10-07 11:29:14.463682] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.335 [2024-10-07 11:29:14.463698] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.335 [2024-10-07 11:29:14.473286] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.335 [2024-10-07 11:29:14.473397] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.335 [2024-10-07 11:29:14.473435] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x61be60 with addr=10.0.0.3, port=4421 00:18:34.335 [2024-10-07 11:29:14.473455] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x61be60 is same with the state(6) to be set 00:18:34.335 [2024-10-07 11:29:14.473475] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x61be60 (9): Bad file descriptor 00:18:34.335 [2024-10-07 11:29:14.473493] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.335 [2024-10-07 11:29:14.473507] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.335 [2024-10-07 11:29:14.473519] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.335 [2024-10-07 11:29:14.473538] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.335 [2024-10-07 11:29:14.473572] nvme_ctrlr.c:1724:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:34.335 [2024-10-07 11:29:14.473633] posix.c:1055:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:18:34.335 [2024-10-07 11:29:14.473659] nvme_tcp.c:2399:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x691b10 with addr=10.0.0.3, port=4422 00:18:34.335 [2024-10-07 11:29:14.473675] nvme_tcp.c: 337:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x691b10 is same with the state(6) to be set 00:18:34.335 [2024-10-07 11:29:14.473693] nvme_tcp.c:2196:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x691b10 (9): Bad file descriptor 00:18:34.335 [2024-10-07 11:29:14.473710] nvme_ctrlr.c:4193:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:34.335 [2024-10-07 11:29:14.473723] nvme_ctrlr.c:1822:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:18:34.335 [2024-10-07 11:29:14.473736] nvme_ctrlr.c:1106:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:34.335 [2024-10-07 11:29:14.473752] bdev_nvme.c:2181:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:18:34.335 Received shutdown signal, test time was about 15.000000 seconds 00:18:34.335 00:18:34.335 Latency(us) 00:18:34.335 [2024-10-07T11:29:16.046Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:34.335 [2024-10-07T11:29:16.046Z] =================================================================================================================== 00:18:34.335 [2024-10-07T11:29:16.047Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:18:34.336 11:29:15 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@1 -- # rm -f /home/vagrant/spdk_repo/spdk/test/nvmf/host/try.txt 00:18:34.336 11:29:15 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@1 -- # killprocess 89076 00:18:34.336 11:29:15 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@950 -- # '[' -z 89076 ']' 00:18:34.336 11:29:15 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@954 -- # kill -0 89076 00:18:34.336 /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh: line 954: kill: (89076) - No such process 00:18:34.336 11:29:15 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@977 -- # echo 'Process with pid 89076 is not found' 00:18:34.336 Process with pid 89076 is not found 00:18:34.336 11:29:15 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@1 -- # nvmftestfini 00:18:34.336 11:29:15 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@514 -- # nvmfcleanup 00:18:34.336 11:29:15 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@121 -- # sync 00:18:34.336 11:29:15 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@123 -- # '[' tcp == tcp ']' 00:18:34.336 11:29:15 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@124 -- # set +e 00:18:34.336 11:29:15 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@125 -- # for i in {1..20} 00:18:34.336 11:29:15 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@126 -- # modprobe -v -r nvme-tcp 00:18:34.336 rmmod nvme_tcp 00:18:34.336 rmmod nvme_fabrics 00:18:34.336 rmmod nvme_keyring 00:18:34.336 11:29:15 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@127 -- # modprobe -v -r nvme-fabrics 00:18:34.336 11:29:15 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@128 -- # set -e 00:18:34.336 11:29:15 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@129 -- # return 0 00:18:34.336 11:29:15 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@515 -- # '[' -n 88957 ']' 00:18:34.336 11:29:15 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@516 -- # killprocess 88957 00:18:34.336 11:29:15 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@950 -- # '[' -z 88957 ']' 00:18:34.336 11:29:15 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@954 -- # kill -0 88957 00:18:34.336 11:29:15 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@955 -- # uname 00:18:34.336 11:29:15 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@955 -- # '[' Linux = Linux ']' 00:18:34.336 11:29:15 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@956 -- # ps --no-headers -o comm= 88957 00:18:34.336 killing process with pid 88957 00:18:34.336 11:29:15 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@956 -- # process_name=reactor_1 00:18:34.336 11:29:15 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@960 -- # '[' reactor_1 = sudo ']' 00:18:34.336 11:29:15 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@968 -- # echo 'killing process with pid 88957' 00:18:34.336 11:29:15 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@969 -- # kill 88957 00:18:34.336 11:29:15 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@974 -- # wait 88957 00:18:34.336 11:29:15 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@518 -- # '[' '' == iso ']' 00:18:34.336 11:29:15 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@521 -- # [[ tcp == \t\c\p ]] 00:18:34.336 11:29:15 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@522 -- # nvmf_tcp_fini 00:18:34.336 11:29:15 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@297 -- # iptr 00:18:34.336 11:29:15 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@789 -- # iptables-save 00:18:34.336 11:29:15 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@789 -- # grep -v SPDK_NVMF 00:18:34.336 11:29:15 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@789 -- # iptables-restore 00:18:34.600 11:29:15 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@298 -- # [[ nvmf_tgt_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s\_\s\p\d\k ]] 00:18:34.600 11:29:15 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@299 -- # nvmf_veth_fini 00:18:34.600 11:29:15 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@233 -- # ip link set nvmf_init_br nomaster 00:18:34.600 11:29:15 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@234 -- # ip link set nvmf_init_br2 nomaster 00:18:34.600 11:29:15 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@235 -- # ip link set nvmf_tgt_br nomaster 00:18:34.600 11:29:15 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@236 -- # ip link set nvmf_tgt_br2 nomaster 00:18:34.600 11:29:15 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@237 -- # ip link set nvmf_init_br down 00:18:34.600 11:29:15 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@238 -- # ip link set nvmf_init_br2 down 00:18:34.600 11:29:15 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@239 -- # ip link set nvmf_tgt_br down 00:18:34.600 11:29:15 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@240 -- # ip link set nvmf_tgt_br2 down 00:18:34.600 11:29:15 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@241 -- # ip link delete nvmf_br type bridge 00:18:34.600 11:29:15 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@242 -- # ip link delete nvmf_init_if 00:18:34.600 11:29:15 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@243 -- # ip link delete nvmf_init_if2 00:18:34.600 11:29:15 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@244 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if 00:18:34.600 11:29:15 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@245 -- # ip netns exec nvmf_tgt_ns_spdk ip link delete nvmf_tgt_if2 00:18:34.600 11:29:15 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@246 -- # remove_spdk_ns 00:18:34.600 11:29:15 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@654 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:34.600 11:29:15 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 15> /dev/null' 00:18:34.600 11:29:15 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:34.600 11:29:15 nvmf_tcp.nvmf_host.nvmf_failover -- nvmf/common.sh@300 -- # return 0 00:18:34.600 11:29:15 nvmf_tcp.nvmf_host.nvmf_failover -- host/failover.sh@1 -- # exit 1 00:18:34.600 11:29:15 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@1125 -- # trap - ERR 00:18:34.600 11:29:15 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@1125 -- # print_backtrace 00:18:34.600 11:29:15 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@1153 -- # [[ ehxBET =~ e ]] 00:18:34.600 11:29:15 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@1155 -- # args=('--transport=tcp' '/home/vagrant/spdk_repo/spdk/test/nvmf/host/failover.sh' 'nvmf_failover' '--transport=tcp') 00:18:34.600 11:29:15 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@1155 -- # local args 00:18:34.600 11:29:15 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@1157 -- # xtrace_disable 00:18:34.600 11:29:15 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@10 -- # set +x 00:18:34.600 ========== Backtrace start: ========== 00:18:34.600 00:18:34.600 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:1125 -> run_test(["nvmf_failover"],["/home/vagrant/spdk_repo/spdk/test/nvmf/host/failover.sh"],["--transport=tcp"]) 00:18:34.600 ... 00:18:34.600 1120 timing_enter $test_name 00:18:34.600 1121 echo "************************************" 00:18:34.600 1122 echo "START TEST $test_name" 00:18:34.600 1123 echo "************************************" 00:18:34.600 1124 xtrace_restore 00:18:34.600 1125 time "$@" 00:18:34.600 1126 xtrace_disable 00:18:34.601 1127 echo "************************************" 00:18:34.601 1128 echo "END TEST $test_name" 00:18:34.601 1129 echo "************************************" 00:18:34.601 1130 timing_exit $test_name 00:18:34.601 ... 00:18:34.601 in /home/vagrant/spdk_repo/spdk/test/nvmf/nvmf_host.sh:25 -> main(["--transport=tcp"]) 00:18:34.601 ... 00:18:34.601 20 fi 00:18:34.601 21 00:18:34.601 22 run_test "nvmf_identify" $rootdir/test/nvmf/host/identify.sh "${TEST_ARGS[@]}" 00:18:34.601 23 run_test "nvmf_perf" $rootdir/test/nvmf/host/perf.sh "${TEST_ARGS[@]}" 00:18:34.601 24 run_test "nvmf_fio_host" $rootdir/test/nvmf/host/fio.sh "${TEST_ARGS[@]}" 00:18:34.601 => 25 run_test "nvmf_failover" $rootdir/test/nvmf/host/failover.sh "${TEST_ARGS[@]}" 00:18:34.601 26 run_test "nvmf_host_discovery" $rootdir/test/nvmf/host/discovery.sh "${TEST_ARGS[@]}" 00:18:34.601 27 run_test "nvmf_host_multipath_status" $rootdir/test/nvmf/host/multipath_status.sh "${TEST_ARGS[@]}" 00:18:34.601 28 run_test "nvmf_discovery_remove_ifc" $rootdir/test/nvmf/host/discovery_remove_ifc.sh "${TEST_ARGS[@]}" 00:18:34.601 29 run_test "nvmf_identify_kernel_target" "$rootdir/test/nvmf/host/identify_kernel_nvmf.sh" "${TEST_ARGS[@]}" 00:18:34.601 30 run_test "nvmf_auth_host" "$rootdir/test/nvmf/host/auth.sh" "${TEST_ARGS[@]}" 00:18:34.601 ... 00:18:34.601 00:18:34.601 ========== Backtrace end ========== 00:18:34.601 11:29:15 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@1194 -- # return 0 00:18:34.601 00:18:34.601 real 0m22.589s 00:18:34.601 user 1m22.502s 00:18:34.601 sys 0m4.487s 00:18:34.601 11:29:15 nvmf_tcp.nvmf_host.nvmf_failover -- common/autotest_common.sh@1 -- # exit 1 00:18:34.601 11:29:15 nvmf_tcp.nvmf_host -- common/autotest_common.sh@1125 -- # trap - ERR 00:18:34.601 11:29:15 nvmf_tcp.nvmf_host -- common/autotest_common.sh@1125 -- # print_backtrace 00:18:34.601 11:29:15 nvmf_tcp.nvmf_host -- common/autotest_common.sh@1153 -- # [[ ehxBET =~ e ]] 00:18:34.601 11:29:15 nvmf_tcp.nvmf_host -- common/autotest_common.sh@1155 -- # args=('--transport=tcp' '/home/vagrant/spdk_repo/spdk/test/nvmf/nvmf_host.sh' 'nvmf_host' '--transport=tcp') 00:18:34.601 11:29:15 nvmf_tcp.nvmf_host -- common/autotest_common.sh@1155 -- # local args 00:18:34.601 11:29:15 nvmf_tcp.nvmf_host -- common/autotest_common.sh@1157 -- # xtrace_disable 00:18:34.601 11:29:15 nvmf_tcp.nvmf_host -- common/autotest_common.sh@10 -- # set +x 00:18:34.601 ========== Backtrace start: ========== 00:18:34.601 00:18:34.601 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:1125 -> run_test(["nvmf_host"],["/home/vagrant/spdk_repo/spdk/test/nvmf/nvmf_host.sh"],["--transport=tcp"]) 00:18:34.601 ... 00:18:34.601 1120 timing_enter $test_name 00:18:34.601 1121 echo "************************************" 00:18:34.601 1122 echo "START TEST $test_name" 00:18:34.601 1123 echo "************************************" 00:18:34.601 1124 xtrace_restore 00:18:34.601 1125 time "$@" 00:18:34.601 1126 xtrace_disable 00:18:34.601 1127 echo "************************************" 00:18:34.601 1128 echo "END TEST $test_name" 00:18:34.601 1129 echo "************************************" 00:18:34.601 1130 timing_exit $test_name 00:18:34.601 ... 00:18:34.601 in /home/vagrant/spdk_repo/spdk/test/nvmf/nvmf.sh:16 -> main(["--transport=tcp"]) 00:18:34.601 ... 00:18:34.601 11 exit 0 00:18:34.601 12 fi 00:18:34.601 13 00:18:34.601 14 run_test "nvmf_target_core" $rootdir/test/nvmf/nvmf_target_core.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:18:34.601 15 run_test "nvmf_target_extra" $rootdir/test/nvmf/nvmf_target_extra.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:18:34.601 => 16 run_test "nvmf_host" $rootdir/test/nvmf/nvmf_host.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:18:34.601 17 00:18:34.601 18 # Interrupt mode for now is supported only on the target, with the TCP transport and posix or ssl socket implementations. 00:18:34.601 19 if [[ "$SPDK_TEST_NVMF_TRANSPORT" = "tcp" && $SPDK_TEST_URING -eq 0 ]]; then 00:18:34.601 20 run_test "nvmf_target_core_interrupt_mode" $rootdir/test/nvmf/nvmf_target_core.sh --transport=$SPDK_TEST_NVMF_TRANSPORT --interrupt-mode 00:18:34.601 21 run_test "nvmf_interrupt" $rootdir/test/nvmf/target/interrupt.sh --transport=$SPDK_TEST_NVMF_TRANSPORT --interrupt-mode 00:18:34.601 ... 00:18:34.601 00:18:34.601 ========== Backtrace end ========== 00:18:34.601 11:29:15 nvmf_tcp.nvmf_host -- common/autotest_common.sh@1194 -- # return 0 00:18:34.601 00:18:34.601 real 1m3.608s 00:18:34.601 user 3m30.177s 00:18:34.601 sys 0m15.368s 00:18:34.601 11:29:15 nvmf_tcp -- common/autotest_common.sh@1125 -- # trap - ERR 00:18:34.601 11:29:15 nvmf_tcp -- common/autotest_common.sh@1125 -- # print_backtrace 00:18:34.601 11:29:15 nvmf_tcp -- common/autotest_common.sh@1153 -- # [[ ehxBET =~ e ]] 00:18:34.601 11:29:15 nvmf_tcp -- common/autotest_common.sh@1155 -- # args=('--transport=tcp' '/home/vagrant/spdk_repo/spdk/test/nvmf/nvmf.sh' 'nvmf_tcp' '/home/vagrant/spdk_repo/autorun-spdk.conf') 00:18:34.601 11:29:15 nvmf_tcp -- common/autotest_common.sh@1155 -- # local args 00:18:34.601 11:29:15 nvmf_tcp -- common/autotest_common.sh@1157 -- # xtrace_disable 00:18:34.601 11:29:15 nvmf_tcp -- common/autotest_common.sh@10 -- # set +x 00:18:34.601 ========== Backtrace start: ========== 00:18:34.601 00:18:34.601 in /home/vagrant/spdk_repo/spdk/test/common/autotest_common.sh:1125 -> run_test(["nvmf_tcp"],["/home/vagrant/spdk_repo/spdk/test/nvmf/nvmf.sh"],["--transport=tcp"]) 00:18:34.601 ... 00:18:34.601 1120 timing_enter $test_name 00:18:34.601 1121 echo "************************************" 00:18:34.601 1122 echo "START TEST $test_name" 00:18:34.601 1123 echo "************************************" 00:18:34.601 1124 xtrace_restore 00:18:34.601 1125 time "$@" 00:18:34.601 1126 xtrace_disable 00:18:34.601 1127 echo "************************************" 00:18:34.601 1128 echo "END TEST $test_name" 00:18:34.601 1129 echo "************************************" 00:18:34.601 1130 timing_exit $test_name 00:18:34.601 ... 00:18:34.601 in /home/vagrant/spdk_repo/spdk/autotest.sh:280 -> main(["/home/vagrant/spdk_repo/autorun-spdk.conf"]) 00:18:34.601 ... 00:18:34.601 275 # list of all tests can properly differentiate them. Please do not merge them into one line. 00:18:34.601 276 if [ "$SPDK_TEST_NVMF_TRANSPORT" = "rdma" ]; then 00:18:34.601 277 run_test "nvmf_rdma" $rootdir/test/nvmf/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:18:34.601 278 run_test "spdkcli_nvmf_rdma" $rootdir/test/spdkcli/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:18:34.601 279 elif [ "$SPDK_TEST_NVMF_TRANSPORT" = "tcp" ]; then 00:18:34.601 => 280 run_test "nvmf_tcp" $rootdir/test/nvmf/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:18:34.601 281 if [[ $SPDK_TEST_URING -eq 0 ]]; then 00:18:34.601 282 run_test "spdkcli_nvmf_tcp" $rootdir/test/spdkcli/nvmf.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:18:34.601 283 run_test "nvmf_identify_passthru" $rootdir/test/nvmf/target/identify_passthru.sh --transport=$SPDK_TEST_NVMF_TRANSPORT 00:18:34.601 284 fi 00:18:34.601 285 run_test "nvmf_dif" $rootdir/test/nvmf/target/dif.sh 00:18:34.601 ... 00:18:34.601 00:18:34.601 ========== Backtrace end ========== 00:18:34.601 11:29:15 nvmf_tcp -- common/autotest_common.sh@1194 -- # return 0 00:18:34.601 00:18:34.601 real 12m43.409s 00:18:34.601 user 34m39.264s 00:18:34.601 sys 2m53.908s 00:18:34.601 11:29:15 nvmf_tcp -- common/autotest_common.sh@1 -- # autotest_cleanup 00:18:34.601 11:29:15 nvmf_tcp -- common/autotest_common.sh@1392 -- # local autotest_es=1 00:18:34.601 11:29:15 nvmf_tcp -- common/autotest_common.sh@1393 -- # xtrace_disable 00:18:34.601 11:29:15 nvmf_tcp -- common/autotest_common.sh@10 -- # set +x 00:18:46.818 INFO: APP EXITING 00:18:46.818 INFO: killing all VMs 00:18:46.818 INFO: killing vhost app 00:18:46.818 INFO: EXIT DONE 00:18:46.818 0000:00:03.0 (1af4 1001): Active devices: mount@vda:vda2,mount@vda:vda3,mount@vda:vda5, so not binding PCI dev 00:18:46.818 Waiting for block devices as requested 00:18:46.818 0000:00:11.0 (1b36 0010): uio_pci_generic -> nvme 00:18:46.818 0000:00:10.0 (1b36 0010): uio_pci_generic -> nvme 00:18:47.384 0000:00:03.0 (1af4 1001): Active devices: mount@vda:vda2,mount@vda:vda3,mount@vda:vda5, so not binding PCI dev 00:18:47.384 Cleaning 00:18:47.384 Removing: /var/run/dpdk/spdk0/config 00:18:47.384 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-0 00:18:47.384 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-1 00:18:47.384 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-2 00:18:47.384 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-3 00:18:47.384 Removing: /var/run/dpdk/spdk0/fbarray_memzone 00:18:47.384 Removing: /var/run/dpdk/spdk0/hugepage_info 00:18:47.384 Removing: /var/run/dpdk/spdk1/config 00:18:47.384 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-0 00:18:47.384 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-1 00:18:47.384 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-2 00:18:47.384 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-3 00:18:47.384 Removing: /var/run/dpdk/spdk1/fbarray_memzone 00:18:47.384 Removing: /var/run/dpdk/spdk1/hugepage_info 00:18:47.384 Removing: /var/run/dpdk/spdk2/config 00:18:47.384 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-0 00:18:47.384 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-1 00:18:47.384 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-2 00:18:47.384 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-3 00:18:47.384 Removing: /var/run/dpdk/spdk2/fbarray_memzone 00:18:47.384 Removing: /var/run/dpdk/spdk2/hugepage_info 00:18:47.384 Removing: /var/run/dpdk/spdk3/config 00:18:47.384 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-0 00:18:47.384 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-1 00:18:47.384 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-2 00:18:47.384 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-3 00:18:47.384 Removing: /var/run/dpdk/spdk3/fbarray_memzone 00:18:47.384 Removing: /var/run/dpdk/spdk3/hugepage_info 00:18:47.384 Removing: /var/run/dpdk/spdk4/config 00:18:47.642 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-0 00:18:47.642 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-1 00:18:47.642 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-2 00:18:47.642 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-3 00:18:47.642 Removing: /var/run/dpdk/spdk4/fbarray_memzone 00:18:47.642 Removing: /var/run/dpdk/spdk4/hugepage_info 00:18:47.642 Removing: /dev/shm/nvmf_trace.0 00:18:47.642 Removing: /dev/shm/spdk_tgt_trace.pid58494 00:18:47.642 Removing: /var/run/dpdk/spdk0 00:18:47.642 Removing: /var/run/dpdk/spdk1 00:18:47.642 Removing: /var/run/dpdk/spdk2 00:18:47.642 Removing: /var/run/dpdk/spdk3 00:18:47.642 Removing: /var/run/dpdk/spdk4 00:18:47.642 Removing: /var/run/dpdk/spdk_pid58335 00:18:47.642 Removing: /var/run/dpdk/spdk_pid58494 00:18:47.642 Removing: /var/run/dpdk/spdk_pid58767 00:18:47.642 Removing: /var/run/dpdk/spdk_pid58860 00:18:47.642 Removing: /var/run/dpdk/spdk_pid58899 00:18:47.642 Removing: /var/run/dpdk/spdk_pid59009 00:18:47.642 Removing: /var/run/dpdk/spdk_pid59044 00:18:47.642 Removing: /var/run/dpdk/spdk_pid59184 00:18:47.642 Removing: /var/run/dpdk/spdk_pid59469 00:18:47.642 Removing: /var/run/dpdk/spdk_pid59652 00:18:47.642 Removing: /var/run/dpdk/spdk_pid59742 00:18:47.642 Removing: /var/run/dpdk/spdk_pid59842 00:18:47.642 Removing: /var/run/dpdk/spdk_pid59945 00:18:47.642 Removing: /var/run/dpdk/spdk_pid59978 00:18:47.642 Removing: /var/run/dpdk/spdk_pid60013 00:18:47.642 Removing: /var/run/dpdk/spdk_pid60083 00:18:47.642 Removing: /var/run/dpdk/spdk_pid60206 00:18:47.642 Removing: /var/run/dpdk/spdk_pid60868 00:18:47.642 Removing: /var/run/dpdk/spdk_pid60914 00:18:47.642 Removing: /var/run/dpdk/spdk_pid60975 00:18:47.642 Removing: /var/run/dpdk/spdk_pid61003 00:18:47.642 Removing: /var/run/dpdk/spdk_pid61093 00:18:47.642 Removing: /var/run/dpdk/spdk_pid61123 00:18:47.642 Removing: /var/run/dpdk/spdk_pid61217 00:18:47.642 Removing: /var/run/dpdk/spdk_pid61245 00:18:47.642 Removing: /var/run/dpdk/spdk_pid61302 00:18:47.642 Removing: /var/run/dpdk/spdk_pid61333 00:18:47.642 Removing: /var/run/dpdk/spdk_pid61384 00:18:47.642 Removing: /var/run/dpdk/spdk_pid61414 00:18:47.642 Removing: /var/run/dpdk/spdk_pid61574 00:18:47.642 Removing: /var/run/dpdk/spdk_pid61610 00:18:47.642 Removing: /var/run/dpdk/spdk_pid61698 00:18:47.642 Removing: /var/run/dpdk/spdk_pid62178 00:18:47.642 Removing: /var/run/dpdk/spdk_pid62555 00:18:47.642 Removing: /var/run/dpdk/spdk_pid65053 00:18:47.642 Removing: /var/run/dpdk/spdk_pid65104 00:18:47.642 Removing: /var/run/dpdk/spdk_pid65468 00:18:47.642 Removing: /var/run/dpdk/spdk_pid65518 00:18:47.642 Removing: /var/run/dpdk/spdk_pid65944 00:18:47.642 Removing: /var/run/dpdk/spdk_pid66543 00:18:47.642 Removing: /var/run/dpdk/spdk_pid67012 00:18:47.642 Removing: /var/run/dpdk/spdk_pid68099 00:18:47.642 Removing: /var/run/dpdk/spdk_pid69216 00:18:47.642 Removing: /var/run/dpdk/spdk_pid69339 00:18:47.642 Removing: /var/run/dpdk/spdk_pid69403 00:18:47.642 Removing: /var/run/dpdk/spdk_pid71054 00:18:47.642 Removing: /var/run/dpdk/spdk_pid71409 00:18:47.642 Removing: /var/run/dpdk/spdk_pid75388 00:18:47.642 Removing: /var/run/dpdk/spdk_pid75827 00:18:47.642 Removing: /var/run/dpdk/spdk_pid76490 00:18:47.642 Removing: /var/run/dpdk/spdk_pid76956 00:18:47.642 Removing: /var/run/dpdk/spdk_pid82897 00:18:47.642 Removing: /var/run/dpdk/spdk_pid83463 00:18:47.642 Removing: /var/run/dpdk/spdk_pid83572 00:18:47.642 Removing: /var/run/dpdk/spdk_pid83743 00:18:47.642 Removing: /var/run/dpdk/spdk_pid83800 00:18:47.642 Removing: /var/run/dpdk/spdk_pid83855 00:18:47.642 Removing: /var/run/dpdk/spdk_pid83913 00:18:47.642 Removing: /var/run/dpdk/spdk_pid84099 00:18:47.642 Removing: /var/run/dpdk/spdk_pid84259 00:18:47.642 Removing: /var/run/dpdk/spdk_pid84572 00:18:47.642 Removing: /var/run/dpdk/spdk_pid84708 00:18:47.642 Removing: /var/run/dpdk/spdk_pid84976 00:18:47.642 Removing: /var/run/dpdk/spdk_pid85089 00:18:47.642 Removing: /var/run/dpdk/spdk_pid85228 00:18:47.642 Removing: /var/run/dpdk/spdk_pid85630 00:18:47.642 Removing: /var/run/dpdk/spdk_pid86101 00:18:47.642 Removing: /var/run/dpdk/spdk_pid86102 00:18:47.642 Removing: /var/run/dpdk/spdk_pid86103 00:18:47.642 Removing: /var/run/dpdk/spdk_pid86394 00:18:47.900 Removing: /var/run/dpdk/spdk_pid86773 00:18:47.900 Removing: /var/run/dpdk/spdk_pid87125 00:18:47.900 Removing: /var/run/dpdk/spdk_pid87746 00:18:47.900 Removing: /var/run/dpdk/spdk_pid87749 00:18:47.900 Removing: /var/run/dpdk/spdk_pid88151 00:18:47.900 Removing: /var/run/dpdk/spdk_pid88166 00:18:47.900 Removing: /var/run/dpdk/spdk_pid88180 00:18:47.900 Removing: /var/run/dpdk/spdk_pid88215 00:18:47.900 Removing: /var/run/dpdk/spdk_pid88220 00:18:47.900 Removing: /var/run/dpdk/spdk_pid88631 00:18:47.900 Removing: /var/run/dpdk/spdk_pid88674 00:18:47.900 Removing: /var/run/dpdk/spdk_pid89076 00:18:47.900 Clean 00:18:54.495 11:29:35 nvmf_tcp -- common/autotest_common.sh@1451 -- # return 1 00:18:54.495 11:29:35 nvmf_tcp -- common/autotest_common.sh@1 -- # : 00:18:54.495 11:29:35 nvmf_tcp -- common/autotest_common.sh@1 -- # exit 1 00:18:54.508 [Pipeline] } 00:18:54.528 [Pipeline] // timeout 00:18:54.535 [Pipeline] } 00:18:54.550 [Pipeline] // stage 00:18:54.556 [Pipeline] } 00:18:54.560 ERROR: script returned exit code 1 00:18:54.560 Setting overall build result to FAILURE 00:18:54.573 [Pipeline] // catchError 00:18:54.582 [Pipeline] stage 00:18:54.584 [Pipeline] { (Stop VM) 00:18:54.595 [Pipeline] sh 00:18:54.869 + vagrant halt 00:18:59.055 ==> default: Halting domain... 00:19:04.357 [Pipeline] sh 00:19:04.634 + vagrant destroy -f 00:19:08.816 ==> default: Removing domain... 00:19:08.827 [Pipeline] sh 00:19:09.107 + mv output /var/jenkins/workspace/nvmf-tcp-vg-autotest_3/output 00:19:09.115 [Pipeline] } 00:19:09.129 [Pipeline] // stage 00:19:09.134 [Pipeline] } 00:19:09.149 [Pipeline] // dir 00:19:09.154 [Pipeline] } 00:19:09.168 [Pipeline] // wrap 00:19:09.174 [Pipeline] } 00:19:09.189 [Pipeline] // catchError 00:19:09.199 [Pipeline] stage 00:19:09.203 [Pipeline] { (Epilogue) 00:19:09.217 [Pipeline] sh 00:19:09.499 + jbp/jenkins/jjb-config/jobs/scripts/compress_artifacts.sh 00:19:12.038 [Pipeline] catchError 00:19:12.039 [Pipeline] { 00:19:12.049 [Pipeline] sh 00:19:12.327 + jbp/jenkins/jjb-config/jobs/scripts/check_artifacts_size.sh 00:19:12.603 Artifacts sizes are good 00:19:12.613 [Pipeline] } 00:19:12.626 [Pipeline] // catchError 00:19:12.636 [Pipeline] archiveArtifacts 00:19:12.642 Archiving artifacts 00:19:12.924 [Pipeline] cleanWs 00:19:12.939 [WS-CLEANUP] Deleting project workspace... 00:19:12.939 [WS-CLEANUP] Deferred wipeout is used... 00:19:12.944 [WS-CLEANUP] done 00:19:12.945 [Pipeline] } 00:19:12.954 [Pipeline] // stage 00:19:12.957 [Pipeline] } 00:19:12.966 [Pipeline] // node 00:19:12.969 [Pipeline] End of Pipeline 00:19:12.994 Finished: FAILURE